2024-09-12T16:51:40.451 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T16:51:40.470 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T16:51:40.558 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703 branch: wip-rgw-meta-handlers description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} email: null first_in_suite: false job_id: '7902703' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rgw-meta-handlers ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-meta-handlers sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6279 sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-meta-handlers suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIv91XCBoJtYPqiTMnspeIbq4zK0R4AftqbTaM/VaEyaUW10f7bqKgJMhmcUiLsLDr/Gr8zMmSDqlZZTavf2I6U= smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHByT+ESv7x/UkoQf3tn/pWkjYiEOLDXRnu/vNSHQBCN+VuWe3BiVMVv8nlnud7kfLYXZQ6CYnoi8kDm+3V7x/o= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_multipart_upload.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-12_15:39:52 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T16:51:40.559 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa; will attempt to use it 2024-09-12T16:51:40.559 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa/tasks 2024-09-12T16:51:40.560 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T16:51:40.561 INFO:teuthology.task.internal:Checking packages... 2024-09-12T16:51:40.584 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bad475c18c96ec20c5778159aa33ba72b84e9c1b' 2024-09-12T16:51:40.584 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T16:51:40.584 INFO:teuthology.packaging:ref: None 2024-09-12T16:51:40.584 INFO:teuthology.packaging:tag: None 2024-09-12T16:51:40.584 INFO:teuthology.packaging:branch: wip-rgw-meta-handlers 2024-09-12T16:51:40.584 INFO:teuthology.packaging:sha1: bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T16:51:40.584 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rgw-meta-handlers 2024-09-12T16:51:40.731 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4762-gbad475c1-1jammy 2024-09-12T16:51:40.733 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T16:51:40.740 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T16:51:40.740 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T16:51:40.792 INFO:teuthology.task.internal:Saving configuration 2024-09-12T16:51:40.807 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T16:51:40.814 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T16:51:40.842 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:46:15.120572', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAION+rh17BwUe67LoGVDWLjq0sVRuEjVr5qMgJ8vs2+W+'} 2024-09-12T16:51:40.863 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 16:46:15.121946', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHtj3TBskfjC0yz+Usdu6Zm/ljPGjbgAodijXvyeHQaa'} 2024-09-12T16:51:40.864 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T16:51:40.869 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T16:51:40.870 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T16:51:40.870 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T16:51:40.924 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0cdc3eb2e0>, signals=[15]) 2024-09-12T16:51:40.924 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T16:51:40.929 INFO:teuthology.task.internal:Opening connections... 2024-09-12T16:51:40.929 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T16:51:40.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:51:41.012 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T16:51:41.013 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:51:41.094 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T16:51:41.100 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-09-12T16:51:41.105 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-09-12T16:51:41.106 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-09-12T16:51:41.156 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T16:51:41.156 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="Ubuntu" 2024-09-12T16:51:41.156 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="22.04" 2024-09-12T16:51:41.156 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T16:51:41.156 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_CODENAME=jammy 2024-09-12T16:51:41.157 INFO:teuthology.orchestra.run.smithi017.stdout:ID=ubuntu 2024-09-12T16:51:41.157 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE=debian 2024-09-12T16:51:41.157 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T16:51:41.157 INFO:teuthology.orchestra.run.smithi017.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T16:51:41.157 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T16:51:41.157 INFO:teuthology.orchestra.run.smithi017.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T16:51:41.157 INFO:teuthology.orchestra.run.smithi017.stdout:UBUNTU_CODENAME=jammy 2024-09-12T16:51:41.158 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-09-12T16:51:41.177 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-09-12T16:51:41.182 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-09-12T16:51:41.182 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-09-12T16:51:41.229 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T16:51:41.229 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="Ubuntu" 2024-09-12T16:51:41.229 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="22.04" 2024-09-12T16:51:41.229 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T16:51:41.229 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_CODENAME=jammy 2024-09-12T16:51:41.229 INFO:teuthology.orchestra.run.smithi047.stdout:ID=ubuntu 2024-09-12T16:51:41.229 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE=debian 2024-09-12T16:51:41.229 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T16:51:41.229 INFO:teuthology.orchestra.run.smithi047.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T16:51:41.229 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T16:51:41.230 INFO:teuthology.orchestra.run.smithi047.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T16:51:41.230 INFO:teuthology.orchestra.run.smithi047.stdout:UBUNTU_CODENAME=jammy 2024-09-12T16:51:41.230 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-09-12T16:51:41.250 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T16:51:41.258 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T16:51:41.264 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T16:51:41.264 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:51:41.266 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-09-12T16:51:41.276 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T16:51:41.281 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T16:51:41.282 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:51:41.314 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-09-12T16:51:41.326 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T16:51:41.383 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T16:51:41.398 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T16:51:41.398 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T16:51:41.398 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:51:41.399 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T16:51:41.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:51:41.403 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-12T16:51:41.404 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T16:51:41.404 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-12T16:51:41.449 INFO:teuthology.orchestra.run.smithi047.stdout:5.15.0-56-generic 2024-09-12T16:51:41.449 INFO:teuthology.task.kernel:Running kernel on smithi047: 5.15.0-56-generic 2024-09-12T16:51:41.449 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get clean 2024-09-12T16:51:41.454 INFO:teuthology.orchestra.run.smithi017.stdout:5.15.0-56-generic 2024-09-12T16:51:41.454 INFO:teuthology.task.kernel:Running kernel on smithi017: 5.15.0-56-generic 2024-09-12T16:51:41.454 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-get clean 2024-09-12T16:51:41.581 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-09-12T16:51:41.587 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-get update 2024-09-12T16:51:41.855 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:51:41.855 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T16:51:41.867 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:51:41.876 INFO:teuthology.orchestra.run.smithi017.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T16:51:41.916 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T16:51:41.925 INFO:teuthology.orchestra.run.smithi017.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T16:51:42.272 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T16:51:42.280 INFO:teuthology.orchestra.run.smithi017.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T16:51:42.293 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T16:51:42.305 INFO:teuthology.orchestra.run.smithi017.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T16:51:42.411 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T16:51:42.422 INFO:teuthology.orchestra.run.smithi017.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T16:51:42.596 INFO:teuthology.orchestra.run.smithi017.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T16:51:42.611 INFO:teuthology.orchestra.run.smithi017.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T16:51:42.615 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T16:51:42.710 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T16:51:42.726 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T16:51:42.735 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T16:51:42.736 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T16:51:42.762 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T16:51:42.774 INFO:teuthology.orchestra.run.smithi017.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T16:51:42.775 INFO:teuthology.orchestra.run.smithi017.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T16:51:42.778 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T16:51:42.778 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T16:51:42.779 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T16:51:42.784 INFO:teuthology.orchestra.run.smithi017.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T16:51:42.786 INFO:teuthology.orchestra.run.smithi017.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T16:51:42.786 INFO:teuthology.orchestra.run.smithi017.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T16:51:42.788 INFO:teuthology.orchestra.run.smithi017.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T16:51:42.788 INFO:teuthology.orchestra.run.smithi017.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T16:51:42.832 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T16:51:42.833 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T16:51:42.843 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T16:51:42.844 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T16:51:42.861 INFO:teuthology.orchestra.run.smithi017.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T16:51:42.861 INFO:teuthology.orchestra.run.smithi017.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T16:51:42.870 INFO:teuthology.orchestra.run.smithi017.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T16:51:42.894 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T16:51:42.894 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T16:51:42.899 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T16:51:42.899 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T16:51:42.908 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T16:51:42.909 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T16:51:42.913 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T16:51:42.914 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T16:51:42.914 INFO:teuthology.orchestra.run.smithi047.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T16:51:42.921 INFO:teuthology.orchestra.run.smithi047.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T16:51:42.924 INFO:teuthology.orchestra.run.smithi047.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T16:51:42.928 INFO:teuthology.orchestra.run.smithi047.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T16:51:42.928 INFO:teuthology.orchestra.run.smithi047.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T16:51:42.929 INFO:teuthology.orchestra.run.smithi047.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T16:51:42.957 INFO:teuthology.orchestra.run.smithi017.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T16:51:42.957 INFO:teuthology.orchestra.run.smithi017.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T16:51:42.958 INFO:teuthology.orchestra.run.smithi017.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T16:51:42.958 INFO:teuthology.orchestra.run.smithi017.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T16:51:42.971 INFO:teuthology.orchestra.run.smithi017.stdout:Get:23 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T16:51:42.972 INFO:teuthology.orchestra.run.smithi047.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T16:51:42.973 INFO:teuthology.orchestra.run.smithi047.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T16:51:42.974 INFO:teuthology.orchestra.run.smithi017.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T16:51:42.993 INFO:teuthology.orchestra.run.smithi017.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T16:51:42.997 INFO:teuthology.orchestra.run.smithi017.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T16:51:42.998 INFO:teuthology.orchestra.run.smithi017.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T16:51:42.998 INFO:teuthology.orchestra.run.smithi017.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T16:51:42.999 INFO:teuthology.orchestra.run.smithi017.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T16:51:43.000 INFO:teuthology.orchestra.run.smithi017.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T16:51:43.004 INFO:teuthology.orchestra.run.smithi017.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T16:51:43.004 INFO:teuthology.orchestra.run.smithi017.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T16:51:43.005 INFO:teuthology.orchestra.run.smithi017.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T16:51:43.006 INFO:teuthology.orchestra.run.smithi047.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T16:51:43.007 INFO:teuthology.orchestra.run.smithi047.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T16:51:43.008 INFO:teuthology.orchestra.run.smithi047.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T16:51:43.009 INFO:teuthology.orchestra.run.smithi047.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T16:51:43.010 INFO:teuthology.orchestra.run.smithi047.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T16:51:43.010 INFO:teuthology.orchestra.run.smithi047.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T16:51:43.010 INFO:teuthology.orchestra.run.smithi047.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T16:51:43.023 INFO:teuthology.orchestra.run.smithi017.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T16:51:43.023 INFO:teuthology.orchestra.run.smithi017.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T16:51:43.023 INFO:teuthology.orchestra.run.smithi017.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T16:51:43.087 INFO:teuthology.orchestra.run.smithi017.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T16:51:43.089 INFO:teuthology.orchestra.run.smithi017.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T16:51:43.090 INFO:teuthology.orchestra.run.smithi017.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T16:51:43.090 INFO:teuthology.orchestra.run.smithi017.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T16:51:43.090 INFO:teuthology.orchestra.run.smithi017.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T16:51:43.091 INFO:teuthology.orchestra.run.smithi047.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T16:51:43.091 INFO:teuthology.orchestra.run.smithi047.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T16:51:43.104 INFO:teuthology.orchestra.run.smithi017.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T16:51:43.105 INFO:teuthology.orchestra.run.smithi017.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T16:51:43.105 INFO:teuthology.orchestra.run.smithi017.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T16:51:49.313 INFO:teuthology.orchestra.run.smithi017.stdout:Fetched 15.8 MB in 3s (5,652 kB/s) 2024-09-12T16:51:49.401 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 15.8 MB in 3s (5,613 kB/s) 2024-09-12T16:51:50.724 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-12T16:51:50.743 DEBUG:teuthology.orchestra.run.smithi017:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:51:50.797 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-12T16:51:50.862 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-09-12T16:51:50.880 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:51:50.946 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-09-12T16:51:50.986 INFO:teuthology.orchestra.run.smithi017.stdout:Building dependency tree... 2024-09-12T16:51:50.986 INFO:teuthology.orchestra.run.smithi017.stdout:Reading state information... 2024-09-12T16:51:51.154 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-09-12T16:51:51.154 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-09-12T16:51:51.158 INFO:teuthology.orchestra.run.smithi017.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:51:51.159 INFO:teuthology.orchestra.run.smithi017.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:51:51.159 INFO:teuthology.orchestra.run.smithi017.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:51:51.160 INFO:teuthology.orchestra.run.smithi017.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:51:51.160 INFO:teuthology.orchestra.run.smithi017.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T16:51:51.160 INFO:teuthology.orchestra.run.smithi017.stdout: python2.7-minimal 2024-09-12T16:51:51.160 INFO:teuthology.orchestra.run.smithi017.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:51:51.161 INFO:teuthology.orchestra.run.smithi017.stdout:The following additional packages will be installed: 2024-09-12T16:51:51.161 INFO:teuthology.orchestra.run.smithi017.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:51:51.161 INFO:teuthology.orchestra.run.smithi017.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T16:51:51.161 INFO:teuthology.orchestra.run.smithi017.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T16:51:51.163 INFO:teuthology.orchestra.run.smithi017.stdout:Suggested packages: 2024-09-12T16:51:51.163 INFO:teuthology.orchestra.run.smithi017.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T16:51:51.163 INFO:teuthology.orchestra.run.smithi017.stdout:Recommended packages: 2024-09-12T16:51:51.163 INFO:teuthology.orchestra.run.smithi017.stdout: thermald 2024-09-12T16:51:51.213 INFO:teuthology.orchestra.run.smithi017.stdout:The following NEW packages will be installed: 2024-09-12T16:51:51.213 INFO:teuthology.orchestra.run.smithi017.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:51:51.213 INFO:teuthology.orchestra.run.smithi017.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T16:51:51.213 INFO:teuthology.orchestra.run.smithi017.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T16:51:51.214 INFO:teuthology.orchestra.run.smithi017.stdout:The following packages will be upgraded: 2024-09-12T16:51:51.214 INFO:teuthology.orchestra.run.smithi017.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T16:51:51.348 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:51:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:51:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:51:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:51:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T16:51:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: python2.7-minimal 2024-09-12T16:51:51.349 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:51:51.350 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2024-09-12T16:51:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:51:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T16:51:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T16:51:51.352 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2024-09-12T16:51:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T16:51:51.352 INFO:teuthology.orchestra.run.smithi047.stdout:Recommended packages: 2024-09-12T16:51:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: thermald 2024-09-12T16:51:51.395 INFO:teuthology.orchestra.run.smithi017.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:51:51.395 INFO:teuthology.orchestra.run.smithi017.stdout:Need to get 113 MB of archives. 2024-09-12T16:51:51.395 INFO:teuthology.orchestra.run.smithi017.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T16:51:51.395 INFO:teuthology.orchestra.run.smithi017.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T16:51:51.406 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2024-09-12T16:51:51.406 INFO:teuthology.orchestra.run.smithi047.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T16:51:51.406 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T16:51:51.407 INFO:teuthology.orchestra.run.smithi047.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T16:51:51.408 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages will be upgraded: 2024-09-12T16:51:51.409 INFO:teuthology.orchestra.run.smithi047.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T16:51:51.590 INFO:teuthology.orchestra.run.smithi047.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:51:51.590 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 113 MB of archives. 2024-09-12T16:51:51.590 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T16:51:51.591 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T16:51:52.848 INFO:teuthology.orchestra.run.smithi017.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T16:51:52.996 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T16:51:53.206 INFO:teuthology.orchestra.run.smithi017.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T16:51:53.353 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T16:51:55.506 INFO:teuthology.orchestra.run.smithi017.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T16:51:55.507 INFO:teuthology.orchestra.run.smithi017.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T16:51:55.507 INFO:teuthology.orchestra.run.smithi017.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T16:51:55.520 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T16:51:55.520 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T16:51:55.520 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T16:51:55.860 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T16:51:55.875 INFO:teuthology.orchestra.run.smithi017.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T16:51:55.942 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T16:51:55.958 INFO:teuthology.orchestra.run.smithi017.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T16:51:56.374 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 113 MB in 5s (25.0 MB/s) 2024-09-12T16:51:56.382 INFO:teuthology.orchestra.run.smithi017.stdout:Fetched 113 MB in 5s (23.9 MB/s) 2024-09-12T16:51:56.545 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T16:51:56.576 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T16:51:58.471 INFO:teuthology.orchestra.run.smithi017.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T16:51:58.476 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:51:58.511 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T16:51:58.515 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:51:58.529 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:51:58.626 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:00.730 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T16:52:00.751 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:52:00.819 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:01.036 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T16:52:01.057 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:52:01.145 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:01.250 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T16:52:01.270 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:52:01.299 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:01.655 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T16:52:01.676 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:52:01.713 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:07.849 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:52:07.973 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:52:08.026 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:52:08.142 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:52:08.290 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:52:08.418 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:52:08.500 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:52:08.654 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:52:08.688 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T16:52:08.711 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T16:52:08.754 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:52:08.949 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T16:52:08.971 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T16:52:09.015 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:52:14.559 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T16:52:14.597 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:52:14.642 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:15.665 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T16:52:15.702 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T16:52:15.739 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:18.196 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:52:18.296 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:52:18.623 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:52:18.749 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:18.869 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T16:52:18.998 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:19.539 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T16:52:19.661 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T16:52:20.036 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T16:52:20.182 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:20.308 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T16:52:20.366 INFO:teuthology.orchestra.run.smithi017.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:52:20.366 INFO:teuthology.orchestra.run.smithi017.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T16:52:20.366 INFO:teuthology.orchestra.run.smithi017.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:52:20.366 INFO:teuthology.orchestra.run.smithi017.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T16:52:20.437 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:20.533 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:21.810 INFO:teuthology.orchestra.run.smithi047.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:52:21.810 INFO:teuthology.orchestra.run.smithi047.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T16:52:21.810 INFO:teuthology.orchestra.run.smithi047.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:52:21.810 INFO:teuthology.orchestra.run.smithi047.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T16:52:21.985 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:21.997 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:23.961 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T16:52:24.087 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T16:52:24.188 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:24.232 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:24.247 INFO:teuthology.orchestra.run.smithi017.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T16:52:24.247 INFO:teuthology.orchestra.run.smithi017.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:52:25.697 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T16:52:25.826 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T16:52:25.952 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T16:52:26.017 INFO:teuthology.orchestra.run.smithi047.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T16:52:26.017 INFO:teuthology.orchestra.run.smithi047.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:52:38.802 INFO:teuthology.orchestra.run.smithi017.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T16:52:38.802 INFO:teuthology.orchestra.run.smithi017.stdout:Sourcing file `/etc/default/grub' 2024-09-12T16:52:38.814 INFO:teuthology.orchestra.run.smithi017.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:52:38.826 INFO:teuthology.orchestra.run.smithi017.stdout:Generating grub configuration file ... 2024-09-12T16:52:39.055 INFO:teuthology.orchestra.run.smithi017.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:52:39.076 INFO:teuthology.orchestra.run.smithi017.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:52:39.359 INFO:teuthology.orchestra.run.smithi017.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:52:39.364 INFO:teuthology.orchestra.run.smithi017.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:52:39.440 INFO:teuthology.orchestra.run.smithi017.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:52:39.445 INFO:teuthology.orchestra.run.smithi017.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:52:39.593 INFO:teuthology.orchestra.run.smithi017.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:52:39.593 INFO:teuthology.orchestra.run.smithi017.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:52:39.593 INFO:teuthology.orchestra.run.smithi017.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:52:39.637 INFO:teuthology.orchestra.run.smithi017.stdout:done 2024-09-12T16:52:40.107 DEBUG:teuthology.orchestra.run.smithi017:> dpkg -s linux-image-generic 2024-09-12T16:52:40.133 INFO:teuthology.orchestra.run.smithi017.stdout:Package: linux-image-generic 2024-09-12T16:52:40.134 INFO:teuthology.orchestra.run.smithi017.stdout:Status: install ok installed 2024-09-12T16:52:40.134 INFO:teuthology.orchestra.run.smithi017.stdout:Priority: optional 2024-09-12T16:52:40.134 INFO:teuthology.orchestra.run.smithi017.stdout:Section: kernel 2024-09-12T16:52:40.134 INFO:teuthology.orchestra.run.smithi017.stdout:Installed-Size: 21 2024-09-12T16:52:40.134 INFO:teuthology.orchestra.run.smithi017.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:52:40.134 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: amd64 2024-09-12T16:52:40.134 INFO:teuthology.orchestra.run.smithi017.stdout:Source: linux-meta 2024-09-12T16:52:40.134 INFO:teuthology.orchestra.run.smithi017.stdout:Version: 5.15.0.119.119 2024-09-12T16:52:40.134 INFO:teuthology.orchestra.run.smithi017.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:52:40.134 INFO:teuthology.orchestra.run.smithi017.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:52:40.135 INFO:teuthology.orchestra.run.smithi017.stdout:Recommends: thermald 2024-09-12T16:52:40.135 INFO:teuthology.orchestra.run.smithi017.stdout:Description: Generic Linux kernel image 2024-09-12T16:52:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:52:40.135 INFO:teuthology.orchestra.run.smithi017.stdout: available. 2024-09-12T16:52:40.137 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T16:52:40.137 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:52:40.137 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:52:40.137 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T16:52:40.138 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:52:40.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-get clean 2024-09-12T16:52:40.330 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-get update 2024-09-12T16:52:40.444 INFO:teuthology.orchestra.run.smithi047.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T16:52:40.445 INFO:teuthology.orchestra.run.smithi047.stdout:Sourcing file `/etc/default/grub' 2024-09-12T16:52:40.477 INFO:teuthology.orchestra.run.smithi047.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:52:40.498 INFO:teuthology.orchestra.run.smithi047.stdout:Generating grub configuration file ... 2024-09-12T16:52:40.585 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:52:40.594 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:52:40.656 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:52:40.738 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:52:40.797 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:52:40.815 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:52:41.122 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:52:41.128 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:52:41.200 INFO:teuthology.orchestra.run.smithi047.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:52:41.206 INFO:teuthology.orchestra.run.smithi047.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:52:41.368 INFO:teuthology.orchestra.run.smithi047.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:52:41.368 INFO:teuthology.orchestra.run.smithi047.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:52:41.368 INFO:teuthology.orchestra.run.smithi047.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:52:41.403 INFO:teuthology.orchestra.run.smithi047.stdout:done 2024-09-12T16:52:41.868 DEBUG:teuthology.orchestra.run.smithi047:> dpkg -s linux-image-generic 2024-09-12T16:52:41.895 INFO:teuthology.orchestra.run.smithi047.stdout:Package: linux-image-generic 2024-09-12T16:52:41.895 INFO:teuthology.orchestra.run.smithi047.stdout:Status: install ok installed 2024-09-12T16:52:41.895 INFO:teuthology.orchestra.run.smithi047.stdout:Priority: optional 2024-09-12T16:52:41.895 INFO:teuthology.orchestra.run.smithi047.stdout:Section: kernel 2024-09-12T16:52:41.896 INFO:teuthology.orchestra.run.smithi047.stdout:Installed-Size: 21 2024-09-12T16:52:41.896 INFO:teuthology.orchestra.run.smithi047.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:52:41.896 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: amd64 2024-09-12T16:52:41.896 INFO:teuthology.orchestra.run.smithi047.stdout:Source: linux-meta 2024-09-12T16:52:41.896 INFO:teuthology.orchestra.run.smithi047.stdout:Version: 5.15.0.119.119 2024-09-12T16:52:41.896 INFO:teuthology.orchestra.run.smithi047.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:52:41.896 INFO:teuthology.orchestra.run.smithi047.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:52:41.896 INFO:teuthology.orchestra.run.smithi047.stdout:Recommends: thermald 2024-09-12T16:52:41.896 INFO:teuthology.orchestra.run.smithi047.stdout:Description: Generic Linux kernel image 2024-09-12T16:52:41.896 INFO:teuthology.orchestra.run.smithi047.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:52:41.896 INFO:teuthology.orchestra.run.smithi047.stdout: available. 2024-09-12T16:52:41.897 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T16:52:41.897 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T16:52:41.897 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T16:52:41.897 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T16:52:41.897 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T16:52:41.897 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get clean 2024-09-12T16:52:42.067 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-12T16:52:42.086 DEBUG:teuthology.orchestra.run.smithi017:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:52:42.093 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-09-12T16:52:42.151 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-12T16:52:42.214 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T16:52:42.223 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T16:52:42.240 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T16:52:42.335 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T16:52:42.369 INFO:teuthology.orchestra.run.smithi017.stdout:Building dependency tree... 2024-09-12T16:52:42.370 INFO:teuthology.orchestra.run.smithi017.stdout:Reading state information... 2024-09-12T16:52:42.569 INFO:teuthology.orchestra.run.smithi017.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T16:52:42.569 INFO:teuthology.orchestra.run.smithi017.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:52:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:52:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:52:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:52:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:52:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:52:42.570 INFO:teuthology.orchestra.run.smithi017.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:52:42.615 INFO:teuthology.orchestra.run.smithi017.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:52:42.618 DEBUG:teuthology.orchestra.run.smithi017:> dpkg -s linux-image-generic 2024-09-12T16:52:42.637 INFO:teuthology.orchestra.run.smithi017.stdout:Package: linux-image-generic 2024-09-12T16:52:42.637 INFO:teuthology.orchestra.run.smithi017.stdout:Status: install ok installed 2024-09-12T16:52:42.637 INFO:teuthology.orchestra.run.smithi017.stdout:Priority: optional 2024-09-12T16:52:42.637 INFO:teuthology.orchestra.run.smithi017.stdout:Section: kernel 2024-09-12T16:52:42.637 INFO:teuthology.orchestra.run.smithi017.stdout:Installed-Size: 21 2024-09-12T16:52:42.638 INFO:teuthology.orchestra.run.smithi017.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:52:42.638 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: amd64 2024-09-12T16:52:42.638 INFO:teuthology.orchestra.run.smithi017.stdout:Source: linux-meta 2024-09-12T16:52:42.638 INFO:teuthology.orchestra.run.smithi017.stdout:Version: 5.15.0.119.119 2024-09-12T16:52:42.638 INFO:teuthology.orchestra.run.smithi017.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:52:42.638 INFO:teuthology.orchestra.run.smithi017.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:52:42.638 INFO:teuthology.orchestra.run.smithi017.stdout:Recommends: thermald 2024-09-12T16:52:42.638 INFO:teuthology.orchestra.run.smithi017.stdout:Description: Generic Linux kernel image 2024-09-12T16:52:42.638 INFO:teuthology.orchestra.run.smithi017.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:52:42.638 INFO:teuthology.orchestra.run.smithi017.stdout: available. 2024-09-12T16:52:42.639 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-12T16:52:42.685 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.rYFHQJxMDn 2024-09-12T16:52:42.685 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub/grub.cfg /tmp/tmp.rYFHQJxMDn 2024-09-12T16:52:42.740 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.rYFHQJxMDn 2024-09-12T16:52:42.855 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.rYFHQJxMDn is 10KB 2024-09-12T16:52:42.869 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.rYFHQJxMDn 2024-09-12T16:52:42.875 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T16:52:42.929 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:52:42.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T16:52:42.929 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T16:52:42.998 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T16:52:42.998 DEBUG:teuthology.orchestra.run.smithi017:> sudo update-grub 2024-09-12T16:52:43.685 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-09-12T16:52:43.705 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T16:52:43.771 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-09-12T16:52:43.985 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-09-12T16:52:43.985 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-09-12T16:52:44.181 INFO:teuthology.orchestra.run.smithi047.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T16:52:44.181 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T16:52:44.181 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T16:52:44.181 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T16:52:44.181 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T16:52:44.181 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T16:52:44.181 INFO:teuthology.orchestra.run.smithi047.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T16:52:44.181 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T16:52:44.220 INFO:teuthology.orchestra.run.smithi017.stderr:Sourcing file `/etc/default/grub' 2024-09-12T16:52:44.221 INFO:teuthology.orchestra.run.smithi017.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:52:44.223 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-09-12T16:52:44.226 INFO:teuthology.orchestra.run.smithi047.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T16:52:44.228 DEBUG:teuthology.orchestra.run.smithi047:> dpkg -s linux-image-generic 2024-09-12T16:52:44.245 INFO:teuthology.orchestra.run.smithi047.stdout:Package: linux-image-generic 2024-09-12T16:52:44.245 INFO:teuthology.orchestra.run.smithi047.stdout:Status: install ok installed 2024-09-12T16:52:44.246 INFO:teuthology.orchestra.run.smithi047.stdout:Priority: optional 2024-09-12T16:52:44.246 INFO:teuthology.orchestra.run.smithi047.stdout:Section: kernel 2024-09-12T16:52:44.246 INFO:teuthology.orchestra.run.smithi047.stdout:Installed-Size: 21 2024-09-12T16:52:44.246 INFO:teuthology.orchestra.run.smithi047.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T16:52:44.246 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: amd64 2024-09-12T16:52:44.246 INFO:teuthology.orchestra.run.smithi047.stdout:Source: linux-meta 2024-09-12T16:52:44.246 INFO:teuthology.orchestra.run.smithi047.stdout:Version: 5.15.0.119.119 2024-09-12T16:52:44.246 INFO:teuthology.orchestra.run.smithi047.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T16:52:44.247 INFO:teuthology.orchestra.run.smithi047.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T16:52:44.247 INFO:teuthology.orchestra.run.smithi047.stdout:Recommends: thermald 2024-09-12T16:52:44.247 INFO:teuthology.orchestra.run.smithi047.stdout:Description: Generic Linux kernel image 2024-09-12T16:52:44.247 INFO:teuthology.orchestra.run.smithi047.stdout: This package will always depend on the latest generic kernel image 2024-09-12T16:52:44.247 INFO:teuthology.orchestra.run.smithi047.stdout: available. 2024-09-12T16:52:44.247 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-09-12T16:52:44.292 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.2xW2NsLgff 2024-09-12T16:52:44.293 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub/grub.cfg /tmp/tmp.2xW2NsLgff 2024-09-12T16:52:44.349 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.2xW2NsLgff 2024-09-12T16:52:44.414 INFO:teuthology.orchestra.run.smithi017.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:52:44.421 INFO:teuthology.orchestra.run.smithi017.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:52:44.465 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.2xW2NsLgff is 10KB 2024-09-12T16:52:44.480 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.2xW2NsLgff 2024-09-12T16:52:44.486 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T16:52:44.540 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:52:44.540 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T16:52:44.540 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T16:52:44.643 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T16:52:44.643 DEBUG:teuthology.orchestra.run.smithi047:> sudo update-grub 2024-09-12T16:52:44.660 INFO:teuthology.orchestra.run.smithi017.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:52:44.666 INFO:teuthology.orchestra.run.smithi017.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:52:44.707 INFO:teuthology.orchestra.run.smithi017.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:52:44.713 INFO:teuthology.orchestra.run.smithi017.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:52:44.835 INFO:teuthology.orchestra.run.smithi017.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:52:44.835 INFO:teuthology.orchestra.run.smithi017.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:52:44.835 INFO:teuthology.orchestra.run.smithi017.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:52:44.849 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-09-12T16:52:44.860 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-09-12T16:52:45.941 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub' 2024-09-12T16:52:45.942 INFO:teuthology.orchestra.run.smithi047.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T16:52:45.945 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-09-12T16:52:46.122 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T16:52:46.129 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T16:52:46.362 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T16:52:46.367 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T16:52:46.411 INFO:teuthology.orchestra.run.smithi047.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T16:52:46.416 INFO:teuthology.orchestra.run.smithi047.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T16:52:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T16:52:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T16:52:46.586 INFO:teuthology.orchestra.run.smithi047.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T16:52:46.610 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-09-12T16:52:46.619 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-09-12T16:53:14.889 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T16:53:14.890 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-12T16:53:14.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:53:16.624 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T16:53:16.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T16:53:16.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:53:33.377 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.17 2024-09-12T16:53:35.169 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-09-12T16:53:42.385 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-12T16:53:42.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:53:44.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T16:53:44.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:54:42.446 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T16:54:44.175 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T16:54:54.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-12T16:54:54.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:54:54.846 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-12T16:54:55.454 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-12T16:54:55.454 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T16:54:55.454 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-09-12T16:54:55.501 INFO:teuthology.orchestra.run.smithi017.stdout:5.15.0-119-generic 2024-09-12T16:54:55.501 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T16:54:55.501 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:54:55.501 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T16:54:56.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T16:54:56.177 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T16:54:56.426 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-12T16:54:56.502 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T16:54:56.502 DEBUG:teuthology.orchestra.run.smithi017:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:54:56.570 INFO:teuthology.orchestra.run.smithi017.stdout:ttyS1 2024-09-12T16:54:56.599 DEBUG:teuthology.parallel:result is None 2024-09-12T16:54:57.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T16:54:57.106 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T16:54:57.107 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-09-12T16:54:57.154 INFO:teuthology.orchestra.run.smithi047.stdout:5.15.0-119-generic 2024-09-12T16:54:57.155 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T16:54:57.155 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T16:54:57.155 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T16:54:58.156 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T16:54:58.157 DEBUG:teuthology.orchestra.run.smithi047:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T16:54:58.243 INFO:teuthology.orchestra.run.smithi047.stdout:ttyS1 2024-09-12T16:54:58.267 DEBUG:teuthology.parallel:result is None 2024-09-12T16:54:58.268 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T16:54:58.274 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T16:54:58.274 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:54:58.277 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T16:54:58.282 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T16:54:58.288 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T16:54:58.295 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T16:54:58.295 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:54:58.326 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T16:54:58.344 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T16:54:58.350 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T16:54:58.350 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:54:58.382 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T16:54:58.400 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:54:58.401 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:54:58.409 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:54:58.410 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T16:54:58.412 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T16:54:58.419 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T16:54:58.419 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:54:58.457 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T16:54:58.471 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T16:54:58.513 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T16:54:58.514 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:54:58.516 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T16:54:58.522 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:54:58.569 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:54:58.616 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T16:54:58.617 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:54:58.680 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T16:54:58.686 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T16:54:58.734 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T16:54:58.734 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T16:54:58.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-09-12T16:54:58.799 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-09-12T16:54:58.876 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T16:54:58.884 INFO:teuthology.task.internal:Starting timer... 2024-09-12T16:54:58.885 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T16:54:58.896 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T16:54:58.904 DEBUG:teuthology.task.selinux:Excluding smithi017: OS 'ubuntu' does not support SELinux 2024-09-12T16:54:58.904 DEBUG:teuthology.task.selinux:Excluding smithi047: OS 'ubuntu' does not support SELinux 2024-09-12T16:54:58.904 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T16:54:58.904 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T16:54:58.905 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T16:54:58.905 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T16:54:58.912 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T16:54:58.916 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T16:54:59.028 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T16:54:59.040 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T16:54:59.041 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi047.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T17:02:42.278 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi047.front.sepia.ceph.com')] 2024-09-12T17:02:42.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-12T17:02:42.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:02:42.377 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-09-12T17:02:42.461 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-09-12T17:02:42.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T17:02:42.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T17:02:42.544 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-09-12T17:02:42.625 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-09-12T17:02:42.625 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T17:02:42.636 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T17:02:42.636 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:02:42.637 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:02:42.639 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T17:02:42.639 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:02:42.667 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:02:42.667 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: Command line: ntpd -gq 2024-09-12T17:02:42.667 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: ---------------------------------------------------- 2024-09-12T17:02:42.667 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:02:42.667 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:02:42.667 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: corporation. Support and training for ntp-4 are 2024-09-12T17:02:42.668 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: available at https://www.nwtime.org/support 2024-09-12T17:02:42.668 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: ---------------------------------------------------- 2024-09-12T17:02:42.668 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: proto: precision = 0.047 usec (-24) 2024-09-12T17:02:42.668 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: basedate set to 2022-02-04 2024-09-12T17:02:42.668 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:02:42.668 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:02:42.668 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:02:42.668 INFO:teuthology.orchestra.run.smithi017.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:02:42.669 INFO:teuthology.orchestra.run.smithi017.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:02:42.670 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:02:42.670 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:02:42.670 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:02:42.670 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: Listen normally on 3 ens1f0 172.21.15.17:123 2024-09-12T17:02:42.670 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: Listen normally on 4 lo [::1]:123 2024-09-12T17:02:42.670 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:fe59:d992%4]:123 2024-09-12T17:02:42.670 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:42 ntpd[18359]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:02:42.695 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T17:02:42.695 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: Command line: ntpd -gq 2024-09-12T17:02:42.695 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: ---------------------------------------------------- 2024-09-12T17:02:42.695 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T17:02:42.695 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T17:02:42.696 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: corporation. Support and training for ntp-4 are 2024-09-12T17:02:42.696 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: available at https://www.nwtime.org/support 2024-09-12T17:02:42.696 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: ---------------------------------------------------- 2024-09-12T17:02:42.696 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: proto: precision = 0.050 usec (-24) 2024-09-12T17:02:42.697 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: basedate set to 2022-02-04 2024-09-12T17:02:42.697 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: gps base set to 2022-02-06 (week 2196) 2024-09-12T17:02:42.697 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:02:42.698 INFO:teuthology.orchestra.run.smithi047.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T17:02:42.698 INFO:teuthology.orchestra.run.smithi047.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:02:42.699 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T17:02:42.699 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T17:02:42.699 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T17:02:42.700 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T17:02:42.700 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: Listen normally on 3 ens1f0 172.21.15.47:123 2024-09-12T17:02:42.700 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: Listen normally on 4 lo [::1]:123 2024-09-12T17:02:42.700 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:148e%4]:123 2024-09-12T17:02:42.700 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:42 ntpd[18433]: Listening on routing socket on fd #22 for interface updates 2024-09-12T17:02:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:43 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:43 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:43 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:43.667 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:43 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:43 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:43 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:43 ntpd[18359]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:43 ntpd[18359]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:44.695 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:44 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:44.695 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:44 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:45.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:45.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:45.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:45.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:45.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:45.670 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:45 ntpd[18359]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:46 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:46 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:46 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:46 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:46 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:46 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:46.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:46 ntpd[18433]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:46.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:46 ntpd[18433]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:46.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:46 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:46.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:46 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:46.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:46 ntpd[18433]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:46.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:46 ntpd[18433]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:47.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:47.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:47.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:47.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:47.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:47.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:47 ntpd[18359]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:47.695 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:47 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:47.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:47 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:47.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:47 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:47.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:47 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:47.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:47 ntpd[18433]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:47.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:47 ntpd[18433]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:48.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:48 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:48.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:48 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:48.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:48 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:48.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:48 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:48.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:48 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:48.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:48 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:48.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:48 ntpd[18433]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:48.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:48 ntpd[18433]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:48.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:48 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:48.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:48 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:48.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:48 ntpd[18433]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:48.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:48 ntpd[18433]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:49.668 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:49.669 INFO:teuthology.orchestra.run.smithi017.stdout:12 Sep 17:02:49 ntpd[18359]: ntpd: time slew -0.000091 s 2024-09-12T17:02:49.669 INFO:teuthology.orchestra.run.smithi017.stdout:ntpd: time slew -0.000091s 2024-09-12T17:02:49.669 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:02:49.670 INFO:teuthology.orchestra.run.smithi017.stderr:12 Sep 17:02:49 ntpd[18359]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:02:49.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:49 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:49.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:49 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:49.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:49 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:49.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:49 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:49.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:49 ntpd[18433]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:49.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:49 ntpd[18433]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:49.718 INFO:teuthology.orchestra.run.smithi017.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:02:49.719 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================== 2024-09-12T17:02:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:02:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:02:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:02:49.719 INFO:teuthology.orchestra.run.smithi017.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:02:50.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:50 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:50.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:50 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:50.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:50 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:50.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:50 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:50.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:50 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:50.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:50 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:50.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:50 ntpd[18433]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:50.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:50 ntpd[18433]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:50.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:50 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:50.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:50 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:50.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:50 ntpd[18433]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:50.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:50 ntpd[18433]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:51.695 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:51 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:51.695 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:51 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:51.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:51 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:51.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:51 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:51.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:51 ntpd[18433]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:51.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:51 ntpd[18433]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:52.695 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:52 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:52 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:52 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:52 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:52 ntpd[18433]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T17:02:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:52 ntpd[18433]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T17:02:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:52 ntpd[18433]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T17:02:52.696 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:52 ntpd[18433]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T17:02:52.696 INFO:teuthology.orchestra.run.smithi047.stdout:12 Sep 17:02:52 ntpd[18433]: ntpd: time slew -0.000550 s 2024-09-12T17:02:52.697 INFO:teuthology.orchestra.run.smithi047.stdout:ntpd: time slew -0.000550s 2024-09-12T17:02:52.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:52 ntpd[18433]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T17:02:52.697 INFO:teuthology.orchestra.run.smithi047.stderr:12 Sep 17:02:52 ntpd[18433]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T17:02:52.751 INFO:teuthology.orchestra.run.smithi047.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:02:52.751 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================== 2024-09-12T17:02:52.751 INFO:teuthology.orchestra.run.smithi047.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:02:52.751 INFO:teuthology.orchestra.run.smithi047.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:02:52.751 INFO:teuthology.orchestra.run.smithi047.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:02:52.751 INFO:teuthology.orchestra.run.smithi047.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:02:52.751 INFO:teuthology.run_tasks:Running task install... 2024-09-12T17:02:52.759 DEBUG:teuthology.task.install:project ceph 2024-09-12T17:02:52.760 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:02:52.760 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'} 2024-09-12T17:02:52.760 INFO:teuthology.task.install:Using flavor: default 2024-09-12T17:02:52.765 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T17:02:52.766 INFO:teuthology.task.install:extra packages: [] 2024-09-12T17:02:52.766 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-key list | grep Ceph 2024-09-12T17:02:52.767 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-key list | grep Ceph 2024-09-12T17:02:52.837 INFO:teuthology.orchestra.run.smithi017.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:02:52.853 INFO:teuthology.orchestra.run.smithi047.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T17:02:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:02:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:02:52.868 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:02:52.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:02:52.882 INFO:teuthology.orchestra.run.smithi047.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T17:02:52.882 INFO:teuthology.orchestra.run.smithi047.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T17:02:52.883 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T17:02:52.883 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:02:53.040 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T17:02:53.040 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:02:53.044 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default/ 2024-09-12T17:02:53.044 INFO:teuthology.task.install.deb:Package version is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:02:53.152 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:02:53.152 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:02:53.161 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:02:53.161 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T17:02:53.166 DEBUG:teuthology.orchestra.run.smithi047:> sudo apt-get update 2024-09-12T17:02:53.176 DEBUG:teuthology.orchestra.run.smithi017:> sudo apt-get update 2024-09-12T17:02:53.346 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:02:53.357 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:02:53.374 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:02:53.395 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:02:53.402 INFO:teuthology.orchestra.run.smithi017.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T17:02:53.417 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T17:02:53.423 INFO:teuthology.orchestra.run.smithi017.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release [7,005 B] 2024-09-12T17:02:53.440 INFO:teuthology.orchestra.run.smithi047.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:02:53.445 INFO:teuthology.orchestra.run.smithi017.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T17:02:53.466 INFO:teuthology.orchestra.run.smithi017.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T17:02:53.469 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T17:02:53.469 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:02:53.478 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:02:53.479 INFO:teuthology.orchestra.run.smithi017.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T17:02:53.494 INFO:teuthology.orchestra.run.smithi017.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-12T17:02:53.498 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,427 B] 2024-09-12T17:02:53.541 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T17:02:53.623 INFO:teuthology.orchestra.run.smithi047.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T17:02:53.716 INFO:teuthology.orchestra.run.smithi017.stdout:Fetched 28.6 kB in 0s (80.2 kB/s) 2024-09-12T17:02:53.864 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 28.6 kB in 1s (55.8 kB/s) 2024-09-12T17:02:54.753 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-12T17:02:54.769 DEBUG:teuthology.orchestra.run.smithi017:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:02:54.836 INFO:teuthology.orchestra.run.smithi017.stdout:Reading package lists... 2024-09-12T17:02:54.893 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-09-12T17:02:54.909 DEBUG:teuthology.orchestra.run.smithi047:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4762-gbad475c1-1jammy cephadm=19.3.0-4762-gbad475c1-1jammy ceph-mds=19.3.0-4762-gbad475c1-1jammy ceph-mgr=19.3.0-4762-gbad475c1-1jammy ceph-common=19.3.0-4762-gbad475c1-1jammy ceph-fuse=19.3.0-4762-gbad475c1-1jammy ceph-test=19.3.0-4762-gbad475c1-1jammy ceph-volume=19.3.0-4762-gbad475c1-1jammy radosgw=19.3.0-4762-gbad475c1-1jammy python3-rados=19.3.0-4762-gbad475c1-1jammy python3-rgw=19.3.0-4762-gbad475c1-1jammy python3-cephfs=19.3.0-4762-gbad475c1-1jammy python3-rbd=19.3.0-4762-gbad475c1-1jammy libcephfs2=19.3.0-4762-gbad475c1-1jammy libcephfs-dev=19.3.0-4762-gbad475c1-1jammy librados2=19.3.0-4762-gbad475c1-1jammy librbd1=19.3.0-4762-gbad475c1-1jammy rbd-fuse=19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:02:54.972 INFO:teuthology.orchestra.run.smithi047.stdout:Reading package lists... 2024-09-12T17:02:55.050 INFO:teuthology.orchestra.run.smithi017.stdout:Building dependency tree... 2024-09-12T17:02:55.051 INFO:teuthology.orchestra.run.smithi017.stdout:Reading state information... 2024-09-12T17:02:55.185 INFO:teuthology.orchestra.run.smithi047.stdout:Building dependency tree... 2024-09-12T17:02:55.186 INFO:teuthology.orchestra.run.smithi047.stdout:Reading state information... 2024-09-12T17:02:55.266 INFO:teuthology.orchestra.run.smithi017.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:02:55.266 INFO:teuthology.orchestra.run.smithi017.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:02:55.266 INFO:teuthology.orchestra.run.smithi017.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:02:55.266 INFO:teuthology.orchestra.run.smithi017.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:02:55.267 INFO:teuthology.orchestra.run.smithi017.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:02:55.267 INFO:teuthology.orchestra.run.smithi017.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:02:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:02:55.267 INFO:teuthology.orchestra.run.smithi017.stdout:The following additional packages will be installed: 2024-09-12T17:02:55.267 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:02:55.267 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:02:55.269 INFO:teuthology.orchestra.run.smithi017.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T17:02:55.269 INFO:teuthology.orchestra.run.smithi017.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T17:02:55.269 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T17:02:55.269 INFO:teuthology.orchestra.run.smithi017.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T17:02:55.270 INFO:teuthology.orchestra.run.smithi017.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T17:02:55.270 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T17:02:55.270 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T17:02:55.270 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:02:55.270 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:02:55.270 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:02:55.270 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:02:55.270 INFO:teuthology.orchestra.run.smithi017.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:02:55.270 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:02:55.270 INFO:teuthology.orchestra.run.smithi017.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:02:55.270 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T17:02:55.271 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T17:02:55.271 INFO:teuthology.orchestra.run.smithi017.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:02:55.271 INFO:teuthology.orchestra.run.smithi017.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:02:55.271 INFO:teuthology.orchestra.run.smithi017.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:02:55.271 INFO:teuthology.orchestra.run.smithi017.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:02:55.271 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:02:55.271 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet zip 2024-09-12T17:02:55.271 INFO:teuthology.orchestra.run.smithi017.stdout:Suggested packages: 2024-09-12T17:02:55.271 INFO:teuthology.orchestra.run.smithi017.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:02:55.272 INFO:teuthology.orchestra.run.smithi017.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:02:55.272 INFO:teuthology.orchestra.run.smithi017.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:02:55.272 INFO:teuthology.orchestra.run.smithi017.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:02:55.272 INFO:teuthology.orchestra.run.smithi017.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:02:55.272 INFO:teuthology.orchestra.run.smithi017.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:02:55.272 INFO:teuthology.orchestra.run.smithi017.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:02:55.272 INFO:teuthology.orchestra.run.smithi017.stdout:Recommended packages: 2024-09-12T17:02:55.272 INFO:teuthology.orchestra.run.smithi017.stdout: btrfs-tools 2024-09-12T17:02:55.381 INFO:teuthology.orchestra.run.smithi017.stdout:The following NEW packages will be installed: 2024-09-12T17:02:55.381 INFO:teuthology.orchestra.run.smithi017.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:02:55.381 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:02:55.381 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:02:55.381 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:02:55.381 INFO:teuthology.orchestra.run.smithi017.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T17:02:55.382 INFO:teuthology.orchestra.run.smithi017.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:02:55.383 INFO:teuthology.orchestra.run.smithi017.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:02:55.383 INFO:teuthology.orchestra.run.smithi017.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:02:55.383 INFO:teuthology.orchestra.run.smithi017.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:02:55.383 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:02:55.383 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:02:55.383 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:02:55.384 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:02:55.384 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:02:55.384 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:02:55.384 INFO:teuthology.orchestra.run.smithi017.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:02:55.384 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:02:55.384 INFO:teuthology.orchestra.run.smithi017.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:02:55.384 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:02:55.384 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:02:55.384 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:02:55.384 INFO:teuthology.orchestra.run.smithi017.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:02:55.384 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:02:55.384 INFO:teuthology.orchestra.run.smithi017.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:02:55.385 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:02:55.385 INFO:teuthology.orchestra.run.smithi017.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:02:55.402 INFO:teuthology.orchestra.run.smithi047.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T17:02:55.402 INFO:teuthology.orchestra.run.smithi047.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T17:02:55.403 INFO:teuthology.orchestra.run.smithi047.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T17:02:55.403 INFO:teuthology.orchestra.run.smithi047.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T17:02:55.403 INFO:teuthology.orchestra.run.smithi047.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T17:02:55.404 INFO:teuthology.orchestra.run.smithi047.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T17:02:55.404 INFO:teuthology.orchestra.run.smithi047.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T17:02:55.404 INFO:teuthology.orchestra.run.smithi047.stdout:The following additional packages will be installed: 2024-09-12T17:02:55.404 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T17:02:55.405 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T17:02:55.406 INFO:teuthology.orchestra.run.smithi047.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T17:02:55.406 INFO:teuthology.orchestra.run.smithi047.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T17:02:55.406 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T17:02:55.406 INFO:teuthology.orchestra.run.smithi047.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T17:02:55.406 INFO:teuthology.orchestra.run.smithi047.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T17:02:55.406 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T17:02:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T17:02:55.408 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T17:02:55.408 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet zip 2024-09-12T17:02:55.408 INFO:teuthology.orchestra.run.smithi047.stdout:Suggested packages: 2024-09-12T17:02:55.408 INFO:teuthology.orchestra.run.smithi047.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T17:02:55.408 INFO:teuthology.orchestra.run.smithi047.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T17:02:55.408 INFO:teuthology.orchestra.run.smithi047.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T17:02:55.408 INFO:teuthology.orchestra.run.smithi047.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T17:02:55.409 INFO:teuthology.orchestra.run.smithi047.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T17:02:55.409 INFO:teuthology.orchestra.run.smithi047.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T17:02:55.409 INFO:teuthology.orchestra.run.smithi047.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T17:02:55.409 INFO:teuthology.orchestra.run.smithi047.stdout:Recommended packages: 2024-09-12T17:02:55.409 INFO:teuthology.orchestra.run.smithi047.stdout: btrfs-tools 2024-09-12T17:02:55.518 INFO:teuthology.orchestra.run.smithi047.stdout:The following NEW packages will be installed: 2024-09-12T17:02:55.518 INFO:teuthology.orchestra.run.smithi047.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T17:02:55.518 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T17:02:55.518 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T17:02:55.519 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T17:02:55.519 INFO:teuthology.orchestra.run.smithi047.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T17:02:55.519 INFO:teuthology.orchestra.run.smithi047.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T17:02:55.520 INFO:teuthology.orchestra.run.smithi047.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T17:02:55.520 INFO:teuthology.orchestra.run.smithi047.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T17:02:55.520 INFO:teuthology.orchestra.run.smithi047.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T17:02:55.520 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T17:02:55.521 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T17:02:55.521 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T17:02:55.521 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T17:02:55.521 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T17:02:55.521 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T17:02:55.521 INFO:teuthology.orchestra.run.smithi047.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T17:02:55.521 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T17:02:55.521 INFO:teuthology.orchestra.run.smithi047.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T17:02:55.521 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T17:02:55.521 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T17:02:55.521 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T17:02:55.522 INFO:teuthology.orchestra.run.smithi047.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T17:02:55.522 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T17:02:55.522 INFO:teuthology.orchestra.run.smithi047.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T17:02:55.522 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T17:02:55.522 INFO:teuthology.orchestra.run.smithi047.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T17:02:55.526 INFO:teuthology.orchestra.run.smithi017.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:02:55.526 INFO:teuthology.orchestra.run.smithi017.stdout:Need to get 243 MB of archives. 2024-09-12T17:02:55.526 INFO:teuthology.orchestra.run.smithi017.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T17:02:55.526 INFO:teuthology.orchestra.run.smithi017.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T17:02:55.571 INFO:teuthology.orchestra.run.smithi017.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:02:55.668 INFO:teuthology.orchestra.run.smithi047.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T17:02:55.668 INFO:teuthology.orchestra.run.smithi047.stdout:Need to get 243 MB of archives. 2024-09-12T17:02:55.668 INFO:teuthology.orchestra.run.smithi047.stdout:After this operation, 908 MB of additional disk space will be used. 2024-09-12T17:02:55.668 INFO:teuthology.orchestra.run.smithi047.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4762-gbad475c1-1jammy [3,629 kB] 2024-09-12T17:02:55.703 INFO:teuthology.orchestra.run.smithi017.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T17:02:55.711 INFO:teuthology.orchestra.run.smithi047.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T17:02:55.751 INFO:teuthology.orchestra.run.smithi017.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T17:02:55.764 INFO:teuthology.orchestra.run.smithi017.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T17:02:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T17:02:55.770 INFO:teuthology.orchestra.run.smithi017.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T17:02:55.773 INFO:teuthology.orchestra.run.smithi017.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T17:02:55.774 INFO:teuthology.orchestra.run.smithi017.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T17:02:55.780 INFO:teuthology.orchestra.run.smithi017.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T17:02:55.924 INFO:teuthology.orchestra.run.smithi017.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T17:02:55.925 INFO:teuthology.orchestra.run.smithi017.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T17:02:55.931 INFO:teuthology.orchestra.run.smithi017.stdout:Get:13 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T17:02:55.992 INFO:teuthology.orchestra.run.smithi017.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:02:56.004 INFO:teuthology.orchestra.run.smithi017.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:02:56.085 INFO:teuthology.orchestra.run.smithi017.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:02:56.135 INFO:teuthology.orchestra.run.smithi047.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T17:02:56.148 INFO:teuthology.orchestra.run.smithi047.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T17:02:56.229 INFO:teuthology.orchestra.run.smithi047.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T17:02:56.317 INFO:teuthology.orchestra.run.smithi017.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:02:56.326 INFO:teuthology.orchestra.run.smithi017.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:02:56.360 INFO:teuthology.orchestra.run.smithi017.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:02:56.369 INFO:teuthology.orchestra.run.smithi017.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:02:56.370 INFO:teuthology.orchestra.run.smithi017.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:02:56.371 INFO:teuthology.orchestra.run.smithi017.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:02:56.388 INFO:teuthology.orchestra.run.smithi017.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:02:56.393 INFO:teuthology.orchestra.run.smithi017.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:02:56.397 INFO:teuthology.orchestra.run.smithi017.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:02:56.400 INFO:teuthology.orchestra.run.smithi017.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:02:56.458 INFO:teuthology.orchestra.run.smithi047.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T17:02:56.469 INFO:teuthology.orchestra.run.smithi047.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T17:02:56.480 INFO:teuthology.orchestra.run.smithi017.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:02:56.499 INFO:teuthology.orchestra.run.smithi047.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T17:02:56.503 INFO:teuthology.orchestra.run.smithi047.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4762-gbad475c1-1jammy [3,322 kB] 2024-09-12T17:02:56.503 INFO:teuthology.orchestra.run.smithi017.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:02:56.507 INFO:teuthology.orchestra.run.smithi047.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T17:02:56.508 INFO:teuthology.orchestra.run.smithi047.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T17:02:56.510 INFO:teuthology.orchestra.run.smithi047.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T17:02:56.528 INFO:teuthology.orchestra.run.smithi047.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T17:02:56.532 INFO:teuthology.orchestra.run.smithi047.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T17:02:56.536 INFO:teuthology.orchestra.run.smithi047.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T17:02:56.540 INFO:teuthology.orchestra.run.smithi047.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T17:02:56.568 INFO:teuthology.orchestra.run.smithi017.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:02:56.568 INFO:teuthology.orchestra.run.smithi017.stdout:Get:30 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T17:02:56.571 INFO:teuthology.orchestra.run.smithi017.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:02:56.573 INFO:teuthology.orchestra.run.smithi017.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:02:56.573 INFO:teuthology.orchestra.run.smithi017.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:02:56.575 INFO:teuthology.orchestra.run.smithi017.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:02:56.576 INFO:teuthology.orchestra.run.smithi017.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:02:56.577 INFO:teuthology.orchestra.run.smithi017.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:02:56.578 INFO:teuthology.orchestra.run.smithi017.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:02:56.620 INFO:teuthology.orchestra.run.smithi047.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T17:02:56.625 INFO:teuthology.orchestra.run.smithi047.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T17:02:56.629 INFO:teuthology.orchestra.run.smithi047.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T17:02:56.633 INFO:teuthology.orchestra.run.smithi047.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T17:02:56.634 INFO:teuthology.orchestra.run.smithi047.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T17:02:56.635 INFO:teuthology.orchestra.run.smithi047.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T17:02:56.637 INFO:teuthology.orchestra.run.smithi047.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T17:02:56.638 INFO:teuthology.orchestra.run.smithi047.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T17:02:56.638 INFO:teuthology.orchestra.run.smithi047.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T17:02:56.640 INFO:teuthology.orchestra.run.smithi017.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T17:02:56.642 INFO:teuthology.orchestra.run.smithi017.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:02:56.643 INFO:teuthology.orchestra.run.smithi017.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T17:02:56.645 INFO:teuthology.orchestra.run.smithi017.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T17:02:56.659 INFO:teuthology.orchestra.run.smithi017.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T17:02:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:02:56.661 INFO:teuthology.orchestra.run.smithi017.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:02:56.667 INFO:teuthology.orchestra.run.smithi017.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:02:56.668 INFO:teuthology.orchestra.run.smithi017.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:02:56.669 INFO:teuthology.orchestra.run.smithi017.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:02:56.703 INFO:teuthology.orchestra.run.smithi047.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T17:02:56.711 INFO:teuthology.orchestra.run.smithi047.stdout:Get:27 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4762-gbad475c1-1jammy [721 kB] 2024-09-12T17:02:56.725 INFO:teuthology.orchestra.run.smithi047.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T17:02:56.726 INFO:teuthology.orchestra.run.smithi047.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T17:02:56.726 INFO:teuthology.orchestra.run.smithi047.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T17:02:56.726 INFO:teuthology.orchestra.run.smithi017.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:02:56.726 INFO:teuthology.orchestra.run.smithi017.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:02:56.727 INFO:teuthology.orchestra.run.smithi017.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:02:56.727 INFO:teuthology.orchestra.run.smithi017.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:02:56.728 INFO:teuthology.orchestra.run.smithi047.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T17:02:56.729 INFO:teuthology.orchestra.run.smithi047.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T17:02:56.780 INFO:teuthology.orchestra.run.smithi017.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T17:02:56.785 INFO:teuthology.orchestra.run.smithi047.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T17:02:56.785 INFO:teuthology.orchestra.run.smithi047.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T17:02:56.787 INFO:teuthology.orchestra.run.smithi047.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T17:02:56.788 INFO:teuthology.orchestra.run.smithi047.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T17:02:56.806 INFO:teuthology.orchestra.run.smithi017.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:02:56.807 INFO:teuthology.orchestra.run.smithi017.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:02:56.808 INFO:teuthology.orchestra.run.smithi017.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:02:56.819 INFO:teuthology.orchestra.run.smithi017.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:02:56.819 INFO:teuthology.orchestra.run.smithi017.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:02:56.820 INFO:teuthology.orchestra.run.smithi047.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4762-gbad475c1-1jammy [357 kB] 2024-09-12T17:02:56.827 INFO:teuthology.orchestra.run.smithi047.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4762-gbad475c1-1jammy [32.8 kB] 2024-09-12T17:02:56.828 INFO:teuthology.orchestra.run.smithi047.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4762-gbad475c1-1jammy [180 kB] 2024-09-12T17:02:56.866 INFO:teuthology.orchestra.run.smithi047.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T17:02:56.868 INFO:teuthology.orchestra.run.smithi047.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T17:02:56.870 INFO:teuthology.orchestra.run.smithi047.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T17:02:56.871 INFO:teuthology.orchestra.run.smithi047.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T17:02:56.880 INFO:teuthology.orchestra.run.smithi047.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4762-gbad475c1-1jammy [71.2 kB] 2024-09-12T17:02:56.882 INFO:teuthology.orchestra.run.smithi047.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T17:02:56.882 INFO:teuthology.orchestra.run.smithi047.stdout:Get:46 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4762-gbad475c1-1jammy [338 kB] 2024-09-12T17:02:56.883 INFO:teuthology.orchestra.run.smithi047.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T17:02:56.887 INFO:teuthology.orchestra.run.smithi017.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:02:56.888 INFO:teuthology.orchestra.run.smithi017.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:02:56.889 INFO:teuthology.orchestra.run.smithi047.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4762-gbad475c1-1jammy [7,972 kB] 2024-09-12T17:02:56.891 INFO:teuthology.orchestra.run.smithi017.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:02:56.895 INFO:teuthology.orchestra.run.smithi017.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:02:56.896 INFO:teuthology.orchestra.run.smithi017.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:02:56.948 INFO:teuthology.orchestra.run.smithi047.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T17:02:56.949 INFO:teuthology.orchestra.run.smithi047.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T17:02:56.951 INFO:teuthology.orchestra.run.smithi047.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T17:02:56.955 INFO:teuthology.orchestra.run.smithi047.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T17:02:56.969 INFO:teuthology.orchestra.run.smithi017.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:02:56.970 INFO:teuthology.orchestra.run.smithi017.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:02:56.975 INFO:teuthology.orchestra.run.smithi017.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:02:56.976 INFO:teuthology.orchestra.run.smithi017.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:02:56.978 INFO:teuthology.orchestra.run.smithi017.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:02:57.029 INFO:teuthology.orchestra.run.smithi047.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T17:02:57.032 INFO:teuthology.orchestra.run.smithi047.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T17:02:57.033 INFO:teuthology.orchestra.run.smithi047.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T17:02:57.038 INFO:teuthology.orchestra.run.smithi047.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T17:02:57.039 INFO:teuthology.orchestra.run.smithi047.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T17:02:57.041 INFO:teuthology.orchestra.run.smithi047.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T17:02:57.050 INFO:teuthology.orchestra.run.smithi017.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:02:57.111 INFO:teuthology.orchestra.run.smithi047.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T17:02:57.169 INFO:teuthology.orchestra.run.smithi017.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:02:57.214 INFO:teuthology.orchestra.run.smithi017.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:02:57.216 INFO:teuthology.orchestra.run.smithi017.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:02:57.217 INFO:teuthology.orchestra.run.smithi017.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:02:57.219 INFO:teuthology.orchestra.run.smithi017.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:02:57.227 INFO:teuthology.orchestra.run.smithi047.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T17:02:57.274 INFO:teuthology.orchestra.run.smithi047.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T17:02:57.277 INFO:teuthology.orchestra.run.smithi047.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T17:02:57.278 INFO:teuthology.orchestra.run.smithi047.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T17:02:57.280 INFO:teuthology.orchestra.run.smithi047.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T17:02:57.308 INFO:teuthology.orchestra.run.smithi017.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:02:57.308 INFO:teuthology.orchestra.run.smithi017.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T17:02:57.309 INFO:teuthology.orchestra.run.smithi017.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T17:02:57.311 INFO:teuthology.orchestra.run.smithi017.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:02:57.312 INFO:teuthology.orchestra.run.smithi017.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:02:57.321 INFO:teuthology.orchestra.run.smithi047.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T17:02:57.321 INFO:teuthology.orchestra.run.smithi017.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T17:02:57.324 INFO:teuthology.orchestra.run.smithi047.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T17:02:57.325 INFO:teuthology.orchestra.run.smithi047.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T17:02:57.340 INFO:teuthology.orchestra.run.smithi017.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:02:57.340 INFO:teuthology.orchestra.run.smithi017.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:02:57.353 INFO:teuthology.orchestra.run.smithi017.stdout:Get:82 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T17:02:57.363 INFO:teuthology.orchestra.run.smithi017.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T17:02:57.365 INFO:teuthology.orchestra.run.smithi017.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T17:02:57.377 INFO:teuthology.orchestra.run.smithi017.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:02:57.377 INFO:teuthology.orchestra.run.smithi017.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:02:57.378 INFO:teuthology.orchestra.run.smithi047.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T17:02:57.379 INFO:teuthology.orchestra.run.smithi017.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:02:57.379 INFO:teuthology.orchestra.run.smithi047.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T17:02:57.379 INFO:teuthology.orchestra.run.smithi017.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:02:57.433 INFO:teuthology.orchestra.run.smithi047.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T17:02:57.433 INFO:teuthology.orchestra.run.smithi047.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T17:02:57.434 INFO:teuthology.orchestra.run.smithi047.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T17:02:57.436 INFO:teuthology.orchestra.run.smithi047.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T17:02:57.436 INFO:teuthology.orchestra.run.smithi047.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:02:57.438 INFO:teuthology.orchestra.run.smithi047.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:02:57.442 INFO:teuthology.orchestra.run.smithi047.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4762-gbad475c1-1jammy [112 kB] 2024-09-12T17:02:57.445 INFO:teuthology.orchestra.run.smithi047.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4762-gbad475c1-1jammy [473 kB] 2024-09-12T17:02:57.445 INFO:teuthology.orchestra.run.smithi047.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:02:57.458 INFO:teuthology.orchestra.run.smithi017.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T17:02:57.459 INFO:teuthology.orchestra.run.smithi017.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T17:02:57.468 INFO:teuthology.orchestra.run.smithi017.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T17:02:57.472 INFO:teuthology.orchestra.run.smithi017.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:02:57.476 INFO:teuthology.orchestra.run.smithi017.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:02:57.478 INFO:teuthology.orchestra.run.smithi017.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:02:57.497 INFO:teuthology.orchestra.run.smithi047.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4762-gbad475c1-1jammy [28.2 MB] 2024-09-12T17:02:57.514 INFO:teuthology.orchestra.run.smithi047.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T17:02:57.517 INFO:teuthology.orchestra.run.smithi047.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T17:02:57.519 INFO:teuthology.orchestra.run.smithi047.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T17:02:57.542 INFO:teuthology.orchestra.run.smithi017.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:02:57.546 INFO:teuthology.orchestra.run.smithi017.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:02:57.548 INFO:teuthology.orchestra.run.smithi017.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:02:57.550 INFO:teuthology.orchestra.run.smithi017.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:02:57.595 INFO:teuthology.orchestra.run.smithi047.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T17:02:57.601 INFO:teuthology.orchestra.run.smithi047.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T17:02:57.604 INFO:teuthology.orchestra.run.smithi047.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T17:02:57.605 INFO:teuthology.orchestra.run.smithi047.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T17:02:57.616 INFO:teuthology.orchestra.run.smithi047.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:02:57.617 INFO:teuthology.orchestra.run.smithi047.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:02:57.622 INFO:teuthology.orchestra.run.smithi017.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T17:02:57.623 INFO:teuthology.orchestra.run.smithi017.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T17:02:57.625 INFO:teuthology.orchestra.run.smithi047.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:02:57.631 INFO:teuthology.orchestra.run.smithi017.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T17:02:57.631 INFO:teuthology.orchestra.run.smithi017.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:02:57.633 INFO:teuthology.orchestra.run.smithi017.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:02:57.634 INFO:teuthology.orchestra.run.smithi017.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:02:57.677 INFO:teuthology.orchestra.run.smithi047.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T17:02:57.678 INFO:teuthology.orchestra.run.smithi047.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T17:02:57.679 INFO:teuthology.orchestra.run.smithi047.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T17:02:57.703 INFO:teuthology.orchestra.run.smithi017.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:02:57.705 INFO:teuthology.orchestra.run.smithi017.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:02:57.722 INFO:teuthology.orchestra.run.smithi017.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:02:57.722 INFO:teuthology.orchestra.run.smithi017.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:02:57.758 INFO:teuthology.orchestra.run.smithi047.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T17:02:57.760 INFO:teuthology.orchestra.run.smithi047.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T17:02:57.777 INFO:teuthology.orchestra.run.smithi047.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T17:02:57.778 INFO:teuthology.orchestra.run.smithi047.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T17:02:57.779 INFO:teuthology.orchestra.run.smithi047.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:02:57.784 INFO:teuthology.orchestra.run.smithi047.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:02:57.785 INFO:teuthology.orchestra.run.smithi017.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T17:02:57.786 INFO:teuthology.orchestra.run.smithi047.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:02:57.790 INFO:teuthology.orchestra.run.smithi017.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T17:02:57.791 INFO:teuthology.orchestra.run.smithi017.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T17:02:58.872 INFO:teuthology.orchestra.run.smithi047.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4762-gbad475c1-1jammy [5,206 kB] 2024-09-12T17:02:58.990 INFO:teuthology.orchestra.run.smithi047.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4762-gbad475c1-1jammy [251 kB] 2024-09-12T17:02:58.995 INFO:teuthology.orchestra.run.smithi047.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4762-gbad475c1-1jammy [124 kB] 2024-09-12T17:02:58.998 INFO:teuthology.orchestra.run.smithi047.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4762-gbad475c1-1jammy [1,562 kB] 2024-09-12T17:02:59.030 INFO:teuthology.orchestra.run.smithi047.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4762-gbad475c1-1jammy [6,310 kB] 2024-09-12T17:02:59.143 INFO:teuthology.orchestra.run.smithi047.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4762-gbad475c1-1jammy [23.1 MB] 2024-09-12T17:02:59.180 INFO:teuthology.orchestra.run.smithi017.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T17:02:59.355 INFO:teuthology.orchestra.run.smithi017.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T17:02:59.355 INFO:teuthology.orchestra.run.smithi017.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T17:03:00.008 INFO:teuthology.orchestra.run.smithi047.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4762-gbad475c1-1jammy [14.1 kB] 2024-09-12T17:03:00.009 INFO:teuthology.orchestra.run.smithi047.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4762-gbad475c1-1jammy [880 kB] 2024-09-12T17:03:00.026 INFO:teuthology.orchestra.run.smithi047.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4762-gbad475c1-1jammy [2,438 kB] 2024-09-12T17:03:00.068 INFO:teuthology.orchestra.run.smithi047.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4762-gbad475c1-1jammy [812 kB] 2024-09-12T17:03:00.090 INFO:teuthology.orchestra.run.smithi047.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4762-gbad475c1-1jammy [160 kB] 2024-09-12T17:03:00.092 INFO:teuthology.orchestra.run.smithi047.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4762-gbad475c1-1jammy [61.4 MB] 2024-09-12T17:03:00.966 INFO:teuthology.orchestra.run.smithi017.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T17:03:00.969 INFO:teuthology.orchestra.run.smithi017.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T17:03:00.970 INFO:teuthology.orchestra.run.smithi017.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T17:03:01.436 INFO:teuthology.orchestra.run.smithi017.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T17:03:02.034 INFO:teuthology.orchestra.run.smithi047.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4762-gbad475c1-1jammy [8,625 kB] 2024-09-12T17:03:02.036 INFO:teuthology.orchestra.run.smithi017.stdout:Fetched 243 MB in 6s (40.3 MB/s) 2024-09-12T17:03:02.146 INFO:teuthology.orchestra.run.smithi047.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4762-gbad475c1-1jammy [14.2 kB] 2024-09-12T17:03:02.147 INFO:teuthology.orchestra.run.smithi047.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4762-gbad475c1-1jammy [48.5 MB] 2024-09-12T17:03:02.205 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:03:02.308 INFO:teuthology.orchestra.run.smithi017.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:03:02.314 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:03:02.412 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:03:02.707 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:03:02.733 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:03:02.765 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:03:03.113 INFO:teuthology.orchestra.run.smithi047.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4762-gbad475c1-1jammy [130 kB] 2024-09-12T17:03:03.185 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:03:03.190 INFO:teuthology.orchestra.run.smithi047.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4762-gbad475c1-1jammy [39.0 kB] 2024-09-12T17:03:03.191 INFO:teuthology.orchestra.run.smithi047.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4762-gbad475c1-1jammy [15.8 MB] 2024-09-12T17:03:03.211 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:03:03.251 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:03:03.488 INFO:teuthology.orchestra.run.smithi047.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-rgw-meta-handlers/bad475c18c96ec20c5778159aa33ba72b84e9c1b/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4762-gbad475c1-1jammy [91.2 kB] 2024-09-12T17:03:03.696 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:03:03.723 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:03:03.771 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:03:04.081 INFO:teuthology.orchestra.run.smithi047.stdout:Fetched 243 MB in 8s (30.6 MB/s) 2024-09-12T17:03:04.157 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:03:04.184 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:03:04.224 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:03:04.251 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T17:03:04.355 INFO:teuthology.orchestra.run.smithi047.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T17:03:04.360 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T17:03:04.442 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:03:04.510 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:03:04.537 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:03:04.568 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:03:04.778 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T17:03:04.805 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T17:03:04.845 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:03:04.922 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:03:04.948 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:03:04.988 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:03:05.189 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T17:03:05.216 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T17:03:05.264 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:03:05.316 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package librados2. 2024-09-12T17:03:05.343 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:05.382 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:05.818 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T17:03:05.844 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:03:05.884 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:03:06.051 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:03:06.078 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:06.110 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:06.262 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T17:03:06.289 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:03:06.329 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:03:06.548 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:03:06.575 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:06.615 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:06.649 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T17:03:06.676 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T17:03:06.715 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:03:06.900 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:03:06.916 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:06.958 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:07.043 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T17:03:07.070 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T17:03:07.110 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:03:07.236 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:03:07.263 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:07.294 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:07.438 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librados2. 2024-09-12T17:03:07.464 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../007-librados2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:07.496 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:03:07.504 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:07.512 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:07.546 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:07.858 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:03:07.884 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:07.924 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:08.015 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librbd1. 2024-09-12T17:03:08.042 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../008-librbd1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:08.082 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:08.252 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:03:08.278 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:03:08.318 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:03:08.501 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T17:03:08.517 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:08.551 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:08.629 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:03:08.656 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:03:08.696 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:03:08.787 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rados. 2024-09-12T17:03:08.803 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:08.836 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:08.923 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:03:08.939 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:08.973 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:09.148 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T17:03:09.174 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:09.214 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:09.318 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:03:09.345 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:03:09.384 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:03:09.475 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T17:03:09.491 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:09.533 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:09.662 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:03:09.689 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:03:09.728 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:03:09.836 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T17:03:09.863 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:09.902 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:10.006 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:03:10.023 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:03:10.065 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:03:10.230 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T17:03:10.257 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T17:03:10.297 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:03:10.393 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:03:10.420 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:03:10.459 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:03:10.617 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T17:03:10.643 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T17:03:10.675 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T17:03:10.770 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:03:10.797 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:03:10.837 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:03:10.927 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T17:03:10.943 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:10.986 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:11.215 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package zip. 2024-09-12T17:03:11.231 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:03:11.265 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:03:11.347 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T17:03:11.374 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T17:03:11.415 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:03:11.609 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package unzip. 2024-09-12T17:03:11.636 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:03:11.676 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:03:11.741 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T17:03:11.768 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T17:03:11.808 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:03:12.069 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T17:03:12.071 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:03:12.085 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T17:03:12.098 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:03:12.119 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:03:12.138 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:03:12.430 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua5.1. 2024-09-12T17:03:12.457 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T17:03:12.497 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:03:12.520 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:03:12.547 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:12.587 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:12.817 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-any. 2024-09-12T17:03:12.832 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T17:03:12.875 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T17:03:13.119 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package zip. 2024-09-12T17:03:13.146 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T17:03:13.185 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T17:03:13.189 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:03:13.205 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:13.239 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:13.447 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package unzip. 2024-09-12T17:03:13.462 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T17:03:13.497 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:03:13.584 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:03:13.611 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:03:13.650 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:03:13.917 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package luarocks. 2024-09-12T17:03:13.944 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T17:03:13.961 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:03:13.984 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:03:13.988 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:14.028 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:14.367 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package librgw2. 2024-09-12T17:03:14.394 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../025-librgw2_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:14.432 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:03:14.433 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:14.458 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:14.498 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:15.035 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T17:03:15.059 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:15.115 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:15.430 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T17:03:15.456 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T17:03:15.496 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:03:15.808 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T17:03:15.834 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:16.003 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:03:16.019 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:16.030 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:16.127 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:16.452 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-common. 2024-09-12T17:03:16.479 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:16.519 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:16.774 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:03:16.801 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:03:16.840 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:03:17.169 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:03:17.197 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:03:17.235 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:03:17.571 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:03:17.598 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:03:17.637 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:03:17.899 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:03:17.926 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:03:17.965 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:03:18.007 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-base. 2024-09-12T17:03:18.035 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:18.092 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:18.268 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:03:18.295 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:03:18.334 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:03:18.603 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T17:03:18.627 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T17:03:18.637 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:03:18.664 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:03:18.692 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:03:18.703 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:03:18.980 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T17:03:18.981 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:03:19.007 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T17:03:19.008 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:03:19.048 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:03:19.056 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:03:19.317 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:03:19.344 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:03:19.384 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T17:03:19.384 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:03:19.411 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T17:03:19.442 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:03:19.687 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:03:19.714 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:03:19.728 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T17:03:19.753 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:03:19.755 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T17:03:19.794 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:03:20.081 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T17:03:20.107 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T17:03:20.124 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:03:20.147 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:03:20.150 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:03:20.190 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:03:20.425 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T17:03:20.442 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T17:03:20.476 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:03:20.483 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T17:03:20.503 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:03:20.534 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:03:20.719 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-portend. 2024-09-12T17:03:20.746 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T17:03:20.785 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T17:03:20.837 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:03:20.864 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:03:20.904 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:03:21.089 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T17:03:21.115 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T17:03:21.155 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T17:03:21.207 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:03:21.233 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:03:21.273 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:03:21.601 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:03:21.628 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:03:21.668 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:03:21.683 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T17:03:21.710 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T17:03:21.749 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:03:21.912 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:03:21.928 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:03:21.962 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:03:22.061 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T17:03:22.077 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T17:03:22.111 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T17:03:22.239 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:03:22.267 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:03:22.306 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:03:22.406 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T17:03:22.433 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T17:03:22.472 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T17:03:22.635 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:03:22.661 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:03:22.704 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:03:22.783 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T17:03:22.812 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T17:03:22.850 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:03:23.037 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:03:23.064 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:03:23.103 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:03:23.153 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-mako. 2024-09-12T17:03:23.180 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T17:03:23.219 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:03:23.406 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:03:23.433 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:03:23.473 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:03:23.572 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T17:03:23.599 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T17:03:23.639 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:03:23.792 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:03:23.808 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:03:23.851 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:03:23.925 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T17:03:23.952 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T17:03:23.992 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:03:24.195 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:03:24.222 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:03:24.261 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:03:24.286 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webob. 2024-09-12T17:03:24.313 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T17:03:24.353 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:03:24.523 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:03:24.550 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:03:24.581 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:03:24.705 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T17:03:24.733 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T17:03:24.775 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:03:24.867 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:03:24.895 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:03:24.934 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:03:25.084 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T17:03:25.111 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T17:03:25.150 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:03:25.297 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:03:25.324 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:03:25.363 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:03:25.411 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-paste. 2024-09-12T17:03:25.438 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T17:03:25.469 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:03:25.691 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:03:25.718 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:03:25.757 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:03:25.797 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T17:03:25.825 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T17:03:25.880 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:03:26.069 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:03:26.096 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:03:26.135 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:03:26.141 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T17:03:26.158 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T17:03:26.191 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:03:26.445 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T17:03:26.471 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T17:03:26.511 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T17:03:26.613 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:03:26.630 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:03:26.663 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:03:26.822 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T17:03:26.849 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T17:03:26.888 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:03:26.916 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:03:26.943 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:03:26.974 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:03:27.260 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T17:03:27.269 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:03:27.285 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:27.287 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T17:03:27.319 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:27.326 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T17:03:27.654 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-idna. 2024-09-12T17:03:27.681 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T17:03:27.715 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:03:27.721 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:03:27.742 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:27.781 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:28.007 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T17:03:28.023 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T17:03:28.057 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:03:28.109 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:03:28.136 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:03:28.176 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:03:28.327 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-requests. 2024-09-12T17:03:28.354 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T17:03:28.385 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:03:28.462 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:03:28.489 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:03:28.520 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:03:28.846 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T17:03:28.848 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:03:28.873 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T17:03:28.875 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:28.915 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:29.263 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:03:29.318 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:03:29.345 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:29.384 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:29.741 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T17:03:29.757 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:29.790 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:29.929 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:03:29.957 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:29.987 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T17:03:30.232 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:30.270 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:30.540 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T17:03:30.567 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T17:03:30.598 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:03:30.901 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T17:03:30.928 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T17:03:30.967 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T17:03:31.057 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph. 2024-09-12T17:03:31.073 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:31.124 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:31.312 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T17:03:31.340 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:31.378 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:31.443 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:03:31.470 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:31.510 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:31.880 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:03:31.907 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:31.946 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:31.965 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T17:03:31.992 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:32.031 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:32.299 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:03:32.326 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:32.357 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:32.568 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T17:03:32.596 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:32.634 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:32.676 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:03:32.705 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:03:32.743 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:03:33.037 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:03:33.053 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:03:33.095 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:03:33.721 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph. 2024-09-12T17:03:33.737 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../066-ceph_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:33.779 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:34.098 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T17:03:34.126 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:34.165 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:34.200 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:03:34.228 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:03:34.267 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:03:34.493 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T17:03:34.521 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:34.560 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:34.586 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:03:34.614 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:03:34.653 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:03:34.946 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package cephadm. 2024-09-12T17:03:34.973 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../069-cephadm_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:34.997 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:03:35.012 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:35.025 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:35.064 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:35.332 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T17:03:35.359 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T17:03:35.401 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T17:03:35.409 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:03:35.436 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:03:35.475 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:03:35.726 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T17:03:35.742 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:03:35.778 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:03:35.784 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:03:35.806 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:03:35.862 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:03:36.214 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:03:36.242 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:36.280 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:36.822 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-babel. 2024-09-12T17:03:36.850 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T17:03:36.897 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:03:37.192 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T17:03:37.219 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T17:03:37.250 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:03:37.553 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T17:03:37.581 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:37.611 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:37.948 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T17:03:37.975 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T17:03:38.014 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T17:03:38.328 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-routes. 2024-09-12T17:03:38.354 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T17:03:38.401 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:03:38.738 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T17:03:38.765 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:38.803 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:39.219 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T17:03:39.249 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T17:03:39.293 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:03:39.813 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T17:03:39.841 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T17:03:39.880 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:03:40.258 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T17:03:40.286 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T17:03:40.325 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:03:40.627 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T17:03:40.655 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T17:03:40.694 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:03:41.394 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T17:03:41.422 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:41.449 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T17:03:41.467 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T17:03:41.507 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:03:41.546 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:42.228 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T17:03:42.256 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T17:03:42.286 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:03:42.399 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T17:03:42.427 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T17:03:42.457 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T17:03:42.673 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T17:03:42.700 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T17:03:42.739 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:03:42.754 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T17:03:42.780 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T17:03:42.818 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:03:42.992 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T17:03:43.019 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T17:03:43.050 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:03:43.155 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T17:03:43.183 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T17:03:43.222 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:03:43.533 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T17:03:43.561 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T17:03:43.599 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T17:03:43.710 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T17:03:43.739 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:43.871 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T17:03:43.879 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:43.888 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T17:03:43.921 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T17:03:44.216 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T17:03:44.244 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T17:03:44.282 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:03:44.602 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T17:03:44.630 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T17:03:44.668 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T17:03:44.802 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T17:03:44.827 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T17:03:44.865 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T17:03:45.005 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T17:03:45.033 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T17:03:45.072 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:03:45.169 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T17:03:45.197 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T17:03:45.235 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:03:45.572 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T17:03:45.600 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T17:03:45.638 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:03:45.786 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T17:03:45.815 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:45.852 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:45.949 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T17:03:45.978 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T17:03:46.016 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T17:03:46.180 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T17:03:46.208 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T17:03:46.246 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:03:46.286 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T17:03:46.314 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T17:03:46.353 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T17:03:46.541 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T17:03:46.569 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:03:46.599 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:03:46.648 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T17:03:46.676 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T17:03:46.714 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:03:47.002 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package jq. 2024-09-12T17:03:47.030 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:03:47.084 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T17:03:47.200 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T17:03:47.228 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T17:03:47.267 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T17:03:47.329 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package socat. 2024-09-12T17:03:47.346 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T17:03:47.379 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:03:47.620 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T17:03:47.649 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T17:03:47.657 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T17:03:47.685 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T17:03:47.686 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:03:47.715 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:03:48.078 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-test. 2024-09-12T17:03:48.106 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:48.144 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:48.300 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T17:03:48.330 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:48.367 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:48.694 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T17:03:48.723 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T17:03:48.761 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:03:49.064 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T17:03:49.080 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:03:49.114 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:03:49.358 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package jq. 2024-09-12T17:03:49.375 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T17:03:49.416 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T17:03:49.669 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package socat. 2024-09-12T17:03:49.685 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T17:03:49.727 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:03:50.047 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T17:03:50.075 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T17:03:50.113 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:03:50.467 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-test. 2024-09-12T17:03:50.484 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:50.518 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T17:03:50.525 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:50.543 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:50.582 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:50.907 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T17:03:50.936 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:50.985 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:51.271 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T17:03:51.289 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T17:03:51.321 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:03:51.634 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T17:03:51.662 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T17:03:51.700 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:03:52.079 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T17:03:52.108 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T17:03:52.146 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:03:52.568 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package pkg-config. 2024-09-12T17:03:52.596 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T17:03:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:03:52.878 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T17:03:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T17:03:52.936 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:03:52.963 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T17:03:52.982 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4762-gbad475c1-1jammy_all.deb ... 2024-09-12T17:03:53.021 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:53.325 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T17:03:53.348 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T17:03:53.353 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:53.378 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T17:03:53.391 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:53.414 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T17:03:53.650 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T17:03:53.679 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T17:03:53.702 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T17:03:53.708 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T17:03:53.731 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T17:03:53.769 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:03:54.020 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T17:03:54.049 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T17:03:54.086 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:03:54.107 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T17:03:54.135 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T17:03:54.173 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:03:54.406 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T17:03:54.435 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T17:03:54.473 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T17:03:54.532 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T17:03:54.560 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T17:03:54.593 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:03:54.809 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-py. 2024-09-12T17:03:54.837 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T17:03:54.875 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T17:03:54.965 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package pkg-config. 2024-09-12T17:03:54.994 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T17:03:55.023 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:03:55.196 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T17:03:55.224 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T17:03:55.262 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:03:55.268 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T17:03:55.285 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T17:03:55.318 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:03:55.708 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T17:03:55.729 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T17:03:55.736 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T17:03:55.758 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T17:03:55.774 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:03:55.787 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T17:03:56.076 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-toml. 2024-09-12T17:03:56.090 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T17:03:56.105 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T17:03:56.119 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T17:03:56.143 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T17:03:56.156 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T17:03:56.396 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T17:03:56.425 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T17:03:56.454 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:03:56.477 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T17:03:56.505 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T17:03:56.543 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:03:56.833 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T17:03:56.861 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T17:03:56.863 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T17:03:56.891 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T17:03:56.899 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:03:56.929 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T17:03:57.168 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T17:03:57.185 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T17:03:57.226 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:03:57.257 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-py. 2024-09-12T17:03:57.275 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T17:03:57.315 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T17:03:57.643 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T17:03:57.672 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T17:03:57.710 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:03:57.955 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package radosgw. 2024-09-12T17:03:57.984 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:58.021 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:58.206 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T17:03:58.235 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T17:03:58.263 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:03:58.558 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-toml. 2024-09-12T17:03:58.587 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T17:03:58.624 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T17:03:58.916 INFO:teuthology.orchestra.run.smithi017.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T17:03:58.927 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T17:03:58.933 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:03:58.956 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T17:03:58.966 INFO:teuthology.orchestra.run.smithi017.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:03:58.993 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:03:59.263 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T17:03:59.356 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T17:03:59.413 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T17:03:59.422 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:03:59.646 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:03:59.699 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T17:03:59.716 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T17:03:59.755 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:03:59.757 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:04:00.026 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T17:04:00.358 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T17:04:00.437 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package radosgw. 2024-09-12T17:04:00.465 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../116-radosgw_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:04:00.494 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:00.775 INFO:teuthology.orchestra.run.smithi017.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T17:04:00.840 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:01.323 INFO:teuthology.orchestra.run.smithi017.stdout:Adding system user cephadm....done 2024-09-12T17:04:01.373 INFO:teuthology.orchestra.run.smithi047.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T17:04:01.401 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4762-gbad475c1-1jammy_amd64.deb ... 2024-09-12T17:04:01.439 INFO:teuthology.orchestra.run.smithi047.stdout:Unpacking rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:01.471 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:04:01.764 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:04:01.768 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T17:04:02.019 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T17:04:02.040 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:04:02.120 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T17:04:02.184 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:04:02.385 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T17:04:02.434 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T17:04:02.694 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:04:02.964 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T17:04:02.964 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T17:04:03.129 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:04:03.151 INFO:teuthology.orchestra.run.smithi047.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T17:04:03.221 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:03.490 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T17:04:03.749 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T17:04:03.762 INFO:teuthology.orchestra.run.smithi047.stdout:Adding system user cephadm....done 2024-09-12T17:04:03.911 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T17:04:04.017 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:04:04.229 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T17:04:04.277 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:04:04.463 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T17:04:04.536 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:04:04.564 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T17:04:04.787 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:04:04.815 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T17:04:05.030 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:05.083 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T17:04:05.209 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T17:04:05.398 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:04:05.516 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:04:05.528 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T17:04:05.616 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:04:05.718 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:04:05.896 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T17:04:05.973 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:04:06.148 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T17:04:06.354 INFO:teuthology.orchestra.run.smithi017.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T17:04:06.384 INFO:teuthology.orchestra.run.smithi017.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T17:04:06.432 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T17:04:06.438 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:04:06.564 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T17:04:06.692 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T17:04:06.932 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:04:06.950 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T17:04:07.033 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T17:04:07.218 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T17:04:07.293 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:04:07.486 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-ceph-argparse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:07.560 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:04:07.779 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T17:04:07.878 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T17:04:07.888 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T17:04:07.979 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:04:08.014 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T17:04:08.140 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T17:04:08.400 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T17:04:08.672 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:04:08.803 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T17:04:08.839 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T17:04:08.928 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T17:04:08.957 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:04:09.029 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T17:04:09.083 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:04:09.209 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:04:09.380 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T17:04:09.506 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T17:04:09.509 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T17:04:09.782 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T17:04:09.911 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T17:04:10.050 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T17:04:10.145 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:04:10.359 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T17:04:10.485 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T17:04:10.530 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:04:10.831 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:04:11.174 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:04:11.205 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T17:04:11.425 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:04:11.438 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T17:04:11.548 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T17:04:11.551 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:11.674 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T17:04:11.877 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:04:11.975 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T17:04:12.212 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:04:12.376 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T17:04:12.685 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T17:04:13.095 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T17:04:13.372 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T17:04:13.467 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:04:13.723 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T17:04:13.727 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:04:13.870 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T17:04:13.982 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T17:04:14.108 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:14.137 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:04:14.263 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:04:14.389 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:04:14.410 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T17:04:14.682 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:04:14.735 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T17:04:14.942 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T17:04:15.209 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:04:15.335 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:04:15.637 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:04:15.871 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T17:04:15.916 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T17:04:16.139 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T17:04:16.184 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:04:16.310 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T17:04:16.390 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:04:16.578 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T17:04:16.633 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T17:04:16.680 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T17:04:16.797 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T17:04:16.900 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:04:17.018 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T17:04:17.115 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T17:04:17.302 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:04:17.375 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T17:04:17.437 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:04:17.626 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:04:17.729 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:04:17.751 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T17:04:18.039 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:04:18.082 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T17:04:18.307 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:04:18.321 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T17:04:18.407 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:04:18.508 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:04:18.572 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T17:04:18.581 INFO:teuthology.orchestra.run.smithi017.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T17:04:18.826 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:04:18.831 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T17:04:18.953 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:04:19.091 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T17:04:19.346 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:04:19.389 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T17:04:19.526 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T17:04:19.614 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T17:04:19.739 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T17:04:19.835 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T17:04:19.978 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T17:04:19.999 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:04:20.133 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:04:20.280 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T17:04:20.459 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:04:20.556 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T17:04:20.768 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:04:20.815 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T17:04:20.941 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T17:04:21.037 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T17:04:21.067 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T17:04:21.137 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T17:04:21.156 INFO:teuthology.orchestra.run.smithi047.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T17:04:21.405 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T17:04:21.410 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T17:04:21.536 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T17:04:21.681 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:04:21.929 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T17:04:22.026 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:04:22.172 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T17:04:22.298 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T17:04:22.411 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T17:04:22.557 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T17:04:22.679 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:04:22.683 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T17:04:23.010 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T17:04:23.015 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:04:23.141 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:23.267 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:23.319 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T17:04:23.393 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:04:23.595 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T17:04:23.697 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:23.697 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T17:04:23.805 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:23.931 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T17:04:23.964 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T17:04:24.240 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T17:04:24.241 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:24.367 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:24.493 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:24.601 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T17:04:24.713 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:04:24.714 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:04:25.036 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T17:04:25.204 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:25.321 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T17:04:25.612 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:25.649 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T17:04:25.738 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:25.775 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librados2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:25.864 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:04:25.901 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:26.027 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T17:04:26.321 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:26.431 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libradosstriper1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:26.556 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T17:04:26.834 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librbd1 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:26.962 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-modules-core (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:27.059 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:27.085 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:27.185 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:27.311 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:27.312 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:04:27.312 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T17:04:27.420 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:27.538 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:27.819 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up libcephfs-dev (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:27.937 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rados (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:28.038 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up librgw2 (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:28.055 INFO:teuthology.orchestra.run.smithi017.stdout:Adding group ceph....done 2024-09-12T17:04:28.156 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T17:04:28.432 INFO:teuthology.orchestra.run.smithi017.stdout:Adding system user ceph....done 2024-09-12T17:04:28.600 INFO:teuthology.orchestra.run.smithi017.stdout:Setting system user ceph properties....done 2024-09-12T17:04:28.618 INFO:teuthology.orchestra.run.smithi017.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T17:04:28.761 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T17:04:29.096 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T17:04:29.418 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rbd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:29.521 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:29.543 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up rbd-fuse (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:29.648 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:29.678 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-rgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:29.798 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up python3-cephfs (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:29.924 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-common (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:30.122 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:04:30.123 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:04:30.475 INFO:teuthology.orchestra.run.smithi047.stdout:Adding group ceph....done 2024-09-12T17:04:30.608 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:30.794 INFO:teuthology.orchestra.run.smithi047.stdout:Adding system user ceph....done 2024-09-12T17:04:30.962 INFO:teuthology.orchestra.run.smithi047.stdout:Setting system user ceph properties....done 2024-09-12T17:04:30.963 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T17:04:30.980 INFO:teuthology.orchestra.run.smithi047.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T17:04:31.126 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T17:04:31.409 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:31.440 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T17:04:31.655 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:04:31.655 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:04:31.908 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-test (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:32.034 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up radosgw (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:32.119 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:32.341 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:04:32.341 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:04:32.522 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:04:32.522 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T17:04:32.839 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:32.987 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-base (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:33.098 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:04:33.098 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:04:33.350 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T17:04:33.557 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:33.667 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:33.823 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:33.840 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mds (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:34.037 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:04:34.038 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:04:34.137 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:04:34.137 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T17:04:34.486 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:34.624 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:34.628 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:34.729 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:34.854 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:04:34.854 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T17:04:34.872 INFO:teuthology.orchestra.run.smithi017.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:35.275 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:04:35.325 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-osd (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:35.367 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:04:35.510 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:04:35.584 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:04:35.584 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T17:04:36.077 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:36.203 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:36.354 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mon (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:36.575 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:04:36.576 INFO:teuthology.orchestra.run.smithi047.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T17:04:36.679 INFO:teuthology.orchestra.run.smithi017.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T17:04:37.063 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-cephadm (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:37.231 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:37.318 INFO:teuthology.orchestra.run.smithi017.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:04:37.325 DEBUG:teuthology.parallel:result is None 2024-09-12T17:04:37.357 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-mgr-dashboard (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:37.508 INFO:teuthology.orchestra.run.smithi047.stdout:Setting up ceph-volume (19.3.0-4762-gbad475c1-1jammy) ... 2024-09-12T17:04:37.894 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T17:04:37.995 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T17:04:38.156 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T17:04:39.325 INFO:teuthology.orchestra.run.smithi047.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T17:04:39.989 INFO:teuthology.orchestra.run.smithi047.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T17:04:39.994 DEBUG:teuthology.parallel:result is None 2024-09-12T17:04:39.994 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:04:40.132 DEBUG:teuthology.orchestra.run.smithi017:> dpkg-query -W -f '${Version}' ceph 2024-09-12T17:04:40.152 INFO:teuthology.orchestra.run.smithi017.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:04:40.153 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:04:40.153 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T17:04:40.155 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:04:40.300 DEBUG:teuthology.orchestra.run.smithi047:> dpkg-query -W -f '${Version}' ceph 2024-09-12T17:04:40.319 INFO:teuthology.orchestra.run.smithi047.stdout:19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:04:40.320 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4762-gbad475c1-1jammy 2024-09-12T17:04:40.320 INFO:teuthology.task.install:The correct ceph version 19.3.0-4762-gbad475c1-1jammy is installed. 2024-09-12T17:04:40.322 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T17:04:40.322 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:04:40.322 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:04:40.336 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:04:40.336 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T17:04:40.375 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T17:04:40.375 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:04:40.375 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:04:40.392 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:04:40.447 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:04:40.447 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T17:04:40.461 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T17:04:40.517 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T17:04:40.517 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:04:40.517 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:04:40.530 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:04:40.587 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:04:40.587 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T17:04:40.601 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T17:04:40.661 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T17:04:40.661 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:04:40.661 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:04:40.675 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:04:40.731 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:04:40.731 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T17:04:40.745 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T17:04:40.805 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T17:04:40.898 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T17:04:40.898 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2024-09-12T17:04:40.901 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-09-12T17:04:40.914 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T17:04:40.914 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:04:40.961 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T17:04:40.973 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T17:04:40.974 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:04:41.016 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T17:04:41.089 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T17:04:41.089 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T17:04:41.089 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703', 'branch': 'wip-rgw-meta-handlers', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}', 'email': None, 'first_in_suite': False, 'job_id': '7902703', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6279, 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-meta-handlers', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bad475c18c96ec20c5778159aa33ba72b84e9c1b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b', 'targets': {'smithi017.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIv91XCBoJtYPqiTMnspeIbq4zK0R4AftqbTaM/VaEyaUW10f7bqKgJMhmcUiLsLDr/Gr8zMmSDqlZZTavf2I6U=', 'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHByT+ESv7x/UkoQf3tn/pWkjYiEOLDXRnu/vNSHQBCN+VuWe3BiVMVv8nlnud7kfLYXZQ6CYnoi8kDm+3V7x/o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_multipart_upload.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-12_15:39:52', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T17:04:41.090 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:04:41.093 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T17:04:41.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:04:41.140 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T17:04:41.155 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:04:41.155 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:04:41.199 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:04:41.200 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-09-12T17:04:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:04:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:04:41.250 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-12T17:04:41.250 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:04:41.250 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-12 16:59:06.253797282 +0000 2024-09-12T17:04:41.250 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-12 16:59:05.997799569 +0000 2024-09-12T17:04:41.250 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-12 16:59:05.997799569 +0000 2024-09-12T17:04:41.250 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-09-12T17:04:41.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:04:41.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-12T17:04:41.302 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-12T17:04:41.302 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000308347 s, 1.7 MB/s 2024-09-12T17:04:41.303 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:04:41.357 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-09-12T17:04:41.403 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:04:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:04:41.404 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-12T17:04:41.404 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:04:41.404 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-12 16:59:06.697793316 +0000 2024-09-12T17:04:41.404 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-12 16:59:06.473795316 +0000 2024-09-12T17:04:41.404 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-12 16:59:06.473795316 +0000 2024-09-12T17:04:41.404 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-09-12T17:04:41.404 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:04:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-12T17:04:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-12T17:04:41.458 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.00026427 s, 1.9 MB/s 2024-09-12T17:04:41.459 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:04:41.509 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-09-12T17:04:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:04:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:04:41.560 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-09-12T17:04:41.560 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:04:41.560 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-12 16:59:07.213788707 +0000 2024-09-12T17:04:41.560 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-12 16:59:06.941791136 +0000 2024-09-12T17:04:41.560 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-12 16:59:06.941791136 +0000 2024-09-12T17:04:41.560 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-09-12T17:04:41.561 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:04:41.614 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-12T17:04:41.615 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-12T17:04:41.615 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000302104 s, 1.7 MB/s 2024-09-12T17:04:41.616 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:04:41.665 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-09-12T17:04:41.711 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:04:41.712 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:04:41.712 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-09-12T17:04:41.712 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:04:41.712 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-09-12 16:59:07.685784491 +0000 2024-09-12T17:04:41.712 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-09-12 16:59:07.425786813 +0000 2024-09-12T17:04:41.712 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-09-12 16:59:07.425786813 +0000 2024-09-12T17:04:41.712 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: - 2024-09-12T17:04:41.713 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:04:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-09-12T17:04:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-09-12T17:04:41.766 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000303241 s, 1.7 MB/s 2024-09-12T17:04:41.768 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:04:41.817 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:04:41.817 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:04:41.817 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T17:04:41.823 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T17:04:41.823 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-09-12T17:04:41.870 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T17:04:41.870 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:04:41.870 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-09-12T17:04:41.871 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:04:41.871 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 16:59:07.304709871 +0000 2024-09-12T17:04:41.871 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 16:59:07.044712193 +0000 2024-09-12T17:04:41.871 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 16:59:07.044712193 +0000 2024-09-12T17:04:41.871 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-09-12T17:04:41.871 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T17:04:41.924 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T17:04:41.925 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T17:04:41.925 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000322094 s, 1.6 MB/s 2024-09-12T17:04:41.926 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T17:04:41.980 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-09-12T17:04:42.026 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T17:04:42.026 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:04:42.026 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-09-12T17:04:42.026 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:04:42.026 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 16:59:07.776705655 +0000 2024-09-12T17:04:42.026 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 16:59:07.544707728 +0000 2024-09-12T17:04:42.026 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 16:59:07.544707728 +0000 2024-09-12T17:04:42.027 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-09-12T17:04:42.027 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T17:04:42.080 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T17:04:42.080 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T17:04:42.080 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000210487 s, 2.4 MB/s 2024-09-12T17:04:42.081 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T17:04:42.131 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-09-12T17:04:42.178 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T17:04:42.178 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:04:42.178 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-09-12T17:04:42.178 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:04:42.178 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 16:59:08.004703619 +0000 2024-09-12T17:04:42.178 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 16:59:08.000703655 +0000 2024-09-12T17:04:42.178 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 16:59:08.000703655 +0000 2024-09-12T17:04:42.178 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-09-12T17:04:42.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T17:04:42.232 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T17:04:42.233 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T17:04:42.233 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000310291 s, 1.7 MB/s 2024-09-12T17:04:42.234 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T17:04:42.287 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-09-12T17:04:42.337 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T17:04:42.338 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T17:04:42.338 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-09-12T17:04:42.338 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T17:04:42.338 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-09-12 16:59:08.448699653 +0000 2024-09-12T17:04:42.338 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-09-12 16:59:08.444699689 +0000 2024-09-12T17:04:42.338 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-09-12 16:59:08.444699689 +0000 2024-09-12T17:04:42.338 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-09-12T17:04:42.338 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T17:04:42.395 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-09-12T17:04:42.396 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-09-12T17:04:42.396 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000211015 s, 2.4 MB/s 2024-09-12T17:04:42.397 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T17:04:42.447 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:04:42.447 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:04:42.448 INFO:tasks.ceph:Generating config... 2024-09-12T17:04:42.450 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-09-12T17:04:42.450 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T17:04:42.450 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T17:04:42.450 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T17:04:42.450 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T17:04:42.451 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T17:04:42.451 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T17:04:42.451 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T17:04:42.451 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T17:04:42.451 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T17:04:42.451 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T17:04:42.451 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T17:04:42.452 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T17:04:42.452 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T17:04:42.452 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T17:04:42.452 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T17:04:42.452 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T17:04:42.452 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T17:04:42.452 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T17:04:42.452 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T17:04:42.452 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T17:04:42.453 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T17:04:42.453 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T17:04:42.453 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T17:04:42.453 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T17:04:42.453 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T17:04:42.490 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T17:04:42.543 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T17:04:42.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:04:42.680 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17'), ('mon.c', '[v2:172.21.15.17:3301,v1:172.21.15.17:6790]'), ('mon.b', '172.21.15.47')] 2024-09-12T17:04:42.680 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.47'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T17:04:42.681 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:04:42.681 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:04:42.728 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.17 --addv c '[v2:172.21.15.17:3301,v1:172.21.15.17:6790]' --add b 172.21.15.47 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:04:42.816 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:04:42.817 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid 505f0ddb-af61-4cad-802f-747b5bdb41a8 2024-09-12T17:04:42.817 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = quincy 2024-09-12T17:04:42.817 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2024-09-12T17:04:42.817 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 505f0ddb-af61-4cad-802f-747b5bdb41a8 2024-09-12T17:04:42.817 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2024-09-12T17:04:42.816473+0000 2024-09-12T17:04:42.817 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-12T17:04:42.816473+0000 2024-09-12T17:04:42.817 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 17 (quincy) 2024-09-12T17:04:42.817 INFO:teuthology.orchestra.run.smithi017.stdout:election_strategy: 1 2024-09-12T17:04:42.817 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-09-12T17:04:42.817 INFO:teuthology.orchestra.run.smithi017.stdout:1: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.b 2024-09-12T17:04:42.817 INFO:teuthology.orchestra.run.smithi017.stdout:2: [v2:172.21.15.17:3301/0,v1:172.21.15.17:6790/0] mon.c 2024-09-12T17:04:42.818 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T17:04:42.819 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T17:04:42.824 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 505f0ddb-af61-4cad-802f-747b5bdb41a8... 2024-09-12T17:04:42.824 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:04:42.868 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T17:04:42.896 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-09-12T17:04:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-09-12T17:04:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:04:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-09-12T17:04:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-09-12T17:04:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-09-12T17:04:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-09-12T17:04:42.897 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-09-12T17:04:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-09-12T17:04:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-09-12T17:04:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:04:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-09-12T17:04:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:04:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:04:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-09-12T17:04:42.898 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.899 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.47" 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 505f0ddb-af61-4cad-802f-747b5bdb41a8 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.900 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug trim objects = true 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-09-12T17:04:42.901 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-09-12T17:04:42.902 INFO:teuthology.orchestra.run.smithi017.stdout: bdev async discard = True 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: bdev enable discard = True 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore allocator = bitmap 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 1/20 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 1/20 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 4/10 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: osd blocked scrub grace period = 3600 2024-09-12T17:04:42.903 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:04:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: osd max markdown count = 1000 2024-09-12T17:04:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-09-12T17:04:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: osd shutdown pgref assert = True 2024-09-12T17:04:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.904 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-09-12T17:04:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-12T17:04:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-09-12T17:04:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-12T17:04:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-12T17:04:42.904 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-09-12T17:04:42.905 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:04:42.906 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:04:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:04:42.907 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-09-12T17:04:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-09-12T17:04:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-09-12T17:04:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-09-12T17:04:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:04:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:04:42.907 INFO:teuthology.orchestra.run.smithi017.stdout: rgw relaxed s3 bucket names = True 2024-09-12T17:04:42.907 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-09-12T17:04:42.907 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2024-09-12T17:04:42.907 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2024-09-12T17:04:42.908 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-09-12T17:04:42.908 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-09-12T17:04:42.908 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T17:04:42.908 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-09-12T17:04:42.908 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.908 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-09-12T17:04:42.908 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.909 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-09-12T17:04:42.909 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.909 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-09-12T17:04:42.909 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-09-12T17:04:42.909 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.909 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-09-12T17:04:42.909 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-09-12T17:04:42.909 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.909 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T17:04:42.909 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-09-12T17:04:42.909 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.910 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T17:04:42.910 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T17:04:42.910 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.910 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-09-12T17:04:42.910 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.910 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-09-12T17:04:42.910 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-09-12T17:04:42.910 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-09-12T17:04:42.910 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-09-12T17:04:42.910 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-09-12T17:04:42.910 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-09-12T17:04:42.910 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-09-12T17:04:42.911 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T17:04:42.911 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T17:04:42.911 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-09-12T17:04:42.911 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.911 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T17:04:42.911 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.911 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-09-12T17:04:42.911 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.911 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-09-12T17:04:42.911 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.911 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-09-12T17:04:42.911 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-09-12T17:04:42.912 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-09-12T17:04:42.912 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.47" 2024-09-12T17:04:42.912 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 505f0ddb-af61-4cad-802f-747b5bdb41a8 2024-09-12T17:04:42.912 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.912 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-09-12T17:04:42.912 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-09-12T17:04:42.912 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.912 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-09-12T17:04:42.912 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-09-12T17:04:42.912 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-09-12T17:04:42.913 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.913 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-09-12T17:04:42.913 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-09-12T17:04:42.913 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.913 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-09-12T17:04:42.913 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-09-12T17:04:42.913 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-09-12T17:04:42.913 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug trim objects = true 2024-09-12T17:04:42.913 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.913 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-09-12T17:04:42.913 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-09-12T17:04:42.914 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.914 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-09-12T17:04:42.914 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.914 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-09-12T17:04:42.914 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.914 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-09-12T17:04:42.914 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.914 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-09-12T17:04:42.915 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-09-12T17:04:42.915 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.915 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-09-12T17:04:42.915 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-09-12T17:04:42.915 INFO:teuthology.orchestra.run.smithi047.stdout: bdev async discard = True 2024-09-12T17:04:42.915 INFO:teuthology.orchestra.run.smithi047.stdout: bdev enable discard = True 2024-09-12T17:04:42.915 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore allocator = bitmap 2024-09-12T17:04:42.915 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-09-12T17:04:42.915 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-09-12T17:04:42.915 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 1/20 2024-09-12T17:04:42.915 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 1/20 2024-09-12T17:04:42.916 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T17:04:42.916 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-09-12T17:04:42.916 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 4/10 2024-09-12T17:04:42.916 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T17:04:42.916 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-09-12T17:04:42.916 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-09-12T17:04:42.916 INFO:teuthology.orchestra.run.smithi047.stdout: osd blocked scrub grace period = 3600 2024-09-12T17:04:42.916 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-09-12T17:04:42.916 INFO:teuthology.orchestra.run.smithi047.stdout: osd max markdown count = 1000 2024-09-12T17:04:42.916 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-09-12T17:04:42.917 INFO:teuthology.orchestra.run.smithi047.stdout: osd shutdown pgref assert = True 2024-09-12T17:04:42.917 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.917 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-09-12T17:04:42.917 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T17:04:42.917 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-09-12T17:04:42.917 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-09-12T17:04:42.917 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-09-12T17:04:42.917 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:04:42.917 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:04:42.917 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-09-12T17:04:42.918 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.918 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-09-12T17:04:42.918 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-09-12T17:04:42.918 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-09-12T17:04:42.918 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-09-12T17:04:42.918 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-09-12T17:04:42.918 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-09-12T17:04:42.918 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-09-12T17:04:42.918 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-09-12T17:04:42.918 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-09-12T17:04:42.918 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-09-12T17:04:42.918 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-09-12T17:04:42.919 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.919 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T17:04:42.919 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T17:04:42.919 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T17:04:42.919 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.919 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T17:04:42.919 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T17:04:42.919 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T17:04:42.919 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.919 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-09-12T17:04:42.920 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-09-12T17:04:42.920 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.920 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-09-12T17:04:42.920 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-09-12T17:04:42.920 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-09-12T17:04:42.920 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-09-12T17:04:42.920 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-09-12T17:04:42.920 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-09-12T17:04:42.920 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T17:04:42.920 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T17:04:42.920 INFO:teuthology.orchestra.run.smithi047.stdout: rgw relaxed s3 bucket names = True 2024-09-12T17:04:42.921 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-09-12T17:04:42.921 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-09-12T17:04:42.921 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-09-12T17:04:42.922 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T17:04:42.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T17:04:43.014 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T17:04:43.014 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:04:43.014 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T17:04:43.020 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:04:43.020 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T17:04:43.068 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T17:04:43.068 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:04:43.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:04:43.068 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:04:43.132 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:04:43.132 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:04:43.180 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:04:43.180 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:04:43.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T17:04:43.180 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T17:04:43.204 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:04:43.204 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:04:43.250 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T17:04:43.250 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T17:04:43.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:04:43.293 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T17:04:43.296 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:04:43.341 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T17:04:43.363 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T17:04:43.363 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T17:04:43.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T17:04:43.401 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T17:04:43.412 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T17:04:43.448 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T17:04:43.459 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T17:04:43.460 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T17:04:43.460 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T17:04:43.472 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:04:43.472 INFO:tasks.ceph:role: osd.0 2024-09-12T17:04:43.472 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T17:04:43.473 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:04:43.529 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:04:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:04:43.529 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:04:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:04:43.530 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:04:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:04:43.530 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:04:43.530 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:04:43.530 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:04:43.530 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:04:43.554 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-12T17:04:43.555 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-12T17:04:43.556 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T17:04:43.617 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T17:04:43.668 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:04:43.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:04:43.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T17:04:43.722 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:04:43.722 INFO:tasks.ceph:role: osd.1 2024-09-12T17:04:43.722 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T17:04:43.722 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:04:43.776 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:04:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:04:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:04:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:04:43.776 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:04:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:04:43.777 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:04:43.777 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:04:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:04:43.777 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:04:43.799 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-12T17:04:43.801 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-12T17:04:43.801 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T17:04:43.858 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T17:04:43.907 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:04:43.908 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:04:43.908 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T17:04:43.968 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:04:43.968 INFO:tasks.ceph:role: osd.2 2024-09-12T17:04:43.968 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T17:04:43.968 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:04:44.027 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:04:44.027 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:04:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:04:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:04:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:04:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:04:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:04:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:04:44.028 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:04:44.028 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:04:44.051 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-12T17:04:44.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-12T17:04:44.054 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T17:04:44.116 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T17:04:44.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:04:44.168 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:04:44.168 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T17:04:44.221 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T17:04:44.221 INFO:tasks.ceph:role: osd.3 2024-09-12T17:04:44.221 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T17:04:44.221 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:04:44.273 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:04:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:04:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:04:44.273 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:04:44.273 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:04:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:04:44.274 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:04:44.274 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:04:44.274 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:04:44.274 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:04:44.297 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-09-12T17:04:44.299 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-09-12T17:04:44.299 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T17:04:44.357 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T17:04:44.408 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:04:44.409 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:04:44.409 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:04:44.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:44.526+0000 7f08c02567c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T17:04:44.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:44.526+0000 7f08c02567c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T17:04:44.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:44.526+0000 7f08c02567c0 -1 bdev(0x55f62fd95800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T17:04:44.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:44.526+0000 7f08c02567c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T17:04:47.686 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T17:04:47.700 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:04:47.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:47.782+0000 7f100adf97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T17:04:47.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:47.782+0000 7f100adf97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T17:04:47.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:47.782+0000 7f100adf97c0 -1 bdev(0x55abf33df800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T17:04:47.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:47.782+0000 7f100adf97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T17:04:50.975 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T17:04:51.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:04:51.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:51.110+0000 7fdeaea337c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T17:04:51.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:51.110+0000 7fdeaea337c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T17:04:51.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:51.110+0000 7fdeaea337c0 -1 bdev(0x55fc47cbf800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T17:04:51.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:51.110+0000 7fdeaea337c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T17:04:54.265 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T17:04:54.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:04:54.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:54.398+0000 7fbc421ec7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T17:04:54.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:54.398+0000 7fbc421ec7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T17:04:54.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:54.402+0000 7fbc421ec7c0 -1 bdev(0x5608c0543800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T17:04:54.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-09-12T17:04:54.402+0000 7fbc421ec7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T17:04:57.559 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T17:04:57.623 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T17:04:57.645 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:04:59.267 INFO:tasks.ceph:role: osd.4 2024-09-12T17:04:59.267 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:04:59.267 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T17:04:59.286 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:04:59.286 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:04:59.286 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:04:59.287 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:04:59.287 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:04:59.287 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:04:59.287 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:04:59.287 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:04:59.287 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:04:59.287 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:04:59.318 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-09-12T17:04:59.318 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-09-12T17:04:59.319 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T17:04:59.380 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T17:04:59.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:04:59.437 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:04:59.438 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T17:04:59.492 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:04:59.492 INFO:tasks.ceph:role: osd.5 2024-09-12T17:04:59.492 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:04:59.492 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T17:04:59.548 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:04:59.548 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:04:59.548 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:04:59.548 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:04:59.549 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:04:59.549 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:04:59.549 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:04:59.549 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:04:59.549 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:04:59.549 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:04:59.575 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-09-12T17:04:59.577 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-09-12T17:04:59.578 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T17:04:59.639 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T17:04:59.696 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:04:59.696 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:04:59.697 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T17:04:59.751 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:04:59.751 INFO:tasks.ceph:role: osd.6 2024-09-12T17:04:59.751 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:04:59.751 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T17:04:59.807 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:04:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:04:59.807 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:04:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:04:59.808 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:04:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:04:59.808 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:04:59.808 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:04:59.808 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:04:59.809 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:04:59.833 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-09-12T17:04:59.835 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-09-12T17:04:59.835 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T17:04:59.893 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T17:04:59.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:04:59.947 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:04:59.948 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T17:04:59.999 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T17:04:59.999 INFO:tasks.ceph:role: osd.7 2024-09-12T17:05:00.000 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:05:00.000 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T17:05:00.053 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T17:05:00.053 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T17:05:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T17:05:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T17:05:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T17:05:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-09-12T17:05:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T17:05:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T17:05:00.054 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T17:05:00.054 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T17:05:00.078 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-09-12T17:05:00.080 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-09-12T17:05:00.080 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T17:05:00.139 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T17:05:00.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:05:00.191 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T17:05:00.191 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:05:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:00.298+0000 7f092a2727c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T17:05:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:00.298+0000 7f092a2727c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T17:05:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:00.298+0000 7f092a2727c0 -1 bdev(0x5620d9acb800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T17:05:00.300 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:00.298+0000 7f092a2727c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T17:05:03.450 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T17:05:03.463 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:05:03.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:03.546+0000 7fdac91787c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T17:05:03.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:03.546+0000 7fdac91787c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T17:05:03.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:03.546+0000 7fdac91787c0 -1 bdev(0x56464fff5800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T17:05:03.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:03.546+0000 7fdac91787c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T17:05:06.681 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T17:05:06.742 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:05:06.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:06.826+0000 7ff4aac7b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T17:05:06.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:06.826+0000 7ff4aac7b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T17:05:06.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:06.826+0000 7ff4aac7b7c0 -1 bdev(0x561c69311800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T17:05:06.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:06.826+0000 7ff4aac7b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T17:05:09.974 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T17:05:10.030 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:05:10.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:10.114+0000 7f0addd0a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T17:05:10.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:10.114+0000 7f0addd0a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T17:05:10.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:10.114+0000 7f0addd0a7c0 -1 bdev(0x5612a1aeb800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T17:05:10.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-09-12T17:05:10.114+0000 7f0addd0a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T17:05:13.271 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T17:05:13.330 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T17:05:13.330 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:05:13.330 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T17:05:13.345 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:05:13.345 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T17:05:13.400 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:05:13.400 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T17:05:13.455 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:05:13.455 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T17:05:13.512 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:05:13.512 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T17:05:13.567 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:05:13.568 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T17:05:13.582 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:05:13.582 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T17:05:13.642 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:05:13.642 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T17:05:13.698 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:05:13.698 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T17:05:13.758 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:05:13.758 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T17:05:13.813 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:05:13.813 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T17:05:13.819 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:05:13.819 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T17:05:13.862 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T17:05:13.862 DEBUG:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:05:13.865 DEBUG:teuthology.orchestra.run.smithi047:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T17:05:13.909 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.y] 2024-09-12T17:05:13.909 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQArH+NmP8F/ERAAas5Glk7pS/UY4C430z2l0A== 2024-09-12T17:05:13.909 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2024-09-12T17:05:13.909 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAsH+Nmj0uLHxAA4pzyndSnq992uKuMfv4XLQ== 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAvH+Nmwb22LhAAP2fQ7QWS93Juq621HyAJMA== 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQAzH+Nmsr/MBhAAoCkjcy2spYLo6O6RijCh2Q== 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.3] 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA2H+Nm7kL9FxAAQE6dgmiY3TWJ75BQVKNxCA== 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQArH+NmX7JlFBAAhUoWfJlP4KNHLfh1NVCRAw== 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.4] 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA8H+Nm/J7yERAAgpHTVLnMQsaNXF+mYbr7Gg== 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.5] 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA/H+NmzkSWIBAANVXz+jsBH/oRHDmOCV1wNg== 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.6] 2024-09-12T17:05:13.910 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBCH+NmdVFSMRAAhF/1Zr4mYM0HVcf1kDLG/w== 2024-09-12T17:05:13.911 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.7] 2024-09-12T17:05:13.911 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBGH+NmKYLeBhAAFZ3tKG9ffPAtRQB3OcGSkA== 2024-09-12T17:05:13.911 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-09-12T17:05:13.911 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQArH+NmQNTjFxAAmjjUTeQhsx1BwCFFBQYJBA== 2024-09-12T17:05:13.911 INFO:teuthology.orchestra.run.smithi017.stdout:[client.1] 2024-09-12T17:05:13.911 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQArH+Nmja/NGhAAKomT9/oYSyC30MrbDNoKsw== 2024-09-12T17:05:13.917 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.y] 2024-09-12T17:05:13.917 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQArH+NmP8F/ERAAas5Glk7pS/UY4C430z2l0A== 2024-09-12T17:05:13.917 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-09-12T17:05:13.917 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQAsH+Nmj0uLHxAA4pzyndSnq992uKuMfv4XLQ== 2024-09-12T17:05:13.917 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-09-12T17:05:13.917 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQAvH+Nmwb22LhAAP2fQ7QWS93Juq621HyAJMA== 2024-09-12T17:05:13.917 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQAzH+Nmsr/MBhAAoCkjcy2spYLo6O6RijCh2Q== 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQA2H+Nm7kL9FxAAQE6dgmiY3TWJ75BQVKNxCA== 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.x] 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQArH+NmX7JlFBAAhUoWfJlP4KNHLfh1NVCRAw== 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.4] 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQA8H+Nm/J7yERAAgpHTVLnMQsaNXF+mYbr7Gg== 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.5] 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQA/H+NmzkSWIBAANVXz+jsBH/oRHDmOCV1wNg== 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.6] 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBCH+NmdVFSMRAAhF/1Zr4mYM0HVcf1kDLG/w== 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.7] 2024-09-12T17:05:13.918 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQBGH+NmKYLeBhAAFZ3tKG9ffPAtRQB3OcGSkA== 2024-09-12T17:05:13.919 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-09-12T17:05:13.919 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQArH+NmQNTjFxAAmjjUTeQhsx1BwCFFBQYJBA== 2024-09-12T17:05:13.919 INFO:teuthology.orchestra.run.smithi047.stdout:[client.1] 2024-09-12T17:05:13.919 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQArH+Nmja/NGhAAKomT9/oYSyC30MrbDNoKsw== 2024-09-12T17:05:13.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:05:13.956 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:05:14.007 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.049 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.095 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.097 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.184 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.229 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.276 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:05:14.364 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T17:05:14.407 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.449 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.495 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.536 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.581 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.629 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.672 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.720 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T17:05:14.762 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:05:14.804 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:05:14.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:05:14.856 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T17:05:14.942 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T17:05:14.942 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T17:05:14.956 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:05:15.048 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T17:05:15.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T17:05:15.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:05:15.211 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T17:05:15.222 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T17:05:15.237 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T17:05:15.334 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T17:05:15.346 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:05:15.348 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T17:05:15.393 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T17:05:15.393 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T17:05:15.393 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T17:05:15.396 INFO:tasks.ceph.mon.a:Started 2024-09-12T17:05:15.396 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T17:05:15.396 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T17:05:15.399 INFO:tasks.ceph.mon.c:Started 2024-09-12T17:05:15.399 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T17:05:15.399 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T17:05:15.438 INFO:tasks.ceph.mon.b:Started 2024-09-12T17:05:15.438 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T17:05:15.439 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T17:05:15.439 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T17:05:15.441 INFO:tasks.ceph.mgr.y:Started 2024-09-12T17:05:15.441 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T17:05:15.441 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T17:05:15.443 INFO:tasks.ceph.mgr.x:Started 2024-09-12T17:05:15.444 DEBUG:tasks.ceph:set 0 configs 2024-09-12T17:05:15.444 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T17:05:15.444 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T17:05:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-09-12T17:05:20.912 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T17:05:20.913 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T17:05:20.913 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:05:20.913 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T17:05:20.925 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:05:20.925 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T17:05:20.979 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:05:20.979 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T17:05:21.035 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:05:21.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T17:05:21.096 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:05:21.096 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T17:05:21.110 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:05:21.111 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T17:05:21.174 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:05:21.175 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T17:05:21.234 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-09-12T17:05:21.234 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T17:05:21.291 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new cf0f0496-2732-4649-9792-6f2117afe076 0 2024-09-12T17:05:21.550 INFO:teuthology.orchestra.run.smithi047.stdout:0 2024-09-12T17:05:21.570 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 931ecda0-1894-411b-a2f8-843472ad493c 1 2024-09-12T17:05:21.780 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-09-12T17:05:21.801 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new e1cc4a34-80dd-42e2-afb1-babce54de8cd 2 2024-09-12T17:05:22.009 INFO:teuthology.orchestra.run.smithi047.stdout:2 2024-09-12T17:05:22.025 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 48424313-1b8e-41ba-b322-d37b813552da 3 2024-09-12T17:05:22.231 INFO:teuthology.orchestra.run.smithi047.stdout:3 2024-09-12T17:05:22.248 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new ba035b82-db0e-4e9a-a45e-fd111aebaea2 4 2024-09-12T17:05:22.451 INFO:teuthology.orchestra.run.smithi047.stdout:4 2024-09-12T17:05:22.468 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 3bad8071-4d77-4ec3-a85f-9648cb1d9c7e 5 2024-09-12T17:05:22.667 INFO:teuthology.orchestra.run.smithi047.stdout:5 2024-09-12T17:05:22.684 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new cef01590-aa71-4356-bd81-0629172de3b6 6 2024-09-12T17:05:22.883 INFO:teuthology.orchestra.run.smithi047.stdout:6 2024-09-12T17:05:22.899 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd new 39b07acd-56a6-47ad-86ec-cb330c7647b7 7 2024-09-12T17:05:23.098 INFO:teuthology.orchestra.run.smithi047.stdout:7 2024-09-12T17:05:23.114 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T17:05:23.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T17:05:23.116 INFO:tasks.ceph.osd.0:Started 2024-09-12T17:05:23.117 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T17:05:23.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T17:05:23.119 INFO:tasks.ceph.osd.1:Started 2024-09-12T17:05:23.120 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T17:05:23.120 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T17:05:23.123 INFO:tasks.ceph.osd.2:Started 2024-09-12T17:05:23.123 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T17:05:23.123 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T17:05:23.125 INFO:tasks.ceph.osd.3:Started 2024-09-12T17:05:23.125 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T17:05:23.125 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T17:05:23.127 INFO:tasks.ceph.osd.4:Started 2024-09-12T17:05:23.127 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T17:05:23.127 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T17:05:23.129 INFO:tasks.ceph.osd.5:Started 2024-09-12T17:05:23.129 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T17:05:23.129 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T17:05:23.131 INFO:tasks.ceph.osd.6:Started 2024-09-12T17:05:23.131 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T17:05:23.132 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T17:05:23.134 INFO:tasks.ceph.osd.7:Started 2024-09-12T17:05:23.134 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:05:23.331 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:05:23.331 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"fsid":"505f0ddb-af61-4cad-802f-747b5bdb41a8","created":"2024-09-12T17:05:20.776084+0000","modified":"2024-09-12T17:05:23.094421+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:05:23.094421+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cf0f0496-2732-4649-9792-6f2117afe076","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"931ecda0-1894-411b-a2f8-843472ad493c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e1cc4a34-80dd-42e2-afb1-babce54de8cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"48424313-1b8e-41ba-b322-d37b813552da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ba035b82-db0e-4e9a-a45e-fd111aebaea2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3bad8071-4d77-4ec3-a85f-9648cb1d9c7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cef01590-aa71-4356-bd81-0629172de3b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"39b07acd-56a6-47ad-86ec-cb330c7647b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:05:23.348 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T17:05:23.349 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T17:05:23.962 INFO:tasks.ceph.mgr.x.smithi047.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T17:05:23.962 INFO:tasks.ceph.mgr.x.smithi047.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T17:05:23.962 INFO:tasks.ceph.mgr.x.smithi047.stderr: from numpy import show_config as show_numpy_config 2024-09-12T17:05:24.155 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:05:24.282 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:05:24.282+0000 7f9bae4d77c0 -1 Falling back to public interface 2024-09-12T17:05:24.320 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:05:24.318+0000 7f9e3f4a17c0 -1 Falling back to public interface 2024-09-12T17:05:24.345 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-12T17:05:24.345 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":10,"fsid":"505f0ddb-af61-4cad-802f-747b5bdb41a8","created":"2024-09-12T17:05:20.776084+0000","modified":"2024-09-12T17:05:23.094421+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:05:23.094421+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cf0f0496-2732-4649-9792-6f2117afe076","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"931ecda0-1894-411b-a2f8-843472ad493c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e1cc4a34-80dd-42e2-afb1-babce54de8cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"48424313-1b8e-41ba-b322-d37b813552da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ba035b82-db0e-4e9a-a45e-fd111aebaea2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3bad8071-4d77-4ec3-a85f-9648cb1d9c7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cef01590-aa71-4356-bd81-0629172de3b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"39b07acd-56a6-47ad-86ec-cb330c7647b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:05:24.365 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:05:24.527 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:05:24.526+0000 7fc34bb137c0 -1 Falling back to public interface 2024-09-12T17:05:24.556 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:05:24.554+0000 7f0d4be2c7c0 -1 Falling back to public interface 2024-09-12T17:05:24.572 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:05:24.570+0000 7f5d4bbb87c0 -1 Falling back to public interface 2024-09-12T17:05:24.766 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:05:24.766+0000 7fc95bb217c0 -1 Falling back to public interface 2024-09-12T17:05:25.014 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:05:25.014+0000 7f6b648397c0 -1 Falling back to public interface 2024-09-12T17:05:25.015 INFO:tasks.ceph.mgr.y.smithi017.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T17:05:25.015 INFO:tasks.ceph.mgr.y.smithi017.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T17:05:25.015 INFO:tasks.ceph.mgr.y.smithi017.stderr: from numpy import show_config as show_numpy_config 2024-09-12T17:05:25.070 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:05:25.066+0000 7fbd919c07c0 -1 Falling back to public interface 2024-09-12T17:05:26.909 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-09-12T17:05:26.910+0000 7f76358e0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T17:05:26.909 INFO:tasks.ceph.mgr.x.smithi047.stderr:2024-09-12T17:05:26.910+0000 7f76358e0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T17:05:28.144 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:05:28.142+0000 7f9e3f4a17c0 -1 osd.2 0 log_to_monitors true 2024-09-12T17:05:28.570 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:05:28.570+0000 7fc34bb137c0 -1 osd.7 0 log_to_monitors true 2024-09-12T17:05:28.598 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:05:28.598+0000 7f9bae4d77c0 -1 osd.5 0 log_to_monitors true 2024-09-12T17:05:28.608 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:05:28.606+0000 7f5d4bbb87c0 -1 osd.0 0 log_to_monitors true 2024-09-12T17:05:28.902 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:05:28.898+0000 7f0d4be2c7c0 -1 osd.3 0 log_to_monitors true 2024-09-12T17:05:29.010 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:05:29.010+0000 7fc95bb217c0 -1 osd.6 0 log_to_monitors true 2024-09-12T17:05:29.223 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:05:29.222+0000 7fbd919c07c0 -1 osd.1 0 log_to_monitors true 2024-09-12T17:05:29.264 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:05:29.262+0000 7f6b648397c0 -1 osd.4 0 log_to_monitors true 2024-09-12T17:05:31.111 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:05:31.110+0000 7f9baac92640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T17:05:31.135 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:05:31.134+0000 7fc3482ce640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T17:05:31.144 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:05:31.142+0000 7f9ba22b2640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:05:31.173 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:05:31.186 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:05:31.186+0000 7fc33f8ee640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:05:31.243 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:05:31.238+0000 7f5d47b61640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T17:05:31.262 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:05:31.258+0000 7f0d47dd5640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T17:05:31.267 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:05:31.266+0000 7f9e3b44a640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T17:05:31.276 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:05:31.274+0000 7f5d3f993640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:05:31.307 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:05:31.306+0000 7f9e3327c640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:05:31.308 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:05:31.306+0000 7f0d3fc07640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:05:31.613 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-12T17:05:31.613 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":13,"fsid":"505f0ddb-af61-4cad-802f-747b5bdb41a8","created":"2024-09-12T17:05:20.776084+0000","modified":"2024-09-12T17:05:30.962401+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T17:05:23.094421+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"cf0f0496-2732-4649-9792-6f2117afe076","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"931ecda0-1894-411b-a2f8-843472ad493c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e1cc4a34-80dd-42e2-afb1-babce54de8cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"48424313-1b8e-41ba-b322-d37b813552da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ba035b82-db0e-4e9a-a45e-fd111aebaea2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"3bad8071-4d77-4ec3-a85f-9648cb1d9c7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"cef01590-aa71-4356-bd81-0629172de3b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"39b07acd-56a6-47ad-86ec-cb330c7647b7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:05:31.628 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T17:05:31.950 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:05:31.946+0000 7fbd8e17b640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T17:05:31.972 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:05:31.970+0000 7fbd8579b640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:05:32.066 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:05:32.066+0000 7f6b60ff4640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T17:05:32.066 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:05:32.066+0000 7fc957aca640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T17:05:32.089 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:05:32.090+0000 7f6b58614640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:05:32.090 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:05:32.090+0000 7fc94f8fc640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T17:05:38.434 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T17:05:38.749 INFO:teuthology.misc.health.smithi017.stdout: 2024-09-12T17:05:38.749 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":18,"fsid":"505f0ddb-af61-4cad-802f-747b5bdb41a8","created":"2024-09-12T17:05:20.776084+0000","modified":"2024-09-12T17:05:36.167720+0000","last_up_change":"2024-09-12T17:05:32.139689+0000","last_in_change":"2024-09-12T17:05:23.094421+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:05:33.945154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf0f0496-2732-4649-9792-6f2117afe076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6817","nonce":2182669987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6819","nonce":2182669987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6823","nonce":2182669987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6821","nonce":2182669987}]},"public_addr":"172.21.15.17:6817/2182669987","cluster_addr":"172.21.15.17:6819/2182669987","heartbeat_back_addr":"172.21.15.17:6823/2182669987","heartbeat_front_addr":"172.21.15.17:6821/2182669987","state":["exists","up"]},{"osd":1,"uuid":"931ecda0-1894-411b-a2f8-843472ad493c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6825","nonce":3677250778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6827","nonce":3677250778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6831","nonce":3677250778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6829","nonce":3677250778}]},"public_addr":"172.21.15.17:6825/3677250778","cluster_addr":"172.21.15.17:6827/3677250778","heartbeat_back_addr":"172.21.15.17:6831/3677250778","heartbeat_front_addr":"172.21.15.17:6829/3677250778","state":["exists","up"]},{"osd":2,"uuid":"e1cc4a34-80dd-42e2-afb1-babce54de8cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6801","nonce":2449755532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6803","nonce":2449755532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6807","nonce":2449755532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6805","nonce":2449755532}]},"public_addr":"172.21.15.17:6801/2449755532","cluster_addr":"172.21.15.17:6803/2449755532","heartbeat_back_addr":"172.21.15.17:6807/2449755532","heartbeat_front_addr":"172.21.15.17:6805/2449755532","state":["exists","up"]},{"osd":3,"uuid":"48424313-1b8e-41ba-b322-d37b813552da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6809","nonce":1410973648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6811","nonce":1410973648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6815","nonce":1410973648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6813","nonce":1410973648}]},"public_addr":"172.21.15.17:6809/1410973648","cluster_addr":"172.21.15.17:6811/1410973648","heartbeat_back_addr":"172.21.15.17:6815/1410973648","heartbeat_front_addr":"172.21.15.17:6813/1410973648","state":["exists","up"]},{"osd":4,"uuid":"ba035b82-db0e-4e9a-a45e-fd111aebaea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6825","nonce":3279960414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6827","nonce":3279960414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6831","nonce":3279960414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6829","nonce":3279960414}]},"public_addr":"172.21.15.47:6825/3279960414","cluster_addr":"172.21.15.47:6827/3279960414","heartbeat_back_addr":"172.21.15.47:6831/3279960414","heartbeat_front_addr":"172.21.15.47:6829/3279960414","state":["exists","up"]},{"osd":5,"uuid":"3bad8071-4d77-4ec3-a85f-9648cb1d9c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6801","nonce":2093714552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6803","nonce":2093714552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6807","nonce":2093714552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6805","nonce":2093714552}]},"public_addr":"172.21.15.47:6801/2093714552","cluster_addr":"172.21.15.47:6803/2093714552","heartbeat_back_addr":"172.21.15.47:6807/2093714552","heartbeat_front_addr":"172.21.15.47:6805/2093714552","state":["exists","up"]},{"osd":6,"uuid":"cef01590-aa71-4356-bd81-0629172de3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6817","nonce":2759913072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6819","nonce":2759913072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6823","nonce":2759913072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6821","nonce":2759913072}]},"public_addr":"172.21.15.47:6817/2759913072","cluster_addr":"172.21.15.47:6819/2759913072","heartbeat_back_addr":"172.21.15.47:6823/2759913072","heartbeat_front_addr":"172.21.15.47:6821/2759913072","state":["exists","up"]},{"osd":7,"uuid":"39b07acd-56a6-47ad-86ec-cb330c7647b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6809","nonce":1836347584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6811","nonce":1836347584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6815","nonce":1836347584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6813","nonce":1836347584}]},"public_addr":"172.21.15.47:6809/1836347584","cluster_addr":"172.21.15.47:6811/1836347584","heartbeat_back_addr":"172.21.15.47:6815/1836347584","heartbeat_front_addr":"172.21.15.47:6813/1836347584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.587047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:30.238668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.152914+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.921710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:30.271565+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.589211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.997198+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.558519+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:05:38.766 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T17:05:38.766 INFO:tasks.ceph:Creating RBD pool 2024-09-12T17:05:38.766 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T17:05:39.191 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'rbd' created 2024-09-12T17:05:39.214 DEBUG:teuthology.orchestra.run.smithi017:> rbd --cluster ceph pool init rbd 2024-09-12T17:05:42.240 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T17:05:42.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T17:05:42.241 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T17:05:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:05:42.585 INFO:teuthology.orchestra.run.smithi017.stdout:[{"version":9,"timestamp":"2024-09-12T17:05:32.073553+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"5478.316067"}]}] 2024-09-12T17:05:42.585 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T17:05:42.585 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T17:05:42.585 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T17:05:42.586 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T17:05:42.936 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:05:42.953 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":1333682511},{"type":"v1","addr":"172.21.15.47:6833","nonce":1333682511}]},"active_addr":"172.21.15.47:6833/1333682511","active_change":"2024-09-12T17:05:25.891353+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":854781311}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2927311836}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2324158639}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.47:0","nonce":2595135371}]}]} 2024-09-12T17:05:42.957 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T17:05:42.957 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:05:42.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:05:43.270 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:05:43.270 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"fsid":"505f0ddb-af61-4cad-802f-747b5bdb41a8","created":"2024-09-12T17:05:20.776084+0000","modified":"2024-09-12T17:05:42.204455+0000","last_up_change":"2024-09-12T17:05:32.139689+0000","last_in_change":"2024-09-12T17:05:23.094421+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:05:33.945154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:05:39.084260+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf0f0496-2732-4649-9792-6f2117afe076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6817","nonce":2182669987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6819","nonce":2182669987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6823","nonce":2182669987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6821","nonce":2182669987}]},"public_addr":"172.21.15.17:6817/2182669987","cluster_addr":"172.21.15.17:6819/2182669987","heartbeat_back_addr":"172.21.15.17:6823/2182669987","heartbeat_front_addr":"172.21.15.17:6821/2182669987","state":["exists","up"]},{"osd":1,"uuid":"931ecda0-1894-411b-a2f8-843472ad493c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6825","nonce":3677250778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6827","nonce":3677250778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6831","nonce":3677250778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6829","nonce":3677250778}]},"public_addr":"172.21.15.17:6825/3677250778","cluster_addr":"172.21.15.17:6827/3677250778","heartbeat_back_addr":"172.21.15.17:6831/3677250778","heartbeat_front_addr":"172.21.15.17:6829/3677250778","state":["exists","up"]},{"osd":2,"uuid":"e1cc4a34-80dd-42e2-afb1-babce54de8cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6801","nonce":2449755532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6803","nonce":2449755532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6807","nonce":2449755532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6805","nonce":2449755532}]},"public_addr":"172.21.15.17:6801/2449755532","cluster_addr":"172.21.15.17:6803/2449755532","heartbeat_back_addr":"172.21.15.17:6807/2449755532","heartbeat_front_addr":"172.21.15.17:6805/2449755532","state":["exists","up"]},{"osd":3,"uuid":"48424313-1b8e-41ba-b322-d37b813552da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6809","nonce":1410973648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6811","nonce":1410973648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6815","nonce":1410973648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6813","nonce":1410973648}]},"public_addr":"172.21.15.17:6809/1410973648","cluster_addr":"172.21.15.17:6811/1410973648","heartbeat_back_addr":"172.21.15.17:6815/1410973648","heartbeat_front_addr":"172.21.15.17:6813/1410973648","state":["exists","up"]},{"osd":4,"uuid":"ba035b82-db0e-4e9a-a45e-fd111aebaea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6825","nonce":3279960414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6827","nonce":3279960414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6831","nonce":3279960414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6829","nonce":3279960414}]},"public_addr":"172.21.15.47:6825/3279960414","cluster_addr":"172.21.15.47:6827/3279960414","heartbeat_back_addr":"172.21.15.47:6831/3279960414","heartbeat_front_addr":"172.21.15.47:6829/3279960414","state":["exists","up"]},{"osd":5,"uuid":"3bad8071-4d77-4ec3-a85f-9648cb1d9c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6801","nonce":2093714552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6803","nonce":2093714552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6807","nonce":2093714552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6805","nonce":2093714552}]},"public_addr":"172.21.15.47:6801/2093714552","cluster_addr":"172.21.15.47:6803/2093714552","heartbeat_back_addr":"172.21.15.47:6807/2093714552","heartbeat_front_addr":"172.21.15.47:6805/2093714552","state":["exists","up"]},{"osd":6,"uuid":"cef01590-aa71-4356-bd81-0629172de3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6817","nonce":2759913072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6819","nonce":2759913072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6823","nonce":2759913072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6821","nonce":2759913072}]},"public_addr":"172.21.15.47:6817/2759913072","cluster_addr":"172.21.15.47:6819/2759913072","heartbeat_back_addr":"172.21.15.47:6823/2759913072","heartbeat_front_addr":"172.21.15.47:6821/2759913072","state":["exists","up"]},{"osd":7,"uuid":"39b07acd-56a6-47ad-86ec-cb330c7647b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6809","nonce":1836347584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6811","nonce":1836347584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6815","nonce":1836347584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6813","nonce":1836347584}]},"public_addr":"172.21.15.47:6809/1836347584","cluster_addr":"172.21.15.47:6811/1836347584","heartbeat_back_addr":"172.21.15.47:6815/1836347584","heartbeat_front_addr":"172.21.15.47:6813/1836347584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.587047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:30.238668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.152914+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.921710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:30.271565+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.589211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.997198+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.558519+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:05:43.290 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:05:43.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:05:43.602 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:05:43.603 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"fsid":"505f0ddb-af61-4cad-802f-747b5bdb41a8","created":"2024-09-12T17:05:20.776084+0000","modified":"2024-09-12T17:05:42.204455+0000","last_up_change":"2024-09-12T17:05:32.139689+0000","last_in_change":"2024-09-12T17:05:23.094421+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:05:33.945154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:05:39.084260+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf0f0496-2732-4649-9792-6f2117afe076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6817","nonce":2182669987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6819","nonce":2182669987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6823","nonce":2182669987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6821","nonce":2182669987}]},"public_addr":"172.21.15.17:6817/2182669987","cluster_addr":"172.21.15.17:6819/2182669987","heartbeat_back_addr":"172.21.15.17:6823/2182669987","heartbeat_front_addr":"172.21.15.17:6821/2182669987","state":["exists","up"]},{"osd":1,"uuid":"931ecda0-1894-411b-a2f8-843472ad493c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6825","nonce":3677250778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6827","nonce":3677250778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6831","nonce":3677250778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6829","nonce":3677250778}]},"public_addr":"172.21.15.17:6825/3677250778","cluster_addr":"172.21.15.17:6827/3677250778","heartbeat_back_addr":"172.21.15.17:6831/3677250778","heartbeat_front_addr":"172.21.15.17:6829/3677250778","state":["exists","up"]},{"osd":2,"uuid":"e1cc4a34-80dd-42e2-afb1-babce54de8cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6801","nonce":2449755532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6803","nonce":2449755532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6807","nonce":2449755532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6805","nonce":2449755532}]},"public_addr":"172.21.15.17:6801/2449755532","cluster_addr":"172.21.15.17:6803/2449755532","heartbeat_back_addr":"172.21.15.17:6807/2449755532","heartbeat_front_addr":"172.21.15.17:6805/2449755532","state":["exists","up"]},{"osd":3,"uuid":"48424313-1b8e-41ba-b322-d37b813552da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6809","nonce":1410973648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6811","nonce":1410973648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6815","nonce":1410973648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6813","nonce":1410973648}]},"public_addr":"172.21.15.17:6809/1410973648","cluster_addr":"172.21.15.17:6811/1410973648","heartbeat_back_addr":"172.21.15.17:6815/1410973648","heartbeat_front_addr":"172.21.15.17:6813/1410973648","state":["exists","up"]},{"osd":4,"uuid":"ba035b82-db0e-4e9a-a45e-fd111aebaea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6825","nonce":3279960414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6827","nonce":3279960414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6831","nonce":3279960414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6829","nonce":3279960414}]},"public_addr":"172.21.15.47:6825/3279960414","cluster_addr":"172.21.15.47:6827/3279960414","heartbeat_back_addr":"172.21.15.47:6831/3279960414","heartbeat_front_addr":"172.21.15.47:6829/3279960414","state":["exists","up"]},{"osd":5,"uuid":"3bad8071-4d77-4ec3-a85f-9648cb1d9c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6801","nonce":2093714552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6803","nonce":2093714552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6807","nonce":2093714552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6805","nonce":2093714552}]},"public_addr":"172.21.15.47:6801/2093714552","cluster_addr":"172.21.15.47:6803/2093714552","heartbeat_back_addr":"172.21.15.47:6807/2093714552","heartbeat_front_addr":"172.21.15.47:6805/2093714552","state":["exists","up"]},{"osd":6,"uuid":"cef01590-aa71-4356-bd81-0629172de3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6817","nonce":2759913072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6819","nonce":2759913072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6823","nonce":2759913072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6821","nonce":2759913072}]},"public_addr":"172.21.15.47:6817/2759913072","cluster_addr":"172.21.15.47:6819/2759913072","heartbeat_back_addr":"172.21.15.47:6823/2759913072","heartbeat_front_addr":"172.21.15.47:6821/2759913072","state":["exists","up"]},{"osd":7,"uuid":"39b07acd-56a6-47ad-86ec-cb330c7647b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6809","nonce":1836347584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6811","nonce":1836347584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6815","nonce":1836347584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6813","nonce":1836347584}]},"public_addr":"172.21.15.47:6809/1836347584","cluster_addr":"172.21.15.47:6811/1836347584","heartbeat_back_addr":"172.21.15.47:6815/1836347584","heartbeat_front_addr":"172.21.15.47:6813/1836347584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.587047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:30.238668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.152914+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.921710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:30.271565+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.589211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.997198+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.558519+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:05:43.622 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:05:43.622 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:05:43.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:05:43.623 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:05:43.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T17:05:43.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T17:05:43.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T17:05:43.625 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T17:05:43.890 INFO:teuthology.orchestra.run.smithi017.stdout:60129542150 2024-09-12T17:05:43.891 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:05:43.892 INFO:teuthology.orchestra.run.smithi017.stdout:60129542150 2024-09-12T17:05:43.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:05:43.893 INFO:teuthology.orchestra.run.smithi017.stdout:60129542150 2024-09-12T17:05:43.893 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:05:43.894 INFO:teuthology.orchestra.run.smithi017.stdout:60129542149 2024-09-12T17:05:43.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:05:43.900 INFO:teuthology.orchestra.run.smithi017.stdout:60129542149 2024-09-12T17:05:43.901 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:05:43.902 INFO:teuthology.orchestra.run.smithi017.stdout:60129542150 2024-09-12T17:05:43.903 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:05:43.907 INFO:teuthology.orchestra.run.smithi017.stdout:60129542150 2024-09-12T17:05:43.907 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:05:43.909 INFO:teuthology.orchestra.run.smithi017.stdout:60129542150 2024-09-12T17:05:43.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:05:44.413 INFO:teuthology.orchestra.run.smithi017.stdout:60129542150 2024-09-12T17:05:44.421 INFO:teuthology.orchestra.run.smithi017.stdout:60129542149 2024-09-12T17:05:44.440 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-12T17:05:44.440 DEBUG:teuthology.parallel:result is None 2024-09-12T17:05:44.447 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2024-09-12T17:05:44.447 DEBUG:teuthology.parallel:result is None 2024-09-12T17:05:44.449 INFO:teuthology.orchestra.run.smithi017.stdout:60129542150 2024-09-12T17:05:44.465 INFO:teuthology.orchestra.run.smithi017.stdout:60129542150 2024-09-12T17:05:44.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.0 2024-09-12T17:05:44.467 DEBUG:teuthology.parallel:result is None 2024-09-12T17:05:44.474 INFO:teuthology.orchestra.run.smithi017.stdout:60129542150 2024-09-12T17:05:44.479 INFO:teuthology.orchestra.run.smithi017.stdout:60129542150 2024-09-12T17:05:44.491 INFO:teuthology.orchestra.run.smithi017.stdout:60129542149 2024-09-12T17:05:44.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.2 2024-09-12T17:05:44.495 DEBUG:teuthology.parallel:result is None 2024-09-12T17:05:44.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2024-09-12T17:05:44.496 DEBUG:teuthology.parallel:result is None 2024-09-12T17:05:44.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.6 2024-09-12T17:05:44.510 INFO:teuthology.orchestra.run.smithi017.stdout:60129542150 2024-09-12T17:05:44.510 DEBUG:teuthology.parallel:result is None 2024-09-12T17:05:44.514 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.7 2024-09-12T17:05:44.515 DEBUG:teuthology.parallel:result is None 2024-09-12T17:05:44.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.4 2024-09-12T17:05:44.527 DEBUG:teuthology.parallel:result is None 2024-09-12T17:05:44.527 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:05:44.527 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:05:44.853 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:05:44.854 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:05:44.871 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T17:05:43.906276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":269120,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705600,"statfs":{"total":773094113280,"available":772818534400,"internally_reserved":0,"allocated":2998272,"data_stored":1794550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.712244"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.680975+0000","last_change":"2024-09-12T17:05:42.680975+0000","last_active":"2024-09-12T17:05:42.680975+0000","last_peered":"2024-09-12T17:05:42.680975+0000","last_clean":"2024-09-12T17:05:42.680975+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:05:42.680975+0000","last_undegraded":"2024-09-12T17:05:42.680975+0000","last_fullsized":"2024-09-12T17:05:42.680975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.660350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.216620+0000","last_change":"2024-09-12T17:05:42.216620+0000","last_active":"2024-09-12T17:05:42.216620+0000","last_peered":"2024-09-12T17:05:42.216620+0000","last_clean":"2024-09-12T17:05:42.216620+0000","last_became_active":"2024-09-12T17:05:40.211977+0000","last_became_peered":"2024-09-12T17:05:40.211977+0000","last_unstale":"2024-09-12T17:05:42.216620+0000","last_undegraded":"2024-09-12T17:05:42.216620+0000","last_fullsized":"2024-09-12T17:05:42.216620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:16.615233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010578320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.218804+0000","last_change":"2024-09-12T17:05:42.218804+0000","last_active":"2024-09-12T17:05:42.218804+0000","last_peered":"2024-09-12T17:05:42.218804+0000","last_clean":"2024-09-12T17:05:42.218804+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:05:42.218804+0000","last_undegraded":"2024-09-12T17:05:42.218804+0000","last_fullsized":"2024-09-12T17:05:42.218804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:48.189931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.216609+0000","last_change":"2024-09-12T17:05:42.216609+0000","last_active":"2024-09-12T17:05:42.216609+0000","last_peered":"2024-09-12T17:05:42.216609+0000","last_clean":"2024-09-12T17:05:42.216609+0000","last_became_active":"2024-09-12T17:05:40.210347+0000","last_became_peered":"2024-09-12T17:05:40.210347+0000","last_unstale":"2024-09-12T17:05:42.216609+0000","last_undegraded":"2024-09-12T17:05:42.216609+0000","last_fullsized":"2024-09-12T17:05:42.216609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:59.135278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010482919999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.228357+0000","last_change":"2024-09-12T17:05:42.226889+0000","last_active":"2024-09-12T17:05:42.228357+0000","last_peered":"2024-09-12T17:05:42.228357+0000","last_clean":"2024-09-12T17:05:42.228357+0000","last_became_active":"2024-09-12T17:05:40.214050+0000","last_became_peered":"2024-09-12T17:05:40.214050+0000","last_unstale":"2024-09-12T17:05:42.228357+0000","last_undegraded":"2024-09-12T17:05:42.228357+0000","last_fullsized":"2024-09-12T17:05:42.228357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:12.972719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.677413+0000","last_change":"2024-09-12T17:05:42.677413+0000","last_active":"2024-09-12T17:05:42.677413+0000","last_peered":"2024-09-12T17:05:42.677413+0000","last_clean":"2024-09-12T17:05:42.677413+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:05:42.677413+0000","last_undegraded":"2024-09-12T17:05:42.677413+0000","last_fullsized":"2024-09-12T17:05:42.677413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.836885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.218859+0000","last_change":"2024-09-12T17:05:42.218859+0000","last_active":"2024-09-12T17:05:42.218859+0000","last_peered":"2024-09-12T17:05:42.218859+0000","last_clean":"2024-09-12T17:05:42.218859+0000","last_became_active":"2024-09-12T17:05:40.212384+0000","last_became_peered":"2024-09-12T17:05:40.212384+0000","last_unstale":"2024-09-12T17:05:42.218859+0000","last_undegraded":"2024-09-12T17:05:42.218859+0000","last_fullsized":"2024-09-12T17:05:42.218859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:29.184124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.225793+0000","last_change":"2024-09-12T17:05:42.225793+0000","last_active":"2024-09-12T17:05:42.225793+0000","last_peered":"2024-09-12T17:05:42.225793+0000","last_clean":"2024-09-12T17:05:42.225793+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:05:42.225793+0000","last_undegraded":"2024-09-12T17:05:42.225793+0000","last_fullsized":"2024-09-12T17:05:42.225793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:54.880257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.217495+0000","last_change":"2024-09-12T17:05:35.688483+0000","last_active":"2024-09-12T17:05:42.217495+0000","last_peered":"2024-09-12T17:05:42.217495+0000","last_clean":"2024-09-12T17:05:42.217495+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:05:42.217495+0000","last_undegraded":"2024-09-12T17:05:42.217495+0000","last_fullsized":"2024-09-12T17:05:42.217495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_clean_scrub_stamp":"2024-09-12T17:05:34.151079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36156,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335684,"statfs":{"total":96636764160,"available":96599740416,"internally_reserved":0,"allocated":819200,"data_stored":667090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":225280,"data_stored":76722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":229376,"data_stored":76741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35572,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":225280,"data_stored":76722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":76722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35576,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336264,"statfs":{"total":96636764160,"available":96600334336,"internally_reserved":0,"allocated":229376,"data_stored":76741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":819200,"data_stored":667090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:05:44.872 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:05:45.159 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:05:45.160 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:05:45.177 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T17:05:43.906276+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":269120,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":265971,"kb_avail":754705600,"statfs":{"total":773094113280,"available":772818534400,"internally_reserved":0,"allocated":2998272,"data_stored":1794550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":272354864},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.712244"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.680975+0000","last_change":"2024-09-12T17:05:42.680975+0000","last_active":"2024-09-12T17:05:42.680975+0000","last_peered":"2024-09-12T17:05:42.680975+0000","last_clean":"2024-09-12T17:05:42.680975+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:05:42.680975+0000","last_undegraded":"2024-09-12T17:05:42.680975+0000","last_fullsized":"2024-09-12T17:05:42.680975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.660350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.216620+0000","last_change":"2024-09-12T17:05:42.216620+0000","last_active":"2024-09-12T17:05:42.216620+0000","last_peered":"2024-09-12T17:05:42.216620+0000","last_clean":"2024-09-12T17:05:42.216620+0000","last_became_active":"2024-09-12T17:05:40.211977+0000","last_became_peered":"2024-09-12T17:05:40.211977+0000","last_unstale":"2024-09-12T17:05:42.216620+0000","last_undegraded":"2024-09-12T17:05:42.216620+0000","last_fullsized":"2024-09-12T17:05:42.216620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:16.615233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010578320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.218804+0000","last_change":"2024-09-12T17:05:42.218804+0000","last_active":"2024-09-12T17:05:42.218804+0000","last_peered":"2024-09-12T17:05:42.218804+0000","last_clean":"2024-09-12T17:05:42.218804+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:05:42.218804+0000","last_undegraded":"2024-09-12T17:05:42.218804+0000","last_fullsized":"2024-09-12T17:05:42.218804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:48.189931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.216609+0000","last_change":"2024-09-12T17:05:42.216609+0000","last_active":"2024-09-12T17:05:42.216609+0000","last_peered":"2024-09-12T17:05:42.216609+0000","last_clean":"2024-09-12T17:05:42.216609+0000","last_became_active":"2024-09-12T17:05:40.210347+0000","last_became_peered":"2024-09-12T17:05:40.210347+0000","last_unstale":"2024-09-12T17:05:42.216609+0000","last_undegraded":"2024-09-12T17:05:42.216609+0000","last_fullsized":"2024-09-12T17:05:42.216609+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:59.135278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010482919999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.228357+0000","last_change":"2024-09-12T17:05:42.226889+0000","last_active":"2024-09-12T17:05:42.228357+0000","last_peered":"2024-09-12T17:05:42.228357+0000","last_clean":"2024-09-12T17:05:42.228357+0000","last_became_active":"2024-09-12T17:05:40.214050+0000","last_became_peered":"2024-09-12T17:05:40.214050+0000","last_unstale":"2024-09-12T17:05:42.228357+0000","last_undegraded":"2024-09-12T17:05:42.228357+0000","last_fullsized":"2024-09-12T17:05:42.228357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:12.972719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.677413+0000","last_change":"2024-09-12T17:05:42.677413+0000","last_active":"2024-09-12T17:05:42.677413+0000","last_peered":"2024-09-12T17:05:42.677413+0000","last_clean":"2024-09-12T17:05:42.677413+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:05:42.677413+0000","last_undegraded":"2024-09-12T17:05:42.677413+0000","last_fullsized":"2024-09-12T17:05:42.677413+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.836885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.218859+0000","last_change":"2024-09-12T17:05:42.218859+0000","last_active":"2024-09-12T17:05:42.218859+0000","last_peered":"2024-09-12T17:05:42.218859+0000","last_clean":"2024-09-12T17:05:42.218859+0000","last_became_active":"2024-09-12T17:05:40.212384+0000","last_became_peered":"2024-09-12T17:05:40.212384+0000","last_unstale":"2024-09-12T17:05:42.218859+0000","last_undegraded":"2024-09-12T17:05:42.218859+0000","last_fullsized":"2024-09-12T17:05:42.218859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:29.184124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.225793+0000","last_change":"2024-09-12T17:05:42.225793+0000","last_active":"2024-09-12T17:05:42.225793+0000","last_peered":"2024-09-12T17:05:42.225793+0000","last_clean":"2024-09-12T17:05:42.225793+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:05:42.225793+0000","last_undegraded":"2024-09-12T17:05:42.225793+0000","last_fullsized":"2024-09-12T17:05:42.225793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:54.880257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T17:05:42.217495+0000","last_change":"2024-09-12T17:05:35.688483+0000","last_active":"2024-09-12T17:05:42.217495+0000","last_peered":"2024-09-12T17:05:42.217495+0000","last_clean":"2024-09-12T17:05:42.217495+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:05:42.217495+0000","last_undegraded":"2024-09-12T17:05:42.217495+0000","last_fullsized":"2024-09-12T17:05:42.217495+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_clean_scrub_stamp":"2024-09-12T17:05:34.151079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36156,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335684,"statfs":{"total":96636764160,"available":96599740416,"internally_reserved":0,"allocated":819200,"data_stored":667090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35572,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":225280,"data_stored":76722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":229376,"data_stored":76741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35572,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336268,"statfs":{"total":96636764160,"available":96600338432,"internally_reserved":0,"allocated":225280,"data_stored":76722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":225280,"data_stored":76722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542150,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31408,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340432,"statfs":{"total":96636764160,"available":96604602368,"internally_reserved":0,"allocated":225280,"data_stored":76722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35576,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336264,"statfs":{"total":96636764160,"available":96600334336,"internally_reserved":0,"allocated":229376,"data_stored":76741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31996,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339844,"statfs":{"total":96636764160,"available":96604000256,"internally_reserved":0,"allocated":819200,"data_stored":667090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:05:45.178 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:05:45.178 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T17:05:45.178 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T17:05:45.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T17:05:45.513 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:05:45.514 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T17:05:45.531 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T17:05:45.532 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T17:05:45.548 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T17:05:45.548 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T17:05:45.548 INFO:tasks.rgw:Creating data pools 2024-09-12T17:05:45.548 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T17:05:45.548 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T17:05:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T17:05:46.528 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T17:05:47.498 INFO:teuthology.orchestra.run.smithi017.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T17:05:47.550 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T17:05:48.509 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T17:05:48.544 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T17:05:49.515 INFO:teuthology.orchestra.run.smithi017.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T17:05:49.566 DEBUG:tasks.rgw:Pools created 2024-09-12T17:05:49.566 INFO:tasks.rgw:Starting rgw... 2024-09-12T17:05:49.566 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T17:05:49.566 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T17:05:49.566 DEBUG:teuthology.orchestra.run.smithi017:> sudo echo -n http://smithi017.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T17:05:49.578 INFO:teuthology.orchestra.run.smithi017.stdout:http://smithi017.front.sepia.ceph.com:80 2024-09-12T17:05:49.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T17:05:49.628 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T17:05:49.628 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T17:05:49.672 INFO:tasks.rgw.client.0:Started 2024-09-12T17:05:49.672 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi017.front.sepia.ceph.com:80/ 2024-09-12T17:05:49.672 DEBUG:teuthology.orchestra.run.smithi017:> curl http://smithi017.front.sepia.ceph.com:80/ 2024-09-12T17:05:49.709 INFO:teuthology.orchestra.run.smithi017.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:05:49.709 INFO:teuthology.orchestra.run.smithi017.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:05:49.711 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:05:49.711 INFO:teuthology.orchestra.run.smithi017.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:05:49.711 INFO:teuthology.orchestra.run.smithi017.stderr:curl: (7) Failed to connect to smithi017.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:05:50.712 DEBUG:teuthology.orchestra.run.smithi017:> curl http://smithi017.front.sepia.ceph.com:80/ 2024-09-12T17:05:50.724 INFO:teuthology.orchestra.run.smithi017.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:05:50.724 INFO:teuthology.orchestra.run.smithi017.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:05:50.724 INFO:teuthology.orchestra.run.smithi017.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:05:50.724 INFO:teuthology.orchestra.run.smithi017.stderr:curl: (7) Failed to connect to smithi017.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:05:50.725 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:05:52.726 DEBUG:teuthology.orchestra.run.smithi017:> curl http://smithi017.front.sepia.ceph.com:80/ 2024-09-12T17:05:52.738 INFO:teuthology.orchestra.run.smithi017.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:05:52.738 INFO:teuthology.orchestra.run.smithi017.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:05:52.738 INFO:teuthology.orchestra.run.smithi017.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:05:52.738 INFO:teuthology.orchestra.run.smithi017.stderr:curl: (7) Failed to connect to smithi017.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:05:52.739 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:05:56.740 DEBUG:teuthology.orchestra.run.smithi017:> curl http://smithi017.front.sepia.ceph.com:80/ 2024-09-12T17:05:56.753 INFO:teuthology.orchestra.run.smithi017.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:05:56.753 INFO:teuthology.orchestra.run.smithi017.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:05:56.753 INFO:teuthology.orchestra.run.smithi017.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T17:05:56.753 INFO:teuthology.orchestra.run.smithi017.stderr:curl: (7) Failed to connect to smithi017.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T17:05:56.754 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T17:06:04.754 DEBUG:teuthology.orchestra.run.smithi017:> curl http://smithi017.front.sepia.ceph.com:80/ 2024-09-12T17:06:04.766 INFO:teuthology.orchestra.run.smithi017.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T17:06:04.766 INFO:teuthology.orchestra.run.smithi017.stderr: Dload Upload Total Spent Left Speed 2024-09-12T17:06:04.769 INFO:teuthology.orchestra.run.smithi017.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 57134 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-12T17:06:04.770 INFO:teuthology.orchestra.run.smithi017.stdout:anonymous 2024-09-12T17:06:04.770 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T17:06:04.782 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T17:06:04.782 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-rgw-meta-handlers'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-meta-handlers', 'sha1': 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'}} 2024-09-12T17:06:04.782 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T17:06:04.783 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T17:06:05.165 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T17:06:05.168 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:06:05.168 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:06:05.520 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:06:05.529 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:06:05.543 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-09-12T17:06:03.912779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":274896,"kb_used_data":4592,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754699824,"statfs":{"total":773094113280,"available":772812619776,"internally_reserved":0,"allocated":4702208,"data_stored":2606492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.357325"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.581245+0000","last_change":"2024-09-12T17:05:47.561581+0000","last_active":"2024-09-12T17:05:58.581245+0000","last_peered":"2024-09-12T17:05:58.581245+0000","last_clean":"2024-09-12T17:05:58.581245+0000","last_became_active":"2024-09-12T17:05:47.560791+0000","last_became_peered":"2024-09-12T17:05:47.560791+0000","last_unstale":"2024-09-12T17:05:58.581245+0000","last_undegraded":"2024-09-12T17:05:58.581245+0000","last_fullsized":"2024-09-12T17:05:58.581245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:23.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587439+0000","last_change":"2024-09-12T17:05:49.558060+0000","last_active":"2024-09-12T17:05:58.587439+0000","last_peered":"2024-09-12T17:05:58.587439+0000","last_clean":"2024-09-12T17:05:58.587439+0000","last_became_active":"2024-09-12T17:05:49.557287+0000","last_became_peered":"2024-09-12T17:05:49.557287+0000","last_unstale":"2024-09-12T17:05:58.587439+0000","last_undegraded":"2024-09-12T17:05:58.587439+0000","last_fullsized":"2024-09-12T17:05:58.587439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576124+0000","last_change":"2024-09-12T17:05:47.523906+0000","last_active":"2024-09-12T17:05:58.576124+0000","last_peered":"2024-09-12T17:05:58.576124+0000","last_clean":"2024-09-12T17:05:58.576124+0000","last_became_active":"2024-09-12T17:05:47.523594+0000","last_became_peered":"2024-09-12T17:05:47.523594+0000","last_unstale":"2024-09-12T17:05:58.576124+0000","last_undegraded":"2024-09-12T17:05:58.576124+0000","last_fullsized":"2024-09-12T17:05:58.576124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:54.958627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577181+0000","last_change":"2024-09-12T17:05:49.546025+0000","last_active":"2024-09-12T17:05:58.577181+0000","last_peered":"2024-09-12T17:05:58.577181+0000","last_clean":"2024-09-12T17:05:58.577181+0000","last_became_active":"2024-09-12T17:05:49.545284+0000","last_became_peered":"2024-09-12T17:05:49.545284+0000","last_unstale":"2024-09-12T17:05:58.577181+0000","last_undegraded":"2024-09-12T17:05:58.577181+0000","last_fullsized":"2024-09-12T17:05:58.577181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.147865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592173+0000","last_change":"2024-09-12T17:05:47.523052+0000","last_active":"2024-09-12T17:05:58.592173+0000","last_peered":"2024-09-12T17:05:58.592173+0000","last_clean":"2024-09-12T17:05:58.592173+0000","last_became_active":"2024-09-12T17:05:47.522544+0000","last_became_peered":"2024-09-12T17:05:47.522544+0000","last_unstale":"2024-09-12T17:05:58.592173+0000","last_undegraded":"2024-09-12T17:05:58.592173+0000","last_fullsized":"2024-09-12T17:05:58.592173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582389+0000","last_change":"2024-09-12T17:05:49.549990+0000","last_active":"2024-09-12T17:05:58.582389+0000","last_peered":"2024-09-12T17:05:58.582389+0000","last_clean":"2024-09-12T17:05:58.582389+0000","last_became_active":"2024-09-12T17:05:49.549241+0000","last_became_peered":"2024-09-12T17:05:49.549241+0000","last_unstale":"2024-09-12T17:05:58.582389+0000","last_undegraded":"2024-09-12T17:05:58.582389+0000","last_fullsized":"2024-09-12T17:05:58.582389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.601256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588701+0000","last_change":"2024-09-12T17:05:47.538653+0000","last_active":"2024-09-12T17:05:58.588701+0000","last_peered":"2024-09-12T17:05:58.588701+0000","last_clean":"2024-09-12T17:05:58.588701+0000","last_became_active":"2024-09-12T17:05:47.535608+0000","last_became_peered":"2024-09-12T17:05:47.535608+0000","last_unstale":"2024-09-12T17:05:58.588701+0000","last_undegraded":"2024-09-12T17:05:58.588701+0000","last_fullsized":"2024-09-12T17:05:58.588701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591180+0000","last_change":"2024-09-12T17:05:49.542142+0000","last_active":"2024-09-12T17:05:58.591180+0000","last_peered":"2024-09-12T17:05:58.591180+0000","last_clean":"2024-09-12T17:05:58.591180+0000","last_became_active":"2024-09-12T17:05:49.541354+0000","last_became_peered":"2024-09-12T17:05:49.541354+0000","last_unstale":"2024-09-12T17:05:58.591180+0000","last_undegraded":"2024-09-12T17:05:58.591180+0000","last_fullsized":"2024-09-12T17:05:58.591180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.147865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579558+0000","last_change":"2024-09-12T17:05:47.556154+0000","last_active":"2024-09-12T17:05:58.579558+0000","last_peered":"2024-09-12T17:05:58.579558+0000","last_clean":"2024-09-12T17:05:58.579558+0000","last_became_active":"2024-09-12T17:05:47.555396+0000","last_became_peered":"2024-09-12T17:05:47.555396+0000","last_unstale":"2024-09-12T17:05:58.579558+0000","last_undegraded":"2024-09-12T17:05:58.579558+0000","last_fullsized":"2024-09-12T17:05:58.579558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:27.784208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605568+0000","last_change":"2024-09-12T17:05:49.529344+0000","last_active":"2024-09-12T17:05:58.605568+0000","last_peered":"2024-09-12T17:05:58.605568+0000","last_clean":"2024-09-12T17:05:58.605568+0000","last_became_active":"2024-09-12T17:05:49.528184+0000","last_became_peered":"2024-09-12T17:05:49.528184+0000","last_unstale":"2024-09-12T17:05:58.605568+0000","last_undegraded":"2024-09-12T17:05:58.605568+0000","last_fullsized":"2024-09-12T17:05:58.605568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:18.357328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587858+0000","last_change":"2024-09-12T17:05:47.532931+0000","last_active":"2024-09-12T17:05:58.587858+0000","last_peered":"2024-09-12T17:05:58.587858+0000","last_clean":"2024-09-12T17:05:58.587858+0000","last_became_active":"2024-09-12T17:05:47.531427+0000","last_became_peered":"2024-09-12T17:05:47.531427+0000","last_unstale":"2024-09-12T17:05:58.587858+0000","last_undegraded":"2024-09-12T17:05:58.587858+0000","last_fullsized":"2024-09-12T17:05:58.587858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578698+0000","last_change":"2024-09-12T17:05:49.550694+0000","last_active":"2024-09-12T17:05:58.578698+0000","last_peered":"2024-09-12T17:05:58.578698+0000","last_clean":"2024-09-12T17:05:58.578698+0000","last_became_active":"2024-09-12T17:05:49.549066+0000","last_became_peered":"2024-09-12T17:05:49.549066+0000","last_unstale":"2024-09-12T17:05:58.578698+0000","last_undegraded":"2024-09-12T17:05:58.578698+0000","last_fullsized":"2024-09-12T17:05:58.578698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:24.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577623+0000","last_change":"2024-09-12T17:05:47.560085+0000","last_active":"2024-09-12T17:05:58.577623+0000","last_peered":"2024-09-12T17:05:58.577623+0000","last_clean":"2024-09-12T17:05:58.577623+0000","last_became_active":"2024-09-12T17:05:47.559160+0000","last_became_peered":"2024-09-12T17:05:47.559160+0000","last_unstale":"2024-09-12T17:05:58.577623+0000","last_undegraded":"2024-09-12T17:05:58.577623+0000","last_fullsized":"2024-09-12T17:05:58.577623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:06.664677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589075+0000","last_change":"2024-09-12T17:05:49.550593+0000","last_active":"2024-09-12T17:05:58.589075+0000","last_peered":"2024-09-12T17:05:58.589075+0000","last_clean":"2024-09-12T17:05:58.589075+0000","last_became_active":"2024-09-12T17:05:49.549728+0000","last_became_peered":"2024-09-12T17:05:49.549728+0000","last_unstale":"2024-09-12T17:05:58.589075+0000","last_undegraded":"2024-09-12T17:05:58.589075+0000","last_fullsized":"2024-09-12T17:05:58.589075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:06.399711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596775+0000","last_change":"2024-09-12T17:05:47.528197+0000","last_active":"2024-09-12T17:05:58.596775+0000","last_peered":"2024-09-12T17:05:58.596775+0000","last_clean":"2024-09-12T17:05:58.596775+0000","last_became_active":"2024-09-12T17:05:47.527467+0000","last_became_peered":"2024-09-12T17:05:47.527467+0000","last_unstale":"2024-09-12T17:05:58.596775+0000","last_undegraded":"2024-09-12T17:05:58.596775+0000","last_fullsized":"2024-09-12T17:05:58.596775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:55.688363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619837+0000","last_change":"2024-09-12T17:05:49.538965+0000","last_active":"2024-09-12T17:05:58.619837+0000","last_peered":"2024-09-12T17:05:58.619837+0000","last_clean":"2024-09-12T17:05:58.619837+0000","last_became_active":"2024-09-12T17:05:49.538637+0000","last_became_peered":"2024-09-12T17:05:49.538637+0000","last_unstale":"2024-09-12T17:05:58.619837+0000","last_undegraded":"2024-09-12T17:05:58.619837+0000","last_fullsized":"2024-09-12T17:05:58.619837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:13.671675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576989+0000","last_change":"2024-09-12T17:05:49.549575+0000","last_active":"2024-09-12T17:05:58.576989+0000","last_peered":"2024-09-12T17:05:58.576989+0000","last_clean":"2024-09-12T17:05:58.576989+0000","last_became_active":"2024-09-12T17:05:49.548292+0000","last_became_peered":"2024-09-12T17:05:49.548292+0000","last_unstale":"2024-09-12T17:05:58.576989+0000","last_undegraded":"2024-09-12T17:05:58.576989+0000","last_fullsized":"2024-09-12T17:05:58.576989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580158+0000","last_change":"2024-09-12T17:05:47.559881+0000","last_active":"2024-09-12T17:05:58.580158+0000","last_peered":"2024-09-12T17:05:58.580158+0000","last_clean":"2024-09-12T17:05:58.580158+0000","last_became_active":"2024-09-12T17:05:47.559165+0000","last_became_peered":"2024-09-12T17:05:47.559165+0000","last_unstale":"2024-09-12T17:05:58.580158+0000","last_undegraded":"2024-09-12T17:05:58.580158+0000","last_fullsized":"2024-09-12T17:05:58.580158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:35.318480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577402+0000","last_change":"2024-09-12T17:05:49.538723+0000","last_active":"2024-09-12T17:05:58.577402+0000","last_peered":"2024-09-12T17:05:58.577402+0000","last_clean":"2024-09-12T17:05:58.577402+0000","last_became_active":"2024-09-12T17:05:49.537974+0000","last_became_peered":"2024-09-12T17:05:49.537974+0000","last_unstale":"2024-09-12T17:05:58.577402+0000","last_undegraded":"2024-09-12T17:05:58.577402+0000","last_fullsized":"2024-09-12T17:05:58.577402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:31.868549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606365+0000","last_change":"2024-09-12T17:05:47.528338+0000","last_active":"2024-09-12T17:05:58.606365+0000","last_peered":"2024-09-12T17:05:58.606365+0000","last_clean":"2024-09-12T17:05:58.606365+0000","last_became_active":"2024-09-12T17:05:47.527533+0000","last_became_peered":"2024-09-12T17:05:47.527533+0000","last_unstale":"2024-09-12T17:05:58.606365+0000","last_undegraded":"2024-09-12T17:05:58.606365+0000","last_fullsized":"2024-09-12T17:05:58.606365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.693731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588238+0000","last_change":"2024-09-12T17:05:49.543097+0000","last_active":"2024-09-12T17:05:58.588238+0000","last_peered":"2024-09-12T17:05:58.588238+0000","last_clean":"2024-09-12T17:05:58.588238+0000","last_became_active":"2024-09-12T17:05:49.542113+0000","last_became_peered":"2024-09-12T17:05:49.542113+0000","last_unstale":"2024-09-12T17:05:58.588238+0000","last_undegraded":"2024-09-12T17:05:58.588238+0000","last_fullsized":"2024-09-12T17:05:58.588238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606704+0000","last_change":"2024-09-12T17:05:47.529868+0000","last_active":"2024-09-12T17:05:58.606704+0000","last_peered":"2024-09-12T17:05:58.606704+0000","last_clean":"2024-09-12T17:05:58.606704+0000","last_became_active":"2024-09-12T17:05:47.529083+0000","last_became_peered":"2024-09-12T17:05:47.529083+0000","last_unstale":"2024-09-12T17:05:58.606704+0000","last_undegraded":"2024-09-12T17:05:58.606704+0000","last_fullsized":"2024-09-12T17:05:58.606704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:16.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619058+0000","last_change":"2024-09-12T17:05:49.548084+0000","last_active":"2024-09-12T17:05:58.619058+0000","last_peered":"2024-09-12T17:05:58.619058+0000","last_clean":"2024-09-12T17:05:58.619058+0000","last_became_active":"2024-09-12T17:05:49.539930+0000","last_became_peered":"2024-09-12T17:05:49.539930+0000","last_unstale":"2024-09-12T17:05:58.619058+0000","last_undegraded":"2024-09-12T17:05:58.619058+0000","last_fullsized":"2024-09-12T17:05:58.619058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:11.453390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.581656+0000","last_change":"2024-09-12T17:05:47.548316+0000","last_active":"2024-09-12T17:05:58.581656+0000","last_peered":"2024-09-12T17:05:58.581656+0000","last_clean":"2024-09-12T17:05:58.581656+0000","last_became_active":"2024-09-12T17:05:47.547430+0000","last_became_peered":"2024-09-12T17:05:47.547430+0000","last_unstale":"2024-09-12T17:05:58.581656+0000","last_undegraded":"2024-09-12T17:05:58.581656+0000","last_fullsized":"2024-09-12T17:05:58.581656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:21.143073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619216+0000","last_change":"2024-09-12T17:05:49.556144+0000","last_active":"2024-09-12T17:05:58.619216+0000","last_peered":"2024-09-12T17:05:58.619216+0000","last_clean":"2024-09-12T17:05:58.619216+0000","last_became_active":"2024-09-12T17:05:49.555033+0000","last_became_peered":"2024-09-12T17:05:49.555033+0000","last_unstale":"2024-09-12T17:05:58.619216+0000","last_undegraded":"2024-09-12T17:05:58.619216+0000","last_fullsized":"2024-09-12T17:05:58.619216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:08.056726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.598033+0000","last_change":"2024-09-12T17:05:47.511375+0000","last_active":"2024-09-12T17:05:58.598033+0000","last_peered":"2024-09-12T17:05:58.598033+0000","last_clean":"2024-09-12T17:05:58.598033+0000","last_became_active":"2024-09-12T17:05:47.510364+0000","last_became_peered":"2024-09-12T17:05:47.510364+0000","last_unstale":"2024-09-12T17:05:58.598033+0000","last_undegraded":"2024-09-12T17:05:58.598033+0000","last_fullsized":"2024-09-12T17:05:58.598033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578941+0000","last_change":"2024-09-12T17:05:49.549815+0000","last_active":"2024-09-12T17:05:58.578941+0000","last_peered":"2024-09-12T17:05:58.578941+0000","last_clean":"2024-09-12T17:05:58.578941+0000","last_became_active":"2024-09-12T17:05:49.547552+0000","last_became_peered":"2024-09-12T17:05:49.547552+0000","last_unstale":"2024-09-12T17:05:58.578941+0000","last_undegraded":"2024-09-12T17:05:58.578941+0000","last_fullsized":"2024-09-12T17:05:58.578941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:03.006310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590744+0000","last_change":"2024-09-12T17:05:47.517789+0000","last_active":"2024-09-12T17:05:58.590744+0000","last_peered":"2024-09-12T17:05:58.590744+0000","last_clean":"2024-09-12T17:05:58.590744+0000","last_became_active":"2024-09-12T17:05:47.517372+0000","last_became_peered":"2024-09-12T17:05:47.517372+0000","last_unstale":"2024-09-12T17:05:58.590744+0000","last_undegraded":"2024-09-12T17:05:58.590744+0000","last_fullsized":"2024-09-12T17:05:58.590744+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:37.072896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576259+0000","last_change":"2024-09-12T17:05:57.588515+0000","last_active":"2024-09-12T17:05:58.576259+0000","last_peered":"2024-09-12T17:05:58.576259+0000","last_clean":"2024-09-12T17:05:58.576259+0000","last_became_active":"2024-09-12T17:05:57.587891+0000","last_became_peered":"2024-09-12T17:05:57.587891+0000","last_unstale":"2024-09-12T17:05:58.576259+0000","last_undegraded":"2024-09-12T17:05:58.576259+0000","last_fullsized":"2024-09-12T17:05:58.576259+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:24.257847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600170+0000","last_change":"2024-09-12T17:05:49.543673+0000","last_active":"2024-09-12T17:05:58.600170+0000","last_peered":"2024-09-12T17:05:58.600170+0000","last_clean":"2024-09-12T17:05:58.600170+0000","last_became_active":"2024-09-12T17:05:49.543386+0000","last_became_peered":"2024-09-12T17:05:49.543386+0000","last_unstale":"2024-09-12T17:05:58.600170+0000","last_undegraded":"2024-09-12T17:05:58.600170+0000","last_fullsized":"2024-09-12T17:05:58.600170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:07.814856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579826+0000","last_change":"2024-09-12T17:05:47.557687+0000","last_active":"2024-09-12T17:05:58.579826+0000","last_peered":"2024-09-12T17:05:58.579826+0000","last_clean":"2024-09-12T17:05:58.579826+0000","last_became_active":"2024-09-12T17:05:47.556980+0000","last_became_peered":"2024-09-12T17:05:47.556980+0000","last_unstale":"2024-09-12T17:05:58.579826+0000","last_undegraded":"2024-09-12T17:05:58.579826+0000","last_fullsized":"2024-09-12T17:05:58.579826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.891909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589081+0000","last_change":"2024-09-12T17:05:51.553342+0000","last_active":"2024-09-12T17:05:58.589081+0000","last_peered":"2024-09-12T17:05:58.589081+0000","last_clean":"2024-09-12T17:05:58.589081+0000","last_became_active":"2024-09-12T17:05:51.552607+0000","last_became_peered":"2024-09-12T17:05:51.552607+0000","last_unstale":"2024-09-12T17:05:58.589081+0000","last_undegraded":"2024-09-12T17:05:58.589081+0000","last_fullsized":"2024-09-12T17:05:58.589081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:25.188530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.958558+0000","last_change":"2024-09-12T17:05:53.537592+0000","last_active":"2024-09-12T17:05:58.958558+0000","last_peered":"2024-09-12T17:05:58.958558+0000","last_clean":"2024-09-12T17:05:58.958558+0000","last_became_active":"2024-09-12T17:05:53.536921+0000","last_became_peered":"2024-09-12T17:05:53.536921+0000","last_unstale":"2024-09-12T17:05:58.958558+0000","last_undegraded":"2024-09-12T17:05:58.958558+0000","last_fullsized":"2024-09-12T17:05:58.958558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:25.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579551+0000","last_change":"2024-09-12T17:05:55.559431+0000","last_active":"2024-09-12T17:05:58.579551+0000","last_peered":"2024-09-12T17:05:58.579551+0000","last_clean":"2024-09-12T17:05:58.579551+0000","last_became_active":"2024-09-12T17:05:55.558297+0000","last_became_peered":"2024-09-12T17:05:55.558297+0000","last_unstale":"2024-09-12T17:05:58.579551+0000","last_undegraded":"2024-09-12T17:05:58.579551+0000","last_fullsized":"2024-09-12T17:05:58.579551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587247+0000","last_change":"2024-09-12T17:05:57.592599+0000","last_active":"2024-09-12T17:05:58.587247+0000","last_peered":"2024-09-12T17:05:58.587247+0000","last_clean":"2024-09-12T17:05:58.587247+0000","last_became_active":"2024-09-12T17:05:57.591877+0000","last_became_peered":"2024-09-12T17:05:57.591877+0000","last_unstale":"2024-09-12T17:05:58.587247+0000","last_undegraded":"2024-09-12T17:05:58.587247+0000","last_fullsized":"2024-09-12T17:05:58.587247+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:57.557525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589578+0000","last_change":"2024-09-12T17:05:49.546093+0000","last_active":"2024-09-12T17:05:58.589578+0000","last_peered":"2024-09-12T17:05:58.589578+0000","last_clean":"2024-09-12T17:05:58.589578+0000","last_became_active":"2024-09-12T17:05:49.544425+0000","last_became_peered":"2024-09-12T17:05:49.544425+0000","last_unstale":"2024-09-12T17:05:58.589578+0000","last_undegraded":"2024-09-12T17:05:58.589578+0000","last_fullsized":"2024-09-12T17:05:58.589578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.495950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590886+0000","last_change":"2024-09-12T17:05:47.535295+0000","last_active":"2024-09-12T17:05:58.590886+0000","last_peered":"2024-09-12T17:05:58.590886+0000","last_clean":"2024-09-12T17:05:58.590886+0000","last_became_active":"2024-09-12T17:05:47.534833+0000","last_became_peered":"2024-09-12T17:05:47.534833+0000","last_unstale":"2024-09-12T17:05:58.590886+0000","last_undegraded":"2024-09-12T17:05:58.590886+0000","last_fullsized":"2024-09-12T17:05:58.590886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.599852+0000","last_change":"2024-09-12T17:05:51.533888+0000","last_active":"2024-09-12T17:05:58.599852+0000","last_peered":"2024-09-12T17:05:58.599852+0000","last_clean":"2024-09-12T17:05:58.599852+0000","last_became_active":"2024-09-12T17:05:51.533164+0000","last_became_peered":"2024-09-12T17:05:51.533164+0000","last_unstale":"2024-09-12T17:05:58.599852+0000","last_undegraded":"2024-09-12T17:05:58.599852+0000","last_fullsized":"2024-09-12T17:05:58.599852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:33.007858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.375198+0000","last_change":"2024-09-12T17:05:53.549534+0000","last_active":"2024-09-12T17:05:59.375198+0000","last_peered":"2024-09-12T17:05:59.375198+0000","last_clean":"2024-09-12T17:05:59.375198+0000","last_became_active":"2024-09-12T17:05:53.548824+0000","last_became_peered":"2024-09-12T17:05:53.548824+0000","last_unstale":"2024-09-12T17:05:59.375198+0000","last_undegraded":"2024-09-12T17:05:59.375198+0000","last_fullsized":"2024-09-12T17:05:59.375198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.765832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577932+0000","last_change":"2024-09-12T17:05:55.557468+0000","last_active":"2024-09-12T17:05:58.577932+0000","last_peered":"2024-09-12T17:05:58.577932+0000","last_clean":"2024-09-12T17:05:58.577932+0000","last_became_active":"2024-09-12T17:05:55.556689+0000","last_became_peered":"2024-09-12T17:05:55.556689+0000","last_unstale":"2024-09-12T17:05:58.577932+0000","last_undegraded":"2024-09-12T17:05:58.577932+0000","last_fullsized":"2024-09-12T17:05:58.577932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:56.879576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590173+0000","last_change":"2024-09-12T17:05:57.589569+0000","last_active":"2024-09-12T17:05:58.590173+0000","last_peered":"2024-09-12T17:05:58.590173+0000","last_clean":"2024-09-12T17:05:58.590173+0000","last_became_active":"2024-09-12T17:05:57.588649+0000","last_became_peered":"2024-09-12T17:05:57.588649+0000","last_unstale":"2024-09-12T17:05:58.590173+0000","last_undegraded":"2024-09-12T17:05:58.590173+0000","last_fullsized":"2024-09-12T17:05:58.590173+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592898+0000","last_change":"2024-09-12T17:05:49.531436+0000","last_active":"2024-09-12T17:05:58.592898+0000","last_peered":"2024-09-12T17:05:58.592898+0000","last_clean":"2024-09-12T17:05:58.592898+0000","last_became_active":"2024-09-12T17:05:49.530687+0000","last_became_peered":"2024-09-12T17:05:49.530687+0000","last_unstale":"2024-09-12T17:05:58.592898+0000","last_undegraded":"2024-09-12T17:05:58.592898+0000","last_fullsized":"2024-09-12T17:05:58.592898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577788+0000","last_change":"2024-09-12T17:05:47.564709+0000","last_active":"2024-09-12T17:05:58.577788+0000","last_peered":"2024-09-12T17:05:58.577788+0000","last_clean":"2024-09-12T17:05:58.577788+0000","last_became_active":"2024-09-12T17:05:47.564189+0000","last_became_peered":"2024-09-12T17:05:47.564189+0000","last_unstale":"2024-09-12T17:05:58.577788+0000","last_undegraded":"2024-09-12T17:05:58.577788+0000","last_fullsized":"2024-09-12T17:05:58.577788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.602087+0000","last_change":"2024-09-12T17:05:51.530947+0000","last_active":"2024-09-12T17:05:58.602087+0000","last_peered":"2024-09-12T17:05:58.602087+0000","last_clean":"2024-09-12T17:05:58.602087+0000","last_became_active":"2024-09-12T17:05:51.530150+0000","last_became_peered":"2024-09-12T17:05:51.530150+0000","last_unstale":"2024-09-12T17:05:58.602087+0000","last_undegraded":"2024-09-12T17:05:58.602087+0000","last_fullsized":"2024-09-12T17:05:58.602087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:52.139381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.427181+0000","last_change":"2024-09-12T17:05:53.549328+0000","last_active":"2024-09-12T17:05:59.427181+0000","last_peered":"2024-09-12T17:05:59.427181+0000","last_clean":"2024-09-12T17:05:59.427181+0000","last_became_active":"2024-09-12T17:05:53.548968+0000","last_became_peered":"2024-09-12T17:05:53.548968+0000","last_unstale":"2024-09-12T17:05:59.427181+0000","last_undegraded":"2024-09-12T17:05:59.427181+0000","last_fullsized":"2024-09-12T17:05:59.427181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:36.974950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.581500+0000","last_change":"2024-09-12T17:05:55.563556+0000","last_active":"2024-09-12T17:05:58.581500+0000","last_peered":"2024-09-12T17:05:58.581500+0000","last_clean":"2024-09-12T17:05:58.581500+0000","last_became_active":"2024-09-12T17:05:55.562522+0000","last_became_peered":"2024-09-12T17:05:55.562522+0000","last_unstale":"2024-09-12T17:05:58.581500+0000","last_undegraded":"2024-09-12T17:05:58.581500+0000","last_fullsized":"2024-09-12T17:05:58.581500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576759+0000","last_change":"2024-09-12T17:05:58.122522+0000","last_active":"2024-09-12T17:05:58.576759+0000","last_peered":"2024-09-12T17:05:58.576759+0000","last_clean":"2024-09-12T17:05:58.576759+0000","last_became_active":"2024-09-12T17:05:58.121871+0000","last_became_peered":"2024-09-12T17:05:58.121871+0000","last_unstale":"2024-09-12T17:05:58.576759+0000","last_undegraded":"2024-09-12T17:05:58.576759+0000","last_fullsized":"2024-09-12T17:05:58.576759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:22.625236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600673+0000","last_change":"2024-09-12T17:05:49.528766+0000","last_active":"2024-09-12T17:05:58.600673+0000","last_peered":"2024-09-12T17:05:58.600673+0000","last_clean":"2024-09-12T17:05:58.600673+0000","last_became_active":"2024-09-12T17:05:49.527758+0000","last_became_peered":"2024-09-12T17:05:49.527758+0000","last_unstale":"2024-09-12T17:05:58.600673+0000","last_undegraded":"2024-09-12T17:05:58.600673+0000","last_fullsized":"2024-09-12T17:05:58.600673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:06.399711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605007+0000","last_change":"2024-09-12T17:05:47.521727+0000","last_active":"2024-09-12T17:05:58.605007+0000","last_peered":"2024-09-12T17:05:58.605007+0000","last_clean":"2024-09-12T17:05:58.605007+0000","last_became_active":"2024-09-12T17:05:47.520943+0000","last_became_peered":"2024-09-12T17:05:47.520943+0000","last_unstale":"2024-09-12T17:05:58.605007+0000","last_undegraded":"2024-09-12T17:05:58.605007+0000","last_fullsized":"2024-09-12T17:05:58.605007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:24.772296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"29'1","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590508+0000","last_change":"2024-09-12T17:05:51.556202+0000","last_active":"2024-09-12T17:05:58.590508+0000","last_peered":"2024-09-12T17:05:58.590508+0000","last_clean":"2024-09-12T17:05:58.590508+0000","last_became_active":"2024-09-12T17:05:51.555420+0000","last_became_peered":"2024-09-12T17:05:51.555420+0000","last_unstale":"2024-09-12T17:05:58.590508+0000","last_undegraded":"2024-09-12T17:05:58.590508+0000","last_fullsized":"2024-09-12T17:05:58.590508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:56.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.436036+0000","last_change":"2024-09-12T17:05:53.554159+0000","last_active":"2024-09-12T17:05:59.436036+0000","last_peered":"2024-09-12T17:05:59.436036+0000","last_clean":"2024-09-12T17:05:59.436036+0000","last_became_active":"2024-09-12T17:05:53.553333+0000","last_became_peered":"2024-09-12T17:05:53.553333+0000","last_unstale":"2024-09-12T17:05:59.436036+0000","last_undegraded":"2024-09-12T17:05:59.436036+0000","last_fullsized":"2024-09-12T17:05:59.436036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:53.266475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596430+0000","last_change":"2024-09-12T17:05:55.556502+0000","last_active":"2024-09-12T17:05:58.596430+0000","last_peered":"2024-09-12T17:05:58.596430+0000","last_clean":"2024-09-12T17:05:58.596430+0000","last_became_active":"2024-09-12T17:05:55.555879+0000","last_became_peered":"2024-09-12T17:05:55.555879+0000","last_unstale":"2024-09-12T17:05:58.596430+0000","last_undegraded":"2024-09-12T17:05:58.596430+0000","last_fullsized":"2024-09-12T17:05:58.596430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:18.672296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587824+0000","last_change":"2024-09-12T17:05:49.553404+0000","last_active":"2024-09-12T17:05:58.587824+0000","last_peered":"2024-09-12T17:05:58.587824+0000","last_clean":"2024-09-12T17:05:58.587824+0000","last_became_active":"2024-09-12T17:05:49.552637+0000","last_became_peered":"2024-09-12T17:05:49.552637+0000","last_unstale":"2024-09-12T17:05:58.587824+0000","last_undegraded":"2024-09-12T17:05:58.587824+0000","last_fullsized":"2024-09-12T17:05:58.587824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580409+0000","last_change":"2024-09-12T17:05:47.562949+0000","last_active":"2024-09-12T17:05:58.580409+0000","last_peered":"2024-09-12T17:05:58.580409+0000","last_clean":"2024-09-12T17:05:58.580409+0000","last_became_active":"2024-09-12T17:05:47.562465+0000","last_became_peered":"2024-09-12T17:05:47.562465+0000","last_unstale":"2024-09-12T17:05:58.580409+0000","last_undegraded":"2024-09-12T17:05:58.580409+0000","last_fullsized":"2024-09-12T17:05:58.580409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576552+0000","last_change":"2024-09-12T17:05:51.542349+0000","last_active":"2024-09-12T17:05:58.576552+0000","last_peered":"2024-09-12T17:05:58.576552+0000","last_clean":"2024-09-12T17:05:58.576552+0000","last_became_active":"2024-09-12T17:05:51.541205+0000","last_became_peered":"2024-09-12T17:05:51.541205+0000","last_unstale":"2024-09-12T17:05:58.576552+0000","last_undegraded":"2024-09-12T17:05:58.576552+0000","last_fullsized":"2024-09-12T17:05:58.576552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"36'19","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.535281+0000","last_change":"2024-09-12T17:05:53.560400+0000","last_active":"2024-09-12T17:05:59.535281+0000","last_peered":"2024-09-12T17:05:59.535281+0000","last_clean":"2024-09-12T17:05:59.535281+0000","last_became_active":"2024-09-12T17:05:53.559463+0000","last_became_peered":"2024-09-12T17:05:53.559463+0000","last_unstale":"2024-09-12T17:05:59.535281+0000","last_undegraded":"2024-09-12T17:05:59.535281+0000","last_fullsized":"2024-09-12T17:05:59.535281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.574257+0000","last_change":"2024-09-12T17:05:55.569650+0000","last_active":"2024-09-12T17:05:58.574257+0000","last_peered":"2024-09-12T17:05:58.574257+0000","last_clean":"2024-09-12T17:05:58.574257+0000","last_became_active":"2024-09-12T17:05:55.568803+0000","last_became_peered":"2024-09-12T17:05:55.568803+0000","last_unstale":"2024-09-12T17:05:58.574257+0000","last_undegraded":"2024-09-12T17:05:58.574257+0000","last_fullsized":"2024-09-12T17:05:58.574257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:14.627182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588256+0000","last_change":"2024-09-12T17:05:57.599403+0000","last_active":"2024-09-12T17:05:58.588256+0000","last_peered":"2024-09-12T17:05:58.588256+0000","last_clean":"2024-09-12T17:05:58.588256+0000","last_became_active":"2024-09-12T17:05:57.598703+0000","last_became_peered":"2024-09-12T17:05:57.598703+0000","last_unstale":"2024-09-12T17:05:58.588256+0000","last_undegraded":"2024-09-12T17:05:58.588256+0000","last_fullsized":"2024-09-12T17:05:58.588256+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578340+0000","last_change":"2024-09-12T17:05:49.546046+0000","last_active":"2024-09-12T17:05:58.578340+0000","last_peered":"2024-09-12T17:05:58.578340+0000","last_clean":"2024-09-12T17:05:58.578340+0000","last_became_active":"2024-09-12T17:05:49.545351+0000","last_became_peered":"2024-09-12T17:05:49.545351+0000","last_unstale":"2024-09-12T17:05:58.578340+0000","last_undegraded":"2024-09-12T17:05:58.578340+0000","last_fullsized":"2024-09-12T17:05:58.578340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:27.007541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580665+0000","last_change":"2024-09-12T17:05:47.563411+0000","last_active":"2024-09-12T17:05:58.580665+0000","last_peered":"2024-09-12T17:05:58.580665+0000","last_clean":"2024-09-12T17:05:58.580665+0000","last_became_active":"2024-09-12T17:05:47.562812+0000","last_became_peered":"2024-09-12T17:05:47.562812+0000","last_unstale":"2024-09-12T17:05:58.580665+0000","last_undegraded":"2024-09-12T17:05:58.580665+0000","last_fullsized":"2024-09-12T17:05:58.580665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:57.659986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.618342+0000","last_change":"2024-09-12T17:05:51.548944+0000","last_active":"2024-09-12T17:05:58.618342+0000","last_peered":"2024-09-12T17:05:58.618342+0000","last_clean":"2024-09-12T17:05:58.618342+0000","last_became_active":"2024-09-12T17:05:51.544649+0000","last_became_peered":"2024-09-12T17:05:51.544649+0000","last_unstale":"2024-09-12T17:05:58.618342+0000","last_undegraded":"2024-09-12T17:05:58.618342+0000","last_fullsized":"2024-09-12T17:05:58.618342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:01.468390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.406299+0000","last_change":"2024-09-12T17:05:53.552838+0000","last_active":"2024-09-12T17:05:59.406299+0000","last_peered":"2024-09-12T17:05:59.406299+0000","last_clean":"2024-09-12T17:05:59.406299+0000","last_became_active":"2024-09-12T17:05:53.550042+0000","last_became_peered":"2024-09-12T17:05:53.550042+0000","last_unstale":"2024-09-12T17:05:59.406299+0000","last_undegraded":"2024-09-12T17:05:59.406299+0000","last_fullsized":"2024-09-12T17:05:59.406299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596031+0000","last_change":"2024-09-12T17:05:55.558761+0000","last_active":"2024-09-12T17:05:58.596031+0000","last_peered":"2024-09-12T17:05:58.596031+0000","last_clean":"2024-09-12T17:05:58.596031+0000","last_became_active":"2024-09-12T17:05:55.557930+0000","last_became_peered":"2024-09-12T17:05:55.557930+0000","last_unstale":"2024-09-12T17:05:58.596031+0000","last_undegraded":"2024-09-12T17:05:58.596031+0000","last_fullsized":"2024-09-12T17:05:58.596031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.015675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605860+0000","last_change":"2024-09-12T17:05:57.592611+0000","last_active":"2024-09-12T17:05:58.605860+0000","last_peered":"2024-09-12T17:05:58.605860+0000","last_clean":"2024-09-12T17:05:58.605860+0000","last_became_active":"2024-09-12T17:05:57.591855+0000","last_became_peered":"2024-09-12T17:05:57.591855+0000","last_unstale":"2024-09-12T17:05:58.605860+0000","last_undegraded":"2024-09-12T17:05:58.605860+0000","last_fullsized":"2024-09-12T17:05:58.605860+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:02.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605807+0000","last_change":"2024-09-12T17:05:49.546691+0000","last_active":"2024-09-12T17:05:58.605807+0000","last_peered":"2024-09-12T17:05:58.605807+0000","last_clean":"2024-09-12T17:05:58.605807+0000","last_became_active":"2024-09-12T17:05:49.545891+0000","last_became_peered":"2024-09-12T17:05:49.545891+0000","last_unstale":"2024-09-12T17:05:58.605807+0000","last_undegraded":"2024-09-12T17:05:58.605807+0000","last_fullsized":"2024-09-12T17:05:58.605807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:06.273531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582876+0000","last_change":"2024-09-12T17:05:47.562243+0000","last_active":"2024-09-12T17:05:58.582876+0000","last_peered":"2024-09-12T17:05:58.582876+0000","last_clean":"2024-09-12T17:05:58.582876+0000","last_became_active":"2024-09-12T17:05:47.561587+0000","last_became_peered":"2024-09-12T17:05:47.561587+0000","last_unstale":"2024-09-12T17:05:58.582876+0000","last_undegraded":"2024-09-12T17:05:58.582876+0000","last_fullsized":"2024-09-12T17:05:58.582876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"29'1","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619413+0000","last_change":"2024-09-12T17:05:51.542843+0000","last_active":"2024-09-12T17:05:58.619413+0000","last_peered":"2024-09-12T17:05:58.619413+0000","last_clean":"2024-09-12T17:05:58.619413+0000","last_became_active":"2024-09-12T17:05:51.542457+0000","last_became_peered":"2024-09-12T17:05:51.542457+0000","last_unstale":"2024-09-12T17:05:58.619413+0000","last_undegraded":"2024-09-12T17:05:58.619413+0000","last_fullsized":"2024-09-12T17:05:58.619413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.837373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.322398+0000","last_change":"2024-09-12T17:05:53.548729+0000","last_active":"2024-09-12T17:05:59.322398+0000","last_peered":"2024-09-12T17:05:59.322398+0000","last_clean":"2024-09-12T17:05:59.322398+0000","last_became_active":"2024-09-12T17:05:53.547990+0000","last_became_peered":"2024-09-12T17:05:53.547990+0000","last_unstale":"2024-09-12T17:05:59.322398+0000","last_undegraded":"2024-09-12T17:05:59.322398+0000","last_fullsized":"2024-09-12T17:05:59.322398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:22.845485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589686+0000","last_change":"2024-09-12T17:05:55.570504+0000","last_active":"2024-09-12T17:05:58.589686+0000","last_peered":"2024-09-12T17:05:58.589686+0000","last_clean":"2024-09-12T17:05:58.589686+0000","last_became_active":"2024-09-12T17:05:55.569625+0000","last_became_peered":"2024-09-12T17:05:55.569625+0000","last_unstale":"2024-09-12T17:05:58.589686+0000","last_undegraded":"2024-09-12T17:05:58.589686+0000","last_fullsized":"2024-09-12T17:05:58.589686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:33.836953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591971+0000","last_change":"2024-09-12T17:05:57.596229+0000","last_active":"2024-09-12T17:05:58.591971+0000","last_peered":"2024-09-12T17:05:58.591971+0000","last_clean":"2024-09-12T17:05:58.591971+0000","last_became_active":"2024-09-12T17:05:57.595658+0000","last_became_peered":"2024-09-12T17:05:57.595658+0000","last_unstale":"2024-09-12T17:05:58.591971+0000","last_undegraded":"2024-09-12T17:05:58.591971+0000","last_fullsized":"2024-09-12T17:05:58.591971+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.644627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592424+0000","last_change":"2024-09-12T17:05:49.549111+0000","last_active":"2024-09-12T17:05:58.592424+0000","last_peered":"2024-09-12T17:05:58.592424+0000","last_clean":"2024-09-12T17:05:58.592424+0000","last_became_active":"2024-09-12T17:05:49.547419+0000","last_became_peered":"2024-09-12T17:05:49.547419+0000","last_unstale":"2024-09-12T17:05:58.592424+0000","last_undegraded":"2024-09-12T17:05:58.592424+0000","last_fullsized":"2024-09-12T17:05:58.592424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:34.475371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589139+0000","last_change":"2024-09-12T17:05:47.535946+0000","last_active":"2024-09-12T17:05:58.589139+0000","last_peered":"2024-09-12T17:05:58.589139+0000","last_clean":"2024-09-12T17:05:58.589139+0000","last_became_active":"2024-09-12T17:05:47.534607+0000","last_became_peered":"2024-09-12T17:05:47.534607+0000","last_unstale":"2024-09-12T17:05:58.589139+0000","last_undegraded":"2024-09-12T17:05:58.589139+0000","last_fullsized":"2024-09-12T17:05:58.589139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.618571+0000","last_change":"2024-09-12T17:05:51.548391+0000","last_active":"2024-09-12T17:05:58.618571+0000","last_peered":"2024-09-12T17:05:58.618571+0000","last_clean":"2024-09-12T17:05:58.618571+0000","last_became_active":"2024-09-12T17:05:51.547939+0000","last_became_peered":"2024-09-12T17:05:51.547939+0000","last_unstale":"2024-09-12T17:05:58.618571+0000","last_undegraded":"2024-09-12T17:05:58.618571+0000","last_fullsized":"2024-09-12T17:05:58.618571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:08.848247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'12","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.922278+0000","last_change":"2024-09-12T17:05:53.535756+0000","last_active":"2024-09-12T17:05:58.922278+0000","last_peered":"2024-09-12T17:05:58.922278+0000","last_clean":"2024-09-12T17:05:58.922278+0000","last_became_active":"2024-09-12T17:05:53.535062+0000","last_became_peered":"2024-09-12T17:05:53.535062+0000","last_unstale":"2024-09-12T17:05:58.922278+0000","last_undegraded":"2024-09-12T17:05:58.922278+0000","last_fullsized":"2024-09-12T17:05:58.922278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.618174+0000","last_change":"2024-09-12T17:05:55.564010+0000","last_active":"2024-09-12T17:05:58.618174+0000","last_peered":"2024-09-12T17:05:58.618174+0000","last_clean":"2024-09-12T17:05:58.618174+0000","last_became_active":"2024-09-12T17:05:55.563125+0000","last_became_peered":"2024-09-12T17:05:55.563125+0000","last_unstale":"2024-09-12T17:05:58.618174+0000","last_undegraded":"2024-09-12T17:05:58.618174+0000","last_fullsized":"2024-09-12T17:05:58.618174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:00.697571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575778+0000","last_change":"2024-09-12T17:05:57.584686+0000","last_active":"2024-09-12T17:05:58.575778+0000","last_peered":"2024-09-12T17:05:58.575778+0000","last_clean":"2024-09-12T17:05:58.575778+0000","last_became_active":"2024-09-12T17:05:57.583946+0000","last_became_peered":"2024-09-12T17:05:57.583946+0000","last_unstale":"2024-09-12T17:05:58.575778+0000","last_undegraded":"2024-09-12T17:05:58.575778+0000","last_fullsized":"2024-09-12T17:05:58.575778+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:50.487184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582126+0000","last_change":"2024-09-12T17:05:49.544092+0000","last_active":"2024-09-12T17:05:58.582126+0000","last_peered":"2024-09-12T17:05:58.582126+0000","last_clean":"2024-09-12T17:05:58.582126+0000","last_became_active":"2024-09-12T17:05:49.543307+0000","last_became_peered":"2024-09-12T17:05:49.543307+0000","last_unstale":"2024-09-12T17:05:58.582126+0000","last_undegraded":"2024-09-12T17:05:58.582126+0000","last_fullsized":"2024-09-12T17:05:58.582126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:36.286410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.597749+0000","last_change":"2024-09-12T17:05:47.526678+0000","last_active":"2024-09-12T17:05:58.597749+0000","last_peered":"2024-09-12T17:05:58.597749+0000","last_clean":"2024-09-12T17:05:58.597749+0000","last_became_active":"2024-09-12T17:05:47.525696+0000","last_became_peered":"2024-09-12T17:05:47.525696+0000","last_unstale":"2024-09-12T17:05:58.597749+0000","last_undegraded":"2024-09-12T17:05:58.597749+0000","last_fullsized":"2024-09-12T17:05:58.597749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:59.012258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.618998+0000","last_change":"2024-09-12T17:05:51.543404+0000","last_active":"2024-09-12T17:05:58.618998+0000","last_peered":"2024-09-12T17:05:58.618998+0000","last_clean":"2024-09-12T17:05:58.618998+0000","last_became_active":"2024-09-12T17:05:51.542737+0000","last_became_peered":"2024-09-12T17:05:51.542737+0000","last_unstale":"2024-09-12T17:05:58.618998+0000","last_undegraded":"2024-09-12T17:05:58.618998+0000","last_fullsized":"2024-09-12T17:05:58.618998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:30.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'11","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.472758+0000","last_change":"2024-09-12T17:05:53.540955+0000","last_active":"2024-09-12T17:05:59.472758+0000","last_peered":"2024-09-12T17:05:59.472758+0000","last_clean":"2024-09-12T17:05:59.472758+0000","last_became_active":"2024-09-12T17:05:53.540080+0000","last_became_peered":"2024-09-12T17:05:53.540080+0000","last_unstale":"2024-09-12T17:05:59.472758+0000","last_undegraded":"2024-09-12T17:05:59.472758+0000","last_fullsized":"2024-09-12T17:05:59.472758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:56.961597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592082+0000","last_change":"2024-09-12T17:05:55.565575+0000","last_active":"2024-09-12T17:05:58.592082+0000","last_peered":"2024-09-12T17:05:58.592082+0000","last_clean":"2024-09-12T17:05:58.592082+0000","last_became_active":"2024-09-12T17:05:55.564802+0000","last_became_peered":"2024-09-12T17:05:55.564802+0000","last_unstale":"2024-09-12T17:05:58.592082+0000","last_undegraded":"2024-09-12T17:05:58.592082+0000","last_fullsized":"2024-09-12T17:05:58.592082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.595889+0000","last_change":"2024-09-12T17:05:57.592294+0000","last_active":"2024-09-12T17:05:58.595889+0000","last_peered":"2024-09-12T17:05:58.595889+0000","last_clean":"2024-09-12T17:05:58.595889+0000","last_became_active":"2024-09-12T17:05:57.591389+0000","last_became_peered":"2024-09-12T17:05:57.591389+0000","last_unstale":"2024-09-12T17:05:58.595889+0000","last_undegraded":"2024-09-12T17:05:58.595889+0000","last_fullsized":"2024-09-12T17:05:58.595889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579185+0000","last_change":"2024-09-12T17:05:49.553177+0000","last_active":"2024-09-12T17:05:58.579185+0000","last_peered":"2024-09-12T17:05:58.579185+0000","last_clean":"2024-09-12T17:05:58.579185+0000","last_became_active":"2024-09-12T17:05:49.552270+0000","last_became_peered":"2024-09-12T17:05:49.552270+0000","last_unstale":"2024-09-12T17:05:58.579185+0000","last_undegraded":"2024-09-12T17:05:58.579185+0000","last_fullsized":"2024-09-12T17:05:58.579185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:34.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606115+0000","last_change":"2024-09-12T17:05:47.543064+0000","last_active":"2024-09-12T17:05:58.606115+0000","last_peered":"2024-09-12T17:05:58.606115+0000","last_clean":"2024-09-12T17:05:58.606115+0000","last_became_active":"2024-09-12T17:05:47.542362+0000","last_became_peered":"2024-09-12T17:05:47.542362+0000","last_unstale":"2024-09-12T17:05:58.606115+0000","last_undegraded":"2024-09-12T17:05:58.606115+0000","last_fullsized":"2024-09-12T17:05:58.606115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.574724+0000","last_change":"2024-09-12T17:05:51.540826+0000","last_active":"2024-09-12T17:05:58.574724+0000","last_peered":"2024-09-12T17:05:58.574724+0000","last_clean":"2024-09-12T17:05:58.574724+0000","last_became_active":"2024-09-12T17:05:51.540460+0000","last_became_peered":"2024-09-12T17:05:51.540460+0000","last_unstale":"2024-09-12T17:05:58.574724+0000","last_undegraded":"2024-09-12T17:05:58.574724+0000","last_fullsized":"2024-09-12T17:05:58.574724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:26.672318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.540514+0000","last_change":"2024-09-12T17:05:53.554531+0000","last_active":"2024-09-12T17:05:59.540514+0000","last_peered":"2024-09-12T17:05:59.540514+0000","last_clean":"2024-09-12T17:05:59.540514+0000","last_became_active":"2024-09-12T17:05:53.554131+0000","last_became_peered":"2024-09-12T17:05:53.554131+0000","last_unstale":"2024-09-12T17:05:59.540514+0000","last_undegraded":"2024-09-12T17:05:59.540514+0000","last_fullsized":"2024-09-12T17:05:59.540514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619386+0000","last_change":"2024-09-12T17:05:55.559204+0000","last_active":"2024-09-12T17:05:58.619386+0000","last_peered":"2024-09-12T17:05:58.619386+0000","last_clean":"2024-09-12T17:05:58.619386+0000","last_became_active":"2024-09-12T17:05:55.556488+0000","last_became_peered":"2024-09-12T17:05:55.556488+0000","last_unstale":"2024-09-12T17:05:58.619386+0000","last_undegraded":"2024-09-12T17:05:58.619386+0000","last_fullsized":"2024-09-12T17:05:58.619386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:15.167640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.573599+0000","last_change":"2024-09-12T17:05:57.584586+0000","last_active":"2024-09-12T17:05:58.573599+0000","last_peered":"2024-09-12T17:05:58.573599+0000","last_clean":"2024-09-12T17:05:58.573599+0000","last_became_active":"2024-09-12T17:05:57.583783+0000","last_became_peered":"2024-09-12T17:05:57.583783+0000","last_unstale":"2024-09-12T17:05:58.573599+0000","last_undegraded":"2024-09-12T17:05:58.573599+0000","last_fullsized":"2024-09-12T17:05:58.573599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:00.992588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580679+0000","last_change":"2024-09-12T17:05:49.562360+0000","last_active":"2024-09-12T17:05:58.580679+0000","last_peered":"2024-09-12T17:05:58.580679+0000","last_clean":"2024-09-12T17:05:58.580679+0000","last_became_active":"2024-09-12T17:05:49.561200+0000","last_became_peered":"2024-09-12T17:05:49.561200+0000","last_unstale":"2024-09-12T17:05:58.580679+0000","last_undegraded":"2024-09-12T17:05:58.580679+0000","last_fullsized":"2024-09-12T17:05:58.580679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.915600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579359+0000","last_change":"2024-09-12T17:05:47.542018+0000","last_active":"2024-09-12T17:05:58.579359+0000","last_peered":"2024-09-12T17:05:58.579359+0000","last_clean":"2024-09-12T17:05:58.579359+0000","last_became_active":"2024-09-12T17:05:47.540484+0000","last_became_peered":"2024-09-12T17:05:47.540484+0000","last_unstale":"2024-09-12T17:05:58.579359+0000","last_undegraded":"2024-09-12T17:05:58.579359+0000","last_fullsized":"2024-09-12T17:05:58.579359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:13.571666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589319+0000","last_change":"2024-09-12T17:05:51.556083+0000","last_active":"2024-09-12T17:05:58.589319+0000","last_peered":"2024-09-12T17:05:58.589319+0000","last_clean":"2024-09-12T17:05:58.589319+0000","last_became_active":"2024-09-12T17:05:51.554176+0000","last_became_peered":"2024-09-12T17:05:51.554176+0000","last_unstale":"2024-09-12T17:05:58.589319+0000","last_undegraded":"2024-09-12T17:05:58.589319+0000","last_fullsized":"2024-09-12T17:05:58.589319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:02.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.327773+0000","last_change":"2024-09-12T17:05:53.553304+0000","last_active":"2024-09-12T17:05:59.327773+0000","last_peered":"2024-09-12T17:05:59.327773+0000","last_clean":"2024-09-12T17:05:59.327773+0000","last_became_active":"2024-09-12T17:05:53.552545+0000","last_became_peered":"2024-09-12T17:05:53.552545+0000","last_unstale":"2024-09-12T17:05:59.327773+0000","last_undegraded":"2024-09-12T17:05:59.327773+0000","last_fullsized":"2024-09-12T17:05:59.327773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606168+0000","last_change":"2024-09-12T17:05:55.575189+0000","last_active":"2024-09-12T17:05:58.606168+0000","last_peered":"2024-09-12T17:05:58.606168+0000","last_clean":"2024-09-12T17:05:58.606168+0000","last_became_active":"2024-09-12T17:05:55.574291+0000","last_became_peered":"2024-09-12T17:05:55.574291+0000","last_unstale":"2024-09-12T17:05:58.606168+0000","last_undegraded":"2024-09-12T17:05:58.606168+0000","last_fullsized":"2024-09-12T17:05:58.606168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:46.932586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578428+0000","last_change":"2024-09-12T17:05:57.597870+0000","last_active":"2024-09-12T17:05:58.578428+0000","last_peered":"2024-09-12T17:05:58.578428+0000","last_clean":"2024-09-12T17:05:58.578428+0000","last_became_active":"2024-09-12T17:05:57.597076+0000","last_became_peered":"2024-09-12T17:05:57.597076+0000","last_unstale":"2024-09-12T17:05:58.578428+0000","last_undegraded":"2024-09-12T17:05:58.578428+0000","last_fullsized":"2024-09-12T17:05:58.578428+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.648974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576738+0000","last_change":"2024-09-12T17:05:49.546538+0000","last_active":"2024-09-12T17:05:58.576738+0000","last_peered":"2024-09-12T17:05:58.576738+0000","last_clean":"2024-09-12T17:05:58.576738+0000","last_became_active":"2024-09-12T17:05:49.545785+0000","last_became_peered":"2024-09-12T17:05:49.545785+0000","last_unstale":"2024-09-12T17:05:58.576738+0000","last_undegraded":"2024-09-12T17:05:58.576738+0000","last_fullsized":"2024-09-12T17:05:58.576738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:18.534657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.597058+0000","last_change":"2024-09-12T17:05:47.524007+0000","last_active":"2024-09-12T17:05:58.597058+0000","last_peered":"2024-09-12T17:05:58.597058+0000","last_clean":"2024-09-12T17:05:58.597058+0000","last_became_active":"2024-09-12T17:05:47.522938+0000","last_became_peered":"2024-09-12T17:05:47.522938+0000","last_unstale":"2024-09-12T17:05:58.597058+0000","last_undegraded":"2024-09-12T17:05:58.597058+0000","last_fullsized":"2024-09-12T17:05:58.597058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:25.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580207+0000","last_change":"2024-09-12T17:05:51.540047+0000","last_active":"2024-09-12T17:05:58.580207+0000","last_peered":"2024-09-12T17:05:58.580207+0000","last_clean":"2024-09-12T17:05:58.580207+0000","last_became_active":"2024-09-12T17:05:51.539302+0000","last_became_peered":"2024-09-12T17:05:51.539302+0000","last_unstale":"2024-09-12T17:05:58.580207+0000","last_undegraded":"2024-09-12T17:05:58.580207+0000","last_fullsized":"2024-09-12T17:05:58.580207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:21.253801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"36'17","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.465530+0000","last_change":"2024-09-12T17:05:53.554817+0000","last_active":"2024-09-12T17:05:59.465530+0000","last_peered":"2024-09-12T17:05:59.465530+0000","last_clean":"2024-09-12T17:05:59.465530+0000","last_became_active":"2024-09-12T17:05:53.554069+0000","last_became_peered":"2024-09-12T17:05:53.554069+0000","last_unstale":"2024-09-12T17:05:59.465530+0000","last_undegraded":"2024-09-12T17:05:59.465530+0000","last_fullsized":"2024-09-12T17:05:59.465530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605243+0000","last_change":"2024-09-12T17:05:55.566749+0000","last_active":"2024-09-12T17:05:58.605243+0000","last_peered":"2024-09-12T17:05:58.605243+0000","last_clean":"2024-09-12T17:05:58.605243+0000","last_became_active":"2024-09-12T17:05:55.565979+0000","last_became_peered":"2024-09-12T17:05:55.565979+0000","last_unstale":"2024-09-12T17:05:58.605243+0000","last_undegraded":"2024-09-12T17:05:58.605243+0000","last_fullsized":"2024-09-12T17:05:58.605243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.573778+0000","last_change":"2024-09-12T17:05:57.590758+0000","last_active":"2024-09-12T17:05:58.573778+0000","last_peered":"2024-09-12T17:05:58.573778+0000","last_clean":"2024-09-12T17:05:58.573778+0000","last_became_active":"2024-09-12T17:05:57.589948+0000","last_became_peered":"2024-09-12T17:05:57.589948+0000","last_unstale":"2024-09-12T17:05:58.573778+0000","last_undegraded":"2024-09-12T17:05:58.573778+0000","last_fullsized":"2024-09-12T17:05:58.573778+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:41.423540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606549+0000","last_change":"2024-09-12T17:05:49.539487+0000","last_active":"2024-09-12T17:05:58.606549+0000","last_peered":"2024-09-12T17:05:58.606549+0000","last_clean":"2024-09-12T17:05:58.606549+0000","last_became_active":"2024-09-12T17:05:49.538713+0000","last_became_peered":"2024-09-12T17:05:49.538713+0000","last_unstale":"2024-09-12T17:05:58.606549+0000","last_undegraded":"2024-09-12T17:05:58.606549+0000","last_fullsized":"2024-09-12T17:05:58.606549+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.731614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":139,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576930+0000","last_change":"2024-09-12T17:05:35.688483+0000","last_active":"2024-09-12T17:05:58.576930+0000","last_peered":"2024-09-12T17:05:58.576930+0000","last_clean":"2024-09-12T17:05:58.576930+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:05:58.576930+0000","last_undegraded":"2024-09-12T17:05:58.576930+0000","last_fullsized":"2024-09-12T17:05:58.576930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_clean_scrub_stamp":"2024-09-12T17:05:34.151079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588066+0000","last_change":"2024-09-12T17:05:42.225793+0000","last_active":"2024-09-12T17:05:58.588066+0000","last_peered":"2024-09-12T17:05:58.588066+0000","last_clean":"2024-09-12T17:05:58.588066+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:05:58.588066+0000","last_undegraded":"2024-09-12T17:05:58.588066+0000","last_fullsized":"2024-09-12T17:05:58.588066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:54.880257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596609+0000","last_change":"2024-09-12T17:05:47.526243+0000","last_active":"2024-09-12T17:05:58.596609+0000","last_peered":"2024-09-12T17:05:58.596609+0000","last_clean":"2024-09-12T17:05:58.596609+0000","last_became_active":"2024-09-12T17:05:47.525694+0000","last_became_peered":"2024-09-12T17:05:47.525694+0000","last_unstale":"2024-09-12T17:05:58.596609+0000","last_undegraded":"2024-09-12T17:05:58.596609+0000","last_fullsized":"2024-09-12T17:05:58.596609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579582+0000","last_change":"2024-09-12T17:05:51.548356+0000","last_active":"2024-09-12T17:05:58.579582+0000","last_peered":"2024-09-12T17:05:58.579582+0000","last_clean":"2024-09-12T17:05:58.579582+0000","last_became_active":"2024-09-12T17:05:51.547503+0000","last_became_peered":"2024-09-12T17:05:51.547503+0000","last_unstale":"2024-09-12T17:05:58.579582+0000","last_undegraded":"2024-09-12T17:05:58.579582+0000","last_fullsized":"2024-09-12T17:05:58.579582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:47.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.255093+0000","last_change":"2024-09-12T17:05:53.546057+0000","last_active":"2024-09-12T17:05:59.255093+0000","last_peered":"2024-09-12T17:05:59.255093+0000","last_clean":"2024-09-12T17:05:59.255093+0000","last_became_active":"2024-09-12T17:05:53.545266+0000","last_became_peered":"2024-09-12T17:05:53.545266+0000","last_unstale":"2024-09-12T17:05:59.255093+0000","last_undegraded":"2024-09-12T17:05:59.255093+0000","last_fullsized":"2024-09-12T17:05:59.255093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592046+0000","last_change":"2024-09-12T17:05:55.562246+0000","last_active":"2024-09-12T17:05:58.592046+0000","last_peered":"2024-09-12T17:05:58.592046+0000","last_clean":"2024-09-12T17:05:58.592046+0000","last_became_active":"2024-09-12T17:05:55.561410+0000","last_became_peered":"2024-09-12T17:05:55.561410+0000","last_unstale":"2024-09-12T17:05:58.592046+0000","last_undegraded":"2024-09-12T17:05:58.592046+0000","last_fullsized":"2024-09-12T17:05:58.592046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.373235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.604801+0000","last_change":"2024-09-12T17:05:57.593095+0000","last_active":"2024-09-12T17:05:58.604801+0000","last_peered":"2024-09-12T17:05:58.604801+0000","last_clean":"2024-09-12T17:05:58.604801+0000","last_became_active":"2024-09-12T17:05:57.592287+0000","last_became_peered":"2024-09-12T17:05:57.592287+0000","last_unstale":"2024-09-12T17:05:58.604801+0000","last_undegraded":"2024-09-12T17:05:58.604801+0000","last_fullsized":"2024-09-12T17:05:58.604801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:52.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592601+0000","last_change":"2024-09-12T17:05:49.543737+0000","last_active":"2024-09-12T17:05:58.592601+0000","last_peered":"2024-09-12T17:05:58.592601+0000","last_clean":"2024-09-12T17:05:58.592601+0000","last_became_active":"2024-09-12T17:05:49.542850+0000","last_became_peered":"2024-09-12T17:05:49.542850+0000","last_unstale":"2024-09-12T17:05:58.592601+0000","last_undegraded":"2024-09-12T17:05:58.592601+0000","last_fullsized":"2024-09-12T17:05:58.592601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:31.868549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576690+0000","last_change":"2024-09-12T17:05:42.218859+0000","last_active":"2024-09-12T17:05:58.576690+0000","last_peered":"2024-09-12T17:05:58.576690+0000","last_clean":"2024-09-12T17:05:58.576690+0000","last_became_active":"2024-09-12T17:05:40.212384+0000","last_became_peered":"2024-09-12T17:05:40.212384+0000","last_unstale":"2024-09-12T17:05:58.576690+0000","last_undegraded":"2024-09-12T17:05:58.576690+0000","last_fullsized":"2024-09-12T17:05:58.576690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:29.184124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590051+0000","last_change":"2024-09-12T17:05:47.544269+0000","last_active":"2024-09-12T17:05:58.590051+0000","last_peered":"2024-09-12T17:05:58.590051+0000","last_clean":"2024-09-12T17:05:58.590051+0000","last_became_active":"2024-09-12T17:05:47.543531+0000","last_became_peered":"2024-09-12T17:05:47.543531+0000","last_unstale":"2024-09-12T17:05:58.590051+0000","last_undegraded":"2024-09-12T17:05:58.590051+0000","last_fullsized":"2024-09-12T17:05:58.590051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:55.688363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590225+0000","last_change":"2024-09-12T17:05:51.554000+0000","last_active":"2024-09-12T17:05:58.590225+0000","last_peered":"2024-09-12T17:05:58.590225+0000","last_clean":"2024-09-12T17:05:58.590225+0000","last_became_active":"2024-09-12T17:05:51.553161+0000","last_became_peered":"2024-09-12T17:05:51.553161+0000","last_unstale":"2024-09-12T17:05:58.590225+0000","last_undegraded":"2024-09-12T17:05:58.590225+0000","last_fullsized":"2024-09-12T17:05:58.590225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:10.443453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"36'23","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.452164+0000","last_change":"2024-09-12T17:05:53.558251+0000","last_active":"2024-09-12T17:05:59.452164+0000","last_peered":"2024-09-12T17:05:59.452164+0000","last_clean":"2024-09-12T17:05:59.452164+0000","last_became_active":"2024-09-12T17:05:53.557763+0000","last_became_peered":"2024-09-12T17:05:53.557763+0000","last_unstale":"2024-09-12T17:05:59.452164+0000","last_undegraded":"2024-09-12T17:05:59.452164+0000","last_fullsized":"2024-09-12T17:05:59.452164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:51.661773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.581638+0000","last_change":"2024-09-12T17:05:55.556362+0000","last_active":"2024-09-12T17:05:58.581638+0000","last_peered":"2024-09-12T17:05:58.581638+0000","last_clean":"2024-09-12T17:05:58.581638+0000","last_became_active":"2024-09-12T17:05:55.555625+0000","last_became_peered":"2024-09-12T17:05:55.555625+0000","last_unstale":"2024-09-12T17:05:58.581638+0000","last_undegraded":"2024-09-12T17:05:58.581638+0000","last_fullsized":"2024-09-12T17:05:58.581638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.573860+0000","last_change":"2024-09-12T17:05:58.119224+0000","last_active":"2024-09-12T17:05:58.573860+0000","last_peered":"2024-09-12T17:05:58.573860+0000","last_clean":"2024-09-12T17:05:58.573860+0000","last_became_active":"2024-09-12T17:05:58.118412+0000","last_became_peered":"2024-09-12T17:05:58.118412+0000","last_unstale":"2024-09-12T17:05:58.573860+0000","last_undegraded":"2024-09-12T17:05:58.573860+0000","last_fullsized":"2024-09-12T17:05:58.573860+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.268994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576911+0000","last_change":"2024-09-12T17:05:49.543179+0000","last_active":"2024-09-12T17:05:58.576911+0000","last_peered":"2024-09-12T17:05:58.576911+0000","last_clean":"2024-09-12T17:05:58.576911+0000","last_became_active":"2024-09-12T17:05:49.541277+0000","last_became_peered":"2024-09-12T17:05:49.541277+0000","last_unstale":"2024-09-12T17:05:58.576911+0000","last_undegraded":"2024-09-12T17:05:58.576911+0000","last_fullsized":"2024-09-12T17:05:58.576911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:05.338596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.618634+0000","last_change":"2024-09-12T17:05:42.677413+0000","last_active":"2024-09-12T17:05:58.618634+0000","last_peered":"2024-09-12T17:05:58.618634+0000","last_clean":"2024-09-12T17:05:58.618634+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:05:58.618634+0000","last_undegraded":"2024-09-12T17:05:58.618634+0000","last_fullsized":"2024-09-12T17:05:58.618634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.836885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.573274+0000","last_change":"2024-09-12T17:05:47.520568+0000","last_active":"2024-09-12T17:05:58.573274+0000","last_peered":"2024-09-12T17:05:58.573274+0000","last_clean":"2024-09-12T17:05:58.573274+0000","last_became_active":"2024-09-12T17:05:47.520173+0000","last_became_peered":"2024-09-12T17:05:47.520173+0000","last_unstale":"2024-09-12T17:05:58.573274+0000","last_undegraded":"2024-09-12T17:05:58.573274+0000","last_fullsized":"2024-09-12T17:05:58.573274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:36.609804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619550+0000","last_change":"2024-09-12T17:05:51.557262+0000","last_active":"2024-09-12T17:05:58.619550+0000","last_peered":"2024-09-12T17:05:58.619550+0000","last_clean":"2024-09-12T17:05:58.619550+0000","last_became_active":"2024-09-12T17:05:51.556959+0000","last_became_peered":"2024-09-12T17:05:51.556959+0000","last_unstale":"2024-09-12T17:05:58.619550+0000","last_undegraded":"2024-09-12T17:05:58.619550+0000","last_fullsized":"2024-09-12T17:05:58.619550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.963181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.461240+0000","last_change":"2024-09-12T17:05:53.555384+0000","last_active":"2024-09-12T17:05:59.461240+0000","last_peered":"2024-09-12T17:05:59.461240+0000","last_clean":"2024-09-12T17:05:59.461240+0000","last_became_active":"2024-09-12T17:05:53.554063+0000","last_became_peered":"2024-09-12T17:05:53.554063+0000","last_unstale":"2024-09-12T17:05:59.461240+0000","last_undegraded":"2024-09-12T17:05:59.461240+0000","last_fullsized":"2024-09-12T17:05:59.461240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590789+0000","last_change":"2024-09-12T17:05:55.547595+0000","last_active":"2024-09-12T17:05:58.590789+0000","last_peered":"2024-09-12T17:05:58.590789+0000","last_clean":"2024-09-12T17:05:58.590789+0000","last_became_active":"2024-09-12T17:05:55.546700+0000","last_became_peered":"2024-09-12T17:05:55.546700+0000","last_unstale":"2024-09-12T17:05:58.590789+0000","last_undegraded":"2024-09-12T17:05:58.590789+0000","last_fullsized":"2024-09-12T17:05:58.590789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.598319+0000","last_change":"2024-09-12T17:05:57.587955+0000","last_active":"2024-09-12T17:05:58.598319+0000","last_peered":"2024-09-12T17:05:58.598319+0000","last_clean":"2024-09-12T17:05:58.598319+0000","last_became_active":"2024-09-12T17:05:57.587199+0000","last_became_peered":"2024-09-12T17:05:57.587199+0000","last_unstale":"2024-09-12T17:05:58.598319+0000","last_undegraded":"2024-09-12T17:05:58.598319+0000","last_fullsized":"2024-09-12T17:05:58.598319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.422656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575041+0000","last_change":"2024-09-12T17:05:49.541493+0000","last_active":"2024-09-12T17:05:58.575041+0000","last_peered":"2024-09-12T17:05:58.575041+0000","last_clean":"2024-09-12T17:05:58.575041+0000","last_became_active":"2024-09-12T17:05:49.541194+0000","last_became_peered":"2024-09-12T17:05:49.541194+0000","last_unstale":"2024-09-12T17:05:58.575041+0000","last_undegraded":"2024-09-12T17:05:58.575041+0000","last_fullsized":"2024-09-12T17:05:58.575041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:58.401990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588586+0000","last_change":"2024-09-12T17:05:42.226889+0000","last_active":"2024-09-12T17:05:58.588586+0000","last_peered":"2024-09-12T17:05:58.588586+0000","last_clean":"2024-09-12T17:05:58.588586+0000","last_became_active":"2024-09-12T17:05:40.214050+0000","last_became_peered":"2024-09-12T17:05:40.214050+0000","last_unstale":"2024-09-12T17:05:58.588586+0000","last_undegraded":"2024-09-12T17:05:58.588586+0000","last_fullsized":"2024-09-12T17:05:58.588586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:12.972719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577621+0000","last_change":"2024-09-12T17:05:47.546543+0000","last_active":"2024-09-12T17:05:58.577621+0000","last_peered":"2024-09-12T17:05:58.577621+0000","last_clean":"2024-09-12T17:05:58.577621+0000","last_became_active":"2024-09-12T17:05:47.545554+0000","last_became_peered":"2024-09-12T17:05:47.545554+0000","last_unstale":"2024-09-12T17:05:58.577621+0000","last_undegraded":"2024-09-12T17:05:58.577621+0000","last_fullsized":"2024-09-12T17:05:58.577621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:07.148131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591020+0000","last_change":"2024-09-12T17:05:51.535295+0000","last_active":"2024-09-12T17:05:58.591020+0000","last_peered":"2024-09-12T17:05:58.591020+0000","last_clean":"2024-09-12T17:05:58.591020+0000","last_became_active":"2024-09-12T17:05:51.534495+0000","last_became_peered":"2024-09-12T17:05:51.534495+0000","last_unstale":"2024-09-12T17:05:58.591020+0000","last_undegraded":"2024-09-12T17:05:58.591020+0000","last_fullsized":"2024-09-12T17:05:58.591020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.290531+0000","last_change":"2024-09-12T17:05:53.551499+0000","last_active":"2024-09-12T17:05:59.290531+0000","last_peered":"2024-09-12T17:05:59.290531+0000","last_clean":"2024-09-12T17:05:59.290531+0000","last_became_active":"2024-09-12T17:05:53.550857+0000","last_became_peered":"2024-09-12T17:05:53.550857+0000","last_unstale":"2024-09-12T17:05:59.290531+0000","last_undegraded":"2024-09-12T17:05:59.290531+0000","last_fullsized":"2024-09-12T17:05:59.290531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606524+0000","last_change":"2024-09-12T17:05:55.571619+0000","last_active":"2024-09-12T17:05:58.606524+0000","last_peered":"2024-09-12T17:05:58.606524+0000","last_clean":"2024-09-12T17:05:58.606524+0000","last_became_active":"2024-09-12T17:05:55.570991+0000","last_became_peered":"2024-09-12T17:05:55.570991+0000","last_unstale":"2024-09-12T17:05:58.606524+0000","last_undegraded":"2024-09-12T17:05:58.606524+0000","last_fullsized":"2024-09-12T17:05:58.606524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:02.401831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587015+0000","last_change":"2024-09-12T17:05:57.590482+0000","last_active":"2024-09-12T17:05:58.587015+0000","last_peered":"2024-09-12T17:05:58.587015+0000","last_clean":"2024-09-12T17:05:58.587015+0000","last_became_active":"2024-09-12T17:05:57.589542+0000","last_became_peered":"2024-09-12T17:05:57.589542+0000","last_unstale":"2024-09-12T17:05:58.587015+0000","last_undegraded":"2024-09-12T17:05:58.587015+0000","last_fullsized":"2024-09-12T17:05:58.587015+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:20.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575001+0000","last_change":"2024-09-12T17:05:49.543005+0000","last_active":"2024-09-12T17:05:58.575001+0000","last_peered":"2024-09-12T17:05:58.575001+0000","last_clean":"2024-09-12T17:05:58.575001+0000","last_became_active":"2024-09-12T17:05:49.542189+0000","last_became_peered":"2024-09-12T17:05:49.542189+0000","last_unstale":"2024-09-12T17:05:58.575001+0000","last_undegraded":"2024-09-12T17:05:58.575001+0000","last_fullsized":"2024-09-12T17:05:58.575001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:18.139854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589691+0000","last_change":"2024-09-12T17:05:47.525858+0000","last_active":"2024-09-12T17:05:58.589691+0000","last_peered":"2024-09-12T17:05:58.589691+0000","last_clean":"2024-09-12T17:05:58.589691+0000","last_became_active":"2024-09-12T17:05:47.525258+0000","last_became_peered":"2024-09-12T17:05:47.525258+0000","last_unstale":"2024-09-12T17:05:58.589691+0000","last_undegraded":"2024-09-12T17:05:58.589691+0000","last_fullsized":"2024-09-12T17:05:58.589691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575432+0000","last_change":"2024-09-12T17:05:42.216609+0000","last_active":"2024-09-12T17:05:58.575432+0000","last_peered":"2024-09-12T17:05:58.575432+0000","last_clean":"2024-09-12T17:05:58.575432+0000","last_became_active":"2024-09-12T17:05:40.210347+0000","last_became_peered":"2024-09-12T17:05:40.210347+0000","last_unstale":"2024-09-12T17:05:58.575432+0000","last_undegraded":"2024-09-12T17:05:58.575432+0000","last_fullsized":"2024-09-12T17:05:58.575432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:59.135278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010482919999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591478+0000","last_change":"2024-09-12T17:05:51.544848+0000","last_active":"2024-09-12T17:05:58.591478+0000","last_peered":"2024-09-12T17:05:58.591478+0000","last_clean":"2024-09-12T17:05:58.591478+0000","last_became_active":"2024-09-12T17:05:51.544078+0000","last_became_peered":"2024-09-12T17:05:51.544078+0000","last_unstale":"2024-09-12T17:05:58.591478+0000","last_undegraded":"2024-09-12T17:05:58.591478+0000","last_fullsized":"2024-09-12T17:05:58.591478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'18","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.386117+0000","last_change":"2024-09-12T17:05:53.540181+0000","last_active":"2024-09-12T17:05:59.386117+0000","last_peered":"2024-09-12T17:05:59.386117+0000","last_clean":"2024-09-12T17:05:59.386117+0000","last_became_active":"2024-09-12T17:05:53.539372+0000","last_became_peered":"2024-09-12T17:05:53.539372+0000","last_unstale":"2024-09-12T17:05:59.386117+0000","last_undegraded":"2024-09-12T17:05:59.386117+0000","last_fullsized":"2024-09-12T17:05:59.386117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:58.931466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577490+0000","last_change":"2024-09-12T17:05:55.554060+0000","last_active":"2024-09-12T17:05:58.577490+0000","last_peered":"2024-09-12T17:05:58.577490+0000","last_clean":"2024-09-12T17:05:58.577490+0000","last_became_active":"2024-09-12T17:05:55.553263+0000","last_became_peered":"2024-09-12T17:05:55.553263+0000","last_unstale":"2024-09-12T17:05:58.577490+0000","last_undegraded":"2024-09-12T17:05:58.577490+0000","last_fullsized":"2024-09-12T17:05:58.577490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:44.303469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591531+0000","last_change":"2024-09-12T17:05:58.121180+0000","last_active":"2024-09-12T17:05:58.591531+0000","last_peered":"2024-09-12T17:05:58.591531+0000","last_clean":"2024-09-12T17:05:58.591531+0000","last_became_active":"2024-09-12T17:05:58.119755+0000","last_became_peered":"2024-09-12T17:05:58.119755+0000","last_unstale":"2024-09-12T17:05:58.591531+0000","last_undegraded":"2024-09-12T17:05:58.591531+0000","last_fullsized":"2024-09-12T17:05:58.591531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592276+0000","last_change":"2024-09-12T17:05:49.550213+0000","last_active":"2024-09-12T17:05:58.592276+0000","last_peered":"2024-09-12T17:05:58.592276+0000","last_clean":"2024-09-12T17:05:58.592276+0000","last_became_active":"2024-09-12T17:05:49.549583+0000","last_became_peered":"2024-09-12T17:05:49.549583+0000","last_unstale":"2024-09-12T17:05:58.592276+0000","last_undegraded":"2024-09-12T17:05:58.592276+0000","last_fullsized":"2024-09-12T17:05:58.592276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:05.085326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575192+0000","last_change":"2024-09-12T17:05:47.520551+0000","last_active":"2024-09-12T17:05:58.575192+0000","last_peered":"2024-09-12T17:05:58.575192+0000","last_clean":"2024-09-12T17:05:58.575192+0000","last_became_active":"2024-09-12T17:05:47.518410+0000","last_became_peered":"2024-09-12T17:05:47.518410+0000","last_unstale":"2024-09-12T17:05:58.575192+0000","last_undegraded":"2024-09-12T17:05:58.575192+0000","last_fullsized":"2024-09-12T17:05:58.575192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:54.172257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.583297+0000","last_change":"2024-09-12T17:05:42.218804+0000","last_active":"2024-09-12T17:05:58.583297+0000","last_peered":"2024-09-12T17:05:58.583297+0000","last_clean":"2024-09-12T17:05:58.583297+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:05:58.583297+0000","last_undegraded":"2024-09-12T17:05:58.583297+0000","last_fullsized":"2024-09-12T17:05:58.583297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:48.189931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605504+0000","last_change":"2024-09-12T17:05:51.545963+0000","last_active":"2024-09-12T17:05:58.605504+0000","last_peered":"2024-09-12T17:05:58.605504+0000","last_clean":"2024-09-12T17:05:58.605504+0000","last_became_active":"2024-09-12T17:05:51.545225+0000","last_became_peered":"2024-09-12T17:05:51.545225+0000","last_unstale":"2024-09-12T17:05:58.605504+0000","last_undegraded":"2024-09-12T17:05:58.605504+0000","last_fullsized":"2024-09-12T17:05:58.605504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:40.407563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.484864+0000","last_change":"2024-09-12T17:05:53.551372+0000","last_active":"2024-09-12T17:05:59.484864+0000","last_peered":"2024-09-12T17:05:59.484864+0000","last_clean":"2024-09-12T17:05:59.484864+0000","last_became_active":"2024-09-12T17:05:53.550594+0000","last_became_peered":"2024-09-12T17:05:53.550594+0000","last_unstale":"2024-09-12T17:05:59.484864+0000","last_undegraded":"2024-09-12T17:05:59.484864+0000","last_fullsized":"2024-09-12T17:05:59.484864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:20.334478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587662+0000","last_change":"2024-09-12T17:05:55.573161+0000","last_active":"2024-09-12T17:05:58.587662+0000","last_peered":"2024-09-12T17:05:58.587662+0000","last_clean":"2024-09-12T17:05:58.587662+0000","last_became_active":"2024-09-12T17:05:55.571897+0000","last_became_peered":"2024-09-12T17:05:55.571897+0000","last_unstale":"2024-09-12T17:05:58.587662+0000","last_undegraded":"2024-09-12T17:05:58.587662+0000","last_fullsized":"2024-09-12T17:05:58.587662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.601582+0000","last_change":"2024-09-12T17:05:58.118437+0000","last_active":"2024-09-12T17:05:58.601582+0000","last_peered":"2024-09-12T17:05:58.601582+0000","last_clean":"2024-09-12T17:05:58.601582+0000","last_became_active":"2024-09-12T17:05:58.117710+0000","last_became_peered":"2024-09-12T17:05:58.117710+0000","last_unstale":"2024-09-12T17:05:58.601582+0000","last_undegraded":"2024-09-12T17:05:58.601582+0000","last_fullsized":"2024-09-12T17:05:58.601582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:00.239807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596506+0000","last_change":"2024-09-12T17:05:49.519509+0000","last_active":"2024-09-12T17:05:58.596506+0000","last_peered":"2024-09-12T17:05:58.596506+0000","last_clean":"2024-09-12T17:05:58.596506+0000","last_became_active":"2024-09-12T17:05:49.519178+0000","last_became_peered":"2024-09-12T17:05:49.519178+0000","last_unstale":"2024-09-12T17:05:58.596506+0000","last_undegraded":"2024-09-12T17:05:58.596506+0000","last_fullsized":"2024-09-12T17:05:58.596506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:33.502884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600287+0000","last_change":"2024-09-12T17:05:47.535321+0000","last_active":"2024-09-12T17:05:58.600287+0000","last_peered":"2024-09-12T17:05:58.600287+0000","last_clean":"2024-09-12T17:05:58.600287+0000","last_became_active":"2024-09-12T17:05:47.534790+0000","last_became_peered":"2024-09-12T17:05:47.534790+0000","last_unstale":"2024-09-12T17:05:58.600287+0000","last_undegraded":"2024-09-12T17:05:58.600287+0000","last_fullsized":"2024-09-12T17:05:58.600287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576368+0000","last_change":"2024-09-12T17:05:42.216620+0000","last_active":"2024-09-12T17:05:58.576368+0000","last_peered":"2024-09-12T17:05:58.576368+0000","last_clean":"2024-09-12T17:05:58.576368+0000","last_became_active":"2024-09-12T17:05:40.211977+0000","last_became_peered":"2024-09-12T17:05:40.211977+0000","last_unstale":"2024-09-12T17:05:58.576368+0000","last_undegraded":"2024-09-12T17:05:58.576368+0000","last_fullsized":"2024-09-12T17:05:58.576368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:16.615233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010578320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578083+0000","last_change":"2024-09-12T17:05:51.533668+0000","last_active":"2024-09-12T17:05:58.578083+0000","last_peered":"2024-09-12T17:05:58.578083+0000","last_clean":"2024-09-12T17:05:58.578083+0000","last_became_active":"2024-09-12T17:05:51.532795+0000","last_became_peered":"2024-09-12T17:05:51.532795+0000","last_unstale":"2024-09-12T17:05:58.578083+0000","last_undegraded":"2024-09-12T17:05:58.578083+0000","last_fullsized":"2024-09-12T17:05:58.578083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.655645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.442779+0000","last_change":"2024-09-12T17:05:53.544503+0000","last_active":"2024-09-12T17:05:59.442779+0000","last_peered":"2024-09-12T17:05:59.442779+0000","last_clean":"2024-09-12T17:05:59.442779+0000","last_became_active":"2024-09-12T17:05:53.543495+0000","last_became_peered":"2024-09-12T17:05:53.543495+0000","last_unstale":"2024-09-12T17:05:59.442779+0000","last_undegraded":"2024-09-12T17:05:59.442779+0000","last_fullsized":"2024-09-12T17:05:59.442779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.721968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.599304+0000","last_change":"2024-09-12T17:05:55.567580+0000","last_active":"2024-09-12T17:05:58.599304+0000","last_peered":"2024-09-12T17:05:58.599304+0000","last_clean":"2024-09-12T17:05:58.599304+0000","last_became_active":"2024-09-12T17:05:55.566652+0000","last_became_peered":"2024-09-12T17:05:55.566652+0000","last_unstale":"2024-09-12T17:05:58.599304+0000","last_undegraded":"2024-09-12T17:05:58.599304+0000","last_fullsized":"2024-09-12T17:05:58.599304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:28.904117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591539+0000","last_change":"2024-09-12T17:05:57.585098+0000","last_active":"2024-09-12T17:05:58.591539+0000","last_peered":"2024-09-12T17:05:58.591539+0000","last_clean":"2024-09-12T17:05:58.591539+0000","last_became_active":"2024-09-12T17:05:57.584326+0000","last_became_peered":"2024-09-12T17:05:57.584326+0000","last_unstale":"2024-09-12T17:05:58.591539+0000","last_undegraded":"2024-09-12T17:05:58.591539+0000","last_fullsized":"2024-09-12T17:05:58.591539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578596+0000","last_change":"2024-09-12T17:05:49.553294+0000","last_active":"2024-09-12T17:05:58.578596+0000","last_peered":"2024-09-12T17:05:58.578596+0000","last_clean":"2024-09-12T17:05:58.578596+0000","last_became_active":"2024-09-12T17:05:49.551726+0000","last_became_peered":"2024-09-12T17:05:49.551726+0000","last_unstale":"2024-09-12T17:05:58.578596+0000","last_undegraded":"2024-09-12T17:05:58.578596+0000","last_fullsized":"2024-09-12T17:05:58.578596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:50.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592925+0000","last_change":"2024-09-12T17:05:47.518931+0000","last_active":"2024-09-12T17:05:58.592925+0000","last_peered":"2024-09-12T17:05:58.592925+0000","last_clean":"2024-09-12T17:05:58.592925+0000","last_became_active":"2024-09-12T17:05:47.518428+0000","last_became_peered":"2024-09-12T17:05:47.518428+0000","last_unstale":"2024-09-12T17:05:58.592925+0000","last_undegraded":"2024-09-12T17:05:58.592925+0000","last_fullsized":"2024-09-12T17:05:58.592925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.607245+0000","last_change":"2024-09-12T17:05:42.680975+0000","last_active":"2024-09-12T17:05:58.607245+0000","last_peered":"2024-09-12T17:05:58.607245+0000","last_clean":"2024-09-12T17:05:58.607245+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:05:58.607245+0000","last_undegraded":"2024-09-12T17:05:58.607245+0000","last_fullsized":"2024-09-12T17:05:58.607245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.660350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596208+0000","last_change":"2024-09-12T17:05:51.530163+0000","last_active":"2024-09-12T17:05:58.596208+0000","last_peered":"2024-09-12T17:05:58.596208+0000","last_clean":"2024-09-12T17:05:58.596208+0000","last_became_active":"2024-09-12T17:05:51.529790+0000","last_became_peered":"2024-09-12T17:05:51.529790+0000","last_unstale":"2024-09-12T17:05:58.596208+0000","last_undegraded":"2024-09-12T17:05:58.596208+0000","last_fullsized":"2024-09-12T17:05:58.596208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:29.387749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'19","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.422455+0000","last_change":"2024-09-12T17:05:53.554751+0000","last_active":"2024-09-12T17:05:59.422455+0000","last_peered":"2024-09-12T17:05:59.422455+0000","last_clean":"2024-09-12T17:05:59.422455+0000","last_became_active":"2024-09-12T17:05:53.553914+0000","last_became_peered":"2024-09-12T17:05:53.553914+0000","last_unstale":"2024-09-12T17:05:59.422455+0000","last_undegraded":"2024-09-12T17:05:59.422455+0000","last_fullsized":"2024-09-12T17:05:59.422455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596725+0000","last_change":"2024-09-12T17:05:55.573020+0000","last_active":"2024-09-12T17:05:58.596725+0000","last_peered":"2024-09-12T17:05:58.596725+0000","last_clean":"2024-09-12T17:05:58.596725+0000","last_became_active":"2024-09-12T17:05:55.571538+0000","last_became_peered":"2024-09-12T17:05:55.571538+0000","last_unstale":"2024-09-12T17:05:58.596725+0000","last_undegraded":"2024-09-12T17:05:58.596725+0000","last_fullsized":"2024-09-12T17:05:58.596725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:29.200717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588696+0000","last_change":"2024-09-12T17:05:57.605829+0000","last_active":"2024-09-12T17:05:58.588696+0000","last_peered":"2024-09-12T17:05:58.588696+0000","last_clean":"2024-09-12T17:05:58.588696+0000","last_became_active":"2024-09-12T17:05:57.605041+0000","last_became_peered":"2024-09-12T17:05:57.605041+0000","last_unstale":"2024-09-12T17:05:58.588696+0000","last_undegraded":"2024-09-12T17:05:58.588696+0000","last_fullsized":"2024-09-12T17:05:58.588696+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591536+0000","last_change":"2024-09-12T17:05:57.594498+0000","last_active":"2024-09-12T17:05:58.591536+0000","last_peered":"2024-09-12T17:05:58.591536+0000","last_clean":"2024-09-12T17:05:58.591536+0000","last_became_active":"2024-09-12T17:05:57.590196+0000","last_became_peered":"2024-09-12T17:05:57.590196+0000","last_unstale":"2024-09-12T17:05:58.591536+0000","last_undegraded":"2024-09-12T17:05:58.591536+0000","last_fullsized":"2024-09-12T17:05:58.591536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.543735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577181+0000","last_change":"2024-09-12T17:05:49.562121+0000","last_active":"2024-09-12T17:05:58.577181+0000","last_peered":"2024-09-12T17:05:58.577181+0000","last_clean":"2024-09-12T17:05:58.577181+0000","last_became_active":"2024-09-12T17:05:49.561429+0000","last_became_peered":"2024-09-12T17:05:49.561429+0000","last_unstale":"2024-09-12T17:05:58.577181+0000","last_undegraded":"2024-09-12T17:05:58.577181+0000","last_fullsized":"2024-09-12T17:05:58.577181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:47.663366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.581437+0000","last_change":"2024-09-12T17:05:47.557270+0000","last_active":"2024-09-12T17:05:58.581437+0000","last_peered":"2024-09-12T17:05:58.581437+0000","last_clean":"2024-09-12T17:05:58.581437+0000","last_became_active":"2024-09-12T17:05:47.556417+0000","last_became_peered":"2024-09-12T17:05:47.556417+0000","last_unstale":"2024-09-12T17:05:58.581437+0000","last_undegraded":"2024-09-12T17:05:58.581437+0000","last_fullsized":"2024-09-12T17:05:58.581437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:00.210632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575408+0000","last_change":"2024-09-12T17:05:51.554693+0000","last_active":"2024-09-12T17:05:58.575408+0000","last_peered":"2024-09-12T17:05:58.575408+0000","last_clean":"2024-09-12T17:05:58.575408+0000","last_became_active":"2024-09-12T17:05:51.554346+0000","last_became_peered":"2024-09-12T17:05:51.554346+0000","last_unstale":"2024-09-12T17:05:58.575408+0000","last_undegraded":"2024-09-12T17:05:58.575408+0000","last_fullsized":"2024-09-12T17:05:58.575408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:21.922825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'11","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.491900+0000","last_change":"2024-09-12T17:05:53.542230+0000","last_active":"2024-09-12T17:05:59.491900+0000","last_peered":"2024-09-12T17:05:59.491900+0000","last_clean":"2024-09-12T17:05:59.491900+0000","last_became_active":"2024-09-12T17:05:53.541653+0000","last_became_peered":"2024-09-12T17:05:53.541653+0000","last_unstale":"2024-09-12T17:05:59.491900+0000","last_undegraded":"2024-09-12T17:05:59.491900+0000","last_fullsized":"2024-09-12T17:05:59.491900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.595768+0000","last_change":"2024-09-12T17:05:55.556535+0000","last_active":"2024-09-12T17:05:58.595768+0000","last_peered":"2024-09-12T17:05:58.595768+0000","last_clean":"2024-09-12T17:05:58.595768+0000","last_became_active":"2024-09-12T17:05:55.555755+0000","last_became_peered":"2024-09-12T17:05:55.555755+0000","last_unstale":"2024-09-12T17:05:58.595768+0000","last_undegraded":"2024-09-12T17:05:58.595768+0000","last_fullsized":"2024-09-12T17:05:58.595768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.707384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600021+0000","last_change":"2024-09-12T17:05:57.593418+0000","last_active":"2024-09-12T17:05:58.600021+0000","last_peered":"2024-09-12T17:05:58.600021+0000","last_clean":"2024-09-12T17:05:58.600021+0000","last_became_active":"2024-09-12T17:05:57.592746+0000","last_became_peered":"2024-09-12T17:05:57.592746+0000","last_unstale":"2024-09-12T17:05:58.600021+0000","last_undegraded":"2024-09-12T17:05:58.600021+0000","last_fullsized":"2024-09-12T17:05:58.600021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:24.794382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.574713+0000","last_change":"2024-09-12T17:05:49.555968+0000","last_active":"2024-09-12T17:05:58.574713+0000","last_peered":"2024-09-12T17:05:58.574713+0000","last_clean":"2024-09-12T17:05:58.574713+0000","last_became_active":"2024-09-12T17:05:49.555597+0000","last_became_peered":"2024-09-12T17:05:49.555597+0000","last_unstale":"2024-09-12T17:05:58.574713+0000","last_undegraded":"2024-09-12T17:05:58.574713+0000","last_fullsized":"2024-09-12T17:05:58.574713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:10.369863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582867+0000","last_change":"2024-09-12T17:05:47.559497+0000","last_active":"2024-09-12T17:05:58.582867+0000","last_peered":"2024-09-12T17:05:58.582867+0000","last_clean":"2024-09-12T17:05:58.582867+0000","last_became_active":"2024-09-12T17:05:47.558641+0000","last_became_peered":"2024-09-12T17:05:47.558641+0000","last_unstale":"2024-09-12T17:05:58.582867+0000","last_undegraded":"2024-09-12T17:05:58.582867+0000","last_fullsized":"2024-09-12T17:05:58.582867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:00.096304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.598140+0000","last_change":"2024-09-12T17:05:51.539784+0000","last_active":"2024-09-12T17:05:58.598140+0000","last_peered":"2024-09-12T17:05:58.598140+0000","last_clean":"2024-09-12T17:05:58.598140+0000","last_became_active":"2024-09-12T17:05:51.539275+0000","last_became_peered":"2024-09-12T17:05:51.539275+0000","last_unstale":"2024-09-12T17:05:58.598140+0000","last_undegraded":"2024-09-12T17:05:58.598140+0000","last_fullsized":"2024-09-12T17:05:58.598140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'4","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.927159+0000","last_change":"2024-09-12T17:05:53.544731+0000","last_active":"2024-09-12T17:05:58.927159+0000","last_peered":"2024-09-12T17:05:58.927159+0000","last_clean":"2024-09-12T17:05:58.927159+0000","last_became_active":"2024-09-12T17:05:53.544127+0000","last_became_peered":"2024-09-12T17:05:53.544127+0000","last_unstale":"2024-09-12T17:05:58.927159+0000","last_undegraded":"2024-09-12T17:05:58.927159+0000","last_fullsized":"2024-09-12T17:05:58.927159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:04.351698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576931+0000","last_change":"2024-09-12T17:05:55.571541+0000","last_active":"2024-09-12T17:05:58.576931+0000","last_peered":"2024-09-12T17:05:58.576931+0000","last_clean":"2024-09-12T17:05:58.576931+0000","last_became_active":"2024-09-12T17:05:55.570822+0000","last_became_peered":"2024-09-12T17:05:55.570822+0000","last_unstale":"2024-09-12T17:05:58.576931+0000","last_undegraded":"2024-09-12T17:05:58.576931+0000","last_fullsized":"2024-09-12T17:05:58.576931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592526+0000","last_change":"2024-09-12T17:05:57.588655+0000","last_active":"2024-09-12T17:05:58.592526+0000","last_peered":"2024-09-12T17:05:58.592526+0000","last_clean":"2024-09-12T17:05:58.592526+0000","last_became_active":"2024-09-12T17:05:57.586264+0000","last_became_peered":"2024-09-12T17:05:57.586264+0000","last_unstale":"2024-09-12T17:05:58.592526+0000","last_undegraded":"2024-09-12T17:05:58.592526+0000","last_fullsized":"2024-09-12T17:05:58.592526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:44.380435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596840+0000","last_change":"2024-09-12T17:05:49.520508+0000","last_active":"2024-09-12T17:05:58.596840+0000","last_peered":"2024-09-12T17:05:58.596840+0000","last_clean":"2024-09-12T17:05:58.596840+0000","last_became_active":"2024-09-12T17:05:49.519721+0000","last_became_peered":"2024-09-12T17:05:49.519721+0000","last_unstale":"2024-09-12T17:05:58.596840+0000","last_undegraded":"2024-09-12T17:05:58.596840+0000","last_fullsized":"2024-09-12T17:05:58.596840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589873+0000","last_change":"2024-09-12T17:05:47.539549+0000","last_active":"2024-09-12T17:05:58.589873+0000","last_peered":"2024-09-12T17:05:58.589873+0000","last_clean":"2024-09-12T17:05:58.589873+0000","last_became_active":"2024-09-12T17:05:47.538581+0000","last_became_peered":"2024-09-12T17:05:47.538581+0000","last_unstale":"2024-09-12T17:05:58.589873+0000","last_undegraded":"2024-09-12T17:05:58.589873+0000","last_fullsized":"2024-09-12T17:05:58.589873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.448924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575893+0000","last_change":"2024-09-12T17:05:51.530541+0000","last_active":"2024-09-12T17:05:58.575893+0000","last_peered":"2024-09-12T17:05:58.575893+0000","last_clean":"2024-09-12T17:05:58.575893+0000","last_became_active":"2024-09-12T17:05:51.527515+0000","last_became_peered":"2024-09-12T17:05:51.527515+0000","last_unstale":"2024-09-12T17:05:58.575893+0000","last_undegraded":"2024-09-12T17:05:58.575893+0000","last_fullsized":"2024-09-12T17:05:58.575893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"36'11","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.400000+0000","last_change":"2024-09-12T17:05:53.555017+0000","last_active":"2024-09-12T17:05:59.400000+0000","last_peered":"2024-09-12T17:05:59.400000+0000","last_clean":"2024-09-12T17:05:59.400000+0000","last_became_active":"2024-09-12T17:05:53.551154+0000","last_became_peered":"2024-09-12T17:05:53.551154+0000","last_unstale":"2024-09-12T17:05:59.400000+0000","last_undegraded":"2024-09-12T17:05:59.400000+0000","last_fullsized":"2024-09-12T17:05:59.400000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:50.736153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605228+0000","last_change":"2024-09-12T17:05:55.570872+0000","last_active":"2024-09-12T17:05:58.605228+0000","last_peered":"2024-09-12T17:05:58.605228+0000","last_clean":"2024-09-12T17:05:58.605228+0000","last_became_active":"2024-09-12T17:05:55.570137+0000","last_became_peered":"2024-09-12T17:05:55.570137+0000","last_unstale":"2024-09-12T17:05:58.605228+0000","last_undegraded":"2024-09-12T17:05:58.605228+0000","last_fullsized":"2024-09-12T17:05:58.605228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.684868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587874+0000","last_change":"2024-09-12T17:05:57.597088+0000","last_active":"2024-09-12T17:05:58.587874+0000","last_peered":"2024-09-12T17:05:58.587874+0000","last_clean":"2024-09-12T17:05:58.587874+0000","last_became_active":"2024-09-12T17:05:57.596377+0000","last_became_peered":"2024-09-12T17:05:57.596377+0000","last_unstale":"2024-09-12T17:05:58.587874+0000","last_undegraded":"2024-09-12T17:05:58.587874+0000","last_fullsized":"2024-09-12T17:05:58.587874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596663+0000","last_change":"2024-09-12T17:05:49.555432+0000","last_active":"2024-09-12T17:05:58.596663+0000","last_peered":"2024-09-12T17:05:58.596663+0000","last_clean":"2024-09-12T17:05:58.596663+0000","last_became_active":"2024-09-12T17:05:49.554663+0000","last_became_peered":"2024-09-12T17:05:49.554663+0000","last_unstale":"2024-09-12T17:05:58.596663+0000","last_undegraded":"2024-09-12T17:05:58.596663+0000","last_fullsized":"2024-09-12T17:05:58.596663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:32.612552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.593086+0000","last_change":"2024-09-12T17:05:47.526555+0000","last_active":"2024-09-12T17:05:58.593086+0000","last_peered":"2024-09-12T17:05:58.593086+0000","last_clean":"2024-09-12T17:05:58.593086+0000","last_became_active":"2024-09-12T17:05:47.525874+0000","last_became_peered":"2024-09-12T17:05:47.525874+0000","last_unstale":"2024-09-12T17:05:58.593086+0000","last_undegraded":"2024-09-12T17:05:58.593086+0000","last_fullsized":"2024-09-12T17:05:58.593086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605372+0000","last_change":"2024-09-12T17:05:51.540509+0000","last_active":"2024-09-12T17:05:58.605372+0000","last_peered":"2024-09-12T17:05:58.605372+0000","last_clean":"2024-09-12T17:05:58.605372+0000","last_became_active":"2024-09-12T17:05:51.539607+0000","last_became_peered":"2024-09-12T17:05:51.539607+0000","last_unstale":"2024-09-12T17:05:58.605372+0000","last_undegraded":"2024-09-12T17:05:58.605372+0000","last_fullsized":"2024-09-12T17:05:58.605372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:02.652624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.167156+0000","last_change":"2024-09-12T17:05:53.549324+0000","last_active":"2024-09-12T17:05:59.167156+0000","last_peered":"2024-09-12T17:05:59.167156+0000","last_clean":"2024-09-12T17:05:59.167156+0000","last_became_active":"2024-09-12T17:05:53.548561+0000","last_became_peered":"2024-09-12T17:05:53.548561+0000","last_unstale":"2024-09-12T17:05:59.167156+0000","last_undegraded":"2024-09-12T17:05:59.167156+0000","last_fullsized":"2024-09-12T17:05:59.167156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:47.932776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590493+0000","last_change":"2024-09-12T17:05:55.561467+0000","last_active":"2024-09-12T17:05:58.590493+0000","last_peered":"2024-09-12T17:05:58.590493+0000","last_clean":"2024-09-12T17:05:58.590493+0000","last_became_active":"2024-09-12T17:05:55.560708+0000","last_became_peered":"2024-09-12T17:05:55.560708+0000","last_unstale":"2024-09-12T17:05:58.590493+0000","last_undegraded":"2024-09-12T17:05:58.590493+0000","last_fullsized":"2024-09-12T17:05:58.590493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.607091+0000","last_change":"2024-09-12T17:05:49.547097+0000","last_active":"2024-09-12T17:05:58.607091+0000","last_peered":"2024-09-12T17:05:58.607091+0000","last_clean":"2024-09-12T17:05:58.607091+0000","last_became_active":"2024-09-12T17:05:49.546232+0000","last_became_peered":"2024-09-12T17:05:49.546232+0000","last_unstale":"2024-09-12T17:05:58.607091+0000","last_undegraded":"2024-09-12T17:05:58.607091+0000","last_fullsized":"2024-09-12T17:05:58.607091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596935+0000","last_change":"2024-09-12T17:05:47.521779+0000","last_active":"2024-09-12T17:05:58.596935+0000","last_peered":"2024-09-12T17:05:58.596935+0000","last_clean":"2024-09-12T17:05:58.596935+0000","last_became_active":"2024-09-12T17:05:47.521097+0000","last_became_peered":"2024-09-12T17:05:47.521097+0000","last_unstale":"2024-09-12T17:05:58.596935+0000","last_undegraded":"2024-09-12T17:05:58.596935+0000","last_fullsized":"2024-09-12T17:05:58.596935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:37.072896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592322+0000","last_change":"2024-09-12T17:05:51.525803+0000","last_active":"2024-09-12T17:05:58.592322+0000","last_peered":"2024-09-12T17:05:58.592322+0000","last_clean":"2024-09-12T17:05:58.592322+0000","last_became_active":"2024-09-12T17:05:51.525457+0000","last_became_peered":"2024-09-12T17:05:51.525457+0000","last_unstale":"2024-09-12T17:05:58.592322+0000","last_undegraded":"2024-09-12T17:05:58.592322+0000","last_fullsized":"2024-09-12T17:05:58.592322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'12","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.519732+0000","last_change":"2024-09-12T17:05:53.549321+0000","last_active":"2024-09-12T17:05:59.519732+0000","last_peered":"2024-09-12T17:05:59.519732+0000","last_clean":"2024-09-12T17:05:59.519732+0000","last_became_active":"2024-09-12T17:05:53.548507+0000","last_became_peered":"2024-09-12T17:05:53.548507+0000","last_unstale":"2024-09-12T17:05:59.519732+0000","last_undegraded":"2024-09-12T17:05:59.519732+0000","last_fullsized":"2024-09-12T17:05:59.519732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:13.646706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588382+0000","last_change":"2024-09-12T17:05:55.563312+0000","last_active":"2024-09-12T17:05:58.588382+0000","last_peered":"2024-09-12T17:05:58.588382+0000","last_clean":"2024-09-12T17:05:58.588382+0000","last_became_active":"2024-09-12T17:05:55.562405+0000","last_became_peered":"2024-09-12T17:05:55.562405+0000","last_unstale":"2024-09-12T17:05:58.588382+0000","last_undegraded":"2024-09-12T17:05:58.588382+0000","last_fullsized":"2024-09-12T17:05:58.588382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.597509+0000","last_change":"2024-09-12T17:05:58.121110+0000","last_active":"2024-09-12T17:05:58.597509+0000","last_peered":"2024-09-12T17:05:58.597509+0000","last_clean":"2024-09-12T17:05:58.597509+0000","last_became_active":"2024-09-12T17:05:58.120367+0000","last_became_peered":"2024-09-12T17:05:58.120367+0000","last_unstale":"2024-09-12T17:05:58.597509+0000","last_undegraded":"2024-09-12T17:05:58.597509+0000","last_fullsized":"2024-09-12T17:05:58.597509+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592595+0000","last_change":"2024-09-12T17:05:49.532377+0000","last_active":"2024-09-12T17:05:58.592595+0000","last_peered":"2024-09-12T17:05:58.592595+0000","last_clean":"2024-09-12T17:05:58.592595+0000","last_became_active":"2024-09-12T17:05:49.531975+0000","last_became_peered":"2024-09-12T17:05:49.531975+0000","last_unstale":"2024-09-12T17:05:58.592595+0000","last_undegraded":"2024-09-12T17:05:58.592595+0000","last_fullsized":"2024-09-12T17:05:58.592595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.574173+0000","last_change":"2024-09-12T17:05:47.518059+0000","last_active":"2024-09-12T17:05:58.574173+0000","last_peered":"2024-09-12T17:05:58.574173+0000","last_clean":"2024-09-12T17:05:58.574173+0000","last_became_active":"2024-09-12T17:05:47.517646+0000","last_became_peered":"2024-09-12T17:05:47.517646+0000","last_unstale":"2024-09-12T17:05:58.574173+0000","last_undegraded":"2024-09-12T17:05:58.574173+0000","last_fullsized":"2024-09-12T17:05:58.574173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:26.484090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606847+0000","last_change":"2024-09-12T17:05:51.546117+0000","last_active":"2024-09-12T17:05:58.606847+0000","last_peered":"2024-09-12T17:05:58.606847+0000","last_clean":"2024-09-12T17:05:58.606847+0000","last_became_active":"2024-09-12T17:05:51.545154+0000","last_became_peered":"2024-09-12T17:05:51.545154+0000","last_unstale":"2024-09-12T17:05:58.606847+0000","last_undegraded":"2024-09-12T17:05:58.606847+0000","last_fullsized":"2024-09-12T17:05:58.606847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:49.670591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.299808+0000","last_change":"2024-09-12T17:05:53.558834+0000","last_active":"2024-09-12T17:05:59.299808+0000","last_peered":"2024-09-12T17:05:59.299808+0000","last_clean":"2024-09-12T17:05:59.299808+0000","last_became_active":"2024-09-12T17:05:53.558086+0000","last_became_peered":"2024-09-12T17:05:53.558086+0000","last_unstale":"2024-09-12T17:05:59.299808+0000","last_undegraded":"2024-09-12T17:05:59.299808+0000","last_fullsized":"2024-09-12T17:05:59.299808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:43.690058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575806+0000","last_change":"2024-09-12T17:05:55.569495+0000","last_active":"2024-09-12T17:05:58.575806+0000","last_peered":"2024-09-12T17:05:58.575806+0000","last_clean":"2024-09-12T17:05:58.575806+0000","last_became_active":"2024-09-12T17:05:55.568867+0000","last_became_peered":"2024-09-12T17:05:55.568867+0000","last_unstale":"2024-09-12T17:05:58.575806+0000","last_undegraded":"2024-09-12T17:05:58.575806+0000","last_fullsized":"2024-09-12T17:05:58.575806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:08.676852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605104+0000","last_change":"2024-09-12T17:05:57.597468+0000","last_active":"2024-09-12T17:05:58.605104+0000","last_peered":"2024-09-12T17:05:58.605104+0000","last_clean":"2024-09-12T17:05:58.605104+0000","last_became_active":"2024-09-12T17:05:57.596651+0000","last_became_peered":"2024-09-12T17:05:57.596651+0000","last_unstale":"2024-09-12T17:05:58.605104+0000","last_undegraded":"2024-09-12T17:05:58.605104+0000","last_fullsized":"2024-09-12T17:05:58.605104+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.466145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.599935+0000","last_change":"2024-09-12T17:05:49.542462+0000","last_active":"2024-09-12T17:05:58.599935+0000","last_peered":"2024-09-12T17:05:58.599935+0000","last_clean":"2024-09-12T17:05:58.599935+0000","last_became_active":"2024-09-12T17:05:49.542201+0000","last_became_peered":"2024-09-12T17:05:49.542201+0000","last_unstale":"2024-09-12T17:05:58.599935+0000","last_undegraded":"2024-09-12T17:05:58.599935+0000","last_fullsized":"2024-09-12T17:05:58.599935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:42.832972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.581006+0000","last_change":"2024-09-12T17:05:47.529542+0000","last_active":"2024-09-12T17:05:58.581006+0000","last_peered":"2024-09-12T17:05:58.581006+0000","last_clean":"2024-09-12T17:05:58.581006+0000","last_became_active":"2024-09-12T17:05:47.528715+0000","last_became_peered":"2024-09-12T17:05:47.528715+0000","last_unstale":"2024-09-12T17:05:58.581006+0000","last_undegraded":"2024-09-12T17:05:58.581006+0000","last_fullsized":"2024-09-12T17:05:58.581006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:14.830888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582972+0000","last_change":"2024-09-12T17:05:51.539916+0000","last_active":"2024-09-12T17:05:58.582972+0000","last_peered":"2024-09-12T17:05:58.582972+0000","last_clean":"2024-09-12T17:05:58.582972+0000","last_became_active":"2024-09-12T17:05:51.539054+0000","last_became_peered":"2024-09-12T17:05:51.539054+0000","last_unstale":"2024-09-12T17:05:58.582972+0000","last_undegraded":"2024-09-12T17:05:58.582972+0000","last_fullsized":"2024-09-12T17:05:58.582972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:11.640578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"36'11","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.498617+0000","last_change":"2024-09-12T17:05:53.557081+0000","last_active":"2024-09-12T17:05:59.498617+0000","last_peered":"2024-09-12T17:05:59.498617+0000","last_clean":"2024-09-12T17:05:59.498617+0000","last_became_active":"2024-09-12T17:05:53.556357+0000","last_became_peered":"2024-09-12T17:05:53.556357+0000","last_unstale":"2024-09-12T17:05:59.498617+0000","last_undegraded":"2024-09-12T17:05:59.498617+0000","last_fullsized":"2024-09-12T17:05:59.498617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:10.984649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575506+0000","last_change":"2024-09-12T17:05:55.560294+0000","last_active":"2024-09-12T17:05:58.575506+0000","last_peered":"2024-09-12T17:05:58.575506+0000","last_clean":"2024-09-12T17:05:58.575506+0000","last_became_active":"2024-09-12T17:05:55.559572+0000","last_became_peered":"2024-09-12T17:05:55.559572+0000","last_unstale":"2024-09-12T17:05:58.575506+0000","last_undegraded":"2024-09-12T17:05:58.575506+0000","last_fullsized":"2024-09-12T17:05:58.575506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:33.871552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587473+0000","last_change":"2024-09-12T17:05:57.596779+0000","last_active":"2024-09-12T17:05:58.587473+0000","last_peered":"2024-09-12T17:05:58.587473+0000","last_clean":"2024-09-12T17:05:58.587473+0000","last_became_active":"2024-09-12T17:05:57.596005+0000","last_became_peered":"2024-09-12T17:05:57.596005+0000","last_unstale":"2024-09-12T17:05:58.587473+0000","last_undegraded":"2024-09-12T17:05:58.587473+0000","last_fullsized":"2024-09-12T17:05:58.587473+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619315+0000","last_change":"2024-09-12T17:05:49.548667+0000","last_active":"2024-09-12T17:05:58.619315+0000","last_peered":"2024-09-12T17:05:58.619315+0000","last_clean":"2024-09-12T17:05:58.619315+0000","last_became_active":"2024-09-12T17:05:49.548296+0000","last_became_peered":"2024-09-12T17:05:49.548296+0000","last_unstale":"2024-09-12T17:05:58.619315+0000","last_undegraded":"2024-09-12T17:05:58.619315+0000","last_fullsized":"2024-09-12T17:05:58.619315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:27.280124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590763+0000","last_change":"2024-09-12T17:05:47.546051+0000","last_active":"2024-09-12T17:05:58.590763+0000","last_peered":"2024-09-12T17:05:58.590763+0000","last_clean":"2024-09-12T17:05:58.590763+0000","last_became_active":"2024-09-12T17:05:47.545466+0000","last_became_peered":"2024-09-12T17:05:47.545466+0000","last_unstale":"2024-09-12T17:05:58.590763+0000","last_undegraded":"2024-09-12T17:05:58.590763+0000","last_fullsized":"2024-09-12T17:05:58.590763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576064+0000","last_change":"2024-09-12T17:05:51.540697+0000","last_active":"2024-09-12T17:05:58.576064+0000","last_peered":"2024-09-12T17:05:58.576064+0000","last_clean":"2024-09-12T17:05:58.576064+0000","last_became_active":"2024-09-12T17:05:51.539717+0000","last_became_peered":"2024-09-12T17:05:51.539717+0000","last_unstale":"2024-09-12T17:05:58.576064+0000","last_undegraded":"2024-09-12T17:05:58.576064+0000","last_fullsized":"2024-09-12T17:05:58.576064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:52.381980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.480145+0000","last_change":"2024-09-12T17:05:53.561278+0000","last_active":"2024-09-12T17:05:59.480145+0000","last_peered":"2024-09-12T17:05:59.480145+0000","last_clean":"2024-09-12T17:05:59.480145+0000","last_became_active":"2024-09-12T17:05:53.559688+0000","last_became_peered":"2024-09-12T17:05:53.559688+0000","last_unstale":"2024-09-12T17:05:59.480145+0000","last_undegraded":"2024-09-12T17:05:59.480145+0000","last_fullsized":"2024-09-12T17:05:59.480145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:37.392549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605895+0000","last_change":"2024-09-12T17:05:55.576227+0000","last_active":"2024-09-12T17:05:58.605895+0000","last_peered":"2024-09-12T17:05:58.605895+0000","last_clean":"2024-09-12T17:05:58.605895+0000","last_became_active":"2024-09-12T17:05:55.571966+0000","last_became_peered":"2024-09-12T17:05:55.571966+0000","last_unstale":"2024-09-12T17:05:58.605895+0000","last_undegraded":"2024-09-12T17:05:58.605895+0000","last_fullsized":"2024-09-12T17:05:58.605895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:24.680106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576020+0000","last_change":"2024-09-12T17:05:57.595153+0000","last_active":"2024-09-12T17:05:58.576020+0000","last_peered":"2024-09-12T17:05:58.576020+0000","last_clean":"2024-09-12T17:05:58.576020+0000","last_became_active":"2024-09-12T17:05:57.594396+0000","last_became_peered":"2024-09-12T17:05:57.594396+0000","last_unstale":"2024-09-12T17:05:58.576020+0000","last_undegraded":"2024-09-12T17:05:58.576020+0000","last_fullsized":"2024-09-12T17:05:58.576020+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:27.040243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577074+0000","last_change":"2024-09-12T17:05:49.543269+0000","last_active":"2024-09-12T17:05:58.577074+0000","last_peered":"2024-09-12T17:05:58.577074+0000","last_clean":"2024-09-12T17:05:58.577074+0000","last_became_active":"2024-09-12T17:05:49.542414+0000","last_became_peered":"2024-09-12T17:05:49.542414+0000","last_unstale":"2024-09-12T17:05:58.577074+0000","last_undegraded":"2024-09-12T17:05:58.577074+0000","last_fullsized":"2024-09-12T17:05:58.577074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:00.645399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588865+0000","last_change":"2024-09-12T17:05:47.553278+0000","last_active":"2024-09-12T17:05:58.588865+0000","last_peered":"2024-09-12T17:05:58.588865+0000","last_clean":"2024-09-12T17:05:58.588865+0000","last_became_active":"2024-09-12T17:05:47.552546+0000","last_became_peered":"2024-09-12T17:05:47.552546+0000","last_unstale":"2024-09-12T17:05:58.588865+0000","last_undegraded":"2024-09-12T17:05:58.588865+0000","last_fullsized":"2024-09-12T17:05:58.588865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:36.333145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578370+0000","last_change":"2024-09-12T17:05:51.528322+0000","last_active":"2024-09-12T17:05:58.578370+0000","last_peered":"2024-09-12T17:05:58.578370+0000","last_clean":"2024-09-12T17:05:58.578370+0000","last_became_active":"2024-09-12T17:05:51.527501+0000","last_became_peered":"2024-09-12T17:05:51.527501+0000","last_unstale":"2024-09-12T17:05:58.578370+0000","last_undegraded":"2024-09-12T17:05:58.578370+0000","last_fullsized":"2024-09-12T17:05:58.578370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.514870+0000","last_change":"2024-09-12T17:05:53.555787+0000","last_active":"2024-09-12T17:05:59.514870+0000","last_peered":"2024-09-12T17:05:59.514870+0000","last_clean":"2024-09-12T17:05:59.514870+0000","last_became_active":"2024-09-12T17:05:53.554972+0000","last_became_peered":"2024-09-12T17:05:53.554972+0000","last_unstale":"2024-09-12T17:05:59.514870+0000","last_undegraded":"2024-09-12T17:05:59.514870+0000","last_fullsized":"2024-09-12T17:05:59.514870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589327+0000","last_change":"2024-09-12T17:05:55.567202+0000","last_active":"2024-09-12T17:05:58.589327+0000","last_peered":"2024-09-12T17:05:58.589327+0000","last_clean":"2024-09-12T17:05:58.589327+0000","last_became_active":"2024-09-12T17:05:55.564710+0000","last_became_peered":"2024-09-12T17:05:55.564710+0000","last_unstale":"2024-09-12T17:05:58.589327+0000","last_undegraded":"2024-09-12T17:05:58.589327+0000","last_fullsized":"2024-09-12T17:05:58.589327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580807+0000","last_change":"2024-09-12T17:05:57.604052+0000","last_active":"2024-09-12T17:05:58.580807+0000","last_peered":"2024-09-12T17:05:58.580807+0000","last_clean":"2024-09-12T17:05:58.580807+0000","last_became_active":"2024-09-12T17:05:57.603285+0000","last_became_peered":"2024-09-12T17:05:57.603285+0000","last_unstale":"2024-09-12T17:05:58.580807+0000","last_undegraded":"2024-09-12T17:05:58.580807+0000","last_fullsized":"2024-09-12T17:05:58.580807+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:31.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580426+0000","last_change":"2024-09-12T17:05:49.548224+0000","last_active":"2024-09-12T17:05:58.580426+0000","last_peered":"2024-09-12T17:05:58.580426+0000","last_clean":"2024-09-12T17:05:58.580426+0000","last_became_active":"2024-09-12T17:05:49.541007+0000","last_became_peered":"2024-09-12T17:05:49.541007+0000","last_unstale":"2024-09-12T17:05:58.580426+0000","last_undegraded":"2024-09-12T17:05:58.580426+0000","last_fullsized":"2024-09-12T17:05:58.580426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:59.768842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589556+0000","last_change":"2024-09-12T17:05:47.543197+0000","last_active":"2024-09-12T17:05:58.589556+0000","last_peered":"2024-09-12T17:05:58.589556+0000","last_clean":"2024-09-12T17:05:58.589556+0000","last_became_active":"2024-09-12T17:05:47.542345+0000","last_became_peered":"2024-09-12T17:05:47.542345+0000","last_unstale":"2024-09-12T17:05:58.589556+0000","last_undegraded":"2024-09-12T17:05:58.589556+0000","last_fullsized":"2024-09-12T17:05:58.589556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.858635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587769+0000","last_change":"2024-09-12T17:05:51.556256+0000","last_active":"2024-09-12T17:05:58.587769+0000","last_peered":"2024-09-12T17:05:58.587769+0000","last_clean":"2024-09-12T17:05:58.587769+0000","last_became_active":"2024-09-12T17:05:51.554248+0000","last_became_peered":"2024-09-12T17:05:51.554248+0000","last_unstale":"2024-09-12T17:05:58.587769+0000","last_undegraded":"2024-09-12T17:05:58.587769+0000","last_fullsized":"2024-09-12T17:05:58.587769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.874638+0000","last_change":"2024-09-12T17:05:53.543908+0000","last_active":"2024-09-12T17:05:58.874638+0000","last_peered":"2024-09-12T17:05:58.874638+0000","last_clean":"2024-09-12T17:05:58.874638+0000","last_became_active":"2024-09-12T17:05:53.543248+0000","last_became_peered":"2024-09-12T17:05:53.543248+0000","last_unstale":"2024-09-12T17:05:58.874638+0000","last_undegraded":"2024-09-12T17:05:58.874638+0000","last_fullsized":"2024-09-12T17:05:58.874638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:58.909981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.604863+0000","last_change":"2024-09-12T17:05:55.567605+0000","last_active":"2024-09-12T17:05:58.604863+0000","last_peered":"2024-09-12T17:05:58.604863+0000","last_clean":"2024-09-12T17:05:58.604863+0000","last_became_active":"2024-09-12T17:05:55.566774+0000","last_became_peered":"2024-09-12T17:05:55.566774+0000","last_unstale":"2024-09-12T17:05:58.604863+0000","last_undegraded":"2024-09-12T17:05:58.604863+0000","last_fullsized":"2024-09-12T17:05:58.604863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:25.935376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600374+0000","last_change":"2024-09-12T17:05:58.121216+0000","last_active":"2024-09-12T17:05:58.600374+0000","last_peered":"2024-09-12T17:05:58.600374+0000","last_clean":"2024-09-12T17:05:58.600374+0000","last_became_active":"2024-09-12T17:05:58.120364+0000","last_became_peered":"2024-09-12T17:05:58.120364+0000","last_unstale":"2024-09-12T17:05:58.600374+0000","last_undegraded":"2024-09-12T17:05:58.600374+0000","last_fullsized":"2024-09-12T17:05:58.600374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.597085+0000","last_change":"2024-09-12T17:05:49.549956+0000","last_active":"2024-09-12T17:05:58.597085+0000","last_peered":"2024-09-12T17:05:58.597085+0000","last_clean":"2024-09-12T17:05:58.597085+0000","last_became_active":"2024-09-12T17:05:49.549481+0000","last_became_peered":"2024-09-12T17:05:49.549481+0000","last_unstale":"2024-09-12T17:05:58.597085+0000","last_undegraded":"2024-09-12T17:05:58.597085+0000","last_fullsized":"2024-09-12T17:05:58.597085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600945+0000","last_change":"2024-09-12T17:05:47.510898+0000","last_active":"2024-09-12T17:05:58.600945+0000","last_peered":"2024-09-12T17:05:58.600945+0000","last_clean":"2024-09-12T17:05:58.600945+0000","last_became_active":"2024-09-12T17:05:47.510462+0000","last_became_peered":"2024-09-12T17:05:47.510462+0000","last_unstale":"2024-09-12T17:05:58.600945+0000","last_undegraded":"2024-09-12T17:05:58.600945+0000","last_fullsized":"2024-09-12T17:05:58.600945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576572+0000","last_change":"2024-09-12T17:05:51.541454+0000","last_active":"2024-09-12T17:05:58.576572+0000","last_peered":"2024-09-12T17:05:58.576572+0000","last_clean":"2024-09-12T17:05:58.576572+0000","last_became_active":"2024-09-12T17:05:51.539938+0000","last_became_peered":"2024-09-12T17:05:51.539938+0000","last_unstale":"2024-09-12T17:05:58.576572+0000","last_undegraded":"2024-09-12T17:05:58.576572+0000","last_fullsized":"2024-09-12T17:05:58.576572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:18.328350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"36'5","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.115706+0000","last_change":"2024-09-12T17:05:53.555764+0000","last_active":"2024-09-12T17:05:59.115706+0000","last_peered":"2024-09-12T17:05:59.115706+0000","last_clean":"2024-09-12T17:05:59.115706+0000","last_became_active":"2024-09-12T17:05:53.552095+0000","last_became_peered":"2024-09-12T17:05:53.552095+0000","last_unstale":"2024-09-12T17:05:59.115706+0000","last_undegraded":"2024-09-12T17:05:59.115706+0000","last_fullsized":"2024-09-12T17:05:59.115706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577461+0000","last_change":"2024-09-12T17:05:55.571520+0000","last_active":"2024-09-12T17:05:58.577461+0000","last_peered":"2024-09-12T17:05:58.577461+0000","last_clean":"2024-09-12T17:05:58.577461+0000","last_became_active":"2024-09-12T17:05:55.570863+0000","last_became_peered":"2024-09-12T17:05:55.570863+0000","last_unstale":"2024-09-12T17:05:58.577461+0000","last_undegraded":"2024-09-12T17:05:58.577461+0000","last_fullsized":"2024-09-12T17:05:58.577461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582223+0000","last_change":"2024-09-12T17:05:57.602260+0000","last_active":"2024-09-12T17:05:58.582223+0000","last_peered":"2024-09-12T17:05:58.582223+0000","last_clean":"2024-09-12T17:05:58.582223+0000","last_became_active":"2024-09-12T17:05:57.601129+0000","last_became_peered":"2024-09-12T17:05:57.601129+0000","last_unstale":"2024-09-12T17:05:58.582223+0000","last_undegraded":"2024-09-12T17:05:58.582223+0000","last_fullsized":"2024-09-12T17:05:58.582223+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:30.928685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577225+0000","last_change":"2024-09-12T17:05:49.561555+0000","last_active":"2024-09-12T17:05:58.577225+0000","last_peered":"2024-09-12T17:05:58.577225+0000","last_clean":"2024-09-12T17:05:58.577225+0000","last_became_active":"2024-09-12T17:05:49.560875+0000","last_became_peered":"2024-09-12T17:05:49.560875+0000","last_unstale":"2024-09-12T17:05:58.577225+0000","last_undegraded":"2024-09-12T17:05:58.577225+0000","last_fullsized":"2024-09-12T17:05:58.577225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.493944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.593065+0000","last_change":"2024-09-12T17:05:47.528128+0000","last_active":"2024-09-12T17:05:58.593065+0000","last_peered":"2024-09-12T17:05:58.593065+0000","last_clean":"2024-09-12T17:05:58.593065+0000","last_became_active":"2024-09-12T17:05:47.527364+0000","last_became_peered":"2024-09-12T17:05:47.527364+0000","last_unstale":"2024-09-12T17:05:58.593065+0000","last_undegraded":"2024-09-12T17:05:58.593065+0000","last_fullsized":"2024-09-12T17:05:58.593065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.573343+0000","last_change":"2024-09-12T17:05:51.538719+0000","last_active":"2024-09-12T17:05:58.573343+0000","last_peered":"2024-09-12T17:05:58.573343+0000","last_clean":"2024-09-12T17:05:58.573343+0000","last_became_active":"2024-09-12T17:05:51.537497+0000","last_became_peered":"2024-09-12T17:05:51.537497+0000","last_unstale":"2024-09-12T17:05:58.573343+0000","last_undegraded":"2024-09-12T17:05:58.573343+0000","last_fullsized":"2024-09-12T17:05:58.573343+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:47.024849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.188582+0000","last_change":"2024-09-12T17:05:53.548391+0000","last_active":"2024-09-12T17:05:59.188582+0000","last_peered":"2024-09-12T17:05:59.188582+0000","last_clean":"2024-09-12T17:05:59.188582+0000","last_became_active":"2024-09-12T17:05:53.547202+0000","last_became_peered":"2024-09-12T17:05:53.547202+0000","last_unstale":"2024-09-12T17:05:59.188582+0000","last_undegraded":"2024-09-12T17:05:59.188582+0000","last_fullsized":"2024-09-12T17:05:59.188582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:00.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590209+0000","last_change":"2024-09-12T17:05:55.566243+0000","last_active":"2024-09-12T17:05:58.590209+0000","last_peered":"2024-09-12T17:05:58.590209+0000","last_clean":"2024-09-12T17:05:58.590209+0000","last_became_active":"2024-09-12T17:05:55.565403+0000","last_became_peered":"2024-09-12T17:05:55.565403+0000","last_unstale":"2024-09-12T17:05:58.590209+0000","last_undegraded":"2024-09-12T17:05:58.590209+0000","last_fullsized":"2024-09-12T17:05:58.590209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.583204+0000","last_change":"2024-09-12T17:05:57.589526+0000","last_active":"2024-09-12T17:05:58.583204+0000","last_peered":"2024-09-12T17:05:58.583204+0000","last_clean":"2024-09-12T17:05:58.583204+0000","last_became_active":"2024-09-12T17:05:57.588626+0000","last_became_peered":"2024-09-12T17:05:57.588626+0000","last_unstale":"2024-09-12T17:05:58.583204+0000","last_undegraded":"2024-09-12T17:05:58.583204+0000","last_fullsized":"2024-09-12T17:05:58.583204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.472663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576506+0000","last_change":"2024-09-12T17:05:49.546327+0000","last_active":"2024-09-12T17:05:58.576506+0000","last_peered":"2024-09-12T17:05:58.576506+0000","last_clean":"2024-09-12T17:05:58.576506+0000","last_became_active":"2024-09-12T17:05:49.545846+0000","last_became_peered":"2024-09-12T17:05:49.545846+0000","last_unstale":"2024-09-12T17:05:58.576506+0000","last_undegraded":"2024-09-12T17:05:58.576506+0000","last_fullsized":"2024-09-12T17:05:58.576506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:30.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.604887+0000","last_change":"2024-09-12T17:05:47.532523+0000","last_active":"2024-09-12T17:05:58.604887+0000","last_peered":"2024-09-12T17:05:58.604887+0000","last_clean":"2024-09-12T17:05:58.604887+0000","last_became_active":"2024-09-12T17:05:47.531750+0000","last_became_peered":"2024-09-12T17:05:47.531750+0000","last_unstale":"2024-09-12T17:05:58.604887+0000","last_undegraded":"2024-09-12T17:05:58.604887+0000","last_fullsized":"2024-09-12T17:05:58.604887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:03.075435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576623+0000","last_change":"2024-09-12T17:05:49.543168+0000","last_active":"2024-09-12T17:05:58.576623+0000","last_peered":"2024-09-12T17:05:58.576623+0000","last_clean":"2024-09-12T17:05:58.576623+0000","last_became_active":"2024-09-12T17:05:49.541557+0000","last_became_peered":"2024-09-12T17:05:49.541557+0000","last_unstale":"2024-09-12T17:05:58.576623+0000","last_undegraded":"2024-09-12T17:05:58.576623+0000","last_fullsized":"2024-09-12T17:05:58.576623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:15.303353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.618306+0000","last_change":"2024-09-12T17:05:47.526020+0000","last_active":"2024-09-12T17:05:58.618306+0000","last_peered":"2024-09-12T17:05:58.618306+0000","last_clean":"2024-09-12T17:05:58.618306+0000","last_became_active":"2024-09-12T17:05:47.525481+0000","last_became_peered":"2024-09-12T17:05:47.525481+0000","last_unstale":"2024-09-12T17:05:58.618306+0000","last_undegraded":"2024-09-12T17:05:58.618306+0000","last_fullsized":"2024-09-12T17:05:58.618306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:05.949135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589133+0000","last_change":"2024-09-12T17:05:49.546848+0000","last_active":"2024-09-12T17:05:58.589133+0000","last_peered":"2024-09-12T17:05:58.589133+0000","last_clean":"2024-09-12T17:05:58.589133+0000","last_became_active":"2024-09-12T17:05:49.545382+0000","last_became_peered":"2024-09-12T17:05:49.545382+0000","last_unstale":"2024-09-12T17:05:58.589133+0000","last_undegraded":"2024-09-12T17:05:58.589133+0000","last_fullsized":"2024-09-12T17:05:58.589133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:42.832972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588498+0000","last_change":"2024-09-12T17:05:47.543411+0000","last_active":"2024-09-12T17:05:58.588498+0000","last_peered":"2024-09-12T17:05:58.588498+0000","last_clean":"2024-09-12T17:05:58.588498+0000","last_became_active":"2024-09-12T17:05:47.535268+0000","last_became_peered":"2024-09-12T17:05:47.535268+0000","last_unstale":"2024-09-12T17:05:58.588498+0000","last_undegraded":"2024-09-12T17:05:58.588498+0000","last_fullsized":"2024-09-12T17:05:58.588498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:26.531937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575290+0000","last_change":"2024-09-12T17:05:49.534157+0000","last_active":"2024-09-12T17:05:58.575290+0000","last_peered":"2024-09-12T17:05:58.575290+0000","last_clean":"2024-09-12T17:05:58.575290+0000","last_became_active":"2024-09-12T17:05:49.533575+0000","last_became_peered":"2024-09-12T17:05:49.533575+0000","last_unstale":"2024-09-12T17:05:58.575290+0000","last_undegraded":"2024-09-12T17:05:58.575290+0000","last_fullsized":"2024-09-12T17:05:58.575290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:39.976851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591395+0000","last_change":"2024-09-12T17:05:47.530275+0000","last_active":"2024-09-12T17:05:58.591395+0000","last_peered":"2024-09-12T17:05:58.591395+0000","last_clean":"2024-09-12T17:05:58.591395+0000","last_became_active":"2024-09-12T17:05:47.529857+0000","last_became_peered":"2024-09-12T17:05:47.529857+0000","last_unstale":"2024-09-12T17:05:58.591395+0000","last_undegraded":"2024-09-12T17:05:58.591395+0000","last_fullsized":"2024-09-12T17:05:58.591395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:47.999516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.598592+0000","last_change":"2024-09-12T17:05:49.525070+0000","last_active":"2024-09-12T17:05:58.598592+0000","last_peered":"2024-09-12T17:05:58.598592+0000","last_clean":"2024-09-12T17:05:58.598592+0000","last_became_active":"2024-09-12T17:05:49.524567+0000","last_became_peered":"2024-09-12T17:05:49.524567+0000","last_unstale":"2024-09-12T17:05:58.598592+0000","last_undegraded":"2024-09-12T17:05:58.598592+0000","last_fullsized":"2024-09-12T17:05:58.598592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:34.320123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600457+0000","last_change":"2024-09-12T17:05:47.547765+0000","last_active":"2024-09-12T17:05:58.600457+0000","last_peered":"2024-09-12T17:05:58.600457+0000","last_clean":"2024-09-12T17:05:58.600457+0000","last_became_active":"2024-09-12T17:05:47.547393+0000","last_became_peered":"2024-09-12T17:05:47.547393+0000","last_unstale":"2024-09-12T17:05:58.600457+0000","last_undegraded":"2024-09-12T17:05:58.600457+0000","last_fullsized":"2024-09-12T17:05:58.600457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:46.746261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580790+0000","last_change":"2024-09-12T17:05:49.561711+0000","last_active":"2024-09-12T17:05:58.580790+0000","last_peered":"2024-09-12T17:05:58.580790+0000","last_clean":"2024-09-12T17:05:58.580790+0000","last_became_active":"2024-09-12T17:05:49.560993+0000","last_became_peered":"2024-09-12T17:05:49.560993+0000","last_unstale":"2024-09-12T17:05:58.580790+0000","last_undegraded":"2024-09-12T17:05:58.580790+0000","last_fullsized":"2024-09-12T17:05:58.580790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:38.400338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576491+0000","last_change":"2024-09-12T17:05:47.521696+0000","last_active":"2024-09-12T17:05:58.576491+0000","last_peered":"2024-09-12T17:05:58.576491+0000","last_clean":"2024-09-12T17:05:58.576491+0000","last_became_active":"2024-09-12T17:05:47.521333+0000","last_became_peered":"2024-09-12T17:05:47.521333+0000","last_unstale":"2024-09-12T17:05:58.576491+0000","last_undegraded":"2024-09-12T17:05:58.576491+0000","last_fullsized":"2024-09-12T17:05:58.576491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:16.633903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596552+0000","last_change":"2024-09-12T17:05:49.543789+0000","last_active":"2024-09-12T17:05:58.596552+0000","last_peered":"2024-09-12T17:05:58.596552+0000","last_clean":"2024-09-12T17:05:58.596552+0000","last_became_active":"2024-09-12T17:05:49.543491+0000","last_became_peered":"2024-09-12T17:05:49.543491+0000","last_unstale":"2024-09-12T17:05:58.596552+0000","last_undegraded":"2024-09-12T17:05:58.596552+0000","last_fullsized":"2024-09-12T17:05:58.596552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606755+0000","last_change":"2024-09-12T17:05:47.541213+0000","last_active":"2024-09-12T17:05:58.606755+0000","last_peered":"2024-09-12T17:05:58.606755+0000","last_clean":"2024-09-12T17:05:58.606755+0000","last_became_active":"2024-09-12T17:05:47.540469+0000","last_became_peered":"2024-09-12T17:05:47.540469+0000","last_unstale":"2024-09-12T17:05:58.606755+0000","last_undegraded":"2024-09-12T17:05:58.606755+0000","last_fullsized":"2024-09-12T17:05:58.606755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:26.620021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.604717+0000","last_change":"2024-09-12T17:05:49.541113+0000","last_active":"2024-09-12T17:05:58.604717+0000","last_peered":"2024-09-12T17:05:58.604717+0000","last_clean":"2024-09-12T17:05:58.604717+0000","last_became_active":"2024-09-12T17:05:49.540395+0000","last_became_peered":"2024-09-12T17:05:49.540395+0000","last_unstale":"2024-09-12T17:05:58.604717+0000","last_undegraded":"2024-09-12T17:05:58.604717+0000","last_fullsized":"2024-09-12T17:05:58.604717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:32.506502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.601241+0000","last_change":"2024-09-12T17:05:47.539986+0000","last_active":"2024-09-12T17:05:58.601241+0000","last_peered":"2024-09-12T17:05:58.601241+0000","last_clean":"2024-09-12T17:05:58.601241+0000","last_became_active":"2024-09-12T17:05:47.539603+0000","last_became_peered":"2024-09-12T17:05:47.539603+0000","last_unstale":"2024-09-12T17:05:58.601241+0000","last_undegraded":"2024-09-12T17:05:58.601241+0000","last_fullsized":"2024-09-12T17:05:58.601241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592738+0000","last_change":"2024-09-12T17:05:49.533938+0000","last_active":"2024-09-12T17:05:58.592738+0000","last_peered":"2024-09-12T17:05:58.592738+0000","last_clean":"2024-09-12T17:05:58.592738+0000","last_became_active":"2024-09-12T17:05:49.531769+0000","last_became_peered":"2024-09-12T17:05:49.531769+0000","last_unstale":"2024-09-12T17:05:58.592738+0000","last_undegraded":"2024-09-12T17:05:58.592738+0000","last_fullsized":"2024-09-12T17:05:58.592738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:33.763423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588153+0000","last_change":"2024-09-12T17:05:47.525739+0000","last_active":"2024-09-12T17:05:58.588153+0000","last_peered":"2024-09-12T17:05:58.588153+0000","last_clean":"2024-09-12T17:05:58.588153+0000","last_became_active":"2024-09-12T17:05:47.524922+0000","last_became_peered":"2024-09-12T17:05:47.524922+0000","last_unstale":"2024-09-12T17:05:58.588153+0000","last_undegraded":"2024-09-12T17:05:58.588153+0000","last_fullsized":"2024-09-12T17:05:58.588153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580448+0000","last_change":"2024-09-12T17:05:49.555307+0000","last_active":"2024-09-12T17:05:58.580448+0000","last_peered":"2024-09-12T17:05:58.580448+0000","last_clean":"2024-09-12T17:05:58.580448+0000","last_became_active":"2024-09-12T17:05:49.554566+0000","last_became_peered":"2024-09-12T17:05:49.554566+0000","last_unstale":"2024-09-12T17:05:58.580448+0000","last_undegraded":"2024-09-12T17:05:58.580448+0000","last_fullsized":"2024-09-12T17:05:58.580448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:45.017623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.597179+0000","last_change":"2024-09-12T17:05:47.543468+0000","last_active":"2024-09-12T17:05:58.597179+0000","last_peered":"2024-09-12T17:05:58.597179+0000","last_clean":"2024-09-12T17:05:58.597179+0000","last_became_active":"2024-09-12T17:05:47.542753+0000","last_became_peered":"2024-09-12T17:05:47.542753+0000","last_unstale":"2024-09-12T17:05:58.597179+0000","last_undegraded":"2024-09-12T17:05:58.597179+0000","last_fullsized":"2024-09-12T17:05:58.597179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619548+0000","last_change":"2024-09-12T17:05:49.536693+0000","last_active":"2024-09-12T17:05:58.619548+0000","last_peered":"2024-09-12T17:05:58.619548+0000","last_clean":"2024-09-12T17:05:58.619548+0000","last_became_active":"2024-09-12T17:05:49.536385+0000","last_became_peered":"2024-09-12T17:05:49.536385+0000","last_unstale":"2024-09-12T17:05:58.619548+0000","last_undegraded":"2024-09-12T17:05:58.619548+0000","last_fullsized":"2024-09-12T17:05:58.619548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.024498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588348+0000","last_change":"2024-09-12T17:05:47.545251+0000","last_active":"2024-09-12T17:05:58.588348+0000","last_peered":"2024-09-12T17:05:58.588348+0000","last_clean":"2024-09-12T17:05:58.588348+0000","last_became_active":"2024-09-12T17:05:47.544406+0000","last_became_peered":"2024-09-12T17:05:47.544406+0000","last_unstale":"2024-09-12T17:05:58.588348+0000","last_undegraded":"2024-09-12T17:05:58.588348+0000","last_fullsized":"2024-09-12T17:05:58.588348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:52.167194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582723+0000","last_change":"2024-09-12T17:05:49.564446+0000","last_active":"2024-09-12T17:05:58.582723+0000","last_peered":"2024-09-12T17:05:58.582723+0000","last_clean":"2024-09-12T17:05:58.582723+0000","last_became_active":"2024-09-12T17:05:49.563625+0000","last_became_peered":"2024-09-12T17:05:49.563625+0000","last_unstale":"2024-09-12T17:05:58.582723+0000","last_undegraded":"2024-09-12T17:05:58.582723+0000","last_fullsized":"2024-09-12T17:05:58.582723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.324265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591643+0000","last_change":"2024-09-12T17:05:47.558422+0000","last_active":"2024-09-12T17:05:58.591643+0000","last_peered":"2024-09-12T17:05:58.591643+0000","last_clean":"2024-09-12T17:05:58.591643+0000","last_became_active":"2024-09-12T17:05:47.558047+0000","last_became_peered":"2024-09-12T17:05:47.558047+0000","last_unstale":"2024-09-12T17:05:58.591643+0000","last_undegraded":"2024-09-12T17:05:58.591643+0000","last_fullsized":"2024-09-12T17:05:58.591643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:25.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579174+0000","last_change":"2024-09-12T17:05:49.522750+0000","last_active":"2024-09-12T17:05:58.579174+0000","last_peered":"2024-09-12T17:05:58.579174+0000","last_clean":"2024-09-12T17:05:58.579174+0000","last_became_active":"2024-09-12T17:05:49.522097+0000","last_became_peered":"2024-09-12T17:05:49.522097+0000","last_unstale":"2024-09-12T17:05:58.579174+0000","last_undegraded":"2024-09-12T17:05:58.579174+0000","last_fullsized":"2024-09-12T17:05:58.579174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.607154+0000","last_change":"2024-09-12T17:05:47.552865+0000","last_active":"2024-09-12T17:05:58.607154+0000","last_peered":"2024-09-12T17:05:58.607154+0000","last_clean":"2024-09-12T17:05:58.607154+0000","last_became_active":"2024-09-12T17:05:47.552207+0000","last_became_peered":"2024-09-12T17:05:47.552207+0000","last_unstale":"2024-09-12T17:05:58.607154+0000","last_undegraded":"2024-09-12T17:05:58.607154+0000","last_fullsized":"2024-09-12T17:05:58.607154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:00.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589972+0000","last_change":"2024-09-12T17:05:49.544019+0000","last_active":"2024-09-12T17:05:58.589972+0000","last_peered":"2024-09-12T17:05:58.589972+0000","last_clean":"2024-09-12T17:05:58.589972+0000","last_became_active":"2024-09-12T17:05:49.543623+0000","last_became_peered":"2024-09-12T17:05:49.543623+0000","last_unstale":"2024-09-12T17:05:58.589972+0000","last_undegraded":"2024-09-12T17:05:58.589972+0000","last_fullsized":"2024-09-12T17:05:58.589972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:26.353496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.583210+0000","last_change":"2024-09-12T17:05:47.561338+0000","last_active":"2024-09-12T17:05:58.583210+0000","last_peered":"2024-09-12T17:05:58.583210+0000","last_clean":"2024-09-12T17:05:58.583210+0000","last_became_active":"2024-09-12T17:05:47.560439+0000","last_became_peered":"2024-09-12T17:05:47.560439+0000","last_unstale":"2024-09-12T17:05:58.583210+0000","last_undegraded":"2024-09-12T17:05:58.583210+0000","last_fullsized":"2024-09-12T17:05:58.583210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:58.530869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596304+0000","last_change":"2024-09-12T17:05:49.526384+0000","last_active":"2024-09-12T17:05:58.596304+0000","last_peered":"2024-09-12T17:05:58.596304+0000","last_clean":"2024-09-12T17:05:58.596304+0000","last_became_active":"2024-09-12T17:05:49.526023+0000","last_became_peered":"2024-09-12T17:05:49.526023+0000","last_unstale":"2024-09-12T17:05:58.596304+0000","last_undegraded":"2024-09-12T17:05:58.596304+0000","last_fullsized":"2024-09-12T17:05:58.596304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:34.498841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.620178+0000","last_change":"2024-09-12T17:05:47.512066+0000","last_active":"2024-09-12T17:05:58.620178+0000","last_peered":"2024-09-12T17:05:58.620178+0000","last_clean":"2024-09-12T17:05:58.620178+0000","last_became_active":"2024-09-12T17:05:47.511470+0000","last_became_peered":"2024-09-12T17:05:47.511470+0000","last_unstale":"2024-09-12T17:05:58.620178+0000","last_undegraded":"2024-09-12T17:05:58.620178+0000","last_fullsized":"2024-09-12T17:05:58.620178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:38.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576480+0000","last_change":"2024-09-12T17:05:49.523060+0000","last_active":"2024-09-12T17:05:58.576480+0000","last_peered":"2024-09-12T17:05:58.576480+0000","last_clean":"2024-09-12T17:05:58.576480+0000","last_became_active":"2024-09-12T17:05:49.522157+0000","last_became_peered":"2024-09-12T17:05:49.522157+0000","last_unstale":"2024-09-12T17:05:58.576480+0000","last_undegraded":"2024-09-12T17:05:58.576480+0000","last_fullsized":"2024-09-12T17:05:58.576480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590460+0000","last_change":"2024-09-12T17:05:47.538305+0000","last_active":"2024-09-12T17:05:58.590460+0000","last_peered":"2024-09-12T17:05:58.590460+0000","last_clean":"2024-09-12T17:05:58.590460+0000","last_became_active":"2024-09-12T17:05:47.535569+0000","last_became_peered":"2024-09-12T17:05:47.535569+0000","last_unstale":"2024-09-12T17:05:58.590460+0000","last_undegraded":"2024-09-12T17:05:58.590460+0000","last_fullsized":"2024-09-12T17:05:58.590460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:24.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587897+0000","last_change":"2024-09-12T17:05:47.537712+0000","last_active":"2024-09-12T17:05:58.587897+0000","last_peered":"2024-09-12T17:05:58.587897+0000","last_clean":"2024-09-12T17:05:58.587897+0000","last_became_active":"2024-09-12T17:05:47.536958+0000","last_became_peered":"2024-09-12T17:05:47.536958+0000","last_unstale":"2024-09-12T17:05:58.587897+0000","last_undegraded":"2024-09-12T17:05:58.587897+0000","last_fullsized":"2024-09-12T17:05:58.587897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592319+0000","last_change":"2024-09-12T17:05:49.544841+0000","last_active":"2024-09-12T17:05:58.592319+0000","last_peered":"2024-09-12T17:05:58.592319+0000","last_clean":"2024-09-12T17:05:58.592319+0000","last_became_active":"2024-09-12T17:05:49.538757+0000","last_became_peered":"2024-09-12T17:05:49.538757+0000","last_unstale":"2024-09-12T17:05:58.592319+0000","last_undegraded":"2024-09-12T17:05:58.592319+0000","last_fullsized":"2024-09-12T17:05:58.592319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.976348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.574014+0000","last_change":"2024-09-12T17:05:47.543930+0000","last_active":"2024-09-12T17:05:58.574014+0000","last_peered":"2024-09-12T17:05:58.574014+0000","last_clean":"2024-09-12T17:05:58.574014+0000","last_became_active":"2024-09-12T17:05:47.542875+0000","last_became_peered":"2024-09-12T17:05:47.542875+0000","last_unstale":"2024-09-12T17:05:58.574014+0000","last_undegraded":"2024-09-12T17:05:58.574014+0000","last_fullsized":"2024-09-12T17:05:58.574014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:28.114730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589496+0000","last_change":"2024-09-12T17:05:49.552327+0000","last_active":"2024-09-12T17:05:58.589496+0000","last_peered":"2024-09-12T17:05:58.589496+0000","last_clean":"2024-09-12T17:05:58.589496+0000","last_became_active":"2024-09-12T17:05:49.551604+0000","last_became_peered":"2024-09-12T17:05:49.551604+0000","last_unstale":"2024-09-12T17:05:58.589496+0000","last_undegraded":"2024-09-12T17:05:58.589496+0000","last_fullsized":"2024-09-12T17:05:58.589496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:55.648527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36368,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335472,"statfs":{"total":96636764160,"available":96599523328,"internally_reserved":0,"allocated":1044480,"data_stored":768728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35760,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336080,"statfs":{"total":96636764160,"available":96600145920,"internally_reserved":0,"allocated":425984,"data_stored":177700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":479232,"data_stored":178983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":413696,"data_stored":177198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":446464,"data_stored":178532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":417792,"data_stored":178255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35784,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336056,"statfs":{"total":96636764160,"available":96600121344,"internally_reserved":0,"allocated":446464,"data_stored":177969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1028096,"data_stored":769127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:06:05.556 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:06:05.923 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:06:05.932 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:06:05.946 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":45,"stamp":"2024-09-12T17:06:03.912779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":196,"num_object_clones":0,"num_object_copies":392,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":196,"num_whiteouts":0,"num_read":758,"num_read_kb":506,"num_write":530,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":274896,"kb_used_data":4592,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":754699824,"statfs":{"total":773094113280,"available":772812619776,"internally_reserved":0,"allocated":4702208,"data_stored":2606492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":276614704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.357325"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.581245+0000","last_change":"2024-09-12T17:05:47.561581+0000","last_active":"2024-09-12T17:05:58.581245+0000","last_peered":"2024-09-12T17:05:58.581245+0000","last_clean":"2024-09-12T17:05:58.581245+0000","last_became_active":"2024-09-12T17:05:47.560791+0000","last_became_peered":"2024-09-12T17:05:47.560791+0000","last_unstale":"2024-09-12T17:05:58.581245+0000","last_undegraded":"2024-09-12T17:05:58.581245+0000","last_fullsized":"2024-09-12T17:05:58.581245+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:23.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587439+0000","last_change":"2024-09-12T17:05:49.558060+0000","last_active":"2024-09-12T17:05:58.587439+0000","last_peered":"2024-09-12T17:05:58.587439+0000","last_clean":"2024-09-12T17:05:58.587439+0000","last_became_active":"2024-09-12T17:05:49.557287+0000","last_became_peered":"2024-09-12T17:05:49.557287+0000","last_unstale":"2024-09-12T17:05:58.587439+0000","last_undegraded":"2024-09-12T17:05:58.587439+0000","last_fullsized":"2024-09-12T17:05:58.587439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576124+0000","last_change":"2024-09-12T17:05:47.523906+0000","last_active":"2024-09-12T17:05:58.576124+0000","last_peered":"2024-09-12T17:05:58.576124+0000","last_clean":"2024-09-12T17:05:58.576124+0000","last_became_active":"2024-09-12T17:05:47.523594+0000","last_became_peered":"2024-09-12T17:05:47.523594+0000","last_unstale":"2024-09-12T17:05:58.576124+0000","last_undegraded":"2024-09-12T17:05:58.576124+0000","last_fullsized":"2024-09-12T17:05:58.576124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:54.958627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577181+0000","last_change":"2024-09-12T17:05:49.546025+0000","last_active":"2024-09-12T17:05:58.577181+0000","last_peered":"2024-09-12T17:05:58.577181+0000","last_clean":"2024-09-12T17:05:58.577181+0000","last_became_active":"2024-09-12T17:05:49.545284+0000","last_became_peered":"2024-09-12T17:05:49.545284+0000","last_unstale":"2024-09-12T17:05:58.577181+0000","last_undegraded":"2024-09-12T17:05:58.577181+0000","last_fullsized":"2024-09-12T17:05:58.577181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.147865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592173+0000","last_change":"2024-09-12T17:05:47.523052+0000","last_active":"2024-09-12T17:05:58.592173+0000","last_peered":"2024-09-12T17:05:58.592173+0000","last_clean":"2024-09-12T17:05:58.592173+0000","last_became_active":"2024-09-12T17:05:47.522544+0000","last_became_peered":"2024-09-12T17:05:47.522544+0000","last_unstale":"2024-09-12T17:05:58.592173+0000","last_undegraded":"2024-09-12T17:05:58.592173+0000","last_fullsized":"2024-09-12T17:05:58.592173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582389+0000","last_change":"2024-09-12T17:05:49.549990+0000","last_active":"2024-09-12T17:05:58.582389+0000","last_peered":"2024-09-12T17:05:58.582389+0000","last_clean":"2024-09-12T17:05:58.582389+0000","last_became_active":"2024-09-12T17:05:49.549241+0000","last_became_peered":"2024-09-12T17:05:49.549241+0000","last_unstale":"2024-09-12T17:05:58.582389+0000","last_undegraded":"2024-09-12T17:05:58.582389+0000","last_fullsized":"2024-09-12T17:05:58.582389+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.601256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588701+0000","last_change":"2024-09-12T17:05:47.538653+0000","last_active":"2024-09-12T17:05:58.588701+0000","last_peered":"2024-09-12T17:05:58.588701+0000","last_clean":"2024-09-12T17:05:58.588701+0000","last_became_active":"2024-09-12T17:05:47.535608+0000","last_became_peered":"2024-09-12T17:05:47.535608+0000","last_unstale":"2024-09-12T17:05:58.588701+0000","last_undegraded":"2024-09-12T17:05:58.588701+0000","last_fullsized":"2024-09-12T17:05:58.588701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591180+0000","last_change":"2024-09-12T17:05:49.542142+0000","last_active":"2024-09-12T17:05:58.591180+0000","last_peered":"2024-09-12T17:05:58.591180+0000","last_clean":"2024-09-12T17:05:58.591180+0000","last_became_active":"2024-09-12T17:05:49.541354+0000","last_became_peered":"2024-09-12T17:05:49.541354+0000","last_unstale":"2024-09-12T17:05:58.591180+0000","last_undegraded":"2024-09-12T17:05:58.591180+0000","last_fullsized":"2024-09-12T17:05:58.591180+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.147865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579558+0000","last_change":"2024-09-12T17:05:47.556154+0000","last_active":"2024-09-12T17:05:58.579558+0000","last_peered":"2024-09-12T17:05:58.579558+0000","last_clean":"2024-09-12T17:05:58.579558+0000","last_became_active":"2024-09-12T17:05:47.555396+0000","last_became_peered":"2024-09-12T17:05:47.555396+0000","last_unstale":"2024-09-12T17:05:58.579558+0000","last_undegraded":"2024-09-12T17:05:58.579558+0000","last_fullsized":"2024-09-12T17:05:58.579558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:27.784208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605568+0000","last_change":"2024-09-12T17:05:49.529344+0000","last_active":"2024-09-12T17:05:58.605568+0000","last_peered":"2024-09-12T17:05:58.605568+0000","last_clean":"2024-09-12T17:05:58.605568+0000","last_became_active":"2024-09-12T17:05:49.528184+0000","last_became_peered":"2024-09-12T17:05:49.528184+0000","last_unstale":"2024-09-12T17:05:58.605568+0000","last_undegraded":"2024-09-12T17:05:58.605568+0000","last_fullsized":"2024-09-12T17:05:58.605568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:18.357328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587858+0000","last_change":"2024-09-12T17:05:47.532931+0000","last_active":"2024-09-12T17:05:58.587858+0000","last_peered":"2024-09-12T17:05:58.587858+0000","last_clean":"2024-09-12T17:05:58.587858+0000","last_became_active":"2024-09-12T17:05:47.531427+0000","last_became_peered":"2024-09-12T17:05:47.531427+0000","last_unstale":"2024-09-12T17:05:58.587858+0000","last_undegraded":"2024-09-12T17:05:58.587858+0000","last_fullsized":"2024-09-12T17:05:58.587858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578698+0000","last_change":"2024-09-12T17:05:49.550694+0000","last_active":"2024-09-12T17:05:58.578698+0000","last_peered":"2024-09-12T17:05:58.578698+0000","last_clean":"2024-09-12T17:05:58.578698+0000","last_became_active":"2024-09-12T17:05:49.549066+0000","last_became_peered":"2024-09-12T17:05:49.549066+0000","last_unstale":"2024-09-12T17:05:58.578698+0000","last_undegraded":"2024-09-12T17:05:58.578698+0000","last_fullsized":"2024-09-12T17:05:58.578698+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:24.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577623+0000","last_change":"2024-09-12T17:05:47.560085+0000","last_active":"2024-09-12T17:05:58.577623+0000","last_peered":"2024-09-12T17:05:58.577623+0000","last_clean":"2024-09-12T17:05:58.577623+0000","last_became_active":"2024-09-12T17:05:47.559160+0000","last_became_peered":"2024-09-12T17:05:47.559160+0000","last_unstale":"2024-09-12T17:05:58.577623+0000","last_undegraded":"2024-09-12T17:05:58.577623+0000","last_fullsized":"2024-09-12T17:05:58.577623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:06.664677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589075+0000","last_change":"2024-09-12T17:05:49.550593+0000","last_active":"2024-09-12T17:05:58.589075+0000","last_peered":"2024-09-12T17:05:58.589075+0000","last_clean":"2024-09-12T17:05:58.589075+0000","last_became_active":"2024-09-12T17:05:49.549728+0000","last_became_peered":"2024-09-12T17:05:49.549728+0000","last_unstale":"2024-09-12T17:05:58.589075+0000","last_undegraded":"2024-09-12T17:05:58.589075+0000","last_fullsized":"2024-09-12T17:05:58.589075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:06.399711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596775+0000","last_change":"2024-09-12T17:05:47.528197+0000","last_active":"2024-09-12T17:05:58.596775+0000","last_peered":"2024-09-12T17:05:58.596775+0000","last_clean":"2024-09-12T17:05:58.596775+0000","last_became_active":"2024-09-12T17:05:47.527467+0000","last_became_peered":"2024-09-12T17:05:47.527467+0000","last_unstale":"2024-09-12T17:05:58.596775+0000","last_undegraded":"2024-09-12T17:05:58.596775+0000","last_fullsized":"2024-09-12T17:05:58.596775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:55.688363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619837+0000","last_change":"2024-09-12T17:05:49.538965+0000","last_active":"2024-09-12T17:05:58.619837+0000","last_peered":"2024-09-12T17:05:58.619837+0000","last_clean":"2024-09-12T17:05:58.619837+0000","last_became_active":"2024-09-12T17:05:49.538637+0000","last_became_peered":"2024-09-12T17:05:49.538637+0000","last_unstale":"2024-09-12T17:05:58.619837+0000","last_undegraded":"2024-09-12T17:05:58.619837+0000","last_fullsized":"2024-09-12T17:05:58.619837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:13.671675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576989+0000","last_change":"2024-09-12T17:05:49.549575+0000","last_active":"2024-09-12T17:05:58.576989+0000","last_peered":"2024-09-12T17:05:58.576989+0000","last_clean":"2024-09-12T17:05:58.576989+0000","last_became_active":"2024-09-12T17:05:49.548292+0000","last_became_peered":"2024-09-12T17:05:49.548292+0000","last_unstale":"2024-09-12T17:05:58.576989+0000","last_undegraded":"2024-09-12T17:05:58.576989+0000","last_fullsized":"2024-09-12T17:05:58.576989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580158+0000","last_change":"2024-09-12T17:05:47.559881+0000","last_active":"2024-09-12T17:05:58.580158+0000","last_peered":"2024-09-12T17:05:58.580158+0000","last_clean":"2024-09-12T17:05:58.580158+0000","last_became_active":"2024-09-12T17:05:47.559165+0000","last_became_peered":"2024-09-12T17:05:47.559165+0000","last_unstale":"2024-09-12T17:05:58.580158+0000","last_undegraded":"2024-09-12T17:05:58.580158+0000","last_fullsized":"2024-09-12T17:05:58.580158+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:35.318480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577402+0000","last_change":"2024-09-12T17:05:49.538723+0000","last_active":"2024-09-12T17:05:58.577402+0000","last_peered":"2024-09-12T17:05:58.577402+0000","last_clean":"2024-09-12T17:05:58.577402+0000","last_became_active":"2024-09-12T17:05:49.537974+0000","last_became_peered":"2024-09-12T17:05:49.537974+0000","last_unstale":"2024-09-12T17:05:58.577402+0000","last_undegraded":"2024-09-12T17:05:58.577402+0000","last_fullsized":"2024-09-12T17:05:58.577402+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:31.868549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606365+0000","last_change":"2024-09-12T17:05:47.528338+0000","last_active":"2024-09-12T17:05:58.606365+0000","last_peered":"2024-09-12T17:05:58.606365+0000","last_clean":"2024-09-12T17:05:58.606365+0000","last_became_active":"2024-09-12T17:05:47.527533+0000","last_became_peered":"2024-09-12T17:05:47.527533+0000","last_unstale":"2024-09-12T17:05:58.606365+0000","last_undegraded":"2024-09-12T17:05:58.606365+0000","last_fullsized":"2024-09-12T17:05:58.606365+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.693731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588238+0000","last_change":"2024-09-12T17:05:49.543097+0000","last_active":"2024-09-12T17:05:58.588238+0000","last_peered":"2024-09-12T17:05:58.588238+0000","last_clean":"2024-09-12T17:05:58.588238+0000","last_became_active":"2024-09-12T17:05:49.542113+0000","last_became_peered":"2024-09-12T17:05:49.542113+0000","last_unstale":"2024-09-12T17:05:58.588238+0000","last_undegraded":"2024-09-12T17:05:58.588238+0000","last_fullsized":"2024-09-12T17:05:58.588238+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606704+0000","last_change":"2024-09-12T17:05:47.529868+0000","last_active":"2024-09-12T17:05:58.606704+0000","last_peered":"2024-09-12T17:05:58.606704+0000","last_clean":"2024-09-12T17:05:58.606704+0000","last_became_active":"2024-09-12T17:05:47.529083+0000","last_became_peered":"2024-09-12T17:05:47.529083+0000","last_unstale":"2024-09-12T17:05:58.606704+0000","last_undegraded":"2024-09-12T17:05:58.606704+0000","last_fullsized":"2024-09-12T17:05:58.606704+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:16.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619058+0000","last_change":"2024-09-12T17:05:49.548084+0000","last_active":"2024-09-12T17:05:58.619058+0000","last_peered":"2024-09-12T17:05:58.619058+0000","last_clean":"2024-09-12T17:05:58.619058+0000","last_became_active":"2024-09-12T17:05:49.539930+0000","last_became_peered":"2024-09-12T17:05:49.539930+0000","last_unstale":"2024-09-12T17:05:58.619058+0000","last_undegraded":"2024-09-12T17:05:58.619058+0000","last_fullsized":"2024-09-12T17:05:58.619058+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:11.453390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.581656+0000","last_change":"2024-09-12T17:05:47.548316+0000","last_active":"2024-09-12T17:05:58.581656+0000","last_peered":"2024-09-12T17:05:58.581656+0000","last_clean":"2024-09-12T17:05:58.581656+0000","last_became_active":"2024-09-12T17:05:47.547430+0000","last_became_peered":"2024-09-12T17:05:47.547430+0000","last_unstale":"2024-09-12T17:05:58.581656+0000","last_undegraded":"2024-09-12T17:05:58.581656+0000","last_fullsized":"2024-09-12T17:05:58.581656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:21.143073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619216+0000","last_change":"2024-09-12T17:05:49.556144+0000","last_active":"2024-09-12T17:05:58.619216+0000","last_peered":"2024-09-12T17:05:58.619216+0000","last_clean":"2024-09-12T17:05:58.619216+0000","last_became_active":"2024-09-12T17:05:49.555033+0000","last_became_peered":"2024-09-12T17:05:49.555033+0000","last_unstale":"2024-09-12T17:05:58.619216+0000","last_undegraded":"2024-09-12T17:05:58.619216+0000","last_fullsized":"2024-09-12T17:05:58.619216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:08.056726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.598033+0000","last_change":"2024-09-12T17:05:47.511375+0000","last_active":"2024-09-12T17:05:58.598033+0000","last_peered":"2024-09-12T17:05:58.598033+0000","last_clean":"2024-09-12T17:05:58.598033+0000","last_became_active":"2024-09-12T17:05:47.510364+0000","last_became_peered":"2024-09-12T17:05:47.510364+0000","last_unstale":"2024-09-12T17:05:58.598033+0000","last_undegraded":"2024-09-12T17:05:58.598033+0000","last_fullsized":"2024-09-12T17:05:58.598033+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578941+0000","last_change":"2024-09-12T17:05:49.549815+0000","last_active":"2024-09-12T17:05:58.578941+0000","last_peered":"2024-09-12T17:05:58.578941+0000","last_clean":"2024-09-12T17:05:58.578941+0000","last_became_active":"2024-09-12T17:05:49.547552+0000","last_became_peered":"2024-09-12T17:05:49.547552+0000","last_unstale":"2024-09-12T17:05:58.578941+0000","last_undegraded":"2024-09-12T17:05:58.578941+0000","last_fullsized":"2024-09-12T17:05:58.578941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:53:03.006310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590744+0000","last_change":"2024-09-12T17:05:47.517789+0000","last_active":"2024-09-12T17:05:58.590744+0000","last_peered":"2024-09-12T17:05:58.590744+0000","last_clean":"2024-09-12T17:05:58.590744+0000","last_became_active":"2024-09-12T17:05:47.517372+0000","last_became_peered":"2024-09-12T17:05:47.517372+0000","last_unstale":"2024-09-12T17:05:58.590744+0000","last_undegraded":"2024-09-12T17:05:58.590744+0000","last_fullsized":"2024-09-12T17:05:58.590744+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:37.072896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576259+0000","last_change":"2024-09-12T17:05:57.588515+0000","last_active":"2024-09-12T17:05:58.576259+0000","last_peered":"2024-09-12T17:05:58.576259+0000","last_clean":"2024-09-12T17:05:58.576259+0000","last_became_active":"2024-09-12T17:05:57.587891+0000","last_became_peered":"2024-09-12T17:05:57.587891+0000","last_unstale":"2024-09-12T17:05:58.576259+0000","last_undegraded":"2024-09-12T17:05:58.576259+0000","last_fullsized":"2024-09-12T17:05:58.576259+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:24.257847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600170+0000","last_change":"2024-09-12T17:05:49.543673+0000","last_active":"2024-09-12T17:05:58.600170+0000","last_peered":"2024-09-12T17:05:58.600170+0000","last_clean":"2024-09-12T17:05:58.600170+0000","last_became_active":"2024-09-12T17:05:49.543386+0000","last_became_peered":"2024-09-12T17:05:49.543386+0000","last_unstale":"2024-09-12T17:05:58.600170+0000","last_undegraded":"2024-09-12T17:05:58.600170+0000","last_fullsized":"2024-09-12T17:05:58.600170+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:15:07.814856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579826+0000","last_change":"2024-09-12T17:05:47.557687+0000","last_active":"2024-09-12T17:05:58.579826+0000","last_peered":"2024-09-12T17:05:58.579826+0000","last_clean":"2024-09-12T17:05:58.579826+0000","last_became_active":"2024-09-12T17:05:47.556980+0000","last_became_peered":"2024-09-12T17:05:47.556980+0000","last_unstale":"2024-09-12T17:05:58.579826+0000","last_undegraded":"2024-09-12T17:05:58.579826+0000","last_fullsized":"2024-09-12T17:05:58.579826+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.891909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589081+0000","last_change":"2024-09-12T17:05:51.553342+0000","last_active":"2024-09-12T17:05:58.589081+0000","last_peered":"2024-09-12T17:05:58.589081+0000","last_clean":"2024-09-12T17:05:58.589081+0000","last_became_active":"2024-09-12T17:05:51.552607+0000","last_became_peered":"2024-09-12T17:05:51.552607+0000","last_unstale":"2024-09-12T17:05:58.589081+0000","last_undegraded":"2024-09-12T17:05:58.589081+0000","last_fullsized":"2024-09-12T17:05:58.589081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:25.188530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.958558+0000","last_change":"2024-09-12T17:05:53.537592+0000","last_active":"2024-09-12T17:05:58.958558+0000","last_peered":"2024-09-12T17:05:58.958558+0000","last_clean":"2024-09-12T17:05:58.958558+0000","last_became_active":"2024-09-12T17:05:53.536921+0000","last_became_peered":"2024-09-12T17:05:53.536921+0000","last_unstale":"2024-09-12T17:05:58.958558+0000","last_undegraded":"2024-09-12T17:05:58.958558+0000","last_fullsized":"2024-09-12T17:05:58.958558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:25.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579551+0000","last_change":"2024-09-12T17:05:55.559431+0000","last_active":"2024-09-12T17:05:58.579551+0000","last_peered":"2024-09-12T17:05:58.579551+0000","last_clean":"2024-09-12T17:05:58.579551+0000","last_became_active":"2024-09-12T17:05:55.558297+0000","last_became_peered":"2024-09-12T17:05:55.558297+0000","last_unstale":"2024-09-12T17:05:58.579551+0000","last_undegraded":"2024-09-12T17:05:58.579551+0000","last_fullsized":"2024-09-12T17:05:58.579551+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587247+0000","last_change":"2024-09-12T17:05:57.592599+0000","last_active":"2024-09-12T17:05:58.587247+0000","last_peered":"2024-09-12T17:05:58.587247+0000","last_clean":"2024-09-12T17:05:58.587247+0000","last_became_active":"2024-09-12T17:05:57.591877+0000","last_became_peered":"2024-09-12T17:05:57.591877+0000","last_unstale":"2024-09-12T17:05:58.587247+0000","last_undegraded":"2024-09-12T17:05:58.587247+0000","last_fullsized":"2024-09-12T17:05:58.587247+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:57.557525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589578+0000","last_change":"2024-09-12T17:05:49.546093+0000","last_active":"2024-09-12T17:05:58.589578+0000","last_peered":"2024-09-12T17:05:58.589578+0000","last_clean":"2024-09-12T17:05:58.589578+0000","last_became_active":"2024-09-12T17:05:49.544425+0000","last_became_peered":"2024-09-12T17:05:49.544425+0000","last_unstale":"2024-09-12T17:05:58.589578+0000","last_undegraded":"2024-09-12T17:05:58.589578+0000","last_fullsized":"2024-09-12T17:05:58.589578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.495950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590886+0000","last_change":"2024-09-12T17:05:47.535295+0000","last_active":"2024-09-12T17:05:58.590886+0000","last_peered":"2024-09-12T17:05:58.590886+0000","last_clean":"2024-09-12T17:05:58.590886+0000","last_became_active":"2024-09-12T17:05:47.534833+0000","last_became_peered":"2024-09-12T17:05:47.534833+0000","last_unstale":"2024-09-12T17:05:58.590886+0000","last_undegraded":"2024-09-12T17:05:58.590886+0000","last_fullsized":"2024-09-12T17:05:58.590886+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.599852+0000","last_change":"2024-09-12T17:05:51.533888+0000","last_active":"2024-09-12T17:05:58.599852+0000","last_peered":"2024-09-12T17:05:58.599852+0000","last_clean":"2024-09-12T17:05:58.599852+0000","last_became_active":"2024-09-12T17:05:51.533164+0000","last_became_peered":"2024-09-12T17:05:51.533164+0000","last_unstale":"2024-09-12T17:05:58.599852+0000","last_undegraded":"2024-09-12T17:05:58.599852+0000","last_fullsized":"2024-09-12T17:05:58.599852+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:33.007858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":30,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.375198+0000","last_change":"2024-09-12T17:05:53.549534+0000","last_active":"2024-09-12T17:05:59.375198+0000","last_peered":"2024-09-12T17:05:59.375198+0000","last_clean":"2024-09-12T17:05:59.375198+0000","last_became_active":"2024-09-12T17:05:53.548824+0000","last_became_peered":"2024-09-12T17:05:53.548824+0000","last_unstale":"2024-09-12T17:05:59.375198+0000","last_undegraded":"2024-09-12T17:05:59.375198+0000","last_fullsized":"2024-09-12T17:05:59.375198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.765832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577932+0000","last_change":"2024-09-12T17:05:55.557468+0000","last_active":"2024-09-12T17:05:58.577932+0000","last_peered":"2024-09-12T17:05:58.577932+0000","last_clean":"2024-09-12T17:05:58.577932+0000","last_became_active":"2024-09-12T17:05:55.556689+0000","last_became_peered":"2024-09-12T17:05:55.556689+0000","last_unstale":"2024-09-12T17:05:58.577932+0000","last_undegraded":"2024-09-12T17:05:58.577932+0000","last_fullsized":"2024-09-12T17:05:58.577932+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:56.879576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590173+0000","last_change":"2024-09-12T17:05:57.589569+0000","last_active":"2024-09-12T17:05:58.590173+0000","last_peered":"2024-09-12T17:05:58.590173+0000","last_clean":"2024-09-12T17:05:58.590173+0000","last_became_active":"2024-09-12T17:05:57.588649+0000","last_became_peered":"2024-09-12T17:05:57.588649+0000","last_unstale":"2024-09-12T17:05:58.590173+0000","last_undegraded":"2024-09-12T17:05:58.590173+0000","last_fullsized":"2024-09-12T17:05:58.590173+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592898+0000","last_change":"2024-09-12T17:05:49.531436+0000","last_active":"2024-09-12T17:05:58.592898+0000","last_peered":"2024-09-12T17:05:58.592898+0000","last_clean":"2024-09-12T17:05:58.592898+0000","last_became_active":"2024-09-12T17:05:49.530687+0000","last_became_peered":"2024-09-12T17:05:49.530687+0000","last_unstale":"2024-09-12T17:05:58.592898+0000","last_undegraded":"2024-09-12T17:05:58.592898+0000","last_fullsized":"2024-09-12T17:05:58.592898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577788+0000","last_change":"2024-09-12T17:05:47.564709+0000","last_active":"2024-09-12T17:05:58.577788+0000","last_peered":"2024-09-12T17:05:58.577788+0000","last_clean":"2024-09-12T17:05:58.577788+0000","last_became_active":"2024-09-12T17:05:47.564189+0000","last_became_peered":"2024-09-12T17:05:47.564189+0000","last_unstale":"2024-09-12T17:05:58.577788+0000","last_undegraded":"2024-09-12T17:05:58.577788+0000","last_fullsized":"2024-09-12T17:05:58.577788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.602087+0000","last_change":"2024-09-12T17:05:51.530947+0000","last_active":"2024-09-12T17:05:58.602087+0000","last_peered":"2024-09-12T17:05:58.602087+0000","last_clean":"2024-09-12T17:05:58.602087+0000","last_became_active":"2024-09-12T17:05:51.530150+0000","last_became_peered":"2024-09-12T17:05:51.530150+0000","last_unstale":"2024-09-12T17:05:58.602087+0000","last_undegraded":"2024-09-12T17:05:58.602087+0000","last_fullsized":"2024-09-12T17:05:58.602087+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:02:52.139381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.427181+0000","last_change":"2024-09-12T17:05:53.549328+0000","last_active":"2024-09-12T17:05:59.427181+0000","last_peered":"2024-09-12T17:05:59.427181+0000","last_clean":"2024-09-12T17:05:59.427181+0000","last_became_active":"2024-09-12T17:05:53.548968+0000","last_became_peered":"2024-09-12T17:05:53.548968+0000","last_unstale":"2024-09-12T17:05:59.427181+0000","last_undegraded":"2024-09-12T17:05:59.427181+0000","last_fullsized":"2024-09-12T17:05:59.427181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:36.974950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.581500+0000","last_change":"2024-09-12T17:05:55.563556+0000","last_active":"2024-09-12T17:05:58.581500+0000","last_peered":"2024-09-12T17:05:58.581500+0000","last_clean":"2024-09-12T17:05:58.581500+0000","last_became_active":"2024-09-12T17:05:55.562522+0000","last_became_peered":"2024-09-12T17:05:55.562522+0000","last_unstale":"2024-09-12T17:05:58.581500+0000","last_undegraded":"2024-09-12T17:05:58.581500+0000","last_fullsized":"2024-09-12T17:05:58.581500+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576759+0000","last_change":"2024-09-12T17:05:58.122522+0000","last_active":"2024-09-12T17:05:58.576759+0000","last_peered":"2024-09-12T17:05:58.576759+0000","last_clean":"2024-09-12T17:05:58.576759+0000","last_became_active":"2024-09-12T17:05:58.121871+0000","last_became_peered":"2024-09-12T17:05:58.121871+0000","last_unstale":"2024-09-12T17:05:58.576759+0000","last_undegraded":"2024-09-12T17:05:58.576759+0000","last_fullsized":"2024-09-12T17:05:58.576759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:22.625236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600673+0000","last_change":"2024-09-12T17:05:49.528766+0000","last_active":"2024-09-12T17:05:58.600673+0000","last_peered":"2024-09-12T17:05:58.600673+0000","last_clean":"2024-09-12T17:05:58.600673+0000","last_became_active":"2024-09-12T17:05:49.527758+0000","last_became_peered":"2024-09-12T17:05:49.527758+0000","last_unstale":"2024-09-12T17:05:58.600673+0000","last_undegraded":"2024-09-12T17:05:58.600673+0000","last_fullsized":"2024-09-12T17:05:58.600673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:06.399711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605007+0000","last_change":"2024-09-12T17:05:47.521727+0000","last_active":"2024-09-12T17:05:58.605007+0000","last_peered":"2024-09-12T17:05:58.605007+0000","last_clean":"2024-09-12T17:05:58.605007+0000","last_became_active":"2024-09-12T17:05:47.520943+0000","last_became_peered":"2024-09-12T17:05:47.520943+0000","last_unstale":"2024-09-12T17:05:58.605007+0000","last_undegraded":"2024-09-12T17:05:58.605007+0000","last_fullsized":"2024-09-12T17:05:58.605007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:24.772296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"29'1","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590508+0000","last_change":"2024-09-12T17:05:51.556202+0000","last_active":"2024-09-12T17:05:58.590508+0000","last_peered":"2024-09-12T17:05:58.590508+0000","last_clean":"2024-09-12T17:05:58.590508+0000","last_became_active":"2024-09-12T17:05:51.555420+0000","last_became_peered":"2024-09-12T17:05:51.555420+0000","last_unstale":"2024-09-12T17:05:58.590508+0000","last_undegraded":"2024-09-12T17:05:58.590508+0000","last_fullsized":"2024-09-12T17:05:58.590508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:56.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.436036+0000","last_change":"2024-09-12T17:05:53.554159+0000","last_active":"2024-09-12T17:05:59.436036+0000","last_peered":"2024-09-12T17:05:59.436036+0000","last_clean":"2024-09-12T17:05:59.436036+0000","last_became_active":"2024-09-12T17:05:53.553333+0000","last_became_peered":"2024-09-12T17:05:53.553333+0000","last_unstale":"2024-09-12T17:05:59.436036+0000","last_undegraded":"2024-09-12T17:05:59.436036+0000","last_fullsized":"2024-09-12T17:05:59.436036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:53.266475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596430+0000","last_change":"2024-09-12T17:05:55.556502+0000","last_active":"2024-09-12T17:05:58.596430+0000","last_peered":"2024-09-12T17:05:58.596430+0000","last_clean":"2024-09-12T17:05:58.596430+0000","last_became_active":"2024-09-12T17:05:55.555879+0000","last_became_peered":"2024-09-12T17:05:55.555879+0000","last_unstale":"2024-09-12T17:05:58.596430+0000","last_undegraded":"2024-09-12T17:05:58.596430+0000","last_fullsized":"2024-09-12T17:05:58.596430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:18.672296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587824+0000","last_change":"2024-09-12T17:05:49.553404+0000","last_active":"2024-09-12T17:05:58.587824+0000","last_peered":"2024-09-12T17:05:58.587824+0000","last_clean":"2024-09-12T17:05:58.587824+0000","last_became_active":"2024-09-12T17:05:49.552637+0000","last_became_peered":"2024-09-12T17:05:49.552637+0000","last_unstale":"2024-09-12T17:05:58.587824+0000","last_undegraded":"2024-09-12T17:05:58.587824+0000","last_fullsized":"2024-09-12T17:05:58.587824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580409+0000","last_change":"2024-09-12T17:05:47.562949+0000","last_active":"2024-09-12T17:05:58.580409+0000","last_peered":"2024-09-12T17:05:58.580409+0000","last_clean":"2024-09-12T17:05:58.580409+0000","last_became_active":"2024-09-12T17:05:47.562465+0000","last_became_peered":"2024-09-12T17:05:47.562465+0000","last_unstale":"2024-09-12T17:05:58.580409+0000","last_undegraded":"2024-09-12T17:05:58.580409+0000","last_fullsized":"2024-09-12T17:05:58.580409+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576552+0000","last_change":"2024-09-12T17:05:51.542349+0000","last_active":"2024-09-12T17:05:58.576552+0000","last_peered":"2024-09-12T17:05:58.576552+0000","last_clean":"2024-09-12T17:05:58.576552+0000","last_became_active":"2024-09-12T17:05:51.541205+0000","last_became_peered":"2024-09-12T17:05:51.541205+0000","last_unstale":"2024-09-12T17:05:58.576552+0000","last_undegraded":"2024-09-12T17:05:58.576552+0000","last_fullsized":"2024-09-12T17:05:58.576552+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"36'19","reported_seq":52,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.535281+0000","last_change":"2024-09-12T17:05:53.560400+0000","last_active":"2024-09-12T17:05:59.535281+0000","last_peered":"2024-09-12T17:05:59.535281+0000","last_clean":"2024-09-12T17:05:59.535281+0000","last_became_active":"2024-09-12T17:05:53.559463+0000","last_became_peered":"2024-09-12T17:05:53.559463+0000","last_unstale":"2024-09-12T17:05:59.535281+0000","last_undegraded":"2024-09-12T17:05:59.535281+0000","last_fullsized":"2024-09-12T17:05:59.535281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.574257+0000","last_change":"2024-09-12T17:05:55.569650+0000","last_active":"2024-09-12T17:05:58.574257+0000","last_peered":"2024-09-12T17:05:58.574257+0000","last_clean":"2024-09-12T17:05:58.574257+0000","last_became_active":"2024-09-12T17:05:55.568803+0000","last_became_peered":"2024-09-12T17:05:55.568803+0000","last_unstale":"2024-09-12T17:05:58.574257+0000","last_undegraded":"2024-09-12T17:05:58.574257+0000","last_fullsized":"2024-09-12T17:05:58.574257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:03:14.627182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588256+0000","last_change":"2024-09-12T17:05:57.599403+0000","last_active":"2024-09-12T17:05:58.588256+0000","last_peered":"2024-09-12T17:05:58.588256+0000","last_clean":"2024-09-12T17:05:58.588256+0000","last_became_active":"2024-09-12T17:05:57.598703+0000","last_became_peered":"2024-09-12T17:05:57.598703+0000","last_unstale":"2024-09-12T17:05:58.588256+0000","last_undegraded":"2024-09-12T17:05:58.588256+0000","last_fullsized":"2024-09-12T17:05:58.588256+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578340+0000","last_change":"2024-09-12T17:05:49.546046+0000","last_active":"2024-09-12T17:05:58.578340+0000","last_peered":"2024-09-12T17:05:58.578340+0000","last_clean":"2024-09-12T17:05:58.578340+0000","last_became_active":"2024-09-12T17:05:49.545351+0000","last_became_peered":"2024-09-12T17:05:49.545351+0000","last_unstale":"2024-09-12T17:05:58.578340+0000","last_undegraded":"2024-09-12T17:05:58.578340+0000","last_fullsized":"2024-09-12T17:05:58.578340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:01:27.007541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580665+0000","last_change":"2024-09-12T17:05:47.563411+0000","last_active":"2024-09-12T17:05:58.580665+0000","last_peered":"2024-09-12T17:05:58.580665+0000","last_clean":"2024-09-12T17:05:58.580665+0000","last_became_active":"2024-09-12T17:05:47.562812+0000","last_became_peered":"2024-09-12T17:05:47.562812+0000","last_unstale":"2024-09-12T17:05:58.580665+0000","last_undegraded":"2024-09-12T17:05:58.580665+0000","last_fullsized":"2024-09-12T17:05:58.580665+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:57.659986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.618342+0000","last_change":"2024-09-12T17:05:51.548944+0000","last_active":"2024-09-12T17:05:58.618342+0000","last_peered":"2024-09-12T17:05:58.618342+0000","last_clean":"2024-09-12T17:05:58.618342+0000","last_became_active":"2024-09-12T17:05:51.544649+0000","last_became_peered":"2024-09-12T17:05:51.544649+0000","last_unstale":"2024-09-12T17:05:58.618342+0000","last_undegraded":"2024-09-12T17:05:58.618342+0000","last_fullsized":"2024-09-12T17:05:58.618342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:01.468390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.406299+0000","last_change":"2024-09-12T17:05:53.552838+0000","last_active":"2024-09-12T17:05:59.406299+0000","last_peered":"2024-09-12T17:05:59.406299+0000","last_clean":"2024-09-12T17:05:59.406299+0000","last_became_active":"2024-09-12T17:05:53.550042+0000","last_became_peered":"2024-09-12T17:05:53.550042+0000","last_unstale":"2024-09-12T17:05:59.406299+0000","last_undegraded":"2024-09-12T17:05:59.406299+0000","last_fullsized":"2024-09-12T17:05:59.406299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596031+0000","last_change":"2024-09-12T17:05:55.558761+0000","last_active":"2024-09-12T17:05:58.596031+0000","last_peered":"2024-09-12T17:05:58.596031+0000","last_clean":"2024-09-12T17:05:58.596031+0000","last_became_active":"2024-09-12T17:05:55.557930+0000","last_became_peered":"2024-09-12T17:05:55.557930+0000","last_unstale":"2024-09-12T17:05:58.596031+0000","last_undegraded":"2024-09-12T17:05:58.596031+0000","last_fullsized":"2024-09-12T17:05:58.596031+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.015675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605860+0000","last_change":"2024-09-12T17:05:57.592611+0000","last_active":"2024-09-12T17:05:58.605860+0000","last_peered":"2024-09-12T17:05:58.605860+0000","last_clean":"2024-09-12T17:05:58.605860+0000","last_became_active":"2024-09-12T17:05:57.591855+0000","last_became_peered":"2024-09-12T17:05:57.591855+0000","last_unstale":"2024-09-12T17:05:58.605860+0000","last_undegraded":"2024-09-12T17:05:58.605860+0000","last_fullsized":"2024-09-12T17:05:58.605860+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:02.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605807+0000","last_change":"2024-09-12T17:05:49.546691+0000","last_active":"2024-09-12T17:05:58.605807+0000","last_peered":"2024-09-12T17:05:58.605807+0000","last_clean":"2024-09-12T17:05:58.605807+0000","last_became_active":"2024-09-12T17:05:49.545891+0000","last_became_peered":"2024-09-12T17:05:49.545891+0000","last_unstale":"2024-09-12T17:05:58.605807+0000","last_undegraded":"2024-09-12T17:05:58.605807+0000","last_fullsized":"2024-09-12T17:05:58.605807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:06.273531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582876+0000","last_change":"2024-09-12T17:05:47.562243+0000","last_active":"2024-09-12T17:05:58.582876+0000","last_peered":"2024-09-12T17:05:58.582876+0000","last_clean":"2024-09-12T17:05:58.582876+0000","last_became_active":"2024-09-12T17:05:47.561587+0000","last_became_peered":"2024-09-12T17:05:47.561587+0000","last_unstale":"2024-09-12T17:05:58.582876+0000","last_undegraded":"2024-09-12T17:05:58.582876+0000","last_fullsized":"2024-09-12T17:05:58.582876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"29'1","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619413+0000","last_change":"2024-09-12T17:05:51.542843+0000","last_active":"2024-09-12T17:05:58.619413+0000","last_peered":"2024-09-12T17:05:58.619413+0000","last_clean":"2024-09-12T17:05:58.619413+0000","last_became_active":"2024-09-12T17:05:51.542457+0000","last_became_peered":"2024-09-12T17:05:51.542457+0000","last_unstale":"2024-09-12T17:05:58.619413+0000","last_undegraded":"2024-09-12T17:05:58.619413+0000","last_fullsized":"2024-09-12T17:05:58.619413+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.837373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.322398+0000","last_change":"2024-09-12T17:05:53.548729+0000","last_active":"2024-09-12T17:05:59.322398+0000","last_peered":"2024-09-12T17:05:59.322398+0000","last_clean":"2024-09-12T17:05:59.322398+0000","last_became_active":"2024-09-12T17:05:53.547990+0000","last_became_peered":"2024-09-12T17:05:53.547990+0000","last_unstale":"2024-09-12T17:05:59.322398+0000","last_undegraded":"2024-09-12T17:05:59.322398+0000","last_fullsized":"2024-09-12T17:05:59.322398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:22.845485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589686+0000","last_change":"2024-09-12T17:05:55.570504+0000","last_active":"2024-09-12T17:05:58.589686+0000","last_peered":"2024-09-12T17:05:58.589686+0000","last_clean":"2024-09-12T17:05:58.589686+0000","last_became_active":"2024-09-12T17:05:55.569625+0000","last_became_peered":"2024-09-12T17:05:55.569625+0000","last_unstale":"2024-09-12T17:05:58.589686+0000","last_undegraded":"2024-09-12T17:05:58.589686+0000","last_fullsized":"2024-09-12T17:05:58.589686+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:05:33.836953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591971+0000","last_change":"2024-09-12T17:05:57.596229+0000","last_active":"2024-09-12T17:05:58.591971+0000","last_peered":"2024-09-12T17:05:58.591971+0000","last_clean":"2024-09-12T17:05:58.591971+0000","last_became_active":"2024-09-12T17:05:57.595658+0000","last_became_peered":"2024-09-12T17:05:57.595658+0000","last_unstale":"2024-09-12T17:05:58.591971+0000","last_undegraded":"2024-09-12T17:05:58.591971+0000","last_fullsized":"2024-09-12T17:05:58.591971+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.644627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592424+0000","last_change":"2024-09-12T17:05:49.549111+0000","last_active":"2024-09-12T17:05:58.592424+0000","last_peered":"2024-09-12T17:05:58.592424+0000","last_clean":"2024-09-12T17:05:58.592424+0000","last_became_active":"2024-09-12T17:05:49.547419+0000","last_became_peered":"2024-09-12T17:05:49.547419+0000","last_unstale":"2024-09-12T17:05:58.592424+0000","last_undegraded":"2024-09-12T17:05:58.592424+0000","last_fullsized":"2024-09-12T17:05:58.592424+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:34.475371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589139+0000","last_change":"2024-09-12T17:05:47.535946+0000","last_active":"2024-09-12T17:05:58.589139+0000","last_peered":"2024-09-12T17:05:58.589139+0000","last_clean":"2024-09-12T17:05:58.589139+0000","last_became_active":"2024-09-12T17:05:47.534607+0000","last_became_peered":"2024-09-12T17:05:47.534607+0000","last_unstale":"2024-09-12T17:05:58.589139+0000","last_undegraded":"2024-09-12T17:05:58.589139+0000","last_fullsized":"2024-09-12T17:05:58.589139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.618571+0000","last_change":"2024-09-12T17:05:51.548391+0000","last_active":"2024-09-12T17:05:58.618571+0000","last_peered":"2024-09-12T17:05:58.618571+0000","last_clean":"2024-09-12T17:05:58.618571+0000","last_became_active":"2024-09-12T17:05:51.547939+0000","last_became_peered":"2024-09-12T17:05:51.547939+0000","last_unstale":"2024-09-12T17:05:58.618571+0000","last_undegraded":"2024-09-12T17:05:58.618571+0000","last_fullsized":"2024-09-12T17:05:58.618571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:08.848247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"36'12","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.922278+0000","last_change":"2024-09-12T17:05:53.535756+0000","last_active":"2024-09-12T17:05:58.922278+0000","last_peered":"2024-09-12T17:05:58.922278+0000","last_clean":"2024-09-12T17:05:58.922278+0000","last_became_active":"2024-09-12T17:05:53.535062+0000","last_became_peered":"2024-09-12T17:05:53.535062+0000","last_unstale":"2024-09-12T17:05:58.922278+0000","last_undegraded":"2024-09-12T17:05:58.922278+0000","last_fullsized":"2024-09-12T17:05:58.922278+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.618174+0000","last_change":"2024-09-12T17:05:55.564010+0000","last_active":"2024-09-12T17:05:58.618174+0000","last_peered":"2024-09-12T17:05:58.618174+0000","last_clean":"2024-09-12T17:05:58.618174+0000","last_became_active":"2024-09-12T17:05:55.563125+0000","last_became_peered":"2024-09-12T17:05:55.563125+0000","last_unstale":"2024-09-12T17:05:58.618174+0000","last_undegraded":"2024-09-12T17:05:58.618174+0000","last_fullsized":"2024-09-12T17:05:58.618174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:00.697571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575778+0000","last_change":"2024-09-12T17:05:57.584686+0000","last_active":"2024-09-12T17:05:58.575778+0000","last_peered":"2024-09-12T17:05:58.575778+0000","last_clean":"2024-09-12T17:05:58.575778+0000","last_became_active":"2024-09-12T17:05:57.583946+0000","last_became_peered":"2024-09-12T17:05:57.583946+0000","last_unstale":"2024-09-12T17:05:58.575778+0000","last_undegraded":"2024-09-12T17:05:58.575778+0000","last_fullsized":"2024-09-12T17:05:58.575778+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:50.487184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582126+0000","last_change":"2024-09-12T17:05:49.544092+0000","last_active":"2024-09-12T17:05:58.582126+0000","last_peered":"2024-09-12T17:05:58.582126+0000","last_clean":"2024-09-12T17:05:58.582126+0000","last_became_active":"2024-09-12T17:05:49.543307+0000","last_became_peered":"2024-09-12T17:05:49.543307+0000","last_unstale":"2024-09-12T17:05:58.582126+0000","last_undegraded":"2024-09-12T17:05:58.582126+0000","last_fullsized":"2024-09-12T17:05:58.582126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:36.286410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.597749+0000","last_change":"2024-09-12T17:05:47.526678+0000","last_active":"2024-09-12T17:05:58.597749+0000","last_peered":"2024-09-12T17:05:58.597749+0000","last_clean":"2024-09-12T17:05:58.597749+0000","last_became_active":"2024-09-12T17:05:47.525696+0000","last_became_peered":"2024-09-12T17:05:47.525696+0000","last_unstale":"2024-09-12T17:05:58.597749+0000","last_undegraded":"2024-09-12T17:05:58.597749+0000","last_fullsized":"2024-09-12T17:05:58.597749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:59.012258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.618998+0000","last_change":"2024-09-12T17:05:51.543404+0000","last_active":"2024-09-12T17:05:58.618998+0000","last_peered":"2024-09-12T17:05:58.618998+0000","last_clean":"2024-09-12T17:05:58.618998+0000","last_became_active":"2024-09-12T17:05:51.542737+0000","last_became_peered":"2024-09-12T17:05:51.542737+0000","last_unstale":"2024-09-12T17:05:58.618998+0000","last_undegraded":"2024-09-12T17:05:58.618998+0000","last_fullsized":"2024-09-12T17:05:58.618998+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:30.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"36'11","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.472758+0000","last_change":"2024-09-12T17:05:53.540955+0000","last_active":"2024-09-12T17:05:59.472758+0000","last_peered":"2024-09-12T17:05:59.472758+0000","last_clean":"2024-09-12T17:05:59.472758+0000","last_became_active":"2024-09-12T17:05:53.540080+0000","last_became_peered":"2024-09-12T17:05:53.540080+0000","last_unstale":"2024-09-12T17:05:59.472758+0000","last_undegraded":"2024-09-12T17:05:59.472758+0000","last_fullsized":"2024-09-12T17:05:59.472758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:56.961597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592082+0000","last_change":"2024-09-12T17:05:55.565575+0000","last_active":"2024-09-12T17:05:58.592082+0000","last_peered":"2024-09-12T17:05:58.592082+0000","last_clean":"2024-09-12T17:05:58.592082+0000","last_became_active":"2024-09-12T17:05:55.564802+0000","last_became_peered":"2024-09-12T17:05:55.564802+0000","last_unstale":"2024-09-12T17:05:58.592082+0000","last_undegraded":"2024-09-12T17:05:58.592082+0000","last_fullsized":"2024-09-12T17:05:58.592082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.595889+0000","last_change":"2024-09-12T17:05:57.592294+0000","last_active":"2024-09-12T17:05:58.595889+0000","last_peered":"2024-09-12T17:05:58.595889+0000","last_clean":"2024-09-12T17:05:58.595889+0000","last_became_active":"2024-09-12T17:05:57.591389+0000","last_became_peered":"2024-09-12T17:05:57.591389+0000","last_unstale":"2024-09-12T17:05:58.595889+0000","last_undegraded":"2024-09-12T17:05:58.595889+0000","last_fullsized":"2024-09-12T17:05:58.595889+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579185+0000","last_change":"2024-09-12T17:05:49.553177+0000","last_active":"2024-09-12T17:05:58.579185+0000","last_peered":"2024-09-12T17:05:58.579185+0000","last_clean":"2024-09-12T17:05:58.579185+0000","last_became_active":"2024-09-12T17:05:49.552270+0000","last_became_peered":"2024-09-12T17:05:49.552270+0000","last_unstale":"2024-09-12T17:05:58.579185+0000","last_undegraded":"2024-09-12T17:05:58.579185+0000","last_fullsized":"2024-09-12T17:05:58.579185+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:34.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606115+0000","last_change":"2024-09-12T17:05:47.543064+0000","last_active":"2024-09-12T17:05:58.606115+0000","last_peered":"2024-09-12T17:05:58.606115+0000","last_clean":"2024-09-12T17:05:58.606115+0000","last_became_active":"2024-09-12T17:05:47.542362+0000","last_became_peered":"2024-09-12T17:05:47.542362+0000","last_unstale":"2024-09-12T17:05:58.606115+0000","last_undegraded":"2024-09-12T17:05:58.606115+0000","last_fullsized":"2024-09-12T17:05:58.606115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.574724+0000","last_change":"2024-09-12T17:05:51.540826+0000","last_active":"2024-09-12T17:05:58.574724+0000","last_peered":"2024-09-12T17:05:58.574724+0000","last_clean":"2024-09-12T17:05:58.574724+0000","last_became_active":"2024-09-12T17:05:51.540460+0000","last_became_peered":"2024-09-12T17:05:51.540460+0000","last_unstale":"2024-09-12T17:05:58.574724+0000","last_undegraded":"2024-09-12T17:05:58.574724+0000","last_fullsized":"2024-09-12T17:05:58.574724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:26.672318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.540514+0000","last_change":"2024-09-12T17:05:53.554531+0000","last_active":"2024-09-12T17:05:59.540514+0000","last_peered":"2024-09-12T17:05:59.540514+0000","last_clean":"2024-09-12T17:05:59.540514+0000","last_became_active":"2024-09-12T17:05:53.554131+0000","last_became_peered":"2024-09-12T17:05:53.554131+0000","last_unstale":"2024-09-12T17:05:59.540514+0000","last_undegraded":"2024-09-12T17:05:59.540514+0000","last_fullsized":"2024-09-12T17:05:59.540514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619386+0000","last_change":"2024-09-12T17:05:55.559204+0000","last_active":"2024-09-12T17:05:58.619386+0000","last_peered":"2024-09-12T17:05:58.619386+0000","last_clean":"2024-09-12T17:05:58.619386+0000","last_became_active":"2024-09-12T17:05:55.556488+0000","last_became_peered":"2024-09-12T17:05:55.556488+0000","last_unstale":"2024-09-12T17:05:58.619386+0000","last_undegraded":"2024-09-12T17:05:58.619386+0000","last_fullsized":"2024-09-12T17:05:58.619386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:15.167640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.573599+0000","last_change":"2024-09-12T17:05:57.584586+0000","last_active":"2024-09-12T17:05:58.573599+0000","last_peered":"2024-09-12T17:05:58.573599+0000","last_clean":"2024-09-12T17:05:58.573599+0000","last_became_active":"2024-09-12T17:05:57.583783+0000","last_became_peered":"2024-09-12T17:05:57.583783+0000","last_unstale":"2024-09-12T17:05:58.573599+0000","last_undegraded":"2024-09-12T17:05:58.573599+0000","last_fullsized":"2024-09-12T17:05:58.573599+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:00.992588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580679+0000","last_change":"2024-09-12T17:05:49.562360+0000","last_active":"2024-09-12T17:05:58.580679+0000","last_peered":"2024-09-12T17:05:58.580679+0000","last_clean":"2024-09-12T17:05:58.580679+0000","last_became_active":"2024-09-12T17:05:49.561200+0000","last_became_peered":"2024-09-12T17:05:49.561200+0000","last_unstale":"2024-09-12T17:05:58.580679+0000","last_undegraded":"2024-09-12T17:05:58.580679+0000","last_fullsized":"2024-09-12T17:05:58.580679+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.915600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579359+0000","last_change":"2024-09-12T17:05:47.542018+0000","last_active":"2024-09-12T17:05:58.579359+0000","last_peered":"2024-09-12T17:05:58.579359+0000","last_clean":"2024-09-12T17:05:58.579359+0000","last_became_active":"2024-09-12T17:05:47.540484+0000","last_became_peered":"2024-09-12T17:05:47.540484+0000","last_unstale":"2024-09-12T17:05:58.579359+0000","last_undegraded":"2024-09-12T17:05:58.579359+0000","last_fullsized":"2024-09-12T17:05:58.579359+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:13.571666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589319+0000","last_change":"2024-09-12T17:05:51.556083+0000","last_active":"2024-09-12T17:05:58.589319+0000","last_peered":"2024-09-12T17:05:58.589319+0000","last_clean":"2024-09-12T17:05:58.589319+0000","last_became_active":"2024-09-12T17:05:51.554176+0000","last_became_peered":"2024-09-12T17:05:51.554176+0000","last_unstale":"2024-09-12T17:05:58.589319+0000","last_undegraded":"2024-09-12T17:05:58.589319+0000","last_fullsized":"2024-09-12T17:05:58.589319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:02.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.327773+0000","last_change":"2024-09-12T17:05:53.553304+0000","last_active":"2024-09-12T17:05:59.327773+0000","last_peered":"2024-09-12T17:05:59.327773+0000","last_clean":"2024-09-12T17:05:59.327773+0000","last_became_active":"2024-09-12T17:05:53.552545+0000","last_became_peered":"2024-09-12T17:05:53.552545+0000","last_unstale":"2024-09-12T17:05:59.327773+0000","last_undegraded":"2024-09-12T17:05:59.327773+0000","last_fullsized":"2024-09-12T17:05:59.327773+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606168+0000","last_change":"2024-09-12T17:05:55.575189+0000","last_active":"2024-09-12T17:05:58.606168+0000","last_peered":"2024-09-12T17:05:58.606168+0000","last_clean":"2024-09-12T17:05:58.606168+0000","last_became_active":"2024-09-12T17:05:55.574291+0000","last_became_peered":"2024-09-12T17:05:55.574291+0000","last_unstale":"2024-09-12T17:05:58.606168+0000","last_undegraded":"2024-09-12T17:05:58.606168+0000","last_fullsized":"2024-09-12T17:05:58.606168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:11:46.932586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578428+0000","last_change":"2024-09-12T17:05:57.597870+0000","last_active":"2024-09-12T17:05:58.578428+0000","last_peered":"2024-09-12T17:05:58.578428+0000","last_clean":"2024-09-12T17:05:58.578428+0000","last_became_active":"2024-09-12T17:05:57.597076+0000","last_became_peered":"2024-09-12T17:05:57.597076+0000","last_unstale":"2024-09-12T17:05:58.578428+0000","last_undegraded":"2024-09-12T17:05:58.578428+0000","last_fullsized":"2024-09-12T17:05:58.578428+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.648974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576738+0000","last_change":"2024-09-12T17:05:49.546538+0000","last_active":"2024-09-12T17:05:58.576738+0000","last_peered":"2024-09-12T17:05:58.576738+0000","last_clean":"2024-09-12T17:05:58.576738+0000","last_became_active":"2024-09-12T17:05:49.545785+0000","last_became_peered":"2024-09-12T17:05:49.545785+0000","last_unstale":"2024-09-12T17:05:58.576738+0000","last_undegraded":"2024-09-12T17:05:58.576738+0000","last_fullsized":"2024-09-12T17:05:58.576738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:18.534657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.597058+0000","last_change":"2024-09-12T17:05:47.524007+0000","last_active":"2024-09-12T17:05:58.597058+0000","last_peered":"2024-09-12T17:05:58.597058+0000","last_clean":"2024-09-12T17:05:58.597058+0000","last_became_active":"2024-09-12T17:05:47.522938+0000","last_became_peered":"2024-09-12T17:05:47.522938+0000","last_unstale":"2024-09-12T17:05:58.597058+0000","last_undegraded":"2024-09-12T17:05:58.597058+0000","last_fullsized":"2024-09-12T17:05:58.597058+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:25.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580207+0000","last_change":"2024-09-12T17:05:51.540047+0000","last_active":"2024-09-12T17:05:58.580207+0000","last_peered":"2024-09-12T17:05:58.580207+0000","last_clean":"2024-09-12T17:05:58.580207+0000","last_became_active":"2024-09-12T17:05:51.539302+0000","last_became_peered":"2024-09-12T17:05:51.539302+0000","last_unstale":"2024-09-12T17:05:58.580207+0000","last_undegraded":"2024-09-12T17:05:58.580207+0000","last_fullsized":"2024-09-12T17:05:58.580207+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:21.253801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"36'17","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.465530+0000","last_change":"2024-09-12T17:05:53.554817+0000","last_active":"2024-09-12T17:05:59.465530+0000","last_peered":"2024-09-12T17:05:59.465530+0000","last_clean":"2024-09-12T17:05:59.465530+0000","last_became_active":"2024-09-12T17:05:53.554069+0000","last_became_peered":"2024-09-12T17:05:53.554069+0000","last_unstale":"2024-09-12T17:05:59.465530+0000","last_undegraded":"2024-09-12T17:05:59.465530+0000","last_fullsized":"2024-09-12T17:05:59.465530+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605243+0000","last_change":"2024-09-12T17:05:55.566749+0000","last_active":"2024-09-12T17:05:58.605243+0000","last_peered":"2024-09-12T17:05:58.605243+0000","last_clean":"2024-09-12T17:05:58.605243+0000","last_became_active":"2024-09-12T17:05:55.565979+0000","last_became_peered":"2024-09-12T17:05:55.565979+0000","last_unstale":"2024-09-12T17:05:58.605243+0000","last_undegraded":"2024-09-12T17:05:58.605243+0000","last_fullsized":"2024-09-12T17:05:58.605243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.573778+0000","last_change":"2024-09-12T17:05:57.590758+0000","last_active":"2024-09-12T17:05:58.573778+0000","last_peered":"2024-09-12T17:05:58.573778+0000","last_clean":"2024-09-12T17:05:58.573778+0000","last_became_active":"2024-09-12T17:05:57.589948+0000","last_became_peered":"2024-09-12T17:05:57.589948+0000","last_unstale":"2024-09-12T17:05:58.573778+0000","last_undegraded":"2024-09-12T17:05:58.573778+0000","last_fullsized":"2024-09-12T17:05:58.573778+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:41.423540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606549+0000","last_change":"2024-09-12T17:05:49.539487+0000","last_active":"2024-09-12T17:05:58.606549+0000","last_peered":"2024-09-12T17:05:58.606549+0000","last_clean":"2024-09-12T17:05:58.606549+0000","last_became_active":"2024-09-12T17:05:49.538713+0000","last_became_peered":"2024-09-12T17:05:49.538713+0000","last_unstale":"2024-09-12T17:05:58.606549+0000","last_undegraded":"2024-09-12T17:05:58.606549+0000","last_fullsized":"2024-09-12T17:05:58.606549+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.731614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":139,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576930+0000","last_change":"2024-09-12T17:05:35.688483+0000","last_active":"2024-09-12T17:05:58.576930+0000","last_peered":"2024-09-12T17:05:58.576930+0000","last_clean":"2024-09-12T17:05:58.576930+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:05:58.576930+0000","last_undegraded":"2024-09-12T17:05:58.576930+0000","last_fullsized":"2024-09-12T17:05:58.576930+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_clean_scrub_stamp":"2024-09-12T17:05:34.151079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":49,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588066+0000","last_change":"2024-09-12T17:05:42.225793+0000","last_active":"2024-09-12T17:05:58.588066+0000","last_peered":"2024-09-12T17:05:58.588066+0000","last_clean":"2024-09-12T17:05:58.588066+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:05:58.588066+0000","last_undegraded":"2024-09-12T17:05:58.588066+0000","last_fullsized":"2024-09-12T17:05:58.588066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:54.880257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596609+0000","last_change":"2024-09-12T17:05:47.526243+0000","last_active":"2024-09-12T17:05:58.596609+0000","last_peered":"2024-09-12T17:05:58.596609+0000","last_clean":"2024-09-12T17:05:58.596609+0000","last_became_active":"2024-09-12T17:05:47.525694+0000","last_became_peered":"2024-09-12T17:05:47.525694+0000","last_unstale":"2024-09-12T17:05:58.596609+0000","last_undegraded":"2024-09-12T17:05:58.596609+0000","last_fullsized":"2024-09-12T17:05:58.596609+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579582+0000","last_change":"2024-09-12T17:05:51.548356+0000","last_active":"2024-09-12T17:05:58.579582+0000","last_peered":"2024-09-12T17:05:58.579582+0000","last_clean":"2024-09-12T17:05:58.579582+0000","last_became_active":"2024-09-12T17:05:51.547503+0000","last_became_peered":"2024-09-12T17:05:51.547503+0000","last_unstale":"2024-09-12T17:05:58.579582+0000","last_undegraded":"2024-09-12T17:05:58.579582+0000","last_fullsized":"2024-09-12T17:05:58.579582+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:47.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"36'13","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.255093+0000","last_change":"2024-09-12T17:05:53.546057+0000","last_active":"2024-09-12T17:05:59.255093+0000","last_peered":"2024-09-12T17:05:59.255093+0000","last_clean":"2024-09-12T17:05:59.255093+0000","last_became_active":"2024-09-12T17:05:53.545266+0000","last_became_peered":"2024-09-12T17:05:53.545266+0000","last_unstale":"2024-09-12T17:05:59.255093+0000","last_undegraded":"2024-09-12T17:05:59.255093+0000","last_fullsized":"2024-09-12T17:05:59.255093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592046+0000","last_change":"2024-09-12T17:05:55.562246+0000","last_active":"2024-09-12T17:05:58.592046+0000","last_peered":"2024-09-12T17:05:58.592046+0000","last_clean":"2024-09-12T17:05:58.592046+0000","last_became_active":"2024-09-12T17:05:55.561410+0000","last_became_peered":"2024-09-12T17:05:55.561410+0000","last_unstale":"2024-09-12T17:05:58.592046+0000","last_undegraded":"2024-09-12T17:05:58.592046+0000","last_fullsized":"2024-09-12T17:05:58.592046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.373235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.604801+0000","last_change":"2024-09-12T17:05:57.593095+0000","last_active":"2024-09-12T17:05:58.604801+0000","last_peered":"2024-09-12T17:05:58.604801+0000","last_clean":"2024-09-12T17:05:58.604801+0000","last_became_active":"2024-09-12T17:05:57.592287+0000","last_became_peered":"2024-09-12T17:05:57.592287+0000","last_unstale":"2024-09-12T17:05:58.604801+0000","last_undegraded":"2024-09-12T17:05:58.604801+0000","last_fullsized":"2024-09-12T17:05:58.604801+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:52.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592601+0000","last_change":"2024-09-12T17:05:49.543737+0000","last_active":"2024-09-12T17:05:58.592601+0000","last_peered":"2024-09-12T17:05:58.592601+0000","last_clean":"2024-09-12T17:05:58.592601+0000","last_became_active":"2024-09-12T17:05:49.542850+0000","last_became_peered":"2024-09-12T17:05:49.542850+0000","last_unstale":"2024-09-12T17:05:58.592601+0000","last_undegraded":"2024-09-12T17:05:58.592601+0000","last_fullsized":"2024-09-12T17:05:58.592601+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:35:31.868549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576690+0000","last_change":"2024-09-12T17:05:42.218859+0000","last_active":"2024-09-12T17:05:58.576690+0000","last_peered":"2024-09-12T17:05:58.576690+0000","last_clean":"2024-09-12T17:05:58.576690+0000","last_became_active":"2024-09-12T17:05:40.212384+0000","last_became_peered":"2024-09-12T17:05:40.212384+0000","last_unstale":"2024-09-12T17:05:58.576690+0000","last_undegraded":"2024-09-12T17:05:58.576690+0000","last_fullsized":"2024-09-12T17:05:58.576690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:36:29.184124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590051+0000","last_change":"2024-09-12T17:05:47.544269+0000","last_active":"2024-09-12T17:05:58.590051+0000","last_peered":"2024-09-12T17:05:58.590051+0000","last_clean":"2024-09-12T17:05:58.590051+0000","last_became_active":"2024-09-12T17:05:47.543531+0000","last_became_peered":"2024-09-12T17:05:47.543531+0000","last_unstale":"2024-09-12T17:05:58.590051+0000","last_undegraded":"2024-09-12T17:05:58.590051+0000","last_fullsized":"2024-09-12T17:05:58.590051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:55.688363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590225+0000","last_change":"2024-09-12T17:05:51.554000+0000","last_active":"2024-09-12T17:05:58.590225+0000","last_peered":"2024-09-12T17:05:58.590225+0000","last_clean":"2024-09-12T17:05:58.590225+0000","last_became_active":"2024-09-12T17:05:51.553161+0000","last_became_peered":"2024-09-12T17:05:51.553161+0000","last_unstale":"2024-09-12T17:05:58.590225+0000","last_undegraded":"2024-09-12T17:05:58.590225+0000","last_fullsized":"2024-09-12T17:05:58.590225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:10.443453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"36'23","reported_seq":64,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.452164+0000","last_change":"2024-09-12T17:05:53.558251+0000","last_active":"2024-09-12T17:05:59.452164+0000","last_peered":"2024-09-12T17:05:59.452164+0000","last_clean":"2024-09-12T17:05:59.452164+0000","last_became_active":"2024-09-12T17:05:53.557763+0000","last_became_peered":"2024-09-12T17:05:53.557763+0000","last_unstale":"2024-09-12T17:05:59.452164+0000","last_undegraded":"2024-09-12T17:05:59.452164+0000","last_fullsized":"2024-09-12T17:05:59.452164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:51.661773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.581638+0000","last_change":"2024-09-12T17:05:55.556362+0000","last_active":"2024-09-12T17:05:58.581638+0000","last_peered":"2024-09-12T17:05:58.581638+0000","last_clean":"2024-09-12T17:05:58.581638+0000","last_became_active":"2024-09-12T17:05:55.555625+0000","last_became_peered":"2024-09-12T17:05:55.555625+0000","last_unstale":"2024-09-12T17:05:58.581638+0000","last_undegraded":"2024-09-12T17:05:58.581638+0000","last_fullsized":"2024-09-12T17:05:58.581638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.573860+0000","last_change":"2024-09-12T17:05:58.119224+0000","last_active":"2024-09-12T17:05:58.573860+0000","last_peered":"2024-09-12T17:05:58.573860+0000","last_clean":"2024-09-12T17:05:58.573860+0000","last_became_active":"2024-09-12T17:05:58.118412+0000","last_became_peered":"2024-09-12T17:05:58.118412+0000","last_unstale":"2024-09-12T17:05:58.573860+0000","last_undegraded":"2024-09-12T17:05:58.573860+0000","last_fullsized":"2024-09-12T17:05:58.573860+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:17:04.268994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576911+0000","last_change":"2024-09-12T17:05:49.543179+0000","last_active":"2024-09-12T17:05:58.576911+0000","last_peered":"2024-09-12T17:05:58.576911+0000","last_clean":"2024-09-12T17:05:58.576911+0000","last_became_active":"2024-09-12T17:05:49.541277+0000","last_became_peered":"2024-09-12T17:05:49.541277+0000","last_unstale":"2024-09-12T17:05:58.576911+0000","last_undegraded":"2024-09-12T17:05:58.576911+0000","last_fullsized":"2024-09-12T17:05:58.576911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:15:05.338596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.618634+0000","last_change":"2024-09-12T17:05:42.677413+0000","last_active":"2024-09-12T17:05:58.618634+0000","last_peered":"2024-09-12T17:05:58.618634+0000","last_clean":"2024-09-12T17:05:58.618634+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:05:58.618634+0000","last_undegraded":"2024-09-12T17:05:58.618634+0000","last_fullsized":"2024-09-12T17:05:58.618634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.836885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.573274+0000","last_change":"2024-09-12T17:05:47.520568+0000","last_active":"2024-09-12T17:05:58.573274+0000","last_peered":"2024-09-12T17:05:58.573274+0000","last_clean":"2024-09-12T17:05:58.573274+0000","last_became_active":"2024-09-12T17:05:47.520173+0000","last_became_peered":"2024-09-12T17:05:47.520173+0000","last_unstale":"2024-09-12T17:05:58.573274+0000","last_undegraded":"2024-09-12T17:05:58.573274+0000","last_fullsized":"2024-09-12T17:05:58.573274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:38:36.609804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619550+0000","last_change":"2024-09-12T17:05:51.557262+0000","last_active":"2024-09-12T17:05:58.619550+0000","last_peered":"2024-09-12T17:05:58.619550+0000","last_clean":"2024-09-12T17:05:58.619550+0000","last_became_active":"2024-09-12T17:05:51.556959+0000","last_became_peered":"2024-09-12T17:05:51.556959+0000","last_unstale":"2024-09-12T17:05:58.619550+0000","last_undegraded":"2024-09-12T17:05:58.619550+0000","last_fullsized":"2024-09-12T17:05:58.619550+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.963181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.461240+0000","last_change":"2024-09-12T17:05:53.555384+0000","last_active":"2024-09-12T17:05:59.461240+0000","last_peered":"2024-09-12T17:05:59.461240+0000","last_clean":"2024-09-12T17:05:59.461240+0000","last_became_active":"2024-09-12T17:05:53.554063+0000","last_became_peered":"2024-09-12T17:05:53.554063+0000","last_unstale":"2024-09-12T17:05:59.461240+0000","last_undegraded":"2024-09-12T17:05:59.461240+0000","last_fullsized":"2024-09-12T17:05:59.461240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590789+0000","last_change":"2024-09-12T17:05:55.547595+0000","last_active":"2024-09-12T17:05:58.590789+0000","last_peered":"2024-09-12T17:05:58.590789+0000","last_clean":"2024-09-12T17:05:58.590789+0000","last_became_active":"2024-09-12T17:05:55.546700+0000","last_became_peered":"2024-09-12T17:05:55.546700+0000","last_unstale":"2024-09-12T17:05:58.590789+0000","last_undegraded":"2024-09-12T17:05:58.590789+0000","last_fullsized":"2024-09-12T17:05:58.590789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.598319+0000","last_change":"2024-09-12T17:05:57.587955+0000","last_active":"2024-09-12T17:05:58.598319+0000","last_peered":"2024-09-12T17:05:58.598319+0000","last_clean":"2024-09-12T17:05:58.598319+0000","last_became_active":"2024-09-12T17:05:57.587199+0000","last_became_peered":"2024-09-12T17:05:57.587199+0000","last_unstale":"2024-09-12T17:05:58.598319+0000","last_undegraded":"2024-09-12T17:05:58.598319+0000","last_fullsized":"2024-09-12T17:05:58.598319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.422656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575041+0000","last_change":"2024-09-12T17:05:49.541493+0000","last_active":"2024-09-12T17:05:58.575041+0000","last_peered":"2024-09-12T17:05:58.575041+0000","last_clean":"2024-09-12T17:05:58.575041+0000","last_became_active":"2024-09-12T17:05:49.541194+0000","last_became_peered":"2024-09-12T17:05:49.541194+0000","last_unstale":"2024-09-12T17:05:58.575041+0000","last_undegraded":"2024-09-12T17:05:58.575041+0000","last_fullsized":"2024-09-12T17:05:58.575041+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:58.401990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":50,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588586+0000","last_change":"2024-09-12T17:05:42.226889+0000","last_active":"2024-09-12T17:05:58.588586+0000","last_peered":"2024-09-12T17:05:58.588586+0000","last_clean":"2024-09-12T17:05:58.588586+0000","last_became_active":"2024-09-12T17:05:40.214050+0000","last_became_peered":"2024-09-12T17:05:40.214050+0000","last_unstale":"2024-09-12T17:05:58.588586+0000","last_undegraded":"2024-09-12T17:05:58.588586+0000","last_fullsized":"2024-09-12T17:05:58.588586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:33:12.972719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577621+0000","last_change":"2024-09-12T17:05:47.546543+0000","last_active":"2024-09-12T17:05:58.577621+0000","last_peered":"2024-09-12T17:05:58.577621+0000","last_clean":"2024-09-12T17:05:58.577621+0000","last_became_active":"2024-09-12T17:05:47.545554+0000","last_became_peered":"2024-09-12T17:05:47.545554+0000","last_unstale":"2024-09-12T17:05:58.577621+0000","last_undegraded":"2024-09-12T17:05:58.577621+0000","last_fullsized":"2024-09-12T17:05:58.577621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:07.148131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591020+0000","last_change":"2024-09-12T17:05:51.535295+0000","last_active":"2024-09-12T17:05:58.591020+0000","last_peered":"2024-09-12T17:05:58.591020+0000","last_clean":"2024-09-12T17:05:58.591020+0000","last_became_active":"2024-09-12T17:05:51.534495+0000","last_became_peered":"2024-09-12T17:05:51.534495+0000","last_unstale":"2024-09-12T17:05:58.591020+0000","last_undegraded":"2024-09-12T17:05:58.591020+0000","last_fullsized":"2024-09-12T17:05:58.591020+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":39,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.290531+0000","last_change":"2024-09-12T17:05:53.551499+0000","last_active":"2024-09-12T17:05:59.290531+0000","last_peered":"2024-09-12T17:05:59.290531+0000","last_clean":"2024-09-12T17:05:59.290531+0000","last_became_active":"2024-09-12T17:05:53.550857+0000","last_became_peered":"2024-09-12T17:05:53.550857+0000","last_unstale":"2024-09-12T17:05:59.290531+0000","last_undegraded":"2024-09-12T17:05:59.290531+0000","last_fullsized":"2024-09-12T17:05:59.290531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606524+0000","last_change":"2024-09-12T17:05:55.571619+0000","last_active":"2024-09-12T17:05:58.606524+0000","last_peered":"2024-09-12T17:05:58.606524+0000","last_clean":"2024-09-12T17:05:58.606524+0000","last_became_active":"2024-09-12T17:05:55.570991+0000","last_became_peered":"2024-09-12T17:05:55.570991+0000","last_unstale":"2024-09-12T17:05:58.606524+0000","last_undegraded":"2024-09-12T17:05:58.606524+0000","last_fullsized":"2024-09-12T17:05:58.606524+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:02.401831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587015+0000","last_change":"2024-09-12T17:05:57.590482+0000","last_active":"2024-09-12T17:05:58.587015+0000","last_peered":"2024-09-12T17:05:58.587015+0000","last_clean":"2024-09-12T17:05:58.587015+0000","last_became_active":"2024-09-12T17:05:57.589542+0000","last_became_peered":"2024-09-12T17:05:57.589542+0000","last_unstale":"2024-09-12T17:05:58.587015+0000","last_undegraded":"2024-09-12T17:05:58.587015+0000","last_fullsized":"2024-09-12T17:05:58.587015+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:20.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575001+0000","last_change":"2024-09-12T17:05:49.543005+0000","last_active":"2024-09-12T17:05:58.575001+0000","last_peered":"2024-09-12T17:05:58.575001+0000","last_clean":"2024-09-12T17:05:58.575001+0000","last_became_active":"2024-09-12T17:05:49.542189+0000","last_became_peered":"2024-09-12T17:05:49.542189+0000","last_unstale":"2024-09-12T17:05:58.575001+0000","last_undegraded":"2024-09-12T17:05:58.575001+0000","last_fullsized":"2024-09-12T17:05:58.575001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:38:18.139854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589691+0000","last_change":"2024-09-12T17:05:47.525858+0000","last_active":"2024-09-12T17:05:58.589691+0000","last_peered":"2024-09-12T17:05:58.589691+0000","last_clean":"2024-09-12T17:05:58.589691+0000","last_became_active":"2024-09-12T17:05:47.525258+0000","last_became_peered":"2024-09-12T17:05:47.525258+0000","last_unstale":"2024-09-12T17:05:58.589691+0000","last_undegraded":"2024-09-12T17:05:58.589691+0000","last_fullsized":"2024-09-12T17:05:58.589691+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575432+0000","last_change":"2024-09-12T17:05:42.216609+0000","last_active":"2024-09-12T17:05:58.575432+0000","last_peered":"2024-09-12T17:05:58.575432+0000","last_clean":"2024-09-12T17:05:58.575432+0000","last_became_active":"2024-09-12T17:05:40.210347+0000","last_became_peered":"2024-09-12T17:05:40.210347+0000","last_unstale":"2024-09-12T17:05:58.575432+0000","last_undegraded":"2024-09-12T17:05:58.575432+0000","last_fullsized":"2024-09-12T17:05:58.575432+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:59.135278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010482919999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591478+0000","last_change":"2024-09-12T17:05:51.544848+0000","last_active":"2024-09-12T17:05:58.591478+0000","last_peered":"2024-09-12T17:05:58.591478+0000","last_clean":"2024-09-12T17:05:58.591478+0000","last_became_active":"2024-09-12T17:05:51.544078+0000","last_became_peered":"2024-09-12T17:05:51.544078+0000","last_unstale":"2024-09-12T17:05:58.591478+0000","last_undegraded":"2024-09-12T17:05:58.591478+0000","last_fullsized":"2024-09-12T17:05:58.591478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"36'18","reported_seq":53,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.386117+0000","last_change":"2024-09-12T17:05:53.540181+0000","last_active":"2024-09-12T17:05:59.386117+0000","last_peered":"2024-09-12T17:05:59.386117+0000","last_clean":"2024-09-12T17:05:59.386117+0000","last_became_active":"2024-09-12T17:05:53.539372+0000","last_became_peered":"2024-09-12T17:05:53.539372+0000","last_unstale":"2024-09-12T17:05:59.386117+0000","last_undegraded":"2024-09-12T17:05:59.386117+0000","last_fullsized":"2024-09-12T17:05:59.386117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:58.931466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577490+0000","last_change":"2024-09-12T17:05:55.554060+0000","last_active":"2024-09-12T17:05:58.577490+0000","last_peered":"2024-09-12T17:05:58.577490+0000","last_clean":"2024-09-12T17:05:58.577490+0000","last_became_active":"2024-09-12T17:05:55.553263+0000","last_became_peered":"2024-09-12T17:05:55.553263+0000","last_unstale":"2024-09-12T17:05:58.577490+0000","last_undegraded":"2024-09-12T17:05:58.577490+0000","last_fullsized":"2024-09-12T17:05:58.577490+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:44.303469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591531+0000","last_change":"2024-09-12T17:05:58.121180+0000","last_active":"2024-09-12T17:05:58.591531+0000","last_peered":"2024-09-12T17:05:58.591531+0000","last_clean":"2024-09-12T17:05:58.591531+0000","last_became_active":"2024-09-12T17:05:58.119755+0000","last_became_peered":"2024-09-12T17:05:58.119755+0000","last_unstale":"2024-09-12T17:05:58.591531+0000","last_undegraded":"2024-09-12T17:05:58.591531+0000","last_fullsized":"2024-09-12T17:05:58.591531+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592276+0000","last_change":"2024-09-12T17:05:49.550213+0000","last_active":"2024-09-12T17:05:58.592276+0000","last_peered":"2024-09-12T17:05:58.592276+0000","last_clean":"2024-09-12T17:05:58.592276+0000","last_became_active":"2024-09-12T17:05:49.549583+0000","last_became_peered":"2024-09-12T17:05:49.549583+0000","last_unstale":"2024-09-12T17:05:58.592276+0000","last_undegraded":"2024-09-12T17:05:58.592276+0000","last_fullsized":"2024-09-12T17:05:58.592276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:05.085326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575192+0000","last_change":"2024-09-12T17:05:47.520551+0000","last_active":"2024-09-12T17:05:58.575192+0000","last_peered":"2024-09-12T17:05:58.575192+0000","last_clean":"2024-09-12T17:05:58.575192+0000","last_became_active":"2024-09-12T17:05:47.518410+0000","last_became_peered":"2024-09-12T17:05:47.518410+0000","last_unstale":"2024-09-12T17:05:58.575192+0000","last_undegraded":"2024-09-12T17:05:58.575192+0000","last_fullsized":"2024-09-12T17:05:58.575192+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:27:54.172257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.583297+0000","last_change":"2024-09-12T17:05:42.218804+0000","last_active":"2024-09-12T17:05:58.583297+0000","last_peered":"2024-09-12T17:05:58.583297+0000","last_clean":"2024-09-12T17:05:58.583297+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:05:58.583297+0000","last_undegraded":"2024-09-12T17:05:58.583297+0000","last_fullsized":"2024-09-12T17:05:58.583297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:48.189931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605504+0000","last_change":"2024-09-12T17:05:51.545963+0000","last_active":"2024-09-12T17:05:58.605504+0000","last_peered":"2024-09-12T17:05:58.605504+0000","last_clean":"2024-09-12T17:05:58.605504+0000","last_became_active":"2024-09-12T17:05:51.545225+0000","last_became_peered":"2024-09-12T17:05:51.545225+0000","last_unstale":"2024-09-12T17:05:58.605504+0000","last_undegraded":"2024-09-12T17:05:58.605504+0000","last_fullsized":"2024-09-12T17:05:58.605504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:40.407563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":42,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.484864+0000","last_change":"2024-09-12T17:05:53.551372+0000","last_active":"2024-09-12T17:05:59.484864+0000","last_peered":"2024-09-12T17:05:59.484864+0000","last_clean":"2024-09-12T17:05:59.484864+0000","last_became_active":"2024-09-12T17:05:53.550594+0000","last_became_peered":"2024-09-12T17:05:53.550594+0000","last_unstale":"2024-09-12T17:05:59.484864+0000","last_undegraded":"2024-09-12T17:05:59.484864+0000","last_fullsized":"2024-09-12T17:05:59.484864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:20.334478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587662+0000","last_change":"2024-09-12T17:05:55.573161+0000","last_active":"2024-09-12T17:05:58.587662+0000","last_peered":"2024-09-12T17:05:58.587662+0000","last_clean":"2024-09-12T17:05:58.587662+0000","last_became_active":"2024-09-12T17:05:55.571897+0000","last_became_peered":"2024-09-12T17:05:55.571897+0000","last_unstale":"2024-09-12T17:05:58.587662+0000","last_undegraded":"2024-09-12T17:05:58.587662+0000","last_fullsized":"2024-09-12T17:05:58.587662+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.601582+0000","last_change":"2024-09-12T17:05:58.118437+0000","last_active":"2024-09-12T17:05:58.601582+0000","last_peered":"2024-09-12T17:05:58.601582+0000","last_clean":"2024-09-12T17:05:58.601582+0000","last_became_active":"2024-09-12T17:05:58.117710+0000","last_became_peered":"2024-09-12T17:05:58.117710+0000","last_unstale":"2024-09-12T17:05:58.601582+0000","last_undegraded":"2024-09-12T17:05:58.601582+0000","last_fullsized":"2024-09-12T17:05:58.601582+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:00.239807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596506+0000","last_change":"2024-09-12T17:05:49.519509+0000","last_active":"2024-09-12T17:05:58.596506+0000","last_peered":"2024-09-12T17:05:58.596506+0000","last_clean":"2024-09-12T17:05:58.596506+0000","last_became_active":"2024-09-12T17:05:49.519178+0000","last_became_peered":"2024-09-12T17:05:49.519178+0000","last_unstale":"2024-09-12T17:05:58.596506+0000","last_undegraded":"2024-09-12T17:05:58.596506+0000","last_fullsized":"2024-09-12T17:05:58.596506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:03:33.502884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600287+0000","last_change":"2024-09-12T17:05:47.535321+0000","last_active":"2024-09-12T17:05:58.600287+0000","last_peered":"2024-09-12T17:05:58.600287+0000","last_clean":"2024-09-12T17:05:58.600287+0000","last_became_active":"2024-09-12T17:05:47.534790+0000","last_became_peered":"2024-09-12T17:05:47.534790+0000","last_unstale":"2024-09-12T17:05:58.600287+0000","last_undegraded":"2024-09-12T17:05:58.600287+0000","last_fullsized":"2024-09-12T17:05:58.600287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576368+0000","last_change":"2024-09-12T17:05:42.216620+0000","last_active":"2024-09-12T17:05:58.576368+0000","last_peered":"2024-09-12T17:05:58.576368+0000","last_clean":"2024-09-12T17:05:58.576368+0000","last_became_active":"2024-09-12T17:05:40.211977+0000","last_became_peered":"2024-09-12T17:05:40.211977+0000","last_unstale":"2024-09-12T17:05:58.576368+0000","last_undegraded":"2024-09-12T17:05:58.576368+0000","last_fullsized":"2024-09-12T17:05:58.576368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:16.615233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010578320000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578083+0000","last_change":"2024-09-12T17:05:51.533668+0000","last_active":"2024-09-12T17:05:58.578083+0000","last_peered":"2024-09-12T17:05:58.578083+0000","last_clean":"2024-09-12T17:05:58.578083+0000","last_became_active":"2024-09-12T17:05:51.532795+0000","last_became_peered":"2024-09-12T17:05:51.532795+0000","last_unstale":"2024-09-12T17:05:58.578083+0000","last_undegraded":"2024-09-12T17:05:58.578083+0000","last_fullsized":"2024-09-12T17:05:58.578083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.655645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.442779+0000","last_change":"2024-09-12T17:05:53.544503+0000","last_active":"2024-09-12T17:05:59.442779+0000","last_peered":"2024-09-12T17:05:59.442779+0000","last_clean":"2024-09-12T17:05:59.442779+0000","last_became_active":"2024-09-12T17:05:53.543495+0000","last_became_peered":"2024-09-12T17:05:53.543495+0000","last_unstale":"2024-09-12T17:05:59.442779+0000","last_undegraded":"2024-09-12T17:05:59.442779+0000","last_fullsized":"2024-09-12T17:05:59.442779+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.721968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.599304+0000","last_change":"2024-09-12T17:05:55.567580+0000","last_active":"2024-09-12T17:05:58.599304+0000","last_peered":"2024-09-12T17:05:58.599304+0000","last_clean":"2024-09-12T17:05:58.599304+0000","last_became_active":"2024-09-12T17:05:55.566652+0000","last_became_peered":"2024-09-12T17:05:55.566652+0000","last_unstale":"2024-09-12T17:05:58.599304+0000","last_undegraded":"2024-09-12T17:05:58.599304+0000","last_fullsized":"2024-09-12T17:05:58.599304+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:28.904117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591539+0000","last_change":"2024-09-12T17:05:57.585098+0000","last_active":"2024-09-12T17:05:58.591539+0000","last_peered":"2024-09-12T17:05:58.591539+0000","last_clean":"2024-09-12T17:05:58.591539+0000","last_became_active":"2024-09-12T17:05:57.584326+0000","last_became_peered":"2024-09-12T17:05:57.584326+0000","last_unstale":"2024-09-12T17:05:58.591539+0000","last_undegraded":"2024-09-12T17:05:58.591539+0000","last_fullsized":"2024-09-12T17:05:58.591539+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578596+0000","last_change":"2024-09-12T17:05:49.553294+0000","last_active":"2024-09-12T17:05:58.578596+0000","last_peered":"2024-09-12T17:05:58.578596+0000","last_clean":"2024-09-12T17:05:58.578596+0000","last_became_active":"2024-09-12T17:05:49.551726+0000","last_became_peered":"2024-09-12T17:05:49.551726+0000","last_unstale":"2024-09-12T17:05:58.578596+0000","last_undegraded":"2024-09-12T17:05:58.578596+0000","last_fullsized":"2024-09-12T17:05:58.578596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:50.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592925+0000","last_change":"2024-09-12T17:05:47.518931+0000","last_active":"2024-09-12T17:05:58.592925+0000","last_peered":"2024-09-12T17:05:58.592925+0000","last_clean":"2024-09-12T17:05:58.592925+0000","last_became_active":"2024-09-12T17:05:47.518428+0000","last_became_peered":"2024-09-12T17:05:47.518428+0000","last_unstale":"2024-09-12T17:05:58.592925+0000","last_undegraded":"2024-09-12T17:05:58.592925+0000","last_fullsized":"2024-09-12T17:05:58.592925+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.607245+0000","last_change":"2024-09-12T17:05:42.680975+0000","last_active":"2024-09-12T17:05:58.607245+0000","last_peered":"2024-09-12T17:05:58.607245+0000","last_clean":"2024-09-12T17:05:58.607245+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:05:58.607245+0000","last_undegraded":"2024-09-12T17:05:58.607245+0000","last_fullsized":"2024-09-12T17:05:58.607245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.660350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596208+0000","last_change":"2024-09-12T17:05:51.530163+0000","last_active":"2024-09-12T17:05:58.596208+0000","last_peered":"2024-09-12T17:05:58.596208+0000","last_clean":"2024-09-12T17:05:58.596208+0000","last_became_active":"2024-09-12T17:05:51.529790+0000","last_became_peered":"2024-09-12T17:05:51.529790+0000","last_unstale":"2024-09-12T17:05:58.596208+0000","last_undegraded":"2024-09-12T17:05:58.596208+0000","last_fullsized":"2024-09-12T17:05:58.596208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:29.387749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"36'19","reported_seq":57,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.422455+0000","last_change":"2024-09-12T17:05:53.554751+0000","last_active":"2024-09-12T17:05:59.422455+0000","last_peered":"2024-09-12T17:05:59.422455+0000","last_clean":"2024-09-12T17:05:59.422455+0000","last_became_active":"2024-09-12T17:05:53.553914+0000","last_became_peered":"2024-09-12T17:05:53.553914+0000","last_unstale":"2024-09-12T17:05:59.422455+0000","last_undegraded":"2024-09-12T17:05:59.422455+0000","last_fullsized":"2024-09-12T17:05:59.422455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596725+0000","last_change":"2024-09-12T17:05:55.573020+0000","last_active":"2024-09-12T17:05:58.596725+0000","last_peered":"2024-09-12T17:05:58.596725+0000","last_clean":"2024-09-12T17:05:58.596725+0000","last_became_active":"2024-09-12T17:05:55.571538+0000","last_became_peered":"2024-09-12T17:05:55.571538+0000","last_unstale":"2024-09-12T17:05:58.596725+0000","last_undegraded":"2024-09-12T17:05:58.596725+0000","last_fullsized":"2024-09-12T17:05:58.596725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:29.200717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588696+0000","last_change":"2024-09-12T17:05:57.605829+0000","last_active":"2024-09-12T17:05:58.588696+0000","last_peered":"2024-09-12T17:05:58.588696+0000","last_clean":"2024-09-12T17:05:58.588696+0000","last_became_active":"2024-09-12T17:05:57.605041+0000","last_became_peered":"2024-09-12T17:05:57.605041+0000","last_unstale":"2024-09-12T17:05:58.588696+0000","last_undegraded":"2024-09-12T17:05:58.588696+0000","last_fullsized":"2024-09-12T17:05:58.588696+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591536+0000","last_change":"2024-09-12T17:05:57.594498+0000","last_active":"2024-09-12T17:05:58.591536+0000","last_peered":"2024-09-12T17:05:58.591536+0000","last_clean":"2024-09-12T17:05:58.591536+0000","last_became_active":"2024-09-12T17:05:57.590196+0000","last_became_peered":"2024-09-12T17:05:57.590196+0000","last_unstale":"2024-09-12T17:05:58.591536+0000","last_undegraded":"2024-09-12T17:05:58.591536+0000","last_fullsized":"2024-09-12T17:05:58.591536+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.543735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577181+0000","last_change":"2024-09-12T17:05:49.562121+0000","last_active":"2024-09-12T17:05:58.577181+0000","last_peered":"2024-09-12T17:05:58.577181+0000","last_clean":"2024-09-12T17:05:58.577181+0000","last_became_active":"2024-09-12T17:05:49.561429+0000","last_became_peered":"2024-09-12T17:05:49.561429+0000","last_unstale":"2024-09-12T17:05:58.577181+0000","last_undegraded":"2024-09-12T17:05:58.577181+0000","last_fullsized":"2024-09-12T17:05:58.577181+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:47.663366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.581437+0000","last_change":"2024-09-12T17:05:47.557270+0000","last_active":"2024-09-12T17:05:58.581437+0000","last_peered":"2024-09-12T17:05:58.581437+0000","last_clean":"2024-09-12T17:05:58.581437+0000","last_became_active":"2024-09-12T17:05:47.556417+0000","last_became_peered":"2024-09-12T17:05:47.556417+0000","last_unstale":"2024-09-12T17:05:58.581437+0000","last_undegraded":"2024-09-12T17:05:58.581437+0000","last_fullsized":"2024-09-12T17:05:58.581437+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:00.210632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575408+0000","last_change":"2024-09-12T17:05:51.554693+0000","last_active":"2024-09-12T17:05:58.575408+0000","last_peered":"2024-09-12T17:05:58.575408+0000","last_clean":"2024-09-12T17:05:58.575408+0000","last_became_active":"2024-09-12T17:05:51.554346+0000","last_became_peered":"2024-09-12T17:05:51.554346+0000","last_unstale":"2024-09-12T17:05:58.575408+0000","last_undegraded":"2024-09-12T17:05:58.575408+0000","last_fullsized":"2024-09-12T17:05:58.575408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:21.922825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"36'11","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.491900+0000","last_change":"2024-09-12T17:05:53.542230+0000","last_active":"2024-09-12T17:05:59.491900+0000","last_peered":"2024-09-12T17:05:59.491900+0000","last_clean":"2024-09-12T17:05:59.491900+0000","last_became_active":"2024-09-12T17:05:53.541653+0000","last_became_peered":"2024-09-12T17:05:53.541653+0000","last_unstale":"2024-09-12T17:05:59.491900+0000","last_undegraded":"2024-09-12T17:05:59.491900+0000","last_fullsized":"2024-09-12T17:05:59.491900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.595768+0000","last_change":"2024-09-12T17:05:55.556535+0000","last_active":"2024-09-12T17:05:58.595768+0000","last_peered":"2024-09-12T17:05:58.595768+0000","last_clean":"2024-09-12T17:05:58.595768+0000","last_became_active":"2024-09-12T17:05:55.555755+0000","last_became_peered":"2024-09-12T17:05:55.555755+0000","last_unstale":"2024-09-12T17:05:58.595768+0000","last_undegraded":"2024-09-12T17:05:58.595768+0000","last_fullsized":"2024-09-12T17:05:58.595768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.707384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600021+0000","last_change":"2024-09-12T17:05:57.593418+0000","last_active":"2024-09-12T17:05:58.600021+0000","last_peered":"2024-09-12T17:05:58.600021+0000","last_clean":"2024-09-12T17:05:58.600021+0000","last_became_active":"2024-09-12T17:05:57.592746+0000","last_became_peered":"2024-09-12T17:05:57.592746+0000","last_unstale":"2024-09-12T17:05:58.600021+0000","last_undegraded":"2024-09-12T17:05:58.600021+0000","last_fullsized":"2024-09-12T17:05:58.600021+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:24.794382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.574713+0000","last_change":"2024-09-12T17:05:49.555968+0000","last_active":"2024-09-12T17:05:58.574713+0000","last_peered":"2024-09-12T17:05:58.574713+0000","last_clean":"2024-09-12T17:05:58.574713+0000","last_became_active":"2024-09-12T17:05:49.555597+0000","last_became_peered":"2024-09-12T17:05:49.555597+0000","last_unstale":"2024-09-12T17:05:58.574713+0000","last_undegraded":"2024-09-12T17:05:58.574713+0000","last_fullsized":"2024-09-12T17:05:58.574713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:59:10.369863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582867+0000","last_change":"2024-09-12T17:05:47.559497+0000","last_active":"2024-09-12T17:05:58.582867+0000","last_peered":"2024-09-12T17:05:58.582867+0000","last_clean":"2024-09-12T17:05:58.582867+0000","last_became_active":"2024-09-12T17:05:47.558641+0000","last_became_peered":"2024-09-12T17:05:47.558641+0000","last_unstale":"2024-09-12T17:05:58.582867+0000","last_undegraded":"2024-09-12T17:05:58.582867+0000","last_fullsized":"2024-09-12T17:05:58.582867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:00.096304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.598140+0000","last_change":"2024-09-12T17:05:51.539784+0000","last_active":"2024-09-12T17:05:58.598140+0000","last_peered":"2024-09-12T17:05:58.598140+0000","last_clean":"2024-09-12T17:05:58.598140+0000","last_became_active":"2024-09-12T17:05:51.539275+0000","last_became_peered":"2024-09-12T17:05:51.539275+0000","last_unstale":"2024-09-12T17:05:58.598140+0000","last_undegraded":"2024-09-12T17:05:58.598140+0000","last_fullsized":"2024-09-12T17:05:58.598140+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"36'4","reported_seq":27,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.927159+0000","last_change":"2024-09-12T17:05:53.544731+0000","last_active":"2024-09-12T17:05:58.927159+0000","last_peered":"2024-09-12T17:05:58.927159+0000","last_clean":"2024-09-12T17:05:58.927159+0000","last_became_active":"2024-09-12T17:05:53.544127+0000","last_became_peered":"2024-09-12T17:05:53.544127+0000","last_unstale":"2024-09-12T17:05:58.927159+0000","last_undegraded":"2024-09-12T17:05:58.927159+0000","last_fullsized":"2024-09-12T17:05:58.927159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:04.351698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576931+0000","last_change":"2024-09-12T17:05:55.571541+0000","last_active":"2024-09-12T17:05:58.576931+0000","last_peered":"2024-09-12T17:05:58.576931+0000","last_clean":"2024-09-12T17:05:58.576931+0000","last_became_active":"2024-09-12T17:05:55.570822+0000","last_became_peered":"2024-09-12T17:05:55.570822+0000","last_unstale":"2024-09-12T17:05:58.576931+0000","last_undegraded":"2024-09-12T17:05:58.576931+0000","last_fullsized":"2024-09-12T17:05:58.576931+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592526+0000","last_change":"2024-09-12T17:05:57.588655+0000","last_active":"2024-09-12T17:05:58.592526+0000","last_peered":"2024-09-12T17:05:58.592526+0000","last_clean":"2024-09-12T17:05:58.592526+0000","last_became_active":"2024-09-12T17:05:57.586264+0000","last_became_peered":"2024-09-12T17:05:57.586264+0000","last_unstale":"2024-09-12T17:05:58.592526+0000","last_undegraded":"2024-09-12T17:05:58.592526+0000","last_fullsized":"2024-09-12T17:05:58.592526+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:44.380435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596840+0000","last_change":"2024-09-12T17:05:49.520508+0000","last_active":"2024-09-12T17:05:58.596840+0000","last_peered":"2024-09-12T17:05:58.596840+0000","last_clean":"2024-09-12T17:05:58.596840+0000","last_became_active":"2024-09-12T17:05:49.519721+0000","last_became_peered":"2024-09-12T17:05:49.519721+0000","last_unstale":"2024-09-12T17:05:58.596840+0000","last_undegraded":"2024-09-12T17:05:58.596840+0000","last_fullsized":"2024-09-12T17:05:58.596840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589873+0000","last_change":"2024-09-12T17:05:47.539549+0000","last_active":"2024-09-12T17:05:58.589873+0000","last_peered":"2024-09-12T17:05:58.589873+0000","last_clean":"2024-09-12T17:05:58.589873+0000","last_became_active":"2024-09-12T17:05:47.538581+0000","last_became_peered":"2024-09-12T17:05:47.538581+0000","last_unstale":"2024-09-12T17:05:58.589873+0000","last_undegraded":"2024-09-12T17:05:58.589873+0000","last_fullsized":"2024-09-12T17:05:58.589873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.448924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575893+0000","last_change":"2024-09-12T17:05:51.530541+0000","last_active":"2024-09-12T17:05:58.575893+0000","last_peered":"2024-09-12T17:05:58.575893+0000","last_clean":"2024-09-12T17:05:58.575893+0000","last_became_active":"2024-09-12T17:05:51.527515+0000","last_became_peered":"2024-09-12T17:05:51.527515+0000","last_unstale":"2024-09-12T17:05:58.575893+0000","last_undegraded":"2024-09-12T17:05:58.575893+0000","last_fullsized":"2024-09-12T17:05:58.575893+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"36'11","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.400000+0000","last_change":"2024-09-12T17:05:53.555017+0000","last_active":"2024-09-12T17:05:59.400000+0000","last_peered":"2024-09-12T17:05:59.400000+0000","last_clean":"2024-09-12T17:05:59.400000+0000","last_became_active":"2024-09-12T17:05:53.551154+0000","last_became_peered":"2024-09-12T17:05:53.551154+0000","last_unstale":"2024-09-12T17:05:59.400000+0000","last_undegraded":"2024-09-12T17:05:59.400000+0000","last_fullsized":"2024-09-12T17:05:59.400000+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:50.736153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605228+0000","last_change":"2024-09-12T17:05:55.570872+0000","last_active":"2024-09-12T17:05:58.605228+0000","last_peered":"2024-09-12T17:05:58.605228+0000","last_clean":"2024-09-12T17:05:58.605228+0000","last_became_active":"2024-09-12T17:05:55.570137+0000","last_became_peered":"2024-09-12T17:05:55.570137+0000","last_unstale":"2024-09-12T17:05:58.605228+0000","last_undegraded":"2024-09-12T17:05:58.605228+0000","last_fullsized":"2024-09-12T17:05:58.605228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.684868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587874+0000","last_change":"2024-09-12T17:05:57.597088+0000","last_active":"2024-09-12T17:05:58.587874+0000","last_peered":"2024-09-12T17:05:58.587874+0000","last_clean":"2024-09-12T17:05:58.587874+0000","last_became_active":"2024-09-12T17:05:57.596377+0000","last_became_peered":"2024-09-12T17:05:57.596377+0000","last_unstale":"2024-09-12T17:05:58.587874+0000","last_undegraded":"2024-09-12T17:05:58.587874+0000","last_fullsized":"2024-09-12T17:05:58.587874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596663+0000","last_change":"2024-09-12T17:05:49.555432+0000","last_active":"2024-09-12T17:05:58.596663+0000","last_peered":"2024-09-12T17:05:58.596663+0000","last_clean":"2024-09-12T17:05:58.596663+0000","last_became_active":"2024-09-12T17:05:49.554663+0000","last_became_peered":"2024-09-12T17:05:49.554663+0000","last_unstale":"2024-09-12T17:05:58.596663+0000","last_undegraded":"2024-09-12T17:05:58.596663+0000","last_fullsized":"2024-09-12T17:05:58.596663+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:09:32.612552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.593086+0000","last_change":"2024-09-12T17:05:47.526555+0000","last_active":"2024-09-12T17:05:58.593086+0000","last_peered":"2024-09-12T17:05:58.593086+0000","last_clean":"2024-09-12T17:05:58.593086+0000","last_became_active":"2024-09-12T17:05:47.525874+0000","last_became_peered":"2024-09-12T17:05:47.525874+0000","last_unstale":"2024-09-12T17:05:58.593086+0000","last_undegraded":"2024-09-12T17:05:58.593086+0000","last_fullsized":"2024-09-12T17:05:58.593086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605372+0000","last_change":"2024-09-12T17:05:51.540509+0000","last_active":"2024-09-12T17:05:58.605372+0000","last_peered":"2024-09-12T17:05:58.605372+0000","last_clean":"2024-09-12T17:05:58.605372+0000","last_became_active":"2024-09-12T17:05:51.539607+0000","last_became_peered":"2024-09-12T17:05:51.539607+0000","last_unstale":"2024-09-12T17:05:58.605372+0000","last_undegraded":"2024-09-12T17:05:58.605372+0000","last_fullsized":"2024-09-12T17:05:58.605372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:02.652624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.167156+0000","last_change":"2024-09-12T17:05:53.549324+0000","last_active":"2024-09-12T17:05:59.167156+0000","last_peered":"2024-09-12T17:05:59.167156+0000","last_clean":"2024-09-12T17:05:59.167156+0000","last_became_active":"2024-09-12T17:05:53.548561+0000","last_became_peered":"2024-09-12T17:05:53.548561+0000","last_unstale":"2024-09-12T17:05:59.167156+0000","last_undegraded":"2024-09-12T17:05:59.167156+0000","last_fullsized":"2024-09-12T17:05:59.167156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:47.932776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590493+0000","last_change":"2024-09-12T17:05:55.561467+0000","last_active":"2024-09-12T17:05:58.590493+0000","last_peered":"2024-09-12T17:05:58.590493+0000","last_clean":"2024-09-12T17:05:58.590493+0000","last_became_active":"2024-09-12T17:05:55.560708+0000","last_became_peered":"2024-09-12T17:05:55.560708+0000","last_unstale":"2024-09-12T17:05:58.590493+0000","last_undegraded":"2024-09-12T17:05:58.590493+0000","last_fullsized":"2024-09-12T17:05:58.590493+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.607091+0000","last_change":"2024-09-12T17:05:49.547097+0000","last_active":"2024-09-12T17:05:58.607091+0000","last_peered":"2024-09-12T17:05:58.607091+0000","last_clean":"2024-09-12T17:05:58.607091+0000","last_became_active":"2024-09-12T17:05:49.546232+0000","last_became_peered":"2024-09-12T17:05:49.546232+0000","last_unstale":"2024-09-12T17:05:58.607091+0000","last_undegraded":"2024-09-12T17:05:58.607091+0000","last_fullsized":"2024-09-12T17:05:58.607091+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596935+0000","last_change":"2024-09-12T17:05:47.521779+0000","last_active":"2024-09-12T17:05:58.596935+0000","last_peered":"2024-09-12T17:05:58.596935+0000","last_clean":"2024-09-12T17:05:58.596935+0000","last_became_active":"2024-09-12T17:05:47.521097+0000","last_became_peered":"2024-09-12T17:05:47.521097+0000","last_unstale":"2024-09-12T17:05:58.596935+0000","last_undegraded":"2024-09-12T17:05:58.596935+0000","last_fullsized":"2024-09-12T17:05:58.596935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:37.072896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592322+0000","last_change":"2024-09-12T17:05:51.525803+0000","last_active":"2024-09-12T17:05:58.592322+0000","last_peered":"2024-09-12T17:05:58.592322+0000","last_clean":"2024-09-12T17:05:58.592322+0000","last_became_active":"2024-09-12T17:05:51.525457+0000","last_became_peered":"2024-09-12T17:05:51.525457+0000","last_unstale":"2024-09-12T17:05:58.592322+0000","last_undegraded":"2024-09-12T17:05:58.592322+0000","last_fullsized":"2024-09-12T17:05:58.592322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"36'12","reported_seq":44,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.519732+0000","last_change":"2024-09-12T17:05:53.549321+0000","last_active":"2024-09-12T17:05:59.519732+0000","last_peered":"2024-09-12T17:05:59.519732+0000","last_clean":"2024-09-12T17:05:59.519732+0000","last_became_active":"2024-09-12T17:05:53.548507+0000","last_became_peered":"2024-09-12T17:05:53.548507+0000","last_unstale":"2024-09-12T17:05:59.519732+0000","last_undegraded":"2024-09-12T17:05:59.519732+0000","last_fullsized":"2024-09-12T17:05:59.519732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:13.646706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588382+0000","last_change":"2024-09-12T17:05:55.563312+0000","last_active":"2024-09-12T17:05:58.588382+0000","last_peered":"2024-09-12T17:05:58.588382+0000","last_clean":"2024-09-12T17:05:58.588382+0000","last_became_active":"2024-09-12T17:05:55.562405+0000","last_became_peered":"2024-09-12T17:05:55.562405+0000","last_unstale":"2024-09-12T17:05:58.588382+0000","last_undegraded":"2024-09-12T17:05:58.588382+0000","last_fullsized":"2024-09-12T17:05:58.588382+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.597509+0000","last_change":"2024-09-12T17:05:58.121110+0000","last_active":"2024-09-12T17:05:58.597509+0000","last_peered":"2024-09-12T17:05:58.597509+0000","last_clean":"2024-09-12T17:05:58.597509+0000","last_became_active":"2024-09-12T17:05:58.120367+0000","last_became_peered":"2024-09-12T17:05:58.120367+0000","last_unstale":"2024-09-12T17:05:58.597509+0000","last_undegraded":"2024-09-12T17:05:58.597509+0000","last_fullsized":"2024-09-12T17:05:58.597509+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592595+0000","last_change":"2024-09-12T17:05:49.532377+0000","last_active":"2024-09-12T17:05:58.592595+0000","last_peered":"2024-09-12T17:05:58.592595+0000","last_clean":"2024-09-12T17:05:58.592595+0000","last_became_active":"2024-09-12T17:05:49.531975+0000","last_became_peered":"2024-09-12T17:05:49.531975+0000","last_unstale":"2024-09-12T17:05:58.592595+0000","last_undegraded":"2024-09-12T17:05:58.592595+0000","last_fullsized":"2024-09-12T17:05:58.592595+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.574173+0000","last_change":"2024-09-12T17:05:47.518059+0000","last_active":"2024-09-12T17:05:58.574173+0000","last_peered":"2024-09-12T17:05:58.574173+0000","last_clean":"2024-09-12T17:05:58.574173+0000","last_became_active":"2024-09-12T17:05:47.517646+0000","last_became_peered":"2024-09-12T17:05:47.517646+0000","last_unstale":"2024-09-12T17:05:58.574173+0000","last_undegraded":"2024-09-12T17:05:58.574173+0000","last_fullsized":"2024-09-12T17:05:58.574173+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:26.484090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606847+0000","last_change":"2024-09-12T17:05:51.546117+0000","last_active":"2024-09-12T17:05:58.606847+0000","last_peered":"2024-09-12T17:05:58.606847+0000","last_clean":"2024-09-12T17:05:58.606847+0000","last_became_active":"2024-09-12T17:05:51.545154+0000","last_became_peered":"2024-09-12T17:05:51.545154+0000","last_unstale":"2024-09-12T17:05:58.606847+0000","last_undegraded":"2024-09-12T17:05:58.606847+0000","last_fullsized":"2024-09-12T17:05:58.606847+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:49.670591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.299808+0000","last_change":"2024-09-12T17:05:53.558834+0000","last_active":"2024-09-12T17:05:59.299808+0000","last_peered":"2024-09-12T17:05:59.299808+0000","last_clean":"2024-09-12T17:05:59.299808+0000","last_became_active":"2024-09-12T17:05:53.558086+0000","last_became_peered":"2024-09-12T17:05:53.558086+0000","last_unstale":"2024-09-12T17:05:59.299808+0000","last_undegraded":"2024-09-12T17:05:59.299808+0000","last_fullsized":"2024-09-12T17:05:59.299808+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:43.690058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575806+0000","last_change":"2024-09-12T17:05:55.569495+0000","last_active":"2024-09-12T17:05:58.575806+0000","last_peered":"2024-09-12T17:05:58.575806+0000","last_clean":"2024-09-12T17:05:58.575806+0000","last_became_active":"2024-09-12T17:05:55.568867+0000","last_became_peered":"2024-09-12T17:05:55.568867+0000","last_unstale":"2024-09-12T17:05:58.575806+0000","last_undegraded":"2024-09-12T17:05:58.575806+0000","last_fullsized":"2024-09-12T17:05:58.575806+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:30:08.676852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605104+0000","last_change":"2024-09-12T17:05:57.597468+0000","last_active":"2024-09-12T17:05:58.605104+0000","last_peered":"2024-09-12T17:05:58.605104+0000","last_clean":"2024-09-12T17:05:58.605104+0000","last_became_active":"2024-09-12T17:05:57.596651+0000","last_became_peered":"2024-09-12T17:05:57.596651+0000","last_unstale":"2024-09-12T17:05:58.605104+0000","last_undegraded":"2024-09-12T17:05:58.605104+0000","last_fullsized":"2024-09-12T17:05:58.605104+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.466145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.599935+0000","last_change":"2024-09-12T17:05:49.542462+0000","last_active":"2024-09-12T17:05:58.599935+0000","last_peered":"2024-09-12T17:05:58.599935+0000","last_clean":"2024-09-12T17:05:58.599935+0000","last_became_active":"2024-09-12T17:05:49.542201+0000","last_became_peered":"2024-09-12T17:05:49.542201+0000","last_unstale":"2024-09-12T17:05:58.599935+0000","last_undegraded":"2024-09-12T17:05:58.599935+0000","last_fullsized":"2024-09-12T17:05:58.599935+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:42.832972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.581006+0000","last_change":"2024-09-12T17:05:47.529542+0000","last_active":"2024-09-12T17:05:58.581006+0000","last_peered":"2024-09-12T17:05:58.581006+0000","last_clean":"2024-09-12T17:05:58.581006+0000","last_became_active":"2024-09-12T17:05:47.528715+0000","last_became_peered":"2024-09-12T17:05:47.528715+0000","last_unstale":"2024-09-12T17:05:58.581006+0000","last_undegraded":"2024-09-12T17:05:58.581006+0000","last_fullsized":"2024-09-12T17:05:58.581006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:13:14.830888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582972+0000","last_change":"2024-09-12T17:05:51.539916+0000","last_active":"2024-09-12T17:05:58.582972+0000","last_peered":"2024-09-12T17:05:58.582972+0000","last_clean":"2024-09-12T17:05:58.582972+0000","last_became_active":"2024-09-12T17:05:51.539054+0000","last_became_peered":"2024-09-12T17:05:51.539054+0000","last_unstale":"2024-09-12T17:05:58.582972+0000","last_undegraded":"2024-09-12T17:05:58.582972+0000","last_fullsized":"2024-09-12T17:05:58.582972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:11.640578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"36'11","reported_seq":40,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.498617+0000","last_change":"2024-09-12T17:05:53.557081+0000","last_active":"2024-09-12T17:05:59.498617+0000","last_peered":"2024-09-12T17:05:59.498617+0000","last_clean":"2024-09-12T17:05:59.498617+0000","last_became_active":"2024-09-12T17:05:53.556357+0000","last_became_peered":"2024-09-12T17:05:53.556357+0000","last_unstale":"2024-09-12T17:05:59.498617+0000","last_undegraded":"2024-09-12T17:05:59.498617+0000","last_fullsized":"2024-09-12T17:05:59.498617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:10.984649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575506+0000","last_change":"2024-09-12T17:05:55.560294+0000","last_active":"2024-09-12T17:05:58.575506+0000","last_peered":"2024-09-12T17:05:58.575506+0000","last_clean":"2024-09-12T17:05:58.575506+0000","last_became_active":"2024-09-12T17:05:55.559572+0000","last_became_peered":"2024-09-12T17:05:55.559572+0000","last_unstale":"2024-09-12T17:05:58.575506+0000","last_undegraded":"2024-09-12T17:05:58.575506+0000","last_fullsized":"2024-09-12T17:05:58.575506+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:45:33.871552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587473+0000","last_change":"2024-09-12T17:05:57.596779+0000","last_active":"2024-09-12T17:05:58.587473+0000","last_peered":"2024-09-12T17:05:58.587473+0000","last_clean":"2024-09-12T17:05:58.587473+0000","last_became_active":"2024-09-12T17:05:57.596005+0000","last_became_peered":"2024-09-12T17:05:57.596005+0000","last_unstale":"2024-09-12T17:05:58.587473+0000","last_undegraded":"2024-09-12T17:05:58.587473+0000","last_fullsized":"2024-09-12T17:05:58.587473+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619315+0000","last_change":"2024-09-12T17:05:49.548667+0000","last_active":"2024-09-12T17:05:58.619315+0000","last_peered":"2024-09-12T17:05:58.619315+0000","last_clean":"2024-09-12T17:05:58.619315+0000","last_became_active":"2024-09-12T17:05:49.548296+0000","last_became_peered":"2024-09-12T17:05:49.548296+0000","last_unstale":"2024-09-12T17:05:58.619315+0000","last_undegraded":"2024-09-12T17:05:58.619315+0000","last_fullsized":"2024-09-12T17:05:58.619315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:27.280124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590763+0000","last_change":"2024-09-12T17:05:47.546051+0000","last_active":"2024-09-12T17:05:58.590763+0000","last_peered":"2024-09-12T17:05:58.590763+0000","last_clean":"2024-09-12T17:05:58.590763+0000","last_became_active":"2024-09-12T17:05:47.545466+0000","last_became_peered":"2024-09-12T17:05:47.545466+0000","last_unstale":"2024-09-12T17:05:58.590763+0000","last_undegraded":"2024-09-12T17:05:58.590763+0000","last_fullsized":"2024-09-12T17:05:58.590763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576064+0000","last_change":"2024-09-12T17:05:51.540697+0000","last_active":"2024-09-12T17:05:58.576064+0000","last_peered":"2024-09-12T17:05:58.576064+0000","last_clean":"2024-09-12T17:05:58.576064+0000","last_became_active":"2024-09-12T17:05:51.539717+0000","last_became_peered":"2024-09-12T17:05:51.539717+0000","last_unstale":"2024-09-12T17:05:58.576064+0000","last_undegraded":"2024-09-12T17:05:58.576064+0000","last_fullsized":"2024-09-12T17:05:58.576064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:52.381980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"36'10","reported_seq":36,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.480145+0000","last_change":"2024-09-12T17:05:53.561278+0000","last_active":"2024-09-12T17:05:59.480145+0000","last_peered":"2024-09-12T17:05:59.480145+0000","last_clean":"2024-09-12T17:05:59.480145+0000","last_became_active":"2024-09-12T17:05:53.559688+0000","last_became_peered":"2024-09-12T17:05:53.559688+0000","last_unstale":"2024-09-12T17:05:59.480145+0000","last_undegraded":"2024-09-12T17:05:59.480145+0000","last_fullsized":"2024-09-12T17:05:59.480145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:37.392549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"33'2","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.605895+0000","last_change":"2024-09-12T17:05:55.576227+0000","last_active":"2024-09-12T17:05:58.605895+0000","last_peered":"2024-09-12T17:05:58.605895+0000","last_clean":"2024-09-12T17:05:58.605895+0000","last_became_active":"2024-09-12T17:05:55.571966+0000","last_became_peered":"2024-09-12T17:05:55.571966+0000","last_unstale":"2024-09-12T17:05:58.605895+0000","last_undegraded":"2024-09-12T17:05:58.605895+0000","last_fullsized":"2024-09-12T17:05:58.605895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:24.680106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576020+0000","last_change":"2024-09-12T17:05:57.595153+0000","last_active":"2024-09-12T17:05:58.576020+0000","last_peered":"2024-09-12T17:05:58.576020+0000","last_clean":"2024-09-12T17:05:58.576020+0000","last_became_active":"2024-09-12T17:05:57.594396+0000","last_became_peered":"2024-09-12T17:05:57.594396+0000","last_unstale":"2024-09-12T17:05:58.576020+0000","last_undegraded":"2024-09-12T17:05:58.576020+0000","last_fullsized":"2024-09-12T17:05:58.576020+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:27.040243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577074+0000","last_change":"2024-09-12T17:05:49.543269+0000","last_active":"2024-09-12T17:05:58.577074+0000","last_peered":"2024-09-12T17:05:58.577074+0000","last_clean":"2024-09-12T17:05:58.577074+0000","last_became_active":"2024-09-12T17:05:49.542414+0000","last_became_peered":"2024-09-12T17:05:49.542414+0000","last_unstale":"2024-09-12T17:05:58.577074+0000","last_undegraded":"2024-09-12T17:05:58.577074+0000","last_fullsized":"2024-09-12T17:05:58.577074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:00.645399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588865+0000","last_change":"2024-09-12T17:05:47.553278+0000","last_active":"2024-09-12T17:05:58.588865+0000","last_peered":"2024-09-12T17:05:58.588865+0000","last_clean":"2024-09-12T17:05:58.588865+0000","last_became_active":"2024-09-12T17:05:47.552546+0000","last_became_peered":"2024-09-12T17:05:47.552546+0000","last_unstale":"2024-09-12T17:05:58.588865+0000","last_undegraded":"2024-09-12T17:05:58.588865+0000","last_fullsized":"2024-09-12T17:05:58.588865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:36.333145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.578370+0000","last_change":"2024-09-12T17:05:51.528322+0000","last_active":"2024-09-12T17:05:58.578370+0000","last_peered":"2024-09-12T17:05:58.578370+0000","last_clean":"2024-09-12T17:05:58.578370+0000","last_became_active":"2024-09-12T17:05:51.527501+0000","last_became_peered":"2024-09-12T17:05:51.527501+0000","last_unstale":"2024-09-12T17:05:58.578370+0000","last_undegraded":"2024-09-12T17:05:58.578370+0000","last_fullsized":"2024-09-12T17:05:58.578370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"36'15","reported_seq":46,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.514870+0000","last_change":"2024-09-12T17:05:53.555787+0000","last_active":"2024-09-12T17:05:59.514870+0000","last_peered":"2024-09-12T17:05:59.514870+0000","last_clean":"2024-09-12T17:05:59.514870+0000","last_became_active":"2024-09-12T17:05:53.554972+0000","last_became_peered":"2024-09-12T17:05:53.554972+0000","last_unstale":"2024-09-12T17:05:59.514870+0000","last_undegraded":"2024-09-12T17:05:59.514870+0000","last_fullsized":"2024-09-12T17:05:59.514870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589327+0000","last_change":"2024-09-12T17:05:55.567202+0000","last_active":"2024-09-12T17:05:58.589327+0000","last_peered":"2024-09-12T17:05:58.589327+0000","last_clean":"2024-09-12T17:05:58.589327+0000","last_became_active":"2024-09-12T17:05:55.564710+0000","last_became_peered":"2024-09-12T17:05:55.564710+0000","last_unstale":"2024-09-12T17:05:58.589327+0000","last_undegraded":"2024-09-12T17:05:58.589327+0000","last_fullsized":"2024-09-12T17:05:58.589327+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580807+0000","last_change":"2024-09-12T17:05:57.604052+0000","last_active":"2024-09-12T17:05:58.580807+0000","last_peered":"2024-09-12T17:05:58.580807+0000","last_clean":"2024-09-12T17:05:58.580807+0000","last_became_active":"2024-09-12T17:05:57.603285+0000","last_became_peered":"2024-09-12T17:05:57.603285+0000","last_unstale":"2024-09-12T17:05:58.580807+0000","last_undegraded":"2024-09-12T17:05:58.580807+0000","last_fullsized":"2024-09-12T17:05:58.580807+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:31.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580426+0000","last_change":"2024-09-12T17:05:49.548224+0000","last_active":"2024-09-12T17:05:58.580426+0000","last_peered":"2024-09-12T17:05:58.580426+0000","last_clean":"2024-09-12T17:05:58.580426+0000","last_became_active":"2024-09-12T17:05:49.541007+0000","last_became_peered":"2024-09-12T17:05:49.541007+0000","last_unstale":"2024-09-12T17:05:58.580426+0000","last_undegraded":"2024-09-12T17:05:58.580426+0000","last_fullsized":"2024-09-12T17:05:58.580426+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:59.768842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589556+0000","last_change":"2024-09-12T17:05:47.543197+0000","last_active":"2024-09-12T17:05:58.589556+0000","last_peered":"2024-09-12T17:05:58.589556+0000","last_clean":"2024-09-12T17:05:58.589556+0000","last_became_active":"2024-09-12T17:05:47.542345+0000","last_became_peered":"2024-09-12T17:05:47.542345+0000","last_unstale":"2024-09-12T17:05:58.589556+0000","last_undegraded":"2024-09-12T17:05:58.589556+0000","last_fullsized":"2024-09-12T17:05:58.589556+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.858635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587769+0000","last_change":"2024-09-12T17:05:51.556256+0000","last_active":"2024-09-12T17:05:58.587769+0000","last_peered":"2024-09-12T17:05:58.587769+0000","last_clean":"2024-09-12T17:05:58.587769+0000","last_became_active":"2024-09-12T17:05:51.554248+0000","last_became_peered":"2024-09-12T17:05:51.554248+0000","last_unstale":"2024-09-12T17:05:58.587769+0000","last_undegraded":"2024-09-12T17:05:58.587769+0000","last_fullsized":"2024-09-12T17:05:58.587769+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.874638+0000","last_change":"2024-09-12T17:05:53.543908+0000","last_active":"2024-09-12T17:05:58.874638+0000","last_peered":"2024-09-12T17:05:58.874638+0000","last_clean":"2024-09-12T17:05:58.874638+0000","last_became_active":"2024-09-12T17:05:53.543248+0000","last_became_peered":"2024-09-12T17:05:53.543248+0000","last_unstale":"2024-09-12T17:05:58.874638+0000","last_undegraded":"2024-09-12T17:05:58.874638+0000","last_fullsized":"2024-09-12T17:05:58.874638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:58.909981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.604863+0000","last_change":"2024-09-12T17:05:55.567605+0000","last_active":"2024-09-12T17:05:58.604863+0000","last_peered":"2024-09-12T17:05:58.604863+0000","last_clean":"2024-09-12T17:05:58.604863+0000","last_became_active":"2024-09-12T17:05:55.566774+0000","last_became_peered":"2024-09-12T17:05:55.566774+0000","last_unstale":"2024-09-12T17:05:58.604863+0000","last_undegraded":"2024-09-12T17:05:58.604863+0000","last_fullsized":"2024-09-12T17:05:58.604863+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:25.935376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600374+0000","last_change":"2024-09-12T17:05:58.121216+0000","last_active":"2024-09-12T17:05:58.600374+0000","last_peered":"2024-09-12T17:05:58.600374+0000","last_clean":"2024-09-12T17:05:58.600374+0000","last_became_active":"2024-09-12T17:05:58.120364+0000","last_became_peered":"2024-09-12T17:05:58.120364+0000","last_unstale":"2024-09-12T17:05:58.600374+0000","last_undegraded":"2024-09-12T17:05:58.600374+0000","last_fullsized":"2024-09-12T17:05:58.600374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.597085+0000","last_change":"2024-09-12T17:05:49.549956+0000","last_active":"2024-09-12T17:05:58.597085+0000","last_peered":"2024-09-12T17:05:58.597085+0000","last_clean":"2024-09-12T17:05:58.597085+0000","last_became_active":"2024-09-12T17:05:49.549481+0000","last_became_peered":"2024-09-12T17:05:49.549481+0000","last_unstale":"2024-09-12T17:05:58.597085+0000","last_undegraded":"2024-09-12T17:05:58.597085+0000","last_fullsized":"2024-09-12T17:05:58.597085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600945+0000","last_change":"2024-09-12T17:05:47.510898+0000","last_active":"2024-09-12T17:05:58.600945+0000","last_peered":"2024-09-12T17:05:58.600945+0000","last_clean":"2024-09-12T17:05:58.600945+0000","last_became_active":"2024-09-12T17:05:47.510462+0000","last_became_peered":"2024-09-12T17:05:47.510462+0000","last_unstale":"2024-09-12T17:05:58.600945+0000","last_undegraded":"2024-09-12T17:05:58.600945+0000","last_fullsized":"2024-09-12T17:05:58.600945+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576572+0000","last_change":"2024-09-12T17:05:51.541454+0000","last_active":"2024-09-12T17:05:58.576572+0000","last_peered":"2024-09-12T17:05:58.576572+0000","last_clean":"2024-09-12T17:05:58.576572+0000","last_became_active":"2024-09-12T17:05:51.539938+0000","last_became_peered":"2024-09-12T17:05:51.539938+0000","last_unstale":"2024-09-12T17:05:58.576572+0000","last_undegraded":"2024-09-12T17:05:58.576572+0000","last_fullsized":"2024-09-12T17:05:58.576572+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:18.328350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"36'5","reported_seq":31,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.115706+0000","last_change":"2024-09-12T17:05:53.555764+0000","last_active":"2024-09-12T17:05:59.115706+0000","last_peered":"2024-09-12T17:05:59.115706+0000","last_clean":"2024-09-12T17:05:59.115706+0000","last_became_active":"2024-09-12T17:05:53.552095+0000","last_became_peered":"2024-09-12T17:05:53.552095+0000","last_unstale":"2024-09-12T17:05:59.115706+0000","last_undegraded":"2024-09-12T17:05:59.115706+0000","last_fullsized":"2024-09-12T17:05:59.115706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577461+0000","last_change":"2024-09-12T17:05:55.571520+0000","last_active":"2024-09-12T17:05:58.577461+0000","last_peered":"2024-09-12T17:05:58.577461+0000","last_clean":"2024-09-12T17:05:58.577461+0000","last_became_active":"2024-09-12T17:05:55.570863+0000","last_became_peered":"2024-09-12T17:05:55.570863+0000","last_unstale":"2024-09-12T17:05:58.577461+0000","last_undegraded":"2024-09-12T17:05:58.577461+0000","last_fullsized":"2024-09-12T17:05:58.577461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582223+0000","last_change":"2024-09-12T17:05:57.602260+0000","last_active":"2024-09-12T17:05:58.582223+0000","last_peered":"2024-09-12T17:05:58.582223+0000","last_clean":"2024-09-12T17:05:58.582223+0000","last_became_active":"2024-09-12T17:05:57.601129+0000","last_became_peered":"2024-09-12T17:05:57.601129+0000","last_unstale":"2024-09-12T17:05:58.582223+0000","last_undegraded":"2024-09-12T17:05:58.582223+0000","last_fullsized":"2024-09-12T17:05:58.582223+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:30.928685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.577225+0000","last_change":"2024-09-12T17:05:49.561555+0000","last_active":"2024-09-12T17:05:58.577225+0000","last_peered":"2024-09-12T17:05:58.577225+0000","last_clean":"2024-09-12T17:05:58.577225+0000","last_became_active":"2024-09-12T17:05:49.560875+0000","last_became_peered":"2024-09-12T17:05:49.560875+0000","last_unstale":"2024-09-12T17:05:58.577225+0000","last_undegraded":"2024-09-12T17:05:58.577225+0000","last_fullsized":"2024-09-12T17:05:58.577225+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.493944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.593065+0000","last_change":"2024-09-12T17:05:47.528128+0000","last_active":"2024-09-12T17:05:58.593065+0000","last_peered":"2024-09-12T17:05:58.593065+0000","last_clean":"2024-09-12T17:05:58.593065+0000","last_became_active":"2024-09-12T17:05:47.527364+0000","last_became_peered":"2024-09-12T17:05:47.527364+0000","last_unstale":"2024-09-12T17:05:58.593065+0000","last_undegraded":"2024-09-12T17:05:58.593065+0000","last_fullsized":"2024-09-12T17:05:58.593065+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":26,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.573343+0000","last_change":"2024-09-12T17:05:51.538719+0000","last_active":"2024-09-12T17:05:58.573343+0000","last_peered":"2024-09-12T17:05:58.573343+0000","last_clean":"2024-09-12T17:05:58.573343+0000","last_became_active":"2024-09-12T17:05:51.537497+0000","last_became_peered":"2024-09-12T17:05:51.537497+0000","last_unstale":"2024-09-12T17:05:58.573343+0000","last_undegraded":"2024-09-12T17:05:58.573343+0000","last_fullsized":"2024-09-12T17:05:58.573343+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:47.024849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"36'9","reported_seq":37,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:59.188582+0000","last_change":"2024-09-12T17:05:53.548391+0000","last_active":"2024-09-12T17:05:59.188582+0000","last_peered":"2024-09-12T17:05:59.188582+0000","last_clean":"2024-09-12T17:05:59.188582+0000","last_became_active":"2024-09-12T17:05:53.547202+0000","last_became_peered":"2024-09-12T17:05:53.547202+0000","last_unstale":"2024-09-12T17:05:59.188582+0000","last_undegraded":"2024-09-12T17:05:59.188582+0000","last_fullsized":"2024-09-12T17:05:59.188582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:00.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590209+0000","last_change":"2024-09-12T17:05:55.566243+0000","last_active":"2024-09-12T17:05:58.590209+0000","last_peered":"2024-09-12T17:05:58.590209+0000","last_clean":"2024-09-12T17:05:58.590209+0000","last_became_active":"2024-09-12T17:05:55.565403+0000","last_became_peered":"2024-09-12T17:05:55.565403+0000","last_unstale":"2024-09-12T17:05:58.590209+0000","last_undegraded":"2024-09-12T17:05:58.590209+0000","last_fullsized":"2024-09-12T17:05:58.590209+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.583204+0000","last_change":"2024-09-12T17:05:57.589526+0000","last_active":"2024-09-12T17:05:58.583204+0000","last_peered":"2024-09-12T17:05:58.583204+0000","last_clean":"2024-09-12T17:05:58.583204+0000","last_became_active":"2024-09-12T17:05:57.588626+0000","last_became_peered":"2024-09-12T17:05:57.588626+0000","last_unstale":"2024-09-12T17:05:58.583204+0000","last_undegraded":"2024-09-12T17:05:58.583204+0000","last_fullsized":"2024-09-12T17:05:58.583204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.472663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576506+0000","last_change":"2024-09-12T17:05:49.546327+0000","last_active":"2024-09-12T17:05:58.576506+0000","last_peered":"2024-09-12T17:05:58.576506+0000","last_clean":"2024-09-12T17:05:58.576506+0000","last_became_active":"2024-09-12T17:05:49.545846+0000","last_became_peered":"2024-09-12T17:05:49.545846+0000","last_unstale":"2024-09-12T17:05:58.576506+0000","last_undegraded":"2024-09-12T17:05:58.576506+0000","last_fullsized":"2024-09-12T17:05:58.576506+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:30.497218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.604887+0000","last_change":"2024-09-12T17:05:47.532523+0000","last_active":"2024-09-12T17:05:58.604887+0000","last_peered":"2024-09-12T17:05:58.604887+0000","last_clean":"2024-09-12T17:05:58.604887+0000","last_became_active":"2024-09-12T17:05:47.531750+0000","last_became_peered":"2024-09-12T17:05:47.531750+0000","last_unstale":"2024-09-12T17:05:58.604887+0000","last_undegraded":"2024-09-12T17:05:58.604887+0000","last_fullsized":"2024-09-12T17:05:58.604887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:03.075435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576623+0000","last_change":"2024-09-12T17:05:49.543168+0000","last_active":"2024-09-12T17:05:58.576623+0000","last_peered":"2024-09-12T17:05:58.576623+0000","last_clean":"2024-09-12T17:05:58.576623+0000","last_became_active":"2024-09-12T17:05:49.541557+0000","last_became_peered":"2024-09-12T17:05:49.541557+0000","last_unstale":"2024-09-12T17:05:58.576623+0000","last_undegraded":"2024-09-12T17:05:58.576623+0000","last_fullsized":"2024-09-12T17:05:58.576623+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:15.303353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.618306+0000","last_change":"2024-09-12T17:05:47.526020+0000","last_active":"2024-09-12T17:05:58.618306+0000","last_peered":"2024-09-12T17:05:58.618306+0000","last_clean":"2024-09-12T17:05:58.618306+0000","last_became_active":"2024-09-12T17:05:47.525481+0000","last_became_peered":"2024-09-12T17:05:47.525481+0000","last_unstale":"2024-09-12T17:05:58.618306+0000","last_undegraded":"2024-09-12T17:05:58.618306+0000","last_fullsized":"2024-09-12T17:05:58.618306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:05.949135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589133+0000","last_change":"2024-09-12T17:05:49.546848+0000","last_active":"2024-09-12T17:05:58.589133+0000","last_peered":"2024-09-12T17:05:58.589133+0000","last_clean":"2024-09-12T17:05:58.589133+0000","last_became_active":"2024-09-12T17:05:49.545382+0000","last_became_peered":"2024-09-12T17:05:49.545382+0000","last_unstale":"2024-09-12T17:05:58.589133+0000","last_undegraded":"2024-09-12T17:05:58.589133+0000","last_fullsized":"2024-09-12T17:05:58.589133+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:42.832972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588498+0000","last_change":"2024-09-12T17:05:47.543411+0000","last_active":"2024-09-12T17:05:58.588498+0000","last_peered":"2024-09-12T17:05:58.588498+0000","last_clean":"2024-09-12T17:05:58.588498+0000","last_became_active":"2024-09-12T17:05:47.535268+0000","last_became_peered":"2024-09-12T17:05:47.535268+0000","last_unstale":"2024-09-12T17:05:58.588498+0000","last_undegraded":"2024-09-12T17:05:58.588498+0000","last_fullsized":"2024-09-12T17:05:58.588498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:26.531937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.575290+0000","last_change":"2024-09-12T17:05:49.534157+0000","last_active":"2024-09-12T17:05:58.575290+0000","last_peered":"2024-09-12T17:05:58.575290+0000","last_clean":"2024-09-12T17:05:58.575290+0000","last_became_active":"2024-09-12T17:05:49.533575+0000","last_became_peered":"2024-09-12T17:05:49.533575+0000","last_unstale":"2024-09-12T17:05:58.575290+0000","last_undegraded":"2024-09-12T17:05:58.575290+0000","last_fullsized":"2024-09-12T17:05:58.575290+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:46:39.976851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591395+0000","last_change":"2024-09-12T17:05:47.530275+0000","last_active":"2024-09-12T17:05:58.591395+0000","last_peered":"2024-09-12T17:05:58.591395+0000","last_clean":"2024-09-12T17:05:58.591395+0000","last_became_active":"2024-09-12T17:05:47.529857+0000","last_became_peered":"2024-09-12T17:05:47.529857+0000","last_unstale":"2024-09-12T17:05:58.591395+0000","last_undegraded":"2024-09-12T17:05:58.591395+0000","last_fullsized":"2024-09-12T17:05:58.591395+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:47.999516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.598592+0000","last_change":"2024-09-12T17:05:49.525070+0000","last_active":"2024-09-12T17:05:58.598592+0000","last_peered":"2024-09-12T17:05:58.598592+0000","last_clean":"2024-09-12T17:05:58.598592+0000","last_became_active":"2024-09-12T17:05:49.524567+0000","last_became_peered":"2024-09-12T17:05:49.524567+0000","last_unstale":"2024-09-12T17:05:58.598592+0000","last_undegraded":"2024-09-12T17:05:58.598592+0000","last_fullsized":"2024-09-12T17:05:58.598592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:34.320123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.600457+0000","last_change":"2024-09-12T17:05:47.547765+0000","last_active":"2024-09-12T17:05:58.600457+0000","last_peered":"2024-09-12T17:05:58.600457+0000","last_clean":"2024-09-12T17:05:58.600457+0000","last_became_active":"2024-09-12T17:05:47.547393+0000","last_became_peered":"2024-09-12T17:05:47.547393+0000","last_unstale":"2024-09-12T17:05:58.600457+0000","last_undegraded":"2024-09-12T17:05:58.600457+0000","last_fullsized":"2024-09-12T17:05:58.600457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:46.746261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580790+0000","last_change":"2024-09-12T17:05:49.561711+0000","last_active":"2024-09-12T17:05:58.580790+0000","last_peered":"2024-09-12T17:05:58.580790+0000","last_clean":"2024-09-12T17:05:58.580790+0000","last_became_active":"2024-09-12T17:05:49.560993+0000","last_became_peered":"2024-09-12T17:05:49.560993+0000","last_unstale":"2024-09-12T17:05:58.580790+0000","last_undegraded":"2024-09-12T17:05:58.580790+0000","last_fullsized":"2024-09-12T17:05:58.580790+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:38.400338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576491+0000","last_change":"2024-09-12T17:05:47.521696+0000","last_active":"2024-09-12T17:05:58.576491+0000","last_peered":"2024-09-12T17:05:58.576491+0000","last_clean":"2024-09-12T17:05:58.576491+0000","last_became_active":"2024-09-12T17:05:47.521333+0000","last_became_peered":"2024-09-12T17:05:47.521333+0000","last_unstale":"2024-09-12T17:05:58.576491+0000","last_undegraded":"2024-09-12T17:05:58.576491+0000","last_fullsized":"2024-09-12T17:05:58.576491+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:18:16.633903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596552+0000","last_change":"2024-09-12T17:05:49.543789+0000","last_active":"2024-09-12T17:05:58.596552+0000","last_peered":"2024-09-12T17:05:58.596552+0000","last_clean":"2024-09-12T17:05:58.596552+0000","last_became_active":"2024-09-12T17:05:49.543491+0000","last_became_peered":"2024-09-12T17:05:49.543491+0000","last_unstale":"2024-09-12T17:05:58.596552+0000","last_undegraded":"2024-09-12T17:05:58.596552+0000","last_fullsized":"2024-09-12T17:05:58.596552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.606755+0000","last_change":"2024-09-12T17:05:47.541213+0000","last_active":"2024-09-12T17:05:58.606755+0000","last_peered":"2024-09-12T17:05:58.606755+0000","last_clean":"2024-09-12T17:05:58.606755+0000","last_became_active":"2024-09-12T17:05:47.540469+0000","last_became_peered":"2024-09-12T17:05:47.540469+0000","last_unstale":"2024-09-12T17:05:58.606755+0000","last_undegraded":"2024-09-12T17:05:58.606755+0000","last_fullsized":"2024-09-12T17:05:58.606755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:26.620021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.604717+0000","last_change":"2024-09-12T17:05:49.541113+0000","last_active":"2024-09-12T17:05:58.604717+0000","last_peered":"2024-09-12T17:05:58.604717+0000","last_clean":"2024-09-12T17:05:58.604717+0000","last_became_active":"2024-09-12T17:05:49.540395+0000","last_became_peered":"2024-09-12T17:05:49.540395+0000","last_unstale":"2024-09-12T17:05:58.604717+0000","last_undegraded":"2024-09-12T17:05:58.604717+0000","last_fullsized":"2024-09-12T17:05:58.604717+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:32.506502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.601241+0000","last_change":"2024-09-12T17:05:47.539986+0000","last_active":"2024-09-12T17:05:58.601241+0000","last_peered":"2024-09-12T17:05:58.601241+0000","last_clean":"2024-09-12T17:05:58.601241+0000","last_became_active":"2024-09-12T17:05:47.539603+0000","last_became_peered":"2024-09-12T17:05:47.539603+0000","last_unstale":"2024-09-12T17:05:58.601241+0000","last_undegraded":"2024-09-12T17:05:58.601241+0000","last_fullsized":"2024-09-12T17:05:58.601241+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592738+0000","last_change":"2024-09-12T17:05:49.533938+0000","last_active":"2024-09-12T17:05:58.592738+0000","last_peered":"2024-09-12T17:05:58.592738+0000","last_clean":"2024-09-12T17:05:58.592738+0000","last_became_active":"2024-09-12T17:05:49.531769+0000","last_became_peered":"2024-09-12T17:05:49.531769+0000","last_unstale":"2024-09-12T17:05:58.592738+0000","last_undegraded":"2024-09-12T17:05:58.592738+0000","last_fullsized":"2024-09-12T17:05:58.592738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:33.763423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588153+0000","last_change":"2024-09-12T17:05:47.525739+0000","last_active":"2024-09-12T17:05:58.588153+0000","last_peered":"2024-09-12T17:05:58.588153+0000","last_clean":"2024-09-12T17:05:58.588153+0000","last_became_active":"2024-09-12T17:05:47.524922+0000","last_became_peered":"2024-09-12T17:05:47.524922+0000","last_unstale":"2024-09-12T17:05:58.588153+0000","last_undegraded":"2024-09-12T17:05:58.588153+0000","last_fullsized":"2024-09-12T17:05:58.588153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.580448+0000","last_change":"2024-09-12T17:05:49.555307+0000","last_active":"2024-09-12T17:05:58.580448+0000","last_peered":"2024-09-12T17:05:58.580448+0000","last_clean":"2024-09-12T17:05:58.580448+0000","last_became_active":"2024-09-12T17:05:49.554566+0000","last_became_peered":"2024-09-12T17:05:49.554566+0000","last_unstale":"2024-09-12T17:05:58.580448+0000","last_undegraded":"2024-09-12T17:05:58.580448+0000","last_fullsized":"2024-09-12T17:05:58.580448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:45.017623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.597179+0000","last_change":"2024-09-12T17:05:47.543468+0000","last_active":"2024-09-12T17:05:58.597179+0000","last_peered":"2024-09-12T17:05:58.597179+0000","last_clean":"2024-09-12T17:05:58.597179+0000","last_became_active":"2024-09-12T17:05:47.542753+0000","last_became_peered":"2024-09-12T17:05:47.542753+0000","last_unstale":"2024-09-12T17:05:58.597179+0000","last_undegraded":"2024-09-12T17:05:58.597179+0000","last_fullsized":"2024-09-12T17:05:58.597179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.619548+0000","last_change":"2024-09-12T17:05:49.536693+0000","last_active":"2024-09-12T17:05:58.619548+0000","last_peered":"2024-09-12T17:05:58.619548+0000","last_clean":"2024-09-12T17:05:58.619548+0000","last_became_active":"2024-09-12T17:05:49.536385+0000","last_became_peered":"2024-09-12T17:05:49.536385+0000","last_unstale":"2024-09-12T17:05:58.619548+0000","last_undegraded":"2024-09-12T17:05:58.619548+0000","last_fullsized":"2024-09-12T17:05:58.619548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.024498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.588348+0000","last_change":"2024-09-12T17:05:47.545251+0000","last_active":"2024-09-12T17:05:58.588348+0000","last_peered":"2024-09-12T17:05:58.588348+0000","last_clean":"2024-09-12T17:05:58.588348+0000","last_became_active":"2024-09-12T17:05:47.544406+0000","last_became_peered":"2024-09-12T17:05:47.544406+0000","last_unstale":"2024-09-12T17:05:58.588348+0000","last_undegraded":"2024-09-12T17:05:58.588348+0000","last_fullsized":"2024-09-12T17:05:58.588348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:52.167194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.582723+0000","last_change":"2024-09-12T17:05:49.564446+0000","last_active":"2024-09-12T17:05:58.582723+0000","last_peered":"2024-09-12T17:05:58.582723+0000","last_clean":"2024-09-12T17:05:58.582723+0000","last_became_active":"2024-09-12T17:05:49.563625+0000","last_became_peered":"2024-09-12T17:05:49.563625+0000","last_unstale":"2024-09-12T17:05:58.582723+0000","last_undegraded":"2024-09-12T17:05:58.582723+0000","last_fullsized":"2024-09-12T17:05:58.582723+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.324265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.591643+0000","last_change":"2024-09-12T17:05:47.558422+0000","last_active":"2024-09-12T17:05:58.591643+0000","last_peered":"2024-09-12T17:05:58.591643+0000","last_clean":"2024-09-12T17:05:58.591643+0000","last_became_active":"2024-09-12T17:05:47.558047+0000","last_became_peered":"2024-09-12T17:05:47.558047+0000","last_unstale":"2024-09-12T17:05:58.591643+0000","last_undegraded":"2024-09-12T17:05:58.591643+0000","last_fullsized":"2024-09-12T17:05:58.591643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:25.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.579174+0000","last_change":"2024-09-12T17:05:49.522750+0000","last_active":"2024-09-12T17:05:58.579174+0000","last_peered":"2024-09-12T17:05:58.579174+0000","last_clean":"2024-09-12T17:05:58.579174+0000","last_became_active":"2024-09-12T17:05:49.522097+0000","last_became_peered":"2024-09-12T17:05:49.522097+0000","last_unstale":"2024-09-12T17:05:58.579174+0000","last_undegraded":"2024-09-12T17:05:58.579174+0000","last_fullsized":"2024-09-12T17:05:58.579174+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.607154+0000","last_change":"2024-09-12T17:05:47.552865+0000","last_active":"2024-09-12T17:05:58.607154+0000","last_peered":"2024-09-12T17:05:58.607154+0000","last_clean":"2024-09-12T17:05:58.607154+0000","last_became_active":"2024-09-12T17:05:47.552207+0000","last_became_peered":"2024-09-12T17:05:47.552207+0000","last_unstale":"2024-09-12T17:05:58.607154+0000","last_undegraded":"2024-09-12T17:05:58.607154+0000","last_fullsized":"2024-09-12T17:05:58.607154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:00.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589972+0000","last_change":"2024-09-12T17:05:49.544019+0000","last_active":"2024-09-12T17:05:58.589972+0000","last_peered":"2024-09-12T17:05:58.589972+0000","last_clean":"2024-09-12T17:05:58.589972+0000","last_became_active":"2024-09-12T17:05:49.543623+0000","last_became_peered":"2024-09-12T17:05:49.543623+0000","last_unstale":"2024-09-12T17:05:58.589972+0000","last_undegraded":"2024-09-12T17:05:58.589972+0000","last_fullsized":"2024-09-12T17:05:58.589972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:04:26.353496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.583210+0000","last_change":"2024-09-12T17:05:47.561338+0000","last_active":"2024-09-12T17:05:58.583210+0000","last_peered":"2024-09-12T17:05:58.583210+0000","last_clean":"2024-09-12T17:05:58.583210+0000","last_became_active":"2024-09-12T17:05:47.560439+0000","last_became_peered":"2024-09-12T17:05:47.560439+0000","last_unstale":"2024-09-12T17:05:58.583210+0000","last_undegraded":"2024-09-12T17:05:58.583210+0000","last_fullsized":"2024-09-12T17:05:58.583210+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:58.530869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.596304+0000","last_change":"2024-09-12T17:05:49.526384+0000","last_active":"2024-09-12T17:05:58.596304+0000","last_peered":"2024-09-12T17:05:58.596304+0000","last_clean":"2024-09-12T17:05:58.596304+0000","last_became_active":"2024-09-12T17:05:49.526023+0000","last_became_peered":"2024-09-12T17:05:49.526023+0000","last_unstale":"2024-09-12T17:05:58.596304+0000","last_undegraded":"2024-09-12T17:05:58.596304+0000","last_fullsized":"2024-09-12T17:05:58.596304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:34.498841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.620178+0000","last_change":"2024-09-12T17:05:47.512066+0000","last_active":"2024-09-12T17:05:58.620178+0000","last_peered":"2024-09-12T17:05:58.620178+0000","last_clean":"2024-09-12T17:05:58.620178+0000","last_became_active":"2024-09-12T17:05:47.511470+0000","last_became_peered":"2024-09-12T17:05:47.511470+0000","last_unstale":"2024-09-12T17:05:58.620178+0000","last_undegraded":"2024-09-12T17:05:58.620178+0000","last_fullsized":"2024-09-12T17:05:58.620178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:38.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.576480+0000","last_change":"2024-09-12T17:05:49.523060+0000","last_active":"2024-09-12T17:05:58.576480+0000","last_peered":"2024-09-12T17:05:58.576480+0000","last_clean":"2024-09-12T17:05:58.576480+0000","last_became_active":"2024-09-12T17:05:49.522157+0000","last_became_peered":"2024-09-12T17:05:49.522157+0000","last_unstale":"2024-09-12T17:05:58.576480+0000","last_undegraded":"2024-09-12T17:05:58.576480+0000","last_fullsized":"2024-09-12T17:05:58.576480+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.590460+0000","last_change":"2024-09-12T17:05:47.538305+0000","last_active":"2024-09-12T17:05:58.590460+0000","last_peered":"2024-09-12T17:05:58.590460+0000","last_clean":"2024-09-12T17:05:58.590460+0000","last_became_active":"2024-09-12T17:05:47.535569+0000","last_became_peered":"2024-09-12T17:05:47.535569+0000","last_unstale":"2024-09-12T17:05:58.590460+0000","last_undegraded":"2024-09-12T17:05:58.590460+0000","last_fullsized":"2024-09-12T17:05:58.590460+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:24.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.587897+0000","last_change":"2024-09-12T17:05:47.537712+0000","last_active":"2024-09-12T17:05:58.587897+0000","last_peered":"2024-09-12T17:05:58.587897+0000","last_clean":"2024-09-12T17:05:58.587897+0000","last_became_active":"2024-09-12T17:05:47.536958+0000","last_became_peered":"2024-09-12T17:05:47.536958+0000","last_unstale":"2024-09-12T17:05:58.587897+0000","last_undegraded":"2024-09-12T17:05:58.587897+0000","last_fullsized":"2024-09-12T17:05:58.587897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.592319+0000","last_change":"2024-09-12T17:05:49.544841+0000","last_active":"2024-09-12T17:05:58.592319+0000","last_peered":"2024-09-12T17:05:58.592319+0000","last_clean":"2024-09-12T17:05:58.592319+0000","last_became_active":"2024-09-12T17:05:49.538757+0000","last_became_peered":"2024-09-12T17:05:49.538757+0000","last_unstale":"2024-09-12T17:05:58.592319+0000","last_undegraded":"2024-09-12T17:05:58.592319+0000","last_fullsized":"2024-09-12T17:05:58.592319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.976348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.574014+0000","last_change":"2024-09-12T17:05:47.543930+0000","last_active":"2024-09-12T17:05:58.574014+0000","last_peered":"2024-09-12T17:05:58.574014+0000","last_clean":"2024-09-12T17:05:58.574014+0000","last_became_active":"2024-09-12T17:05:47.542875+0000","last_became_peered":"2024-09-12T17:05:47.542875+0000","last_unstale":"2024-09-12T17:05:58.574014+0000","last_undegraded":"2024-09-12T17:05:58.574014+0000","last_fullsized":"2024-09-12T17:05:58.574014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:00:28.114730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-12T17:05:58.589496+0000","last_change":"2024-09-12T17:05:49.552327+0000","last_active":"2024-09-12T17:05:58.589496+0000","last_peered":"2024-09-12T17:05:58.589496+0000","last_clean":"2024-09-12T17:05:58.589496+0000","last_became_active":"2024-09-12T17:05:49.551604+0000","last_became_peered":"2024-09-12T17:05:49.551604+0000","last_unstale":"2024-09-12T17:05:58.589496+0000","last_undegraded":"2024-09-12T17:05:58.589496+0000","last_fullsized":"2024-09-12T17:05:58.589496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:55.648527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36368,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335472,"statfs":{"total":96636764160,"available":96599523328,"internally_reserved":0,"allocated":1044480,"data_stored":768728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35760,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336080,"statfs":{"total":96636764160,"available":96600145920,"internally_reserved":0,"allocated":425984,"data_stored":177700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35816,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336024,"statfs":{"total":96636764160,"available":96600088576,"internally_reserved":0,"allocated":479232,"data_stored":178983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542154,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35752,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336088,"statfs":{"total":96636764160,"available":96600154112,"internally_reserved":0,"allocated":413696,"data_stored":177198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31624,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340216,"statfs":{"total":96636764160,"available":96604381184,"internally_reserved":0,"allocated":446464,"data_stored":178532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31600,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340240,"statfs":{"total":96636764160,"available":96604405760,"internally_reserved":0,"allocated":417792,"data_stored":178255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35784,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336056,"statfs":{"total":96636764160,"available":96600121344,"internally_reserved":0,"allocated":446464,"data_stored":177969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1028096,"data_stored":769127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:06:05.955 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:06:05.956 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T17:06:06.305 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 36 2024-09-12T17:06:06.305 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 505f0ddb-af61-4cad-802f-747b5bdb41a8 2024-09-12T17:06:06.305 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-09-12T17:05:20.776084+0000 2024-09-12T17:06:06.305 INFO:teuthology.orchestra.run.smithi017.stdout:modified 2024-09-12T17:05:58.560987+0000 2024-09-12T17:06:06.305 INFO:teuthology.orchestra.run.smithi017.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T17:06:06.305 INFO:teuthology.orchestra.run.smithi017.stdout:crush_version 5 2024-09-12T17:06:06.305 INFO:teuthology.orchestra.run.smithi017.stdout:full_ratio 0.95 2024-09-12T17:06:06.305 INFO:teuthology.orchestra.run.smithi017.stdout:backfillfull_ratio 0.9 2024-09-12T17:06:06.305 INFO:teuthology.orchestra.run.smithi017.stdout:nearfull_ratio 0.85 2024-09-12T17:06:06.305 INFO:teuthology.orchestra.run.smithi017.stdout:require_min_compat_client luminous 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:min_compat_client jewel 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:require_osd_release squid 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:stretch_mode_enabled false 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 22 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 28 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 30 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 32 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 34 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 36 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:max_osd 8 2024-09-12T17:06:06.306 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6816/2182669987,v1:172.21.15.17:6817/2182669987] [v2:172.21.15.17:6818/2182669987,v1:172.21.15.17:6819/2182669987] exists,up cf0f0496-2732-4649-9792-6f2117afe076 2024-09-12T17:06:06.307 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6824/3677250778,v1:172.21.15.17:6825/3677250778] [v2:172.21.15.17:6826/3677250778,v1:172.21.15.17:6827/3677250778] exists,up 931ecda0-1894-411b-a2f8-843472ad493c 2024-09-12T17:06:06.307 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6800/2449755532,v1:172.21.15.17:6801/2449755532] [v2:172.21.15.17:6802/2449755532,v1:172.21.15.17:6803/2449755532] exists,up e1cc4a34-80dd-42e2-afb1-babce54de8cd 2024-09-12T17:06:06.307 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6808/1410973648,v1:172.21.15.17:6809/1410973648] [v2:172.21.15.17:6810/1410973648,v1:172.21.15.17:6811/1410973648] exists,up 48424313-1b8e-41ba-b322-d37b813552da 2024-09-12T17:06:06.307 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6824/3279960414,v1:172.21.15.47:6825/3279960414] [v2:172.21.15.47:6826/3279960414,v1:172.21.15.47:6827/3279960414] exists,up ba035b82-db0e-4e9a-a45e-fd111aebaea2 2024-09-12T17:06:06.307 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6800/2093714552,v1:172.21.15.47:6801/2093714552] [v2:172.21.15.47:6802/2093714552,v1:172.21.15.47:6803/2093714552] exists,up 3bad8071-4d77-4ec3-a85f-9648cb1d9c7e 2024-09-12T17:06:06.307 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6816/2759913072,v1:172.21.15.47:6817/2759913072] [v2:172.21.15.47:6818/2759913072,v1:172.21.15.47:6819/2759913072] exists,up cef01590-aa71-4356-bd81-0629172de3b6 2024-09-12T17:06:06.307 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6808/1836347584,v1:172.21.15.47:6809/1836347584] [v2:172.21.15.47:6810/1836347584,v1:172.21.15.47:6811/1836347584] exists,up 39b07acd-56a6-47ad-86ec-cb330c7647b7 2024-09-12T17:06:06.324 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6816/2182669987,v1:172.21.15.17:6817/2182669987] [v2:172.21.15.17:6818/2182669987,v1:172.21.15.17:6819/2182669987] exists,up cf0f0496-2732-4649-9792-6f2117afe076', 'osd.1 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6824/3677250778,v1:172.21.15.17:6825/3677250778] [v2:172.21.15.17:6826/3677250778,v1:172.21.15.17:6827/3677250778] exists,up 931ecda0-1894-411b-a2f8-843472ad493c', 'osd.2 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6800/2449755532,v1:172.21.15.17:6801/2449755532] [v2:172.21.15.17:6802/2449755532,v1:172.21.15.17:6803/2449755532] exists,up e1cc4a34-80dd-42e2-afb1-babce54de8cd', 'osd.3 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.17:6808/1410973648,v1:172.21.15.17:6809/1410973648] [v2:172.21.15.17:6810/1410973648,v1:172.21.15.17:6811/1410973648] exists,up 48424313-1b8e-41ba-b322-d37b813552da', 'osd.4 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6824/3279960414,v1:172.21.15.47:6825/3279960414] [v2:172.21.15.47:6826/3279960414,v1:172.21.15.47:6827/3279960414] exists,up ba035b82-db0e-4e9a-a45e-fd111aebaea2', 'osd.5 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6800/2093714552,v1:172.21.15.47:6801/2093714552] [v2:172.21.15.47:6802/2093714552,v1:172.21.15.47:6803/2093714552] exists,up 3bad8071-4d77-4ec3-a85f-9648cb1d9c7e', 'osd.6 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6816/2759913072,v1:172.21.15.47:6817/2759913072] [v2:172.21.15.47:6818/2759913072,v1:172.21.15.47:6819/2759913072] exists,up cef01590-aa71-4356-bd81-0629172de3b6', 'osd.7 up in weight 1 up_from 14 up_thru 34 down_at 0 last_clean_interval [0,0) [v2:172.21.15.47:6808/1836347584,v1:172.21.15.47:6809/1836347584] [v2:172.21.15.47:6810/1836347584,v1:172.21.15.47:6811/1836347584] exists,up 39b07acd-56a6-47ad-86ec-cb330c7647b7'] 2024-09-12T17:06:06.325 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T17:06:06.448 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:06.448 INFO:teuthology.orchestra.run.smithi017.stdout: "name": "mon.a", 2024-09-12T17:06:06.448 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster": "ceph", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "admin_socket_mode": "", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_client_required": "cephx, none", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_cluster_required": "cephx", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_debug": "true", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_service_required": "cephx", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_supported": "cephx", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio": "true", 2024-09-12T17:06:06.449 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_aio_reap_max": "16", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_async_discard_threads": "0", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_block_size": "4096", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_aio": "false", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_enable_discard": "false", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_flock_retry": "3", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_inject_crash": "0", 2024-09-12T17:06:06.450 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_ioring": "false", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_ioring_hipri": "false", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bdev_type": "", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_allocator": "hybrid", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_buffered_io": "true", 2024-09-12T17:06:06.451 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_replay_recovery": "false", 2024-09-12T17:06:06.452 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluefs_sync_write": "false", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_allocator": "hybrid", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_async_db_compaction": "true", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T17:06:06.453 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T17:06:06.454 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T17:06:06.454 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T17:06:06.454 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T17:06:06.454 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T17:06:06.454 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T17:06:06.454 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_create": "true", 2024-09-12T17:06:06.454 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_db_create": "false", 2024-09-12T17:06:06.454 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_db_path": "", 2024-09-12T17:06:06.454 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_db_size": "0", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_path": "", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_size": "107374182400", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_wal_create": "false", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_wal_path": "", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs": "true", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T17:06:06.455 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_autotune": "true", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_size": "0", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T17:06:06.456 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cache_type": "2q", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_clone_cow": "true", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_mode": "none", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T17:06:06.457 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_freelist": "false", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T17:06:06.458 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T17:06:06.459 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fail_eio": "false", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T17:06:06.460 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T17:06:06.461 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_blob_size": "0", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T17:06:06.462 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_spdk_mem": "512", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T17:06:06.463 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_tracing": "false", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T17:06:06.464 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_write_v2": "false", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_write_v2_random": "false", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T17:06:06.465 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_cluster_require_version": "2", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_require_signatures": "false", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_require_version": "2", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_service_require_signatures": "false", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_service_require_version": "2", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "cephx_sign_messages": "true", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "chdir": "", 2024-09-12T17:06:06.466 INFO:teuthology.orchestra.run.smithi017.stdout: "client_acl_type": "", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_asio_thread_count": "2", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_cache_mid": "0.750000", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_cache_size": "16384", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_caps_release_delay": "5", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_check_pool_perm": "true", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_force_sync_read": "false", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_getattr_caps": "false", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_inject_features": "", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_die_on_failed_remount": "false", 2024-09-12T17:06:06.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_dirsize_rbytes": "true", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_force_lazyio": "false", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_fs": "", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_inject_release_failure": "false", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_max_inline_size": "4096", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mds_namespace": "", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_metadata": "", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mount_gid": "-1", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mount_timeout": "300", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mount_uid": "-1", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_mountpoint": "/", 2024-09-12T17:06:06.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_notify_timeout": "10", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc": "true", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_max_objects": "1000", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_size": "209715200", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_permissions": "true", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_quota": "true", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_quota_df": "true", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_readahead_max_bytes": "0", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_readahead_max_periods": "4", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_readahead_min": "131072", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_reconnect_stale": "false", 2024-09-12T17:06:06.469 INFO:teuthology.orchestra.run.smithi017.stdout: "client_shutdown_timeout": "30", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_snapdir": ".snap", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_tick_interval": "1", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_trace": "", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_use_faked_inos": "false", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_use_random_mds": "false", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_graylog": "false", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_graylog_port": "12201", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_monitors": "default=true", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_syslog": "false", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T17:06:06.470 INFO:teuthology.orchestra.run.smithi017.stdout: "clog_to_syslog_level": "info", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_addr": "-", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_network": "", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_network_interface": "", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zlib_isal": "false", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zlib_level": "5", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "compressor_zstd_level": "1", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T17:06:06.471 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_location": "", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_location_hook": "", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "crush_location_hook_timeout": "10", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "daemonize": "false", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "daos_pool": "tank", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_alienstore": "0/5", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T17:06:06.472 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_asok": "1/5", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_asok_assert_abort": "false", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_auth": "20/20", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_bdev": "1/3", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_bluefs": "1/5", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_bluestore": "1/5", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_buffer": "0/1", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_ceph_dedup": "0/5", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_cephsqlite": "0/5", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_client": "0/5", 2024-09-12T17:06:06.473 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_compressor": "1/5", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_context": "0/1", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_crush": "1/1", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_crypto": "1/5", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_cyanstore": "0/5", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_dpdk": "1/5", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_eventtrace": "1/5", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_filer": "0/1", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_filestore": "1/3", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_finisher": "1/1", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_fuse": "1/5", 2024-09-12T17:06:06.474 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_javaclient": "1/5", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_journal": "1/3", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_journaler": "0/5", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_kstore": "1/5", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_lockdep": "0/1", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mclock": "1/5", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds": "1/5", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_balancer": "1/5", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_locker": "1/5", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_log": "1/5", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T17:06:06.475 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_migrator": "1/5", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_memstore": "1/5", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mgr": "2/5", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mgrc": "1/5", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_mon": "20/20", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_monc": "0/10", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_ms": "1/1", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_none": "0/5", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_objclass": "0/5", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_objectcacher": "0/5", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_objecter": "0/1", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_optracker": "0/5", 2024-09-12T17:06:06.476 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_osd": "1/5", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_paxos": "20/20", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_perfcounter": "1/5", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_prioritycache": "1/5", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rados": "0/5", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd": "0/5", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rbd_replay": "0/5", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_refs": "0/0", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_reserver": "1/1", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw": "1/5", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_access": "1/5", 2024-09-12T17:06:06.477 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_flight": "1/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_notification": "1/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rgw_sync": "1/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_rocksdb": "4/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore": "0/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_backref": "0/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_cache": "0/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_device": "0/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_epm": "0/5", 2024-09-12T17:06:06.478 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_journal": "0/5", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_lba": "0/5", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_odata": "0/5", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_omap": "0/5", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_onode": "0/5", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_t": "0/5", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_seastore_tm": "0/5", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_striper": "0/1", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_test": "0/5", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_throttle": "1/1", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_timer": "0/1", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_tp": "0/5", 2024-09-12T17:06:06.479 INFO:teuthology.orchestra.run.smithi017.stdout: "debug_trace": "1/5", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "device_failure_prediction_mode": "none", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_graylog": "false", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_journald": "false", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_stderr": "true", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "err_to_syslog": "false", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event_tracing": "false", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_cert_file": "", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_http_port": "9926", 2024-09-12T17:06:06.480 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_key_file": "", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_prio_limit": "5", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_sort_metrics": "true", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "exporter_stats_period": "5", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "fake_statfs_for_testing": "0", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "fatal_signal_handlers": "true", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "filer_max_purge_ops": "10", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "filer_max_truncate_ops": "128", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_blackhole": "false", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_btrfs_snap": "true", 2024-09-12T17:06:06.481 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_caller_concurrency": "10", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_omap_check": "false", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_debug_verify_split": "false", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_dump_file": "", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fadvise": "true", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fail_eio": "true", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fd_cache_size": "128", 2024-09-12T17:06:06.482 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fiemap": "false", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_inject_stall": "0", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_journal_parallel": "false", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_journal_trailing": "false", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_journal_writeahead": "false", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_kill_at": "0", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T17:06:06.483 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_merge_threshold": "-10", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_odsync_write": "false", 2024-09-12T17:06:06.484 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_omap_backend_path": "", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_op_threads": "2", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_punch_hole": "false", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T17:06:06.485 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_queue_max_ops": "50", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_seek_data_hole": "false", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_sloppy_crc": "false", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_splice": "false", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_split_multiple": "2", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_split_rand_factor": "20", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_update_to": "1000", 2024-09-12T17:06:06.486 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_xfs_extsize": "false", 2024-09-12T17:06:06.487 INFO:teuthology.orchestra.run.smithi017.stdout: "filestore_zfs_snap": "false", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fio_dir": "/tmp/fio", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fsid": "505f0ddb-af61-4cad-802f-747b5bdb41a8", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_allow_other": "true", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_big_writes": "true", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_debug": "false", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_default_permissions": "false", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_disable_pagecache": "false", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_max_write": "0", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_multithreaded": "true", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_require_active_mds": "true", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_set_user_groups": "true", 2024-09-12T17:06:06.488 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_splice_move": "true", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_splice_read": "true", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_splice_write": "true", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "gss_target_name": "ceph", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_file": "", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_inject_failure": "0", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "heartbeat_interval": "5", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "host": "smithi017", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T17:06:06.489 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "inject_early_sigterm": "false", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "jaeger_agent_port": "6799", 2024-09-12T17:06:06.490 INFO:teuthology.orchestra.run.smithi017.stdout: "jaeger_tracing_enable": "false", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_aio": "true", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_align_min_size": "65536", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_block_align": "true", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_block_size": "4096", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_dio": "true", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_discard": "false", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_force_aio": "false", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_ignore_corruption": "false", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_max_write_entries": "100", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_replay_from": "0", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T17:06:06.491 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_write_header_frequency": "0", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "journal_zero_on_create": "false", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "journaler_prefetch_periods": "10", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "journaler_prezero_periods": "5", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "journaler_write_head_interval": "15", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "keyfile": "", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_backend": "rocksdb", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T17:06:06.492 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_max_bytes": "67108864", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_max_ops": "512", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_onode_map_size": "1024", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "kstore_sync_transaction": "false", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "librados_thread_count": "2", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "lockdep": "false", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "lockdep_force_backtrace": "false", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "log_coarse_timestamps": "true", 2024-09-12T17:06:06.493 INFO:teuthology.orchestra.run.smithi017.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_flush_on_exit": "false", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_graylog_port": "12201", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_max_new": "1000", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_max_recent": "10000", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_stderr_prefix": "", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_file": "true", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_graylog": "false", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_journald": "false", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_stderr": "false", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "log_to_syslog": "false", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T17:06:06.494 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_action_on_write_error": "1", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_alternate_name_max": "8192", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_asio_thread_count": "2", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_export_pin": "true", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_interval": "10", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_max": "-1", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_max_until": "-1", 2024-09-12T17:06:06.495 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_merge_size": "50", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_mode": "0", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_bits": "3", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T17:06:06.496 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_size": "10000", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_mid": "0.700000", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T17:06:06.497 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_trim_interval": "1", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T17:06:06.498 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_auth_pins": "false", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_frag": "false", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_scatterstat": "false", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_debug_subtrees": "false", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_default_dir_hash": "2", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_defer_session_stale": "true", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_max_entries": "0", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dir_prefetch": "true", 2024-09-12T17:06:06.499 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_early_reply": "true", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_enable_op_tracker": "true", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_enforce_unique_name": "true", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T17:06:06.500 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_health_dummy": "false", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T17:06:06.501 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T17:06:06.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T17:06:06.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_join_fs": "", 2024-09-12T17:06:06.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_journal_format": "1", 2024-09-12T17:06:06.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T17:06:06.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_create_at": "0", 2024-09-12T17:06:06.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_dirfrag_at": "0", 2024-09-12T17:06:06.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_export_at": "0", 2024-09-12T17:06:06.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_import_at": "0", 2024-09-12T17:06:06.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_journal_at": "0", 2024-09-12T17:06:06.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T17:06:06.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T17:06:06.502 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_link_at": "0", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_openc_at": "0", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_rename_at": "0", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_max_events": "-1", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_max_segments": "128", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_pause": "false", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_segment_size": "0", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T17:06:06.503 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T17:06:06.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T17:06:06.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_trim_threshold": "128", 2024-09-12T17:06:06.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T17:06:06.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T17:06:06.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T17:06:06.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T17:06:06.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_completed_requests": "100000", 2024-09-12T17:06:06.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_export_size": "20971520", 2024-09-12T17:06:06.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_file_recover": "32", 2024-09-12T17:06:06.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_purge_files": "64", 2024-09-12T17:06:06.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_purge_ops": "8192", 2024-09-12T17:06:06.504 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_metrics_update_interval": "2", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_min_caps_per_client": "100", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_numa_node": "-1", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_duration": "600", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_size": "20", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T17:06:06.505 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_op_log_threshold": "5", 2024-09-12T17:06:06.506 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_ping_grace": "15", 2024-09-12T17:06:06.506 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_ping_interval": "5", 2024-09-12T17:06:06.506 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T17:06:06.506 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T17:06:06.506 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_max_caps": "30000", 2024-09-12T17:06:06.506 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T17:06:06.506 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T17:06:06.506 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T17:06:06.506 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T17:06:06.506 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T17:06:06.506 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_replay_interval": "1.000000", 2024-09-12T17:06:06.506 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_root_ino_gid": "0", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_root_ino_uid": "0", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T17:06:06.507 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_shutdown_check": "0", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_skip_ino": "0", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_snap_min_uid": "0", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_snap_rstat": "false", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_symlink_recovery": "true", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_thrash_exports": "0", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_thrash_fragments": "0", 2024-09-12T17:06:06.508 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_tick_interval": "5.000000", 2024-09-12T17:06:06.509 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_valgrind_exit": "false", 2024-09-12T17:06:06.509 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_verify_backtrace": "1", 2024-09-12T17:06:06.509 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_verify_scatter": "false", 2024-09-12T17:06:06.509 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T17:06:06.509 INFO:teuthology.orchestra.run.smithi017.stdout: "mds_wipe_sessions": "false", 2024-09-12T17:06:06.509 INFO:teuthology.orchestra.run.smithi017.stdout: "mempool_debug": "false", 2024-09-12T17:06:06.509 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T17:06:06.509 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T17:06:06.509 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_page_set": "false", 2024-09-12T17:06:06.509 INFO:teuthology.orchestra.run.smithi017.stdout: "memstore_page_size": "65536", 2024-09-12T17:06:06.509 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_client_bytes": "134217728", 2024-09-12T17:06:06.510 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_client_messages": "512", 2024-09-12T17:06:06.510 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T17:06:06.510 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T17:06:06.510 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T17:06:06.510 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T17:06:06.510 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_disabled_modules": "", 2024-09-12T17:06:06.510 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T17:06:06.510 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T17:06:06.510 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_max_pg_creating": "1024", 2024-09-12T17:06:06.510 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T17:06:06.510 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mds_messages": "128", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_mon_messages": "128", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_op_history_duration": "600", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_op_history_size": "20", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_op_log_threshold": "5", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T17:06:06.511 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_osd_messages": "8192", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_pool": "true", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_standby_modules": "true", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_stats_period": "5", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_stats_threshold": "5", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_tick_period": "2", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_allow_pool_delete": "true", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T17:06:06.512 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_bytes": "104857600", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_directed_command_retry": "2", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_client_target_rank": "-1", 2024-09-12T17:06:06.513 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_level": "debug", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T17:06:06.514 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_compact_on_start": "false", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_compact_on_trim": "true", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_cpu_threads": "4", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data_avail_crit": "5", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data_avail_warn": "5", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T17:06:06.515 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_dump_json": "false", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_extra_checks": "false", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_down_uptime_grace": "60", 2024-09-12T17:06:06.516 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_election_default_strategy": "1", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_election_timeout": "5.000000", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_enable_op_tracker": "true", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_fake_pool_delete": "false", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_force_quorum_join": "false", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_log_update_period": "5", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_max_detail": "50", 2024-09-12T17:06:06.517 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_to_clog": "true", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_host": "172.21.15.17,[v2:172.21.15.17:3301,v1:172.21.15.17:6790],172.21.15.47", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_host_override": "", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_initial_members": "", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_lease": "5.000000", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T17:06:06.518 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_log_full_interval": "50", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_log_max": "10000", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_log_max_summary": "50", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_log_epochs": "500", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_osd": "10000", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T17:06:06.519 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_memory_autotune": "true", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_memory_target": "2147483648", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_digest_period": "5", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-12T17:06:06.520 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_complaint_time": "30", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_duration": "600", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_size": "20", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_op_log_threshold": "5", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_cache_size": "500", 2024-09-12T17:06:06.521 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T17:06:06.522 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_report_timeout": "900", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T17:06:06.523 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T17:06:06.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T17:06:06.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T17:06:06.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T17:06:06.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T17:06:06.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T17:06:06.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T17:06:06.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T17:06:06.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T17:06:06.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T17:06:06.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T17:06:06.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T17:06:06.524 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_max_osds": "4", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_interval": "86400", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_max_keys": "100", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_scrub_timeout": "300", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_session_timeout": "300", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_smart_report_timeout": "5", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T17:06:06.525 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_pool_size": "4", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_debug": "false", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_tick_interval": "5", 2024-09-12T17:06:06.526 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_older_version": "true", 2024-09-12T17:06:06.527 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "monmap": "", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T17:06:06.528 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "motr_tracing_enabled": "false", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_op_threads": "3", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_cm": "false", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_device_name": "", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T17:06:06.529 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_sl": "3", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_rdma_type": "ib", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_async_reap_threshold": "5", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_before_connect": "false", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_ipv4": "true", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_ipv6": "false", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_msgr1": "true", 2024-09-12T17:06:06.530 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_msgr2": "true", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_port_max": "7568", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_port_min": "6800", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_retry_count": "3", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_bind_retry_delay": "5", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_client": "false", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_mds": "false", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_mgr": "false", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_mon": "false", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_blackhole_osd": "false", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_client_mode": "crc secure", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-12T17:06:06.531 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_cluster_type": "", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_compress_secure": "false", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_crc_data": "true", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_crc_header": "true", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_bug": "true", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_old_message": "true", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T17:06:06.532 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_hugepages": "", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_lro": "true", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_pmd": "", 2024-09-12T17:06:06.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_port_id": "0", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_dump_on_send": "false", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_delay_type": "", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_network_congestion": "0", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_inject_socket_failures": "0", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_max_accept_failures": "4", 2024-09-12T17:06:06.534 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_max_backoff": "15.000000", 2024-09-12T17:06:06.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T17:06:06.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T17:06:06.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T17:06:06.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T17:06:06.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_osd_compress_mode": "none", 2024-09-12T17:06:06.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T17:06:06.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T17:06:06.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_pq_min_cost": "65536", 2024-09-12T17:06:06.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_public_type": "", 2024-09-12T17:06:06.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_service_mode": "crc secure", 2024-09-12T17:06:06.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T17:06:06.535 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_nodelay": "true", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "ms_type": "async+posix", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "no_config_file": "false", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_inflight_ops": "1024", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T17:06:06.536 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T17:06:06.537 INFO:teuthology.orchestra.run.smithi017.stdout: "objecter_timeout": "10.000000", 2024-09-12T17:06:06.537 INFO:teuthology.orchestra.run.smithi017.stdout: "objectstore_blackhole": "false", 2024-09-12T17:06:06.537 INFO:teuthology.orchestra.run.smithi017.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T17:06:06.537 INFO:teuthology.orchestra.run.smithi017.stdout: "openssl_engine_opts": "", 2024-09-12T17:06:06.537 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T17:06:06.537 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T17:06:06.537 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T17:06:06.537 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_max_ops": "4", 2024-09-12T17:06:06.537 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T17:06:06.537 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T17:06:06.537 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_agent_slop": "0.020000", 2024-09-12T17:06:06.537 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_asio_thread_count": "2", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backfill_scan_max": "512", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backfill_scan_min": "64", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backoff_on_peering": "false", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_beacon_report_interval": "300", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_duration": "30", 2024-09-12T17:06:06.538 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_blkin_trace_all": "false", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T17:06:06.539 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_class_update_on_start": "true", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_message_cap": "256", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_op_priority": "63", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_client_watch_timeout": "30", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_command_max_records": "256", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_compact_on_start": "false", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_update_on_start": "true", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T17:06:06.540 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_op_order": "false", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T17:06:06.541 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_shutdown": "false", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_trim_objects": "false", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T17:06:06.542 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_default_notify_timeout": "30", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_ec_partial_reads": "true", 2024-09-12T17:06:06.543 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_enable_op_tracker": "true", 2024-09-12T17:06:06.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T17:06:06.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T17:06:06.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T17:06:06.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T17:06:06.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_info": "true", 2024-09-12T17:06:06.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_shutdown": "true", 2024-09-12T17:06:06.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T17:06:06.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T17:06:06.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T17:06:06.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T17:06:06.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T17:06:06.544 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_function_tracing": "false", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_grace": "20", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_interval": "6", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_stale": "600", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T17:06:06.545 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_journal_size": "5120", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_kill_backfill_at": "0", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_cache_size": "50", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_dedup": "true", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_message_max": "40", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_attr_name_len": "100", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_attr_size": "0", 2024-09-12T17:06:06.546 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_backfills": "1", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_markdown_count": "5", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_markdown_period": "600", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_object_name_len": "2048", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_object_size": "134217728", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_pgls": "1024", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_push_cost": "8388608", 2024-09-12T17:06:06.547 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_push_objects": "10", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_scrubs": "3", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_max_write_size": "90", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T17:06:06.548 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_profile": "balanced", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T17:06:06.549 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_base": "805306368", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_target": "4294967296", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_target_autotune": "false", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_min_recovery_priority": "0", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_report_interval": "5", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T17:06:06.550 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_num_cache_shards": "32", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_numa_node": "-1", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objecter_finishers": "1", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore": "bluestore", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore_fuse": "false", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_objectstore_tracing": "false", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_duration": "600", 2024-09-12T17:06:06.551 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_size": "20", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_log_threshold": "5", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_shards": "0", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T17:06:06.552 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_op_thread_timeout": "15", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_open_classes_on_start": "true", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_os_flags": "0", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_peering_op_priority": "255", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_delete_priority": "5", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T17:06:06.553 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_crimson": "false", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T17:06:06.554 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_flags": "0", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_min_size": "0", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T17:06:06.555 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_size": "2", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_default_type": "replicated", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_cost": "20971520", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_active": "0", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T17:06:06.556 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_op_priority": "3", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_priority": "5", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_repair_during_recovery": "false", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T17:06:06.557 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_cost": "52428800", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_end_hour": "0", 2024-09-12T17:06:06.558 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_priority": "5", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T17:06:06.559 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_skip_data_digest": "false", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_smart_report_timeout": "5", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_priority": "5", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_target_transaction_size": "30", 2024-09-12T17:06:06.560 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_tracing": "false", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_use_stale_snap": "false", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T17:06:06.561 INFO:teuthology.orchestra.run.smithi017.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T17:06:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_kill_at": "0", 2024-09-12T17:06:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_max_join_drift": "10", 2024-09-12T17:06:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_min": "500", 2024-09-12T17:06:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_min_wait": "0.050000", 2024-09-12T17:06:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T17:06:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_service_trim_max": "500", 2024-09-12T17:06:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T17:06:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_service_trim_min": "250", 2024-09-12T17:06:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_stash_full_interval": "25", 2024-09-12T17:06:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_trim_max": "500", 2024-09-12T17:06:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: "paxos_trim_min": "250", 2024-09-12T17:06:06.562 INFO:teuthology.orchestra.run.smithi017.stdout: "perf": "true", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addr": "-", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "public_addrv": "", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "public_bind_addr": "-", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "public_network": "", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "public_network_interface": "", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "qat_compressor_enabled": "false", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "rados_mon_op_timeout": "0", 2024-09-12T17:06:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: "rados_osd_op_timeout": "0", 2024-09-12T17:06:06.564 INFO:teuthology.orchestra.run.smithi017.stdout: "rados_tracing": "false", 2024-09-12T17:06:06.564 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_atime_update_interval": "60", 2024-09-12T17:06:06.564 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T17:06:06.564 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T17:06:06.564 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T17:06:06.564 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T17:06:06.564 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T17:06:06.564 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T17:06:06.564 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache": "true", 2024-09-12T17:06:06.564 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T17:06:06.564 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T17:06:06.564 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_policy": "writearound", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_size": "33554432", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_compression_hint": "none", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_clone_format": "auto", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_data_pool": "", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_features": "61", 2024-09-12T17:06:06.565 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_format": "2", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_map_options": "", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_order": "22", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_pool": "rbd", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_stripe_count": "0", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_io_scheduler": "simple", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T17:06:06.566 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_order": "24", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_pool": "", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_journal_splay_width": "4", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T17:06:06.567 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T17:06:06.568 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T17:06:06.568 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T17:06:06.568 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T17:06:06.568 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T17:06:06.568 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T17:06:06.568 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T17:06:06.568 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T17:06:06.568 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T17:06:06.568 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T17:06:06.568 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T17:06:06.568 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T17:06:06.568 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T17:06:06.569 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_op_threads": "1", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T17:06:06.570 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_plugins": "", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T17:06:06.571 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T17:06:06.572 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_tracing": "false", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_validate_names": "true", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "rbd_validate_pool": "true", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "restapi_base_url": "", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "restapi_log_level": "", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_admin_entry": "admin", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T17:06:06.573 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_asio_assert_yielding": "false", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_backend_store": "rados", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_barbican_url": "", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_beast_enable_async": "true", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cache_enabled": "true", 2024-09-12T17:06:06.574 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_config_store": "rados", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_content_length_compat": "false", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_cross_domain_policy": "", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T17:06:06.575 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T17:06:06.576 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T17:06:06.577 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T17:06:06.578 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T17:06:06.579 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_log_window": "30", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T17:06:06.580 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T17:06:06.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T17:06:06.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T17:06:06.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_disable_s3select": "false", 2024-09-12T17:06:06.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T17:06:06.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T17:06:06.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T17:06:06.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T17:06:06.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T17:06:06.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T17:06:06.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T17:06:06.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T17:06:06.581 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dns_name": "", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dns_s3website_name": "", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_mdsearch": "true", 2024-09-12T17:06:06.582 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_ops_log": "false", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_static_website": "false", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enable_usage_log": "false", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_expose_bucket": "false", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_extended_http_attrs": "", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_filter": "none", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T17:06:06.583 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_objs": "32", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_init_timeout": "300", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T17:06:06.584 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_password": "", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_project": "", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_token": "", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T17:06:06.585 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_admin_user": "", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_url": "", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T17:06:06.586 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_objs": "32", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_worker": "3", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ldap_uri": "", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-12T17:06:06.587 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_http_headers": "", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_attr_size": "0", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T17:06:06.588 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_listing_results": "1000", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_notify_retries": "10", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T17:06:06.589 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T17:06:06.590 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_num_control_oids": "8", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_numa_node": "-1", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T17:06:06.591 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_op_tracing": "false", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_opa_token": "", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_opa_url": "", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_rados": "false", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T17:06:06.592 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T17:06:06.593 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T17:06:06.593 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T17:06:06.593 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T17:06:06.593 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T17:06:06.593 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T17:06:06.593 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T17:06:06.596 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_print_continue": "true", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rados_tracing": "false", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_realm": "", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_realm_id": "", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T17:06:06.597 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_region": "", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_request_uri": "", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-12T17:06:06.598 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_resolve_cname": "false", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_run_sync_thread": "true", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T17:06:06.599 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_script_uri": "", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_service_provider_name": "", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_client_id": "", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_client_secret": "", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_entry": "sts", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_key": "sts", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T17:06:06.600 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_auth_url": "", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_custom_header": "", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_need_stats": "true", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_tenant_name": "", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_url": "", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_lease_period": "120", 2024-09-12T17:06:06.601 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_thread_pool_size": "512", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T17:06:06.602 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_comment": "", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_createby": "", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_encoding": "", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_flag": "false", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_origin": "", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_torrent_tracker": "", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_max_shards": "32", 2024-09-12T17:06:06.603 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T17:06:06.604 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_use_opa_authz": "false", 2024-09-12T17:06:06.604 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_counters_cache": "false", 2024-09-12T17:06:06.604 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T17:06:06.604 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T17:06:06.604 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T17:06:06.604 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T17:06:06.604 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T17:06:06.604 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T17:06:06.604 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T17:06:06.604 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T17:06:06.604 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T17:06:06.604 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_user_unique_email": "true", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_verify_ssl": "true", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zone": "", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zone_id": "", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zonegroup": "", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zonegroup_id": "", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_block_size": "4096", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T17:06:06.605 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T17:06:06.606 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_partition_filters": "false", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_perf": "false", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "run_dir": "/var/run/ceph", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_block_create": "true", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T17:06:06.607 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T17:06:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_device_size": "53687091200", 2024-09-12T17:06:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T17:06:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_full_integrity_check": "false", 2024-09-12T17:06:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T17:06:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T17:06:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T17:06:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T17:06:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_main_device_type": "SSD", 2024-09-12T17:06:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T17:06:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T17:06:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T17:06:06.608 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "seastore_segment_size": "67108864", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "set_keepcaps": "false", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "setgroup": "", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "setuser": "", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "setuser_match_path": "", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "thp": "false", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "threadpool_default_timeout": "60", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "throttler_perf_counter": "true", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tmp_dir": "/tmp", 2024-09-12T17:06:06.609 INFO:teuthology.orchestra.run.smithi017.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-12T17:06:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "uadk_compressor_enabled": "false", 2024-09-12T17:06:06.610 INFO:teuthology.orchestra.run.smithi017.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-12T17:06:06.610 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:06.612 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T17:06:06.759 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a: {} 2024-09-12T17:06:06.759 INFO:teuthology.orchestra.run.smithi017.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T17:06:06.773 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b: {} 2024-09-12T17:06:06.773 INFO:teuthology.orchestra.run.smithi017.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T17:06:06.782 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c: {} 2024-09-12T17:06:06.783 INFO:teuthology.orchestra.run.smithi017.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T17:06:06.802 DEBUG:teuthology.orchestra.run.smithi047:> type ceph-objectstore-tool 2024-09-12T17:06:06.807 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T17:06:06.808 DEBUG:teuthology.orchestra.run.smithi017:> type ceph-objectstore-tool 2024-09-12T17:06:06.812 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T17:06:06.812 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T17:06:06.826 INFO:tasks.workunit:Pulling workunits from ref bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:06:06.826 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T17:06:06.826 DEBUG:teuthology.orchestra.run.smithi017:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:06:06.827 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T17:06:06.827 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T17:06:06.827 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T17:06:06.827 INFO:tasks.thrashosds.thrasher:Reweighting osd 1 to 0.6150824821830378 2024-09-12T17:06:06.827 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 0.6150824821830378 2024-09-12T17:06:06.828 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T17:06:06.828 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T17:06:06.828 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:06:06.828 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T17:06:06.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:06:06.829 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T17:06:06.829 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T17:06:06.853 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:06.853+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:06.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:06:06.861 INFO:teuthology.orchestra.run.smithi017.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T17:06:06.861 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:06:06.907 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T17:06:06.908 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T17:06:06.929 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:06.929+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:06.956 INFO:tasks.workunit:timeout=3h 2024-09-12T17:06:06.956 INFO:tasks.workunit:cleanup=True 2024-09-12T17:06:06.956 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout bad475c18c96ec20c5778159aa33ba72b84e9c1b 2024-09-12T17:06:06.980 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:06.980 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:06.980 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:06.981 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:06.986 INFO:tasks.workunit.client.0.smithi017.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T17:06:07.002 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:06:07.002 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:07.003 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:07.035 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:07.036 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:07.036 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:07.034+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:07.054 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:07.054 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:07.077 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:07.077 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:07.103 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:07.103 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:07.122 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:07.123 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:07.124 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:07.124 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:07.131 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:07.129+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:07.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:06:07.145 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:07.146 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:07.167 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:07.167 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:07.239 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:07.238+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:07.256 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:07.256 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:07.269 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:06:07.355 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:07.354+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:07.418 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:07.419 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:07.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:06:07.433 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:07.433+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:07.534 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:07.533+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:07.594 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.1 to 0.615082 (9d76) 2024-09-12T17:06:07.600 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T17:06:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:07.603 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:07.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:06:07.644 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:07.642+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:07.736 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:07.734+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:07.740 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:07.740 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:07.754 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:06:07.837 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:07.837+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:07.905 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:07.905 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:07.918 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:06:07.963 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:07.962+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:08.030 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:08.030 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:08.039 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:08.038+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:08.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:06:08.139 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:08.138+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:08.212 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:08.212 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:08.226 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:06:08.271 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:08.270+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:08.341 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:08.337+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:08.393 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:08.393 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:08.408 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:06:08.445 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:08.441+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:08.543 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:08.541+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:08.582 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:08.582 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:08.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:06:08.649 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:08.645+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:08.738 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:08.738 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:08.745 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:08.745+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:08.752 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:06:08.846 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:08.845+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:08.885 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:08.885 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:08.899 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:06:08.984 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:08.985+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:09.048 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:09.045+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:09.067 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:09.067 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:09.081 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:06:09.149 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:09.145+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:09.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:06:09.250 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:09.245+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:09.251 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:09.251 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:09.266 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:06:09.350 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:09.345+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:09.354 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:09.355 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:09.371 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:09.372 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:09.388 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:09.388 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:09.394 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:09.394 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:09.405 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:09.405 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:09.409 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:06:09.424 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:09.424 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:09.444 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:09.444 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:09.456 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:09.457+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:09.463 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:09.463 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:09.481 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:09.537 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:09.537 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:09.537 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:09.537 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:09.537 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:09.552 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:06:09.552 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:09.553+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:09.646 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T17:06:09.653 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:09.653+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:09.728 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:09.728 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:06:09.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:06:09.728 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:06:09.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.728 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4257.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T17:06:09.728 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:40.211679+0000", 2024-09-12T17:06:09.728 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.513702962, 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0076009049999999998, 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4257", 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/3507825183", 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.211679+0000", 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.211679+0000", 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.211692+0000", 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2847000000000001e-05 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.211708+0000", 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6016e-05 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.211749+0000", 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1097000000000003e-05 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.211776+0000", 2024-09-12T17:06:09.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6903e-05 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.211936+0000", 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016010500000000001 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.211958+0000", 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1820000000000001e-05 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.216216+0000", 2024-09-12T17:06:09.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042580539999999998 2024-09-12T17:06:09.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.216542+0000", 2024-09-12T17:06:09.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032530800000000001 2024-09-12T17:06:09.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:06:09.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.216893+0000", 2024-09-12T17:06:09.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035158999999999999 2024-09-12T17:06:09.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.218763+0000", 2024-09-12T17:06:09.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001869873 2024-09-12T17:06:09.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.219085+0000", 2024-09-12T17:06:09.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032231700000000002 2024-09-12T17:06:09.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.219167+0000", 2024-09-12T17:06:09.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1872999999999994e-05 2024-09-12T17:06:09.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:40.219280+0000", 2024-09-12T17:06:09.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113102 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4257.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:41.212148+0000", 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.513234079, 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074523790000000003, 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.737 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4257", 2024-09-12T17:06:09.738 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/3507825183", 2024-09-12T17:06:09.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 5 2024-09-12T17:06:09.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.739 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.212148+0000", 2024-09-12T17:06:09.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.212148+0000", 2024-09-12T17:06:09.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.212152+0000", 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.49e-06 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.212175+0000", 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2946e-05 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.212211+0000", 2024-09-12T17:06:09.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6053999999999997e-05 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.212239+0000", 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8753000000000001e-05 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.212405+0000", 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016503199999999999 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.212415+0000", 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.096e-05 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.216360+0000", 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039445560000000001 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.216588+0000", 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022782499999999999 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.216801+0000", 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021359800000000001 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.218435+0000", 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016336339999999999 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.219327+0000", 2024-09-12T17:06:09.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00089149300000000004 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.219481+0000", 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015417600000000001 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:41.219601+0000", 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119862 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.744 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.745 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4257.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e22)", 2024-09-12T17:06:09.745 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:42.220734+0000", 2024-09-12T17:06:09.745 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 27.504648579000001, 2024-09-12T17:06:09.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0076927499999999999, 2024-09-12T17:06:09.745 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.745 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4257", 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/3507825183", 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 7 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.220734+0000", 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.220734+0000", 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.220737+0000", 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2399999999999999e-06 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.220753+0000", 2024-09-12T17:06:09.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6422999999999998e-05 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.220789+0000", 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5352999999999998e-05 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.220807+0000", 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7782999999999999e-05 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.220938+0000", 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013159200000000001 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.220950+0000", 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1610000000000001e-05 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.225367+0000", 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044169630000000003 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.225518+0000", 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015092799999999999 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.225730+0000", 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000212652 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.227204+0000", 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001473432 2024-09-12T17:06:09.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.228266+0000", 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001062396 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.228354+0000", 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7892000000000005e-05 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:42.228426+0000", 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2485999999999997e-05 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4367.0:40 5.16 5:699bf539:::zonegroup_info.735ef487-4317-4eaa-b9c2-4ef75245b2ea:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:51.595709+0000", 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.129673419, 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032199049999999999, 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.752 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4367", 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 40 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.595709+0000", 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.595709+0000", 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.595710+0000", 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.353e-06 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.595718+0000", 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5800000000000003e-06 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.595739+0000", 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.158e-05 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.595752+0000", 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2567e-05 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.595887+0000", 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013463900000000001 2024-09-12T17:06:09.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.596234+0000", 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034709999999999998 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.596699+0000", 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046527599999999998 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.598362+0000", 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001662801 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.598737+0000", 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000374824 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.598819+0000", 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2556e-05 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:51.598929+0000", 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109629 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.579796+0000", 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.145585971999999, 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064919369999999997, 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.758 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 205 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.579796+0000", 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.759 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.579796+0000", 2024-09-12T17:06:09.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.579800+0000", 2024-09-12T17:06:09.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0199999999999996e-06 2024-09-12T17:06:09.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.579819+0000", 2024-09-12T17:06:09.760 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8694000000000001e-05 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.579874+0000", 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5229000000000003e-05 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.579902+0000", 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8099999999999999e-05 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.580080+0000", 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000177799 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.580443+0000", 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036244000000000001 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.581165+0000", 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00072238100000000002 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.583204+0000", 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020390009999999999 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.586128+0000", 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029238939999999998 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.586223+0000", 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5179000000000005e-05 2024-09-12T17:06:09.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.586288+0000", 2024-09-12T17:06:09.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5199999999999999e-05 2024-09-12T17:06:09.764 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.764 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.764 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.764 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.764 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.641361+0000", 2024-09-12T17:06:09.764 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.084021643, 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035913220000000001, 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 220 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.641361+0000", 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.641361+0000", 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.641364+0000", 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2260000000000001e-06 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.641377+0000", 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3067e-05 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.641409+0000", 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2523e-05 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.641424+0000", 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4727e-05 2024-09-12T17:06:09.767 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.641573+0000", 2024-09-12T17:06:09.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000148932 2024-09-12T17:06:09.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.641777+0000", 2024-09-12T17:06:09.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020425200000000001 2024-09-12T17:06:09.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.642163+0000", 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038571699999999999 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.643764+0000", 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016007409999999999 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.644744+0000", 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00097983500000000008 2024-09-12T17:06:09.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.644836+0000", 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2252999999999999e-05 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.644952+0000", 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116049 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.652540+0000", 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.072842183000001, 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036496720000000001, 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 223 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.652540+0000", 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.652540+0000", 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.652543+0000", 2024-09-12T17:06:09.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000002e-06 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.652554+0000", 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1506e-05 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.652586+0000", 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1996999999999999e-05 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.652604+0000", 2024-09-12T17:06:09.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7506000000000001e-05 2024-09-12T17:06:09.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.652708+0000", 2024-09-12T17:06:09.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000104609 2024-09-12T17:06:09.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.652909+0000", 2024-09-12T17:06:09.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000201036 2024-09-12T17:06:09.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.653340+0000", 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00043050899999999998 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.654831+0000", 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014916930000000001 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.775 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.655904+0000", 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001072358 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.656064+0000", 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015979199999999999 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.656190+0000", 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012620599999999999 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.776 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.660752+0000", 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.064630157, 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003551397, 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.777 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 225 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.660752+0000", 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.660752+0000", 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.660755+0000", 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.48e-06 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.660768+0000", 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2996999999999999e-05 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.660800+0000", 2024-09-12T17:06:09.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1930000000000001e-05 2024-09-12T17:06:09.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.660815+0000", 2024-09-12T17:06:09.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4960000000000001e-05 2024-09-12T17:06:09.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.660922+0000", 2024-09-12T17:06:09.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107292 2024-09-12T17:06:09.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.661165+0000", 2024-09-12T17:06:09.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000243565 2024-09-12T17:06:09.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:09.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.661611+0000", 2024-09-12T17:06:09.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044553000000000003 2024-09-12T17:06:09.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.662954+0000", 2024-09-12T17:06:09.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013429830000000001 2024-09-12T17:06:09.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.664095+0000", 2024-09-12T17:06:09.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011410770000000001 2024-09-12T17:06:09.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.664187+0000", 2024-09-12T17:06:09.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2440000000000003e-05 2024-09-12T17:06:09.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.664304+0000", 2024-09-12T17:06:09.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116143 2024-09-12T17:06:09.783 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.783 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.783 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.783 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.783 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.664633+0000", 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.060748909999999, 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032593779999999998, 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 226 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.784 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.664633+0000", 2024-09-12T17:06:09.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.664633+0000", 2024-09-12T17:06:09.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.664636+0000", 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.52e-06 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.664647+0000", 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.128e-05 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.664679+0000", 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1350000000000003e-05 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.664694+0000", 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.507e-05 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.664812+0000", 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011848199999999999 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665032+0000", 2024-09-12T17:06:09.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000219705 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665418+0000", 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038640000000000001 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.666774+0000", 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013557269999999999 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.667738+0000", 2024-09-12T17:06:09.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00096448499999999995 2024-09-12T17:06:09.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.667825+0000", 2024-09-12T17:06:09.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6502999999999995e-05 2024-09-12T17:06:09.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.667893+0000", 2024-09-12T17:06:09.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7855999999999995e-05 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.694465+0000", 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.030917150000001, 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038256409999999999, 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.790 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 234 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.694465+0000", 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.791 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.694465+0000", 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.694468+0000", 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4530000000000001e-06 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.694479+0000", 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1199999999999999e-05 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.694506+0000", 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7466000000000001e-05 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.694523+0000", 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6719999999999999e-05 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.694669+0000", 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014628899999999999 2024-09-12T17:06:09.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.695045+0000", 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037530700000000002 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.695831+0000", 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00078615100000000002 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.697437+0000", 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016062240000000001 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.698003+0000", 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056561999999999997 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.698168+0000", 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016551900000000001 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.698291+0000", 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012269200000000001 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:276 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.716081+0000", 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.00930103, 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032409309999999998, 2024-09-12T17:06:09.796 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 276 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.716081+0000", 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.716081+0000", 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.716084+0000", 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9830000000000001e-06 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.716099+0000", 2024-09-12T17:06:09.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4569999999999999e-05 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.716138+0000", 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9177000000000001e-05 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.716161+0000", 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2623e-05 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.716287+0000", 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000126086 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.716520+0000", 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023289099999999999 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.716927+0000", 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040774700000000002 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.800 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.718385+0000", 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001457372 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.719068+0000", 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00068278800000000004 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.719205+0000", 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000137119 2024-09-12T17:06:09.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.719322+0000", 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117575 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:311 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.723263+0000", 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.002118969, 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003288409, 2024-09-12T17:06:09.802 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 311 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723263+0000", 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723263+0000", 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723265+0000", 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.717e-06 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723276+0000", 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0823e-05 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723301+0000", 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4905999999999998e-05 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723319+0000", 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7980000000000001e-05 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723444+0000", 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000125499 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723649+0000", 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020509900000000001 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724137+0000", 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00048810299999999999 2024-09-12T17:06:09.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725554+0000", 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001416685 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.726378+0000", 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082336400000000004 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.726459+0000", 2024-09-12T17:06:09.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1422999999999996e-05 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.726552+0000", 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2810000000000001e-05 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:433 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.759799+0000", 2024-09-12T17:06:09.808 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.965583514, 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003442156, 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 433 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.759799+0000", 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.759799+0000", 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.759801+0000", 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5000000000000002e-06 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.759815+0000", 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3393e-05 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.759840+0000", 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5675999999999999e-05 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.759854+0000", 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3613e-05 2024-09-12T17:06:09.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.759971+0000", 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117496 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760157+0000", 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018557900000000001 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760573+0000", 2024-09-12T17:06:09.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041557999999999998 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762212+0000", 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016396340000000001 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762986+0000", 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00077402099999999995 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763139+0000", 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000152855 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763241+0000", 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101809 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:763 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.814 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.076258+0000", 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.649124207, 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032336280000000001, 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 763 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.076258+0000", 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.076258+0000", 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.076261+0000", 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4600000000000002e-06 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.076272+0000", 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1357e-05 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.076303+0000", 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1335999999999999e-05 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.076318+0000", 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4627000000000001e-05 2024-09-12T17:06:09.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.076451+0000", 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013327200000000001 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.076661+0000", 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000210072 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.076969+0000", 2024-09-12T17:06:09.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030821800000000002 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.078224+0000", 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012545900000000001 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.079216+0000", 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00099156900000000009 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.079376+0000", 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000160602 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.079492+0000", 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115525 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:765 6.d 6:b603df87:::obj_delete_at_hint.0000000062:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.820 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.080871+0000", 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.644511149, 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003338751, 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 765 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.080871+0000", 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.080871+0000", 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.080874+0000", 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6960000000000001e-06 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.080885+0000", 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1364e-05 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.080919+0000", 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3578999999999998e-05 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.080935+0000", 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6569999999999999e-05 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.081066+0000", 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013094300000000001 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.081287+0000", 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022032400000000001 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.081773+0000", 2024-09-12T17:06:09.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00048627000000000002 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.083079+0000", 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001305963 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.083943+0000", 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00086452700000000003 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.084098+0000", 2024-09-12T17:06:09.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015441900000000001 2024-09-12T17:06:09.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.084210+0000", 2024-09-12T17:06:09.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011209600000000001 2024-09-12T17:06:09.826 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.826 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.826 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:766 6.19 6:9edc23b1:::obj_delete_at_hint.0000000063:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.084523+0000", 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.640858864, 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033067309999999998, 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 766 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.084523+0000", 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.084523+0000", 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.084526+0000", 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6769999999999999e-06 2024-09-12T17:06:09.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.084540+0000", 2024-09-12T17:06:09.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3529999999999999e-05 2024-09-12T17:06:09.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.084571+0000", 2024-09-12T17:06:09.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1625999999999998e-05 2024-09-12T17:06:09.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.084586+0000", 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4927e-05 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.084720+0000", 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000133449 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.085067+0000", 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034743399999999998 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.085612+0000", 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00054487199999999996 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.087168+0000", 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001555812 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.087566+0000", 2024-09-12T17:06:09.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00039772599999999999 2024-09-12T17:06:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.087716+0000", 2024-09-12T17:06:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000150149 2024-09-12T17:06:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.087830+0000", 2024-09-12T17:06:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000114529 2024-09-12T17:06:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.832 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.833 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:795 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.833 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.153090+0000", 2024-09-12T17:06:09.833 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.572291863, 2024-09-12T17:06:09.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033312049999999998, 2024-09-12T17:06:09.833 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.833 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.833 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.833 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.833 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.834 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.834 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 795 2024-09-12T17:06:09.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.834 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.153090+0000", 2024-09-12T17:06:09.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.153090+0000", 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.153093+0000", 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4930000000000001e-06 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.153104+0000", 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1474000000000001e-05 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.153136+0000", 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1795999999999998e-05 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.153154+0000", 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7632999999999999e-05 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.153291+0000", 2024-09-12T17:06:09.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013711600000000001 2024-09-12T17:06:09.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.153546+0000", 2024-09-12T17:06:09.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025473100000000001 2024-09-12T17:06:09.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:09.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.154022+0000", 2024-09-12T17:06:09.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00047583 2024-09-12T17:06:09.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.155340+0000", 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001318973 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.156146+0000", 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080539399999999997 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.156297+0000", 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015096200000000001 2024-09-12T17:06:09.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.156422+0000", 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012480299999999999 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:820 6.a 6:50a39311:::obj_delete_at_hint.0000000081:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.213656+0000", 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.511726424000001, 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032980610000000001, 2024-09-12T17:06:09.839 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.840 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.840 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.840 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.840 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.840 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.840 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 820 2024-09-12T17:06:09.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.840 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.213656+0000", 2024-09-12T17:06:09.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.213656+0000", 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.213659+0000", 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7e-06 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.213674+0000", 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5130000000000001e-05 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.213704+0000", 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0577000000000002e-05 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.213719+0000", 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5013e-05 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.213873+0000", 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015369200000000001 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.214234+0000", 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036117400000000002 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.214817+0000", 2024-09-12T17:06:09.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00058283499999999997 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.216296+0000", 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014785149999999999 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.216809+0000", 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00051318999999999996 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.216890+0000", 2024-09-12T17:06:09.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1759000000000001e-05 2024-09-12T17:06:09.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.216954+0000", 2024-09-12T17:06:09.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3476e-05 2024-09-12T17:06:09.845 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.845 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.347951+0000", 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.377431526000001, 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031976280000000001, 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.846 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 874 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.347951+0000", 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.347951+0000", 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.347953+0000", 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4830000000000002e-06 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.347965+0000", 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1603000000000001e-05 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.347996+0000", 2024-09-12T17:06:09.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1229999999999997e-05 2024-09-12T17:06:09.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.348011+0000", 2024-09-12T17:06:09.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4732999999999999e-05 2024-09-12T17:06:09.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.348165+0000", 2024-09-12T17:06:09.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015422499999999999 2024-09-12T17:06:09.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.348377+0000", 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021233499999999999 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.348695+0000", 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031774800000000002 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.349968+0000", 2024-09-12T17:06:09.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012732399999999999 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.350993+0000", 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001025059 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.351080+0000", 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6261999999999995e-05 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.351148+0000", 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8709999999999998e-05 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:877 6.19 6:98c4c580:::obj_delete_at_hint.0000000100:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.355599+0000", 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.369783630000001, 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0034627600000000001, 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:09.852 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 877 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.355599+0000", 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.355599+0000", 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.355601+0000", 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0499999999999999e-06 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.355611+0000", 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7969999999999995e-06 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.355636+0000", 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5372999999999999e-05 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.355648+0000", 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2507000000000001e-05 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.355797+0000", 2024-09-12T17:06:09.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014844899999999999 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.356163+0000", 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036659000000000003 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.356723+0000", 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055975199999999995 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.358121+0000", 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00139748 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.358771+0000", 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00065029499999999995 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.358934+0000", 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000162802 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:09.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:09.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:09.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.359061+0000", 2024-09-12T17:06:09.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012766500000000001 2024-09-12T17:06:09.858 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.858 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.858 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.858 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:09.858 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:09.858 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:09.860 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:06:09.860 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:09.857+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:09.960 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:09.957+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:10.031 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:10.031 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:10.031 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:06:10.031 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:10.045 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:06:10.061 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:10.057+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:10.162 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:10.157+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:10.165 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:10.165 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:10.165 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:10.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:06:10.263 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:10.261+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:10.305 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:10.305 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:06:10.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:06:10.305 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:06:10.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.305 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:10.305 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:06:10.305 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.768081721, 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.040278856000000002, 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 46 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:06:10.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537089+0000", 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3000000000000002e-06 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537103+0000", 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4097000000000001e-05 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537137+0000", 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4079999999999999e-05 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537162+0000", 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4579999999999998e-05 2024-09-12T17:06:10.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537327+0000", 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000165081 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537344+0000", 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7447000000000001e-05 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.552576+0000", 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015231339 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.552597+0000", 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0934e-05 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.572608+0000", 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020010917 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.572902+0000", 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029482400000000001 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.573205+0000", 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030300900000000003 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.576854+0000", 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003648966 2024-09-12T17:06:10.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577088+0000", 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023368099999999999 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577216+0000", 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012821600000000001 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577365+0000", 2024-09-12T17:06:10.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014838500000000001 2024-09-12T17:06:10.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.313 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.313 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117020027008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:10.313 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.577764+0000", 2024-09-12T17:06:10.313 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.727403632, 2024-09-12T17:06:10.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026568799999999999, 2024-09-12T17:06:10.313 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.313 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.314 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:10.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:10.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:10.314 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 47 2024-09-12T17:06:10.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.314 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577764+0000", 2024-09-12T17:06:10.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577764+0000", 2024-09-12T17:06:10.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577767+0000", 2024-09-12T17:06:10.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8289999999999999e-06 2024-09-12T17:06:10.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577778+0000", 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1415e-05 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577803+0000", 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5341999999999999e-05 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577837+0000", 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3825000000000002e-05 2024-09-12T17:06:10.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577938+0000", 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100301 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.578111+0000", 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017378399999999999 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.578414+0000", 2024-09-12T17:06:10.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030282399999999999 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.579488+0000", 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001074242 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.580119+0000", 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063073299999999997 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.580242+0000", 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012259900000000001 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.580421+0000", 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017898600000000001 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.319 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.586577+0000", 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.718590559000001, 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023422579999999998, 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 54 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586577+0000", 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586577+0000", 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586579+0000", 2024-09-12T17:06:10.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4940000000000002e-06 2024-09-12T17:06:10.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586591+0000", 2024-09-12T17:06:10.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1116e-05 2024-09-12T17:06:10.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586625+0000", 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4779e-05 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586641+0000", 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5466999999999999e-05 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586743+0000", 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010244 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586882+0000", 2024-09-12T17:06:10.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000139121 2024-09-12T17:06:10.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:10.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.587026+0000", 2024-09-12T17:06:10.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014360299999999999 2024-09-12T17:06:10.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.587909+0000", 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00088268000000000005 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.588722+0000", 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081364700000000002 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.588802+0000", 2024-09-12T17:06:10.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9661999999999997e-05 2024-09-12T17:06:10.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.588919+0000", 2024-09-12T17:06:10.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117249 2024-09-12T17:06:10.326 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.326 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.326 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117020030464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.589104+0000", 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.716063259, 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024774900000000002, 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:10.327 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55 2024-09-12T17:06:10.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.328 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589104+0000", 2024-09-12T17:06:10.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589104+0000", 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589106+0000", 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0269999999999998e-06 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589117+0000", 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0647e-05 2024-09-12T17:06:10.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589144+0000", 2024-09-12T17:06:10.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6916000000000001e-05 2024-09-12T17:06:10.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589160+0000", 2024-09-12T17:06:10.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6123000000000001e-05 2024-09-12T17:06:10.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589267+0000", 2024-09-12T17:06:10.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107373 2024-09-12T17:06:10.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589400+0000", 2024-09-12T17:06:10.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000132762 2024-09-12T17:06:10.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:10.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589651+0000", 2024-09-12T17:06:10.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025080799999999999 2024-09-12T17:06:10.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:10.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.590859+0000", 2024-09-12T17:06:10.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001208317 2024-09-12T17:06:10.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:10.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.591421+0000", 2024-09-12T17:06:10.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056174100000000004 2024-09-12T17:06:10.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.591495+0000", 2024-09-12T17:06:10.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4245000000000005e-05 2024-09-12T17:06:10.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.591582+0000", 2024-09-12T17:06:10.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6531000000000002e-05 2024-09-12T17:06:10.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.334 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:191 6.5 e33/30 6:a2ace8b3:::data_log.0:head v 33'1, mlcod=0'0)", 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.682203+0000", 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.622964633, 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017792789999999999, 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682203+0000", 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682203+0000", 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682205+0000", 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0829999999999998e-06 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682219+0000", 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4413000000000001e-05 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682254+0000", 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4659000000000001e-05 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682274+0000", 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9959999999999999e-05 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682455+0000", 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018075900000000001 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682508+0000", 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2785999999999999e-05 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.683904+0000", 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001396696 2024-09-12T17:06:10.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.683982+0000", 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7923000000000006e-05 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:209 6.3 e36/30 6:c60da066:gc::gc.4:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.601065+0000", 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.70410263, 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021210780000000002, 2024-09-12T17:06:10.339 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601065+0000", 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601065+0000", 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601066+0000", 2024-09-12T17:06:10.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1399999999999996e-07 2024-09-12T17:06:10.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.341 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601077+0000", 2024-09-12T17:06:10.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1253000000000001e-05 2024-09-12T17:06:10.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.341 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601115+0000", 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7902999999999999e-05 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601139+0000", 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3913e-05 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601323+0000", 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018393899999999999 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601373+0000", 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9873000000000002e-05 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.603095+0000", 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017221859999999999 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.603186+0000", 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1197000000000001e-05 2024-09-12T17:06:10.343 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:217 6.15 e36/30 6:ab569f81:gc::gc.12:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.631481+0000", 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.673686238, 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018198859999999999, 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631481+0000", 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631481+0000", 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631483+0000", 2024-09-12T17:06:10.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.823e-06 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631496+0000", 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.313e-05 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631525+0000", 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8297e-05 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631539+0000", 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4212999999999999e-05 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631683+0000", 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143883 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631740+0000", 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7315000000000003e-05 2024-09-12T17:06:10.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.633227+0000", 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001486596 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.633301+0000", 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4629000000000007e-05 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:221 6.3 e36/30 6:c623b173:gc::gc.16:head v 36'3, mlcod=36'1)", 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.646376+0000", 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.658791463, 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018164660000000001, 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646376+0000", 2024-09-12T17:06:10.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646376+0000", 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646378+0000", 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646390+0000", 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.153e-05 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646418+0000", 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8133e-05 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646431+0000", 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3044000000000001e-05 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646574+0000", 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014290200000000001 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646637+0000", 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3736000000000001e-05 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.648113+0000", 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014753189999999999 2024-09-12T17:06:10.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.648192+0000", 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9841999999999999e-05 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:226 6.a e36/30 6:5127e642:gc::gc.21:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.665705+0000", 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.639462744999999, 2024-09-12T17:06:10.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001702823, 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665705+0000", 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665705+0000", 2024-09-12T17:06:10.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665705+0000", 2024-09-12T17:06:10.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9299999999999998e-07 2024-09-12T17:06:10.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665712+0000", 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0230000000000004e-06 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665739+0000", 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7007000000000001e-05 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665753+0000", 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3226e-05 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665871+0000", 2024-09-12T17:06:10.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118529 2024-09-12T17:06:10.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665900+0000", 2024-09-12T17:06:10.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9073000000000001e-05 2024-09-12T17:06:10.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.667322+0000", 2024-09-12T17:06:10.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001421919 2024-09-12T17:06:10.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.667408+0000", 2024-09-12T17:06:10.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5452999999999997e-05 2024-09-12T17:06:10.358 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.358 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.358 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.359 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:303 6.1 e36/30 6:856b9b26:reshard::reshard.0000000002:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:10.359 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.721622+0000", 2024-09-12T17:06:10.359 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.583545504, 2024-09-12T17:06:10.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001801743, 2024-09-12T17:06:10.359 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.359 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.359 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.359 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721622+0000", 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721622+0000", 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721623+0000", 2024-09-12T17:06:10.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.37e-07 2024-09-12T17:06:10.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721632+0000", 2024-09-12T17:06:10.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8300000000000002e-06 2024-09-12T17:06:10.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721659+0000", 2024-09-12T17:06:10.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7503000000000001e-05 2024-09-12T17:06:10.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721677+0000", 2024-09-12T17:06:10.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8050000000000002e-05 2024-09-12T17:06:10.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721804+0000", 2024-09-12T17:06:10.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000127262 2024-09-12T17:06:10.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721849+0000", 2024-09-12T17:06:10.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4496000000000002e-05 2024-09-12T17:06:10.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723309+0000", 2024-09-12T17:06:10.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014601760000000001 2024-09-12T17:06:10.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723424+0000", 2024-09-12T17:06:10.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000114689 2024-09-12T17:06:10.364 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.364 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.364 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.364 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:318 6.1 e36/30 6:856b9b26:reshard::reshard.0000000002:head v 36'2, mlcod=0'0)", 2024-09-12T17:06:10.364 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.724965+0000", 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.580202569000001, 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001908412, 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724965+0000", 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724965+0000", 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724967+0000", 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1069999999999999e-06 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724979+0000", 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.183e-05 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725006+0000", 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7432000000000001e-05 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725020+0000", 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3573e-05 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725179+0000", 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015895899999999999 2024-09-12T17:06:10.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725236+0000", 2024-09-12T17:06:10.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7163999999999997e-05 2024-09-12T17:06:10.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.726797+0000", 2024-09-12T17:06:10.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015610439999999999 2024-09-12T17:06:10.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.726873+0000", 2024-09-12T17:06:10.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6303000000000005e-05 2024-09-12T17:06:10.369 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.369 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.369 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.370 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:350 6.5 e36/30 6:a60f9269:lc::lua_package_allowlist:head v 36'2, mlcod=0'0)", 2024-09-12T17:06:10.370 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.732394+0000", 2024-09-12T17:06:10.370 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.572773474, 2024-09-12T17:06:10.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033606479999999999, 2024-09-12T17:06:10.370 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.370 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.370 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.370 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732394+0000", 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732394+0000", 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732396+0000", 2024-09-12T17:06:10.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2199999999999999e-06 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732411+0000", 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4450000000000001e-05 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732445+0000", 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4427000000000001e-05 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732465+0000", 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0047e-05 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732619+0000", 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015389200000000001 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732677+0000", 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7671999999999999e-05 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735650+0000", 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002973594 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735755+0000", 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010434599999999999 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:360 6.3 e36/30 6:c3a682d4:reshard::reshard.0000000004:head v 36'4, mlcod=36'2)", 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.735399+0000", 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.569768523, 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017447630000000001, 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735399+0000", 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735399+0000", 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735432+0000", 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3420000000000002e-05 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735446+0000", 2024-09-12T17:06:10.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3196e-05 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735473+0000", 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6950000000000001e-05 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735494+0000", 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1282999999999999e-05 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735638+0000", 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000144635 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735691+0000", 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2176999999999999e-05 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737025+0000", 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001334163 2024-09-12T17:06:10.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737144+0000", 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011893899999999999 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:368 6.5 e36/30 6:a60f9269:lc::lua_package_allowlist:head v 36'3, mlcod=33'1)", 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.737977+0000", 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.567190199000001, 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017574159999999999, 2024-09-12T17:06:10.379 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737977+0000", 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737977+0000", 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737979+0000", 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0159999999999998e-06 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737993+0000", 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3937000000000001e-05 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738029+0000", 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5302999999999997e-05 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738047+0000", 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8919999999999998e-05 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738203+0000", 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015550500000000001 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738258+0000", 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5303000000000002e-05 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739627+0000", 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013687160000000001 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739735+0000", 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107716 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.383 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:374 6.c e36/30 6:3677c228:::obj_delete_at_hint.0000000006:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.738951+0000", 2024-09-12T17:06:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.566216464, 2024-09-12T17:06:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019538120000000001, 2024-09-12T17:06:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738951+0000", 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738951+0000", 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738953+0000", 2024-09-12T17:06:10.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.12e-06 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738967+0000", 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4324e-05 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738996+0000", 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8572999999999999e-05 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739017+0000", 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0826e-05 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739175+0000", 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000157675 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739223+0000", 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8059999999999997e-05 2024-09-12T17:06:10.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.740818+0000", 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015950910000000001 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.740905+0000", 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7143000000000002e-05 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:433 6.a e36/30 6:50d64734:::obj_delete_at_hint.0000000009:head v 36'5, mlcod=36'3)", 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.760784+0000", 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.544383823, 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018873760000000001, 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760784+0000", 2024-09-12T17:06:10.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760784+0000", 2024-09-12T17:06:10.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760786+0000", 2024-09-12T17:06:10.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.39e-06 2024-09-12T17:06:10.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760828+0000", 2024-09-12T17:06:10.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1814000000000003e-05 2024-09-12T17:06:10.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760862+0000", 2024-09-12T17:06:10.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3682e-05 2024-09-12T17:06:10.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760881+0000", 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9017000000000001e-05 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.761032+0000", 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000151142 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.761095+0000", 2024-09-12T17:06:10.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2860000000000005e-05 2024-09-12T17:06:10.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762570+0000", 2024-09-12T17:06:10.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001475315 2024-09-12T17:06:10.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762671+0000", 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010115600000000001 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:461 6.1 e36/30 6:80b6fe23:reshard::reshard.0000000011:head v 36'3, mlcod=36'1)", 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.775384+0000", 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.529783145, 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002057835, 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.394 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.395 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.395 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775384+0000", 2024-09-12T17:06:10.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775384+0000", 2024-09-12T17:06:10.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775386+0000", 2024-09-12T17:06:10.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.849e-06 2024-09-12T17:06:10.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775397+0000", 2024-09-12T17:06:10.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1197e-05 2024-09-12T17:06:10.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775424+0000", 2024-09-12T17:06:10.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.633e-05 2024-09-12T17:06:10.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775440+0000", 2024-09-12T17:06:10.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.643e-05 2024-09-12T17:06:10.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775581+0000", 2024-09-12T17:06:10.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141309 2024-09-12T17:06:10.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775647+0000", 2024-09-12T17:06:10.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5321999999999996e-05 2024-09-12T17:06:10.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.777337+0000", 2024-09-12T17:06:10.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001690422 2024-09-12T17:06:10.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.777442+0000", 2024-09-12T17:06:10.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010497600000000001 2024-09-12T17:06:10.399 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.399 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.399 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.400 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:466 6.1 e36/30 6:80b6fe23:reshard::reshard.0000000011:head v 36'4, mlcod=36'2)", 2024-09-12T17:06:10.400 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.778592+0000", 2024-09-12T17:06:10.400 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.526575902999999, 2024-09-12T17:06:10.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018789340000000001, 2024-09-12T17:06:10.400 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.400 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.400 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.400 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778592+0000", 2024-09-12T17:06:10.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778592+0000", 2024-09-12T17:06:10.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778594+0000", 2024-09-12T17:06:10.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.317e-06 2024-09-12T17:06:10.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778608+0000", 2024-09-12T17:06:10.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3876999999999999e-05 2024-09-12T17:06:10.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778633+0000", 2024-09-12T17:06:10.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5282999999999998e-05 2024-09-12T17:06:10.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778650+0000", 2024-09-12T17:06:10.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6731e-05 2024-09-12T17:06:10.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778876+0000", 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022571099999999999 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778907+0000", 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1906000000000003e-05 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.780381+0000", 2024-09-12T17:06:10.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014737979999999999 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.780471+0000", 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9310999999999999e-05 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:754 6.a e36/30 6:576130b8:::obj_delete_at_hint.0000000059:head v 36'8, mlcod=36'6)", 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.056368+0000", 2024-09-12T17:06:10.405 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.248799414, 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001746404, 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056368+0000", 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056368+0000", 2024-09-12T17:06:10.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056370+0000", 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1119999999999999e-06 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056384+0000", 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3935e-05 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056416+0000", 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1544999999999997e-05 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056433+0000", 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7108999999999998e-05 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056590+0000", 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015706699999999999 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056660+0000", 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0396999999999997e-05 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.058012+0000", 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013513990000000001 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.058114+0000", 2024-09-12T17:06:10.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010284 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:928 6.1e e36/30 6:7adbb485:::obj_delete_at_hint.0000000117:head v 36'9, mlcod=36'7)", 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.477128+0000", 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.828039325000001, 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00171068, 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477128+0000", 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477128+0000", 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477130+0000", 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.317e-06 2024-09-12T17:06:10.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477143+0000", 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2276000000000001e-05 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477172+0000", 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8966999999999999e-05 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477185+0000", 2024-09-12T17:06:10.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2996999999999999e-05 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477348+0000", 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016369900000000001 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477410+0000", 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1384999999999996e-05 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.478750+0000", 2024-09-12T17:06:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013406869999999999 2024-09-12T17:06:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.478839+0000", 2024-09-12T17:06:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8351999999999997e-05 2024-09-12T17:06:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.414 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.414 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:10.416 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:06:10.416 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:10.417+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:10.516 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:10.517+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:10.589 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:10.589 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:06:10.590 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:10.603 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:06:10.644 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:10.645+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:10.658 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T17:06:10.718 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:10.717+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:10.764 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:10.764 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:10.764 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:10.778 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:06:10.819 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:10.813+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:10.919 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:10.917+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:10.953 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:06:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:06:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:06:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:06:10.953 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.772085783000001, 2024-09-12T17:06:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.51115267600000003, 2024-09-12T17:06:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T17:06:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178732+0000", 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:06:10.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178746+0000", 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4273e-05 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178768+0000", 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2246e-05 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178786+0000", 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7354e-05 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.179126+0000", 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034083699999999998 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.179140+0000", 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3879999999999999e-05 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.686346+0000", 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.50720528799999998 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.686808+0000", 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046207300000000002 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.687360+0000", 2024-09-12T17:06:10.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055267599999999999 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689052+0000", 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016913329999999999 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689665+0000", 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00061308200000000004 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689763+0000", 2024-09-12T17:06:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8048999999999996e-05 2024-09-12T17:06:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689882+0000", 2024-09-12T17:06:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119252 2024-09-12T17:06:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.960 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833597+0000", 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.117218121999997, 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015512720000000001, 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 47 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833597+0000", 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833597+0000", 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833598+0000", 2024-09-12T17:06:10.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1299999999999999e-07 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833744+0000", 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145702 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833768+0000", 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4947e-05 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833789+0000", 2024-09-12T17:06:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0177e-05 2024-09-12T17:06:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.844353+0000", 2024-09-12T17:06:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010564634999999999 2024-09-12T17:06:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.844518+0000", 2024-09-12T17:06:10.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016429199999999999 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.844857+0000", 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033895399999999998 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.848742+0000", 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003885983 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:10.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.848899+0000", 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000156572 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849017+0000", 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117852 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849110+0000", 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2893000000000007e-05 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.966 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833827+0000", 2024-09-12T17:06:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.116987794000003, 2024-09-12T17:06:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015427058, 2024-09-12T17:06:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:10.967 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 48 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833827+0000", 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833827+0000", 2024-09-12T17:06:10.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833828+0000", 2024-09-12T17:06:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.08e-06 2024-09-12T17:06:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833836+0000", 2024-09-12T17:06:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0700000000000001e-06 2024-09-12T17:06:10.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833848+0000", 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2622999999999999e-05 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833857+0000", 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8899999999999996e-06 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.846379+0000", 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012521607000000001 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.846536+0000", 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000157732 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.846727+0000", 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190669 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.848846+0000", 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021189199999999998 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849137+0000", 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029135400000000002 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849200+0000", 2024-09-12T17:06:10.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3102999999999995e-05 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849254+0000", 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.401e-05 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:10.973 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.116943687999999, 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017063485, 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 49 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:10.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5700000000000002e-07 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833878+0000", 2024-09-12T17:06:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3800000000000002e-06 2024-09-12T17:06:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833887+0000", 2024-09-12T17:06:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369999999999992e-06 2024-09-12T17:06:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833908+0000", 2024-09-12T17:06:10.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0435999999999999e-05 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.847415+0000", 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013506676 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.847562+0000", 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147739 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.847819+0000", 2024-09-12T17:06:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025651500000000002 2024-09-12T17:06:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850751+0000", 2024-09-12T17:06:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00293202 2024-09-12T17:06:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850779+0000", 2024-09-12T17:06:10.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8606999999999999e-05 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850864+0000", 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4552e-05 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850935+0000", 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1066e-05 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.979 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833952+0000", 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.116863295000002, 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019704071, 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:10.980 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 50 2024-09-12T17:06:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833952+0000", 2024-09-12T17:06:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833952+0000", 2024-09-12T17:06:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833953+0000", 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0640000000000001e-06 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834044+0000", 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1192000000000004e-05 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834058+0000", 2024-09-12T17:06:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.348e-05 2024-09-12T17:06:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834066+0000", 2024-09-12T17:06:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7269999999999996e-06 2024-09-12T17:06:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849344+0000", 2024-09-12T17:06:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015277469 2024-09-12T17:06:10.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849467+0000", 2024-09-12T17:06:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012350499999999999 2024-09-12T17:06:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849674+0000", 2024-09-12T17:06:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020653800000000001 2024-09-12T17:06:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853306+0000", 2024-09-12T17:06:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036320189999999998 2024-09-12T17:06:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853421+0000", 2024-09-12T17:06:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011495200000000001 2024-09-12T17:06:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853493+0000", 2024-09-12T17:06:10.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1695999999999999e-05 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853656+0000", 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016342900000000001 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.834084+0000", 2024-09-12T17:06:10.986 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.116730726, 2024-09-12T17:06:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019740911, 2024-09-12T17:06:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 51 2024-09-12T17:06:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834084+0000", 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834084+0000", 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834085+0000", 2024-09-12T17:06:10.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834103+0000", 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7723e-05 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834115+0000", 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2023e-05 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834125+0000", 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5459999999999997e-06 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.851062+0000", 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016937163000000002 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.851313+0000", 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025102499999999999 2024-09-12T17:06:10.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.851589+0000", 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027657700000000002 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853401+0000", 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018117999999999999 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:10.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853667+0000", 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026570800000000002 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853768+0000", 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101662 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853825+0000", 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6929999999999999e-05 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.992 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.834139+0000", 2024-09-12T17:06:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.116676146000003, 2024-09-12T17:06:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019918142, 2024-09-12T17:06:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:10.993 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 52 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834139+0000", 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834139+0000", 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:10.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834140+0000", 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.13e-07 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834147+0000", 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:10.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834168+0000", 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1112999999999999e-05 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834182+0000", 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.852295+0000", 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018112817 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.852428+0000", 2024-09-12T17:06:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013252199999999999 2024-09-12T17:06:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.852646+0000", 2024-09-12T17:06:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021851499999999999 2024-09-12T17:06:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:10.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853854+0000", 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012082079999999999 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853922+0000", 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7939000000000001e-05 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.854002+0000", 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9845999999999994e-05 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.854057+0000", 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4948999999999999e-05 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:64 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 0~512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085667+0000", 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.865147784000001, 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015548268000000001, 2024-09-12T17:06:10.999 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 64 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085667+0000", 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085667+0000", 2024-09-12T17:06:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085669+0000", 2024-09-12T17:06:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.578e-06 2024-09-12T17:06:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085677+0000", 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2989999999999997e-06 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085695+0000", 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8074e-05 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085705+0000", 2024-09-12T17:06:11.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3700000000000001e-06 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085799+0000", 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4631999999999998e-05 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085888+0000", 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8164999999999994e-05 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086005+0000", 2024-09-12T17:06:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117886 2024-09-12T17:06:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088869+0000", 2024-09-12T17:06:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028639339999999998 2024-09-12T17:06:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101160+0000", 2024-09-12T17:06:11.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012290264 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101190+0000", 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0354000000000001e-05 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101216+0000", 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5712e-05 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.005 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:65 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085772+0000", 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.865043169000003, 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015620775999999999, 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.006 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 65 2024-09-12T17:06:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085772+0000", 2024-09-12T17:06:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085772+0000", 2024-09-12T17:06:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085773+0000", 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2440000000000001e-06 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085780+0000", 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.204e-06 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085794+0000", 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3899e-05 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085803+0000", 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2449999999999998e-06 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086444+0000", 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00064089500000000005 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086582+0000", 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013844399999999999 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086738+0000", 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015597300000000001 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090637+0000", 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003898721 2024-09-12T17:06:11.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101279+0000", 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010641958 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101354+0000", 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5264000000000003e-05 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101393+0000", 2024-09-12T17:06:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8928999999999999e-05 2024-09-12T17:06:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:66 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085836+0000", 2024-09-12T17:06:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.864979458000001, 2024-09-12T17:06:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015663347000000001, 2024-09-12T17:06:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.012 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 66 2024-09-12T17:06:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085836+0000", 2024-09-12T17:06:11.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085836+0000", 2024-09-12T17:06:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085837+0000", 2024-09-12T17:06:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.06e-06 2024-09-12T17:06:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085908+0000", 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0735999999999995e-05 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085921+0000", 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346000000000001e-05 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085929+0000", 2024-09-12T17:06:11.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4139999999999994e-06 2024-09-12T17:06:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.087208+0000", 2024-09-12T17:06:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012785369999999999 2024-09-12T17:06:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.087330+0000", 2024-09-12T17:06:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000122027 2024-09-12T17:06:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.087534+0000", 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020403199999999999 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091533+0000", 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039988439999999997 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101448+0000", 2024-09-12T17:06:11.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0099155319999999995 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101477+0000", 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9082e-05 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101499+0000", 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1736999999999999e-05 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.018 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085949+0000", 2024-09-12T17:06:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.864866085999999, 2024-09-12T17:06:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015624106, 2024-09-12T17:06:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.019 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 67 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085949+0000", 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085949+0000", 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085950+0000", 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4499999999999995e-07 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085956+0000", 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085969+0000", 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2529e-05 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085976+0000", 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0230000000000004e-06 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088269+0000", 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022934219999999998 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088376+0000", 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010649699999999999 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088487+0000", 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011079899999999999 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093209+0000", 2024-09-12T17:06:11.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047220589999999998 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101526+0000", 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083176799999999992 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101553+0000", 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7223e-05 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101573+0000", 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9731000000000001e-05 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086238+0000", 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.864577031000003, 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015404706000000001, 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.025 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 68 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086238+0000", 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086238+0000", 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086240+0000", 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1210000000000001e-06 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086248+0000", 2024-09-12T17:06:11.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0269999999999995e-06 2024-09-12T17:06:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086263+0000", 2024-09-12T17:06:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5047e-05 2024-09-12T17:06:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086273+0000", 2024-09-12T17:06:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.577e-06 2024-09-12T17:06:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088933+0000", 2024-09-12T17:06:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026599700000000002 2024-09-12T17:06:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089062+0000", 2024-09-12T17:06:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012944700000000001 2024-09-12T17:06:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089246+0000", 2024-09-12T17:06:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018397199999999999 2024-09-12T17:06:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093213+0000", 2024-09-12T17:06:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039662960000000002 2024-09-12T17:06:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101598+0000", 2024-09-12T17:06:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083858449999999994 2024-09-12T17:06:11.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101624+0000", 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5857e-05 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101643+0000", 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8547e-05 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.864513686000002, 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015412403, 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 69 2024-09-12T17:06:11.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.61e-07 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086429+0000", 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012675800000000001 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086444+0000", 2024-09-12T17:06:11.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5310000000000001e-05 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086457+0000", 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2317000000000001e-05 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089748+0000", 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032910679999999999 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089817+0000", 2024-09-12T17:06:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9136999999999999e-05 2024-09-12T17:06:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089924+0000", 2024-09-12T17:06:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107611 2024-09-12T17:06:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093216+0000", 2024-09-12T17:06:11.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032914419999999999 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101668+0000", 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0084523629999999992 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101694+0000", 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6202000000000001e-05 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101714+0000", 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9434000000000001e-05 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086485+0000", 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.864329939000001, 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015302071, 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.038 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 70 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086485+0000", 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086485+0000", 2024-09-12T17:06:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086486+0000", 2024-09-12T17:06:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1170000000000001e-06 2024-09-12T17:06:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086493+0000", 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5740000000000001e-06 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086505+0000", 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1562999999999999e-05 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086512+0000", 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8499999999999994e-06 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090668+0000", 2024-09-12T17:06:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041558280000000003 2024-09-12T17:06:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090802+0000", 2024-09-12T17:06:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013367199999999999 2024-09-12T17:06:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090997+0000", 2024-09-12T17:06:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019551400000000001 2024-09-12T17:06:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094672+0000", 2024-09-12T17:06:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036750749999999999 2024-09-12T17:06:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101741+0000", 2024-09-12T17:06:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0070688280000000001 2024-09-12T17:06:11.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101768+0000", 2024-09-12T17:06:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6676e-05 2024-09-12T17:06:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101787+0000", 2024-09-12T17:06:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9374000000000001e-05 2024-09-12T17:06:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.044 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086529+0000", 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.864285799000001, 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015328430000000001, 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.045 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 71 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086529+0000", 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086529+0000", 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086530+0000", 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2799999999999996e-07 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086534+0000", 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.104e-06 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086552+0000", 2024-09-12T17:06:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7716000000000001e-05 2024-09-12T17:06:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086569+0000", 2024-09-12T17:06:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6966e-05 2024-09-12T17:06:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091570+0000", 2024-09-12T17:06:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050011869999999998 2024-09-12T17:06:11.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091693+0000", 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012295700000000001 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091871+0000", 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017795899999999999 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094676+0000", 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028055089999999999 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101811+0000", 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0071346350000000003 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101836+0000", 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4592000000000001e-05 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101858+0000", 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2177000000000001e-05 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086581+0000", 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.864233769999998, 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015450432, 2024-09-12T17:06:11.051 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 72 2024-09-12T17:06:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086581+0000", 2024-09-12T17:06:11.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086581+0000", 2024-09-12T17:06:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086582+0000", 2024-09-12T17:06:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8599999999999998e-07 2024-09-12T17:06:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086664+0000", 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1930999999999999e-05 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086673+0000", 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3340000000000008e-06 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086682+0000", 2024-09-12T17:06:11.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6170000000000007e-06 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.092334+0000", 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056518610000000002 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.092402+0000", 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8198e-05 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.092510+0000", 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010851 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096201+0000", 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036908919999999999 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101929+0000", 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057277259999999998 2024-09-12T17:06:11.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101993+0000", 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4068999999999999e-05 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102032+0000", 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8807999999999998e-05 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.864113570999997, 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015429554, 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 73 2024-09-12T17:06:11.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5599999999999995e-07 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086709+0000", 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9659999999999999e-06 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086715+0000", 2024-09-12T17:06:11.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.361e-06 2024-09-12T17:06:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086721+0000", 2024-09-12T17:06:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3860000000000004e-06 2024-09-12T17:06:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093279+0000", 2024-09-12T17:06:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065577719999999999 2024-09-12T17:06:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093415+0000", 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013671899999999999 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093611+0000", 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019514700000000001 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096205+0000", 2024-09-12T17:06:11.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025945569999999999 2024-09-12T17:06:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102084+0000", 2024-09-12T17:06:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058785119999999998 2024-09-12T17:06:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102111+0000", 2024-09-12T17:06:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6970000000000001e-05 2024-09-12T17:06:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102131+0000", 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0608e-05 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.864085352000004, 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015560805, 2024-09-12T17:06:11.064 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 74 2024-09-12T17:06:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:11.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8099999999999998e-07 2024-09-12T17:06:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086733+0000", 2024-09-12T17:06:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.65e-06 2024-09-12T17:06:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086740+0000", 2024-09-12T17:06:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6200000000000001e-06 2024-09-12T17:06:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086744+0000", 2024-09-12T17:06:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3239999999999996e-06 2024-09-12T17:06:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094098+0000", 2024-09-12T17:06:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0073542909999999998 2024-09-12T17:06:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094177+0000", 2024-09-12T17:06:11.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9290999999999997e-05 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094286+0000", 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000108646 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096213+0000", 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001926587 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102201+0000", 2024-09-12T17:06:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059879360000000001 2024-09-12T17:06:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102250+0000", 2024-09-12T17:06:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9882000000000001e-05 2024-09-12T17:06:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102291+0000", 2024-09-12T17:06:11.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0197000000000002e-05 2024-09-12T17:06:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.864063266999999, 2024-09-12T17:06:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015655273000000001, 2024-09-12T17:06:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.071 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 75 2024-09-12T17:06:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3299999999999998e-07 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086811+0000", 2024-09-12T17:06:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9194000000000003e-05 2024-09-12T17:06:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086819+0000", 2024-09-12T17:06:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7640000000000005e-06 2024-09-12T17:06:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086826+0000", 2024-09-12T17:06:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.126e-06 2024-09-12T17:06:11.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094745+0000", 2024-09-12T17:06:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0079189989999999995 2024-09-12T17:06:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094870+0000", 2024-09-12T17:06:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012493500000000001 2024-09-12T17:06:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095045+0000", 2024-09-12T17:06:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000174465 2024-09-12T17:06:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096216+0000", 2024-09-12T17:06:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001171014 2024-09-12T17:06:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102355+0000", 2024-09-12T17:06:11.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061392579999999999 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102383+0000", 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8308000000000001e-05 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102407+0000", 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3876999999999999e-05 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.077 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086838+0000", 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.863976999000002, 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015725032, 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:11.078 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 76 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086838+0000", 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086838+0000", 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086839+0000", 2024-09-12T17:06:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1399999999999997e-07 2024-09-12T17:06:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086842+0000", 2024-09-12T17:06:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0920000000000002e-06 2024-09-12T17:06:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:11.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086848+0000", 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.674e-06 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086852+0000", 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8909999999999997e-06 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095627+0000", 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087745189999999997 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095713+0000", 2024-09-12T17:06:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5958000000000006e-05 2024-09-12T17:06:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095824+0000", 2024-09-12T17:06:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011079 2024-09-12T17:06:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096550+0000", 2024-09-12T17:06:11.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00072662200000000001 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102471+0000", 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059210419999999996 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102533+0000", 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1321000000000005e-05 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:11.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102563+0000", 2024-09-12T17:06:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0608999999999998e-05 2024-09-12T17:06:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:11.084 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:11.084 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:11.085 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:06:11.086 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:11.081+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:11.187 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:11.185+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:11.220 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:11.221 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:11.221 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:11.221 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:11.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:06:11.288 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:11.289+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:11.360 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:11.360 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:11.360 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:11.360 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:11.360 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:11.374 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:06:11.389 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:11.389+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:11.490 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:11.489+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:11.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:06:11.504 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.504 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:64 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'40)", 2024-09-12T17:06:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.415402538000002, 2024-09-12T17:06:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014733802000000001, 2024-09-12T17:06:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084341+0000", 2024-09-12T17:06:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9700000000000002e-06 2024-09-12T17:06:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084353+0000", 2024-09-12T17:06:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2279999999999999e-05 2024-09-12T17:06:11.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084382+0000", 2024-09-12T17:06:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9179e-05 2024-09-12T17:06:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084395+0000", 2024-09-12T17:06:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.322e-05 2024-09-12T17:06:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084525+0000", 2024-09-12T17:06:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129789 2024-09-12T17:06:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084582+0000", 2024-09-12T17:06:11.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6486000000000001e-05 2024-09-12T17:06:11.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099005+0000", 2024-09-12T17:06:11.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014423689 2024-09-12T17:06:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099073+0000", 2024-09-12T17:06:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7188999999999997e-05 2024-09-12T17:06:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.511 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:65 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'40)", 2024-09-12T17:06:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:11.512 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.414581538, 2024-09-12T17:06:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013950562, 2024-09-12T17:06:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085162+0000", 2024-09-12T17:06:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0099999999999998e-06 2024-09-12T17:06:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085174+0000", 2024-09-12T17:06:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2223e-05 2024-09-12T17:06:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085222+0000", 2024-09-12T17:06:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8029999999999999e-05 2024-09-12T17:06:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085237+0000", 2024-09-12T17:06:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4666e-05 2024-09-12T17:06:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085428+0000", 2024-09-12T17:06:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019164900000000001 2024-09-12T17:06:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085488+0000", 2024-09-12T17:06:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0149000000000003e-05 2024-09-12T17:06:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099075+0000", 2024-09-12T17:06:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013587042000000001 2024-09-12T17:06:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099110+0000", 2024-09-12T17:06:11.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4792999999999997e-05 2024-09-12T17:06:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:66 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T17:06:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.413789418, 2024-09-12T17:06:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013198259, 2024-09-12T17:06:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.518 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085954+0000", 2024-09-12T17:06:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0530000000000001e-06 2024-09-12T17:06:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086013+0000", 2024-09-12T17:06:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8854000000000003e-05 2024-09-12T17:06:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086045+0000", 2024-09-12T17:06:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2672999999999997e-05 2024-09-12T17:06:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086058+0000", 2024-09-12T17:06:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.306e-05 2024-09-12T17:06:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086438+0000", 2024-09-12T17:06:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037959300000000001 2024-09-12T17:06:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086495+0000", 2024-09-12T17:06:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6679999999999999e-05 2024-09-12T17:06:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099115+0000", 2024-09-12T17:06:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012620256 2024-09-12T17:06:11.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099150+0000", 2024-09-12T17:06:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5089999999999998e-05 2024-09-12T17:06:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:67 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'45, mlcod=17'40)", 2024-09-12T17:06:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:11.523 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.412872538000002, 2024-09-12T17:06:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012332911, 2024-09-12T17:06:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:11.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086871+0000", 2024-09-12T17:06:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.063e-06 2024-09-12T17:06:11.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086884+0000", 2024-09-12T17:06:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.294e-05 2024-09-12T17:06:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086970+0000", 2024-09-12T17:06:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6312999999999998e-05 2024-09-12T17:06:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086990+0000", 2024-09-12T17:06:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9602999999999998e-05 2024-09-12T17:06:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087863+0000", 2024-09-12T17:06:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087312999999999996 2024-09-12T17:06:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087915+0000", 2024-09-12T17:06:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2516000000000003e-05 2024-09-12T17:06:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099152+0000", 2024-09-12T17:06:11.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011237 2024-09-12T17:06:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099202+0000", 2024-09-12T17:06:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9345999999999998e-05 2024-09-12T17:06:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.529 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'46, mlcod=17'40)", 2024-09-12T17:06:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.412153582999998, 2024-09-12T17:06:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011670056, 2024-09-12T17:06:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:11.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087590+0000", 2024-09-12T17:06:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.956e-06 2024-09-12T17:06:11.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087602+0000", 2024-09-12T17:06:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1939999999999999e-05 2024-09-12T17:06:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087630+0000", 2024-09-12T17:06:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8736000000000001e-05 2024-09-12T17:06:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087652+0000", 2024-09-12T17:06:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1693000000000001e-05 2024-09-12T17:06:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088864+0000", 2024-09-12T17:06:11.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001211578 2024-09-12T17:06:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088939+0000", 2024-09-12T17:06:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5885999999999998e-05 2024-09-12T17:06:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099206+0000", 2024-09-12T17:06:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010266287000000001 2024-09-12T17:06:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099258+0000", 2024-09-12T17:06:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.198e-05 2024-09-12T17:06:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'47, mlcod=17'40)", 2024-09-12T17:06:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.411412255999998, 2024-09-12T17:06:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010963379000000001, 2024-09-12T17:06:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.536 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:11.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088331+0000", 2024-09-12T17:06:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T17:06:11.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088388+0000", 2024-09-12T17:06:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7274000000000001e-05 2024-09-12T17:06:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088418+0000", 2024-09-12T17:06:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9609000000000001e-05 2024-09-12T17:06:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088439+0000", 2024-09-12T17:06:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0820000000000001e-05 2024-09-12T17:06:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090024+0000", 2024-09-12T17:06:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001585588 2024-09-12T17:06:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090090+0000", 2024-09-12T17:06:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5660000000000005e-05 2024-09-12T17:06:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099260+0000", 2024-09-12T17:06:11.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091697050000000002 2024-09-12T17:06:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099292+0000", 2024-09-12T17:06:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2750000000000003e-05 2024-09-12T17:06:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'48, mlcod=17'40)", 2024-09-12T17:06:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.410332941, 2024-09-12T17:06:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0099341629999999993, 2024-09-12T17:06:11.544 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:11.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089410+0000", 2024-09-12T17:06:11.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9740000000000001e-06 2024-09-12T17:06:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089424+0000", 2024-09-12T17:06:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4036000000000001e-05 2024-09-12T17:06:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089466+0000", 2024-09-12T17:06:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1563000000000002e-05 2024-09-12T17:06:11.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089492+0000", 2024-09-12T17:06:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5812999999999998e-05 2024-09-12T17:06:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091523+0000", 2024-09-12T17:06:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002030895 2024-09-12T17:06:11.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091564+0000", 2024-09-12T17:06:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1263000000000001e-05 2024-09-12T17:06:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099294+0000", 2024-09-12T17:06:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0077302400000000002 2024-09-12T17:06:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099342+0000", 2024-09-12T17:06:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8378999999999999e-05 2024-09-12T17:06:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:71 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'49, mlcod=17'40)", 2024-09-12T17:06:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.409525932999998, 2024-09-12T17:06:11.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0092012150000000004, 2024-09-12T17:06:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090217+0000", 2024-09-12T17:06:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090229+0000", 2024-09-12T17:06:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090261+0000", 2024-09-12T17:06:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1986999999999997e-05 2024-09-12T17:06:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090280+0000", 2024-09-12T17:06:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8536e-05 2024-09-12T17:06:11.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092530+0000", 2024-09-12T17:06:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022498959999999999 2024-09-12T17:06:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092588+0000", 2024-09-12T17:06:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8276000000000002e-05 2024-09-12T17:06:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099345+0000", 2024-09-12T17:06:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006757028 2024-09-12T17:06:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099417+0000", 2024-09-12T17:06:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1645999999999998e-05 2024-09-12T17:06:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:72 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'50, mlcod=17'40)", 2024-09-12T17:06:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.408857681999997, 2024-09-12T17:06:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085677930000000006, 2024-09-12T17:06:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:11.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090885+0000", 2024-09-12T17:06:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3799999999999999e-06 2024-09-12T17:06:11.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090938+0000", 2024-09-12T17:06:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3013000000000002e-05 2024-09-12T17:06:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090965+0000", 2024-09-12T17:06:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6610000000000001e-05 2024-09-12T17:06:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090979+0000", 2024-09-12T17:06:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4113e-05 2024-09-12T17:06:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093482+0000", 2024-09-12T17:06:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025028870000000001 2024-09-12T17:06:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093573+0000", 2024-09-12T17:06:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0989999999999994e-05 2024-09-12T17:06:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099418+0000", 2024-09-12T17:06:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058459109999999996 2024-09-12T17:06:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099451+0000", 2024-09-12T17:06:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2889000000000003e-05 2024-09-12T17:06:11.560 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:73 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'51, mlcod=17'40)", 2024-09-12T17:06:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.407745521000002, 2024-09-12T17:06:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075262419999999998, 2024-09-12T17:06:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.561 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091998+0000", 2024-09-12T17:06:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.894e-06 2024-09-12T17:06:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092010+0000", 2024-09-12T17:06:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2176e-05 2024-09-12T17:06:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092043+0000", 2024-09-12T17:06:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3226999999999999e-05 2024-09-12T17:06:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092062+0000", 2024-09-12T17:06:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9453000000000002e-05 2024-09-12T17:06:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.095140+0000", 2024-09-12T17:06:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00307792 2024-09-12T17:06:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.095196+0000", 2024-09-12T17:06:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6008999999999999e-05 2024-09-12T17:06:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099453+0000", 2024-09-12T17:06:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042563899999999997 2024-09-12T17:06:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099522+0000", 2024-09-12T17:06:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9172999999999997e-05 2024-09-12T17:06:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:74 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'52, mlcod=17'40)", 2024-09-12T17:06:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.407140208999998, 2024-09-12T17:06:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0069855890000000004, 2024-09-12T17:06:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092603+0000", 2024-09-12T17:06:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0099999999999998e-06 2024-09-12T17:06:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092618+0000", 2024-09-12T17:06:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.469e-05 2024-09-12T17:06:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092647+0000", 2024-09-12T17:06:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9107000000000001e-05 2024-09-12T17:06:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092660+0000", 2024-09-12T17:06:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.347e-05 2024-09-12T17:06:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.096074+0000", 2024-09-12T17:06:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034132300000000002 2024-09-12T17:06:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.096158+0000", 2024-09-12T17:06:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4863000000000004e-05 2024-09-12T17:06:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099524+0000", 2024-09-12T17:06:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033656670000000001 2024-09-12T17:06:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099587+0000", 2024-09-12T17:06:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2551999999999993e-05 2024-09-12T17:06:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:75 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'40)", 2024-09-12T17:06:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.406314115000001, 2024-09-12T17:06:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006221725, 2024-09-12T17:06:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093429+0000", 2024-09-12T17:06:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1299999999999999e-06 2024-09-12T17:06:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093522+0000", 2024-09-12T17:06:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2236000000000003e-05 2024-09-12T17:06:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093562+0000", 2024-09-12T17:06:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0386000000000003e-05 2024-09-12T17:06:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093576+0000", 2024-09-12T17:06:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4154e-05 2024-09-12T17:06:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.097039+0000", 2024-09-12T17:06:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034632629999999998 2024-09-12T17:06:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.097092+0000", 2024-09-12T17:06:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2918999999999999e-05 2024-09-12T17:06:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099591+0000", 2024-09-12T17:06:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024984310000000002 2024-09-12T17:06:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099649+0000", 2024-09-12T17:06:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8205999999999998e-05 2024-09-12T17:06:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:76 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'40)", 2024-09-12T17:06:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.405589284000001, 2024-09-12T17:06:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057612949999999996, 2024-09-12T17:06:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094154+0000", 2024-09-12T17:06:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2699999999999999e-06 2024-09-12T17:06:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094169+0000", 2024-09-12T17:06:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4296e-05 2024-09-12T17:06:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094203+0000", 2024-09-12T17:06:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3980000000000003e-05 2024-09-12T17:06:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094220+0000", 2024-09-12T17:06:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7337e-05 2024-09-12T17:06:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.098459+0000", 2024-09-12T17:06:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004238917 2024-09-12T17:06:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.098495+0000", 2024-09-12T17:06:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6662999999999998e-05 2024-09-12T17:06:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099861+0000", 2024-09-12T17:06:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013660359999999999 2024-09-12T17:06:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099913+0000", 2024-09-12T17:06:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1795999999999997e-05 2024-09-12T17:06:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:77 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'55, mlcod=17'53)", 2024-09-12T17:06:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.398239081, 2024-09-12T17:06:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030906760000000001, 2024-09-12T17:06:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101504+0000", 2024-09-12T17:06:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.353e-06 2024-09-12T17:06:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101585+0000", 2024-09-12T17:06:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1576000000000006e-05 2024-09-12T17:06:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101614+0000", 2024-09-12T17:06:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9133e-05 2024-09-12T17:06:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101627+0000", 2024-09-12T17:06:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3253e-05 2024-09-12T17:06:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101727+0000", 2024-09-12T17:06:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9569999999999997e-05 2024-09-12T17:06:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101764+0000", 2024-09-12T17:06:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6495999999999998e-05 2024-09-12T17:06:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.104506+0000", 2024-09-12T17:06:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027422660000000001 2024-09-12T17:06:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.104593+0000", 2024-09-12T17:06:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7028999999999996e-05 2024-09-12T17:06:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.915264861000001, 2024-09-12T17:06:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036836849999999999, 2024-09-12T17:06:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 206 2024-09-12T17:06:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584480+0000", 2024-09-12T17:06:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4860000000000002e-06 2024-09-12T17:06:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584496+0000", 2024-09-12T17:06:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5883999999999999e-05 2024-09-12T17:06:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584534+0000", 2024-09-12T17:06:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8089000000000001e-05 2024-09-12T17:06:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584551+0000", 2024-09-12T17:06:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7220000000000001e-05 2024-09-12T17:06:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584691+0000", 2024-09-12T17:06:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013991599999999999 2024-09-12T17:06:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584957+0000", 2024-09-12T17:06:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000266161 2024-09-12T17:06:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.585389+0000", 2024-09-12T17:06:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00043172399999999997 2024-09-12T17:06:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.587593+0000", 2024-09-12T17:06:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022045160000000001 2024-09-12T17:06:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.587984+0000", 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039048099999999998 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588073+0000", 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8648999999999998e-05 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588160+0000", 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7559000000000007e-05 2024-09-12T17:06:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.897856356, 2024-09-12T17:06:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039464799999999996, 2024-09-12T17:06:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 210 2024-09-12T17:06:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601887+0000", 2024-09-12T17:06:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5170000000000002e-06 2024-09-12T17:06:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601899+0000", 2024-09-12T17:06:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1897e-05 2024-09-12T17:06:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601930+0000", 2024-09-12T17:06:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0190000000000001e-05 2024-09-12T17:06:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601945+0000", 2024-09-12T17:06:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5075999999999999e-05 2024-09-12T17:06:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.602115+0000", 2024-09-12T17:06:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016993600000000001 2024-09-12T17:06:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.602470+0000", 2024-09-12T17:06:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000355554 2024-09-12T17:06:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.603208+0000", 2024-09-12T17:06:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073791700000000004 2024-09-12T17:06:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.604956+0000", 2024-09-12T17:06:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00174832 2024-09-12T17:06:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605676+0000", 2024-09-12T17:06:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071966100000000002 2024-09-12T17:06:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605762+0000", 2024-09-12T17:06:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6159e-05 2024-09-12T17:06:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605831+0000", 2024-09-12T17:06:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9252999999999996e-05 2024-09-12T17:06:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.867871709999999, 2024-09-12T17:06:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033897799999999998, 2024-09-12T17:06:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 218 2024-09-12T17:06:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631872+0000", 2024-09-12T17:06:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9469999999999999e-06 2024-09-12T17:06:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631884+0000", 2024-09-12T17:06:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1823e-05 2024-09-12T17:06:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631916+0000", 2024-09-12T17:06:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1319999999999998e-05 2024-09-12T17:06:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631931+0000", 2024-09-12T17:06:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5299e-05 2024-09-12T17:06:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632074+0000", 2024-09-12T17:06:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142922 2024-09-12T17:06:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632301+0000", 2024-09-12T17:06:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022715600000000001 2024-09-12T17:06:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632716+0000", 2024-09-12T17:06:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041482900000000002 2024-09-12T17:06:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.634244+0000", 2024-09-12T17:06:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001528242 2024-09-12T17:06:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635103+0000", 2024-09-12T17:06:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085923399999999995 2024-09-12T17:06:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635189+0000", 2024-09-12T17:06:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5405e-05 2024-09-12T17:06:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635259+0000", 2024-09-12T17:06:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0603000000000001e-05 2024-09-12T17:06:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.852903326, 2024-09-12T17:06:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033001250000000001, 2024-09-12T17:06:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 222 2024-09-12T17:06:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646841+0000", 2024-09-12T17:06:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9969999999999999e-06 2024-09-12T17:06:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646853+0000", 2024-09-12T17:06:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2500000000000001e-05 2024-09-12T17:06:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646884+0000", 2024-09-12T17:06:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.048e-05 2024-09-12T17:06:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646899+0000", 2024-09-12T17:06:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4810000000000001e-05 2024-09-12T17:06:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647031+0000", 2024-09-12T17:06:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013203499999999999 2024-09-12T17:06:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647248+0000", 2024-09-12T17:06:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021723200000000001 2024-09-12T17:06:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647648+0000", 2024-09-12T17:06:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040051000000000003 2024-09-12T17:06:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.649222+0000", 2024-09-12T17:06:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015737150000000001 2024-09-12T17:06:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.649984+0000", 2024-09-12T17:06:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076208000000000005 2024-09-12T17:06:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.650070+0000", 2024-09-12T17:06:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6032999999999994e-05 2024-09-12T17:06:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.650138+0000", 2024-09-12T17:06:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7732999999999997e-05 2024-09-12T17:06:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.823015663, 2024-09-12T17:06:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041653740000000003, 2024-09-12T17:06:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 230 2024-09-12T17:06:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676728+0000", 2024-09-12T17:06:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4899999999999999e-06 2024-09-12T17:06:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676739+0000", 2024-09-12T17:06:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1226000000000001e-05 2024-09-12T17:06:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676770+0000", 2024-09-12T17:06:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0297000000000001e-05 2024-09-12T17:06:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676784+0000", 2024-09-12T17:06:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4796e-05 2024-09-12T17:06:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676940+0000", 2024-09-12T17:06:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015539300000000001 2024-09-12T17:06:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.677328+0000", 2024-09-12T17:06:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038856699999999998 2024-09-12T17:06:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.678139+0000", 2024-09-12T17:06:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081085 2024-09-12T17:06:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.679704+0000", 2024-09-12T17:06:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015644109999999999 2024-09-12T17:06:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680598+0000", 2024-09-12T17:06:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00089426999999999996 2024-09-12T17:06:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680767+0000", 2024-09-12T17:06:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016875500000000001 2024-09-12T17:06:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680891+0000", 2024-09-12T17:06:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012431899999999999 2024-09-12T17:06:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.545145164999999, 2024-09-12T17:06:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033901650000000001, 2024-09-12T17:06:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 712 2024-09-12T17:06:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954598+0000", 2024-09-12T17:06:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6249999999999999e-06 2024-09-12T17:06:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954605+0000", 2024-09-12T17:06:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7219999999999999e-06 2024-09-12T17:06:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954625+0000", 2024-09-12T17:06:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0013e-05 2024-09-12T17:06:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954635+0000", 2024-09-12T17:06:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2310000000000002e-06 2024-09-12T17:06:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954787+0000", 2024-09-12T17:06:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015215399999999999 2024-09-12T17:06:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.955172+0000", 2024-09-12T17:06:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038501699999999998 2024-09-12T17:06:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.955729+0000", 2024-09-12T17:06:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055745600000000001 2024-09-12T17:06:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.956989+0000", 2024-09-12T17:06:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012593179999999999 2024-09-12T17:06:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957706+0000", 2024-09-12T17:06:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000717477 2024-09-12T17:06:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957868+0000", 2024-09-12T17:06:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016208300000000001 2024-09-12T17:06:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957986+0000", 2024-09-12T17:06:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118069 2024-09-12T17:06:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:11.642 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:11.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:06:11.645 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:11.645+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:11.649 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:11.650 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:11.667 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:11.667 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:11.684 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:11.684 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:11.701 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:11.701 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:11.722 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:11.722 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:11.743 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:11.743 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:11.744 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:11.741+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:11.764 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:11.764 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:11.769 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:11.769 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:11.784 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:06:11.785 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:11.786 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:11.846 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:11.845+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:11.917 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:11.917 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:11.932 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:06:11.947 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:11.945+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:12.048 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:12.049+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:12.058 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:12.058 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:12.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:06:12.149 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:12.145+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:12.202 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:12.203 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:12.217 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:06:12.259 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:12.257+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:12.351 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:12.349+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:12.386 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:12.386 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:12.402 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:06:12.452 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:12.449+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:12.530 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:12.531 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:12.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:06:12.591 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:12.589+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:12.654 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:12.649+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:12.673 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:12.673 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:12.682 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T17:06:12.688 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:06:12.755 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:12.753+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:12.852 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:12.852 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:12.855 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:12.853+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:12.867 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:06:12.957 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:12.957+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:13.036 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:13.036 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:13.051 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:06:13.057 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:13.053+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:13.158 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:13.153+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:13.186 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:13.187 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:13.201 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:06:13.259 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:13.257+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:13.328 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:13.328 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:13.343 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:06:13.360 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:13.357+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:13.461 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:13.457+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:13.512 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:13.512 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:13.527 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:06:13.562 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:13.557+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:13.649 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:13.649 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:13.663 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T17:06:13.663 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:13.661+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:13.667 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:06:13.764 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:13.761+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:13.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:06:13.831 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:13.832 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:13.846 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:06:13.889 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:13.889+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:13.963 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:13.964 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:13.966 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:13.965+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:13.980 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:13.980 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:13.997 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:13.997 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:14.013 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:14.014 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:14.014 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:14.015 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:14.030 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:06:14.032 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:14.032 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:14.050 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:14.051 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:14.067 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:14.065+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:14.068 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:14.068 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:14.086 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:14.086 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:14.169 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:14.165+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:14.206 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:14.207 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:14.207 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:06:14.207 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:14.221 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:06:14.270 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:14.269+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:14.349 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:14.349 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:14.349 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:14.349 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:14.349 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:14.364 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:06:14.371 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:14.369+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:14.472 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:14.469+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:14.538 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:14.538 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:06:14.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:06:14.538 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.99997887, 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.040278856000000002, 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 46 2024-09-12T17:06:14.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.540 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:06:14.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:06:14.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537089+0000", 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3000000000000002e-06 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537103+0000", 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4097000000000001e-05 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537137+0000", 2024-09-12T17:06:14.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4079999999999999e-05 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537162+0000", 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4579999999999998e-05 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537327+0000", 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000165081 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537344+0000", 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7447000000000001e-05 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.552576+0000", 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015231339 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.552597+0000", 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0934e-05 2024-09-12T17:06:14.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.572608+0000", 2024-09-12T17:06:14.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020010917 2024-09-12T17:06:14.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.572902+0000", 2024-09-12T17:06:14.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029482400000000001 2024-09-12T17:06:14.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:14.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.573205+0000", 2024-09-12T17:06:14.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030300900000000003 2024-09-12T17:06:14.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:14.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.576854+0000", 2024-09-12T17:06:14.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003648966 2024-09-12T17:06:14.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:14.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577088+0000", 2024-09-12T17:06:14.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023368099999999999 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577216+0000", 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012821600000000001 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577365+0000", 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014838500000000001 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.546 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117020027008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.577764+0000", 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.959300781, 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026568799999999999, 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:14.547 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 47 2024-09-12T17:06:14.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.548 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577764+0000", 2024-09-12T17:06:14.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577764+0000", 2024-09-12T17:06:14.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577767+0000", 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8289999999999999e-06 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577778+0000", 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1415e-05 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577803+0000", 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5341999999999999e-05 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577837+0000", 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3825000000000002e-05 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577938+0000", 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100301 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.578111+0000", 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017378399999999999 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.578414+0000", 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030282399999999999 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.579488+0000", 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001074242 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.580119+0000", 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063073299999999997 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.580242+0000", 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012259900000000001 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.580421+0000", 2024-09-12T17:06:14.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017898600000000001 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.586577+0000", 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.950487708000001, 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023422579999999998, 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.553 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 54 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586577+0000", 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586577+0000", 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586579+0000", 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4940000000000002e-06 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586591+0000", 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1116e-05 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586625+0000", 2024-09-12T17:06:14.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4779e-05 2024-09-12T17:06:14.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586641+0000", 2024-09-12T17:06:14.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5466999999999999e-05 2024-09-12T17:06:14.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586743+0000", 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010244 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586882+0000", 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000139121 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.587026+0000", 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014360299999999999 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.587909+0000", 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00088268000000000005 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.588722+0000", 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081364700000000002 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.588802+0000", 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9661999999999997e-05 2024-09-12T17:06:14.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.588919+0000", 2024-09-12T17:06:14.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117249 2024-09-12T17:06:14.559 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.559 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.559 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.559 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117020030464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:14.559 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.589104+0000", 2024-09-12T17:06:14.559 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.947960408, 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024774900000000002, 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589104+0000", 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589104+0000", 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589106+0000", 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0269999999999998e-06 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589117+0000", 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0647e-05 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589144+0000", 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6916000000000001e-05 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589160+0000", 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6123000000000001e-05 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589267+0000", 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107373 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589400+0000", 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000132762 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589651+0000", 2024-09-12T17:06:14.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025080799999999999 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.590859+0000", 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001208317 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.591421+0000", 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056174100000000004 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.591495+0000", 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4245000000000005e-05 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.591582+0000", 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6531000000000002e-05 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:191 6.5 e33/30 6:a2ace8b3:::data_log.0:head v 33'1, mlcod=0'0)", 2024-09-12T17:06:14.565 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.682203+0000", 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.854861782, 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017792789999999999, 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682203+0000", 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682203+0000", 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682205+0000", 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0829999999999998e-06 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682219+0000", 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4413000000000001e-05 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682254+0000", 2024-09-12T17:06:14.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4659000000000001e-05 2024-09-12T17:06:14.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682274+0000", 2024-09-12T17:06:14.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9959999999999999e-05 2024-09-12T17:06:14.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682455+0000", 2024-09-12T17:06:14.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018075900000000001 2024-09-12T17:06:14.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682508+0000", 2024-09-12T17:06:14.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2785999999999999e-05 2024-09-12T17:06:14.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.683904+0000", 2024-09-12T17:06:14.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001396696 2024-09-12T17:06:14.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.683982+0000", 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7923000000000006e-05 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:209 6.3 e36/30 6:c60da066:gc::gc.4:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.601065+0000", 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.935999778999999, 2024-09-12T17:06:14.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021210780000000002, 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601065+0000", 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601065+0000", 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601066+0000", 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1399999999999996e-07 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601077+0000", 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1253000000000001e-05 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601115+0000", 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7902999999999999e-05 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601139+0000", 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3913e-05 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601323+0000", 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018393899999999999 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601373+0000", 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9873000000000002e-05 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.603095+0000", 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017221859999999999 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.603186+0000", 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1197000000000001e-05 2024-09-12T17:06:14.574 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:217 6.15 e36/30 6:ab569f81:gc::gc.12:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.631481+0000", 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.905583387, 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018198859999999999, 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631481+0000", 2024-09-12T17:06:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631481+0000", 2024-09-12T17:06:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631483+0000", 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.823e-06 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631496+0000", 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.313e-05 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631525+0000", 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8297e-05 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631539+0000", 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4212999999999999e-05 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631683+0000", 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143883 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631740+0000", 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7315000000000003e-05 2024-09-12T17:06:14.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.633227+0000", 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001486596 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.633301+0000", 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4629000000000007e-05 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:221 6.3 e36/30 6:c623b173:gc::gc.16:head v 36'3, mlcod=36'1)", 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.646376+0000", 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.890688612, 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018164660000000001, 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646376+0000", 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646376+0000", 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646378+0000", 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646390+0000", 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.153e-05 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646418+0000", 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8133e-05 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646431+0000", 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3044000000000001e-05 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646574+0000", 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014290200000000001 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646637+0000", 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3736000000000001e-05 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.648113+0000", 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014753189999999999 2024-09-12T17:06:14.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.648192+0000", 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9841999999999999e-05 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:226 6.a e36/30 6:5127e642:gc::gc.21:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.665705+0000", 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.871359893999999, 2024-09-12T17:06:14.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001702823, 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665705+0000", 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665705+0000", 2024-09-12T17:06:14.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665705+0000", 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9299999999999998e-07 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665712+0000", 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0230000000000004e-06 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665739+0000", 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7007000000000001e-05 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665753+0000", 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3226e-05 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665871+0000", 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118529 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665900+0000", 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9073000000000001e-05 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.667322+0000", 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001421919 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.667408+0000", 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5452999999999997e-05 2024-09-12T17:06:14.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:303 6.1 e36/30 6:856b9b26:reshard::reshard.0000000002:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.721622+0000", 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.815442653, 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001801743, 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721622+0000", 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721622+0000", 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721623+0000", 2024-09-12T17:06:14.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.37e-07 2024-09-12T17:06:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721632+0000", 2024-09-12T17:06:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8300000000000002e-06 2024-09-12T17:06:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721659+0000", 2024-09-12T17:06:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7503000000000001e-05 2024-09-12T17:06:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721677+0000", 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8050000000000002e-05 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721804+0000", 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000127262 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721849+0000", 2024-09-12T17:06:14.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4496000000000002e-05 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723309+0000", 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014601760000000001 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723424+0000", 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000114689 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.595 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:318 6.1 e36/30 6:856b9b26:reshard::reshard.0000000002:head v 36'2, mlcod=0'0)", 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.724965+0000", 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.812099718000001, 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001908412, 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724965+0000", 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724965+0000", 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724967+0000", 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1069999999999999e-06 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724979+0000", 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.183e-05 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725006+0000", 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7432000000000001e-05 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725020+0000", 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3573e-05 2024-09-12T17:06:14.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725179+0000", 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015895899999999999 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725236+0000", 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7163999999999997e-05 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.726797+0000", 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015610439999999999 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.726873+0000", 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6303000000000005e-05 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:350 6.5 e36/30 6:a60f9269:lc::lua_package_allowlist:head v 36'2, mlcod=0'0)", 2024-09-12T17:06:14.600 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.732394+0000", 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.804670623, 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033606479999999999, 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732394+0000", 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732394+0000", 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732396+0000", 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2199999999999999e-06 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732411+0000", 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4450000000000001e-05 2024-09-12T17:06:14.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732445+0000", 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4427000000000001e-05 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732465+0000", 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0047e-05 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732619+0000", 2024-09-12T17:06:14.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015389200000000001 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732677+0000", 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7671999999999999e-05 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735650+0000", 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002973594 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735755+0000", 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010434599999999999 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:360 6.3 e36/30 6:c3a682d4:reshard::reshard.0000000004:head v 36'4, mlcod=36'2)", 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.735399+0000", 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.801665672, 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017447630000000001, 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.605 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735399+0000", 2024-09-12T17:06:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735399+0000", 2024-09-12T17:06:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735432+0000", 2024-09-12T17:06:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3420000000000002e-05 2024-09-12T17:06:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735446+0000", 2024-09-12T17:06:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3196e-05 2024-09-12T17:06:14.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735473+0000", 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6950000000000001e-05 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735494+0000", 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1282999999999999e-05 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735638+0000", 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000144635 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735691+0000", 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2176999999999999e-05 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737025+0000", 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001334163 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737144+0000", 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011893899999999999 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:368 6.5 e36/30 6:a60f9269:lc::lua_package_allowlist:head v 36'3, mlcod=33'1)", 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.737977+0000", 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.799087348, 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017574159999999999, 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.610 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737977+0000", 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737977+0000", 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737979+0000", 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0159999999999998e-06 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737993+0000", 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3937000000000001e-05 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738029+0000", 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5302999999999997e-05 2024-09-12T17:06:14.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738047+0000", 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8919999999999998e-05 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738203+0000", 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015550500000000001 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738258+0000", 2024-09-12T17:06:14.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5303000000000002e-05 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739627+0000", 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013687160000000001 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739735+0000", 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107716 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.614 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:374 6.c e36/30 6:3677c228:::obj_delete_at_hint.0000000006:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.738951+0000", 2024-09-12T17:06:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.798113613, 2024-09-12T17:06:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019538120000000001, 2024-09-12T17:06:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738951+0000", 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738951+0000", 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738953+0000", 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.12e-06 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738967+0000", 2024-09-12T17:06:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4324e-05 2024-09-12T17:06:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738996+0000", 2024-09-12T17:06:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8572999999999999e-05 2024-09-12T17:06:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739017+0000", 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0826e-05 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739175+0000", 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000157675 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739223+0000", 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8059999999999997e-05 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.740818+0000", 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015950910000000001 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.740905+0000", 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7143000000000002e-05 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:433 6.a e36/30 6:50d64734:::obj_delete_at_hint.0000000009:head v 36'5, mlcod=36'3)", 2024-09-12T17:06:14.619 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.760784+0000", 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.776280972, 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018873760000000001, 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760784+0000", 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760784+0000", 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760786+0000", 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.39e-06 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760828+0000", 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1814000000000003e-05 2024-09-12T17:06:14.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760862+0000", 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3682e-05 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760881+0000", 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9017000000000001e-05 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.761032+0000", 2024-09-12T17:06:14.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000151142 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.761095+0000", 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2860000000000005e-05 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762570+0000", 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001475315 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762671+0000", 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010115600000000001 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:461 6.1 e36/30 6:80b6fe23:reshard::reshard.0000000011:head v 36'3, mlcod=36'1)", 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.775384+0000", 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.761680294, 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002057835, 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.624 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775384+0000", 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775384+0000", 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775386+0000", 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.849e-06 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775397+0000", 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1197e-05 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775424+0000", 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.633e-05 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775440+0000", 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.643e-05 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775581+0000", 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141309 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775647+0000", 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5321999999999996e-05 2024-09-12T17:06:14.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.777337+0000", 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001690422 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.777442+0000", 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010497600000000001 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:466 6.1 e36/30 6:80b6fe23:reshard::reshard.0000000011:head v 36'4, mlcod=36'2)", 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.778592+0000", 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.758473051999999, 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018789340000000001, 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778592+0000", 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778592+0000", 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778594+0000", 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.317e-06 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778608+0000", 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3876999999999999e-05 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778633+0000", 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5282999999999998e-05 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778650+0000", 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6731e-05 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778876+0000", 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022571099999999999 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778907+0000", 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1906000000000003e-05 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.780381+0000", 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014737979999999999 2024-09-12T17:06:14.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.780471+0000", 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9310999999999999e-05 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:754 6.a e36/30 6:576130b8:::obj_delete_at_hint.0000000059:head v 36'8, mlcod=36'6)", 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.056368+0000", 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.480696563, 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001746404, 2024-09-12T17:06:14.633 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056368+0000", 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056368+0000", 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056370+0000", 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1119999999999999e-06 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056384+0000", 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3935e-05 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056416+0000", 2024-09-12T17:06:14.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1544999999999997e-05 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056433+0000", 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7108999999999998e-05 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056590+0000", 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015706699999999999 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056660+0000", 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0396999999999997e-05 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.058012+0000", 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013513990000000001 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.058114+0000", 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010284 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.637 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:928 6.1e e36/30 6:7adbb485:::obj_delete_at_hint.0000000117:head v 36'9, mlcod=36'7)", 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.477128+0000", 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.059936474000001, 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00171068, 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477128+0000", 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477128+0000", 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477130+0000", 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.317e-06 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477143+0000", 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2276000000000001e-05 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477172+0000", 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8966999999999999e-05 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477185+0000", 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2996999999999999e-05 2024-09-12T17:06:14.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477348+0000", 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016369900000000001 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477410+0000", 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1384999999999996e-05 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:14.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.478750+0000", 2024-09-12T17:06:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013406869999999999 2024-09-12T17:06:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.478839+0000", 2024-09-12T17:06:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8351999999999997e-05 2024-09-12T17:06:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:14.642 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:14.642 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:14.644 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:06:14.644 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:14.645+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:14.744 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:14.745+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:14.822 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:14.822 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:14.822 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:06:14.822 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:14.836 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:06:14.881 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:14.881+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:14.946 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:14.941+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:15.000 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:15.000 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:15.000 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:15.000 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:15.000 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:15.014 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:06:15.060 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:15.061+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:15.146 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:06:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:06:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:06:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.146 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:06:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.965102066999997, 2024-09-12T17:06:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.51115267600000003, 2024-09-12T17:06:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T17:06:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178732+0000", 2024-09-12T17:06:15.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178746+0000", 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4273e-05 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178768+0000", 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2246e-05 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178786+0000", 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7354e-05 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.179126+0000", 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034083699999999998 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.179140+0000", 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3879999999999999e-05 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.686346+0000", 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.50720528799999998 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.686808+0000", 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046207300000000002 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.687360+0000", 2024-09-12T17:06:15.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055267599999999999 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689052+0000", 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016913329999999999 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689665+0000", 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00061308200000000004 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689763+0000", 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8048999999999996e-05 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689882+0000", 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119252 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.153 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833597+0000", 2024-09-12T17:06:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.310234405999999, 2024-09-12T17:06:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015512720000000001, 2024-09-12T17:06:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 47 2024-09-12T17:06:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.154 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833597+0000", 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833597+0000", 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833598+0000", 2024-09-12T17:06:15.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1299999999999999e-07 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833744+0000", 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145702 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833768+0000", 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4947e-05 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833789+0000", 2024-09-12T17:06:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0177e-05 2024-09-12T17:06:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.844353+0000", 2024-09-12T17:06:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010564634999999999 2024-09-12T17:06:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.844518+0000", 2024-09-12T17:06:15.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016429199999999999 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.844857+0000", 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033895399999999998 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.848742+0000", 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003885983 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.848899+0000", 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000156572 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849017+0000", 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117852 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849110+0000", 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2893000000000007e-05 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.159 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833827+0000", 2024-09-12T17:06:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.310004077999999, 2024-09-12T17:06:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015427058, 2024-09-12T17:06:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.160 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 48 2024-09-12T17:06:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833827+0000", 2024-09-12T17:06:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833827+0000", 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833828+0000", 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.08e-06 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833836+0000", 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0700000000000001e-06 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833848+0000", 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2622999999999999e-05 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833857+0000", 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8899999999999996e-06 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.846379+0000", 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012521607000000001 2024-09-12T17:06:15.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.846536+0000", 2024-09-12T17:06:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000157732 2024-09-12T17:06:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.846727+0000", 2024-09-12T17:06:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190669 2024-09-12T17:06:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.848846+0000", 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021189199999999998 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849137+0000", 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029135400000000002 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849200+0000", 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3102999999999995e-05 2024-09-12T17:06:15.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849254+0000", 2024-09-12T17:06:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.401e-05 2024-09-12T17:06:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.166 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.309959972000001, 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017063485, 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 49 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:15.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5700000000000002e-07 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833878+0000", 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3800000000000002e-06 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833887+0000", 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369999999999992e-06 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833908+0000", 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0435999999999999e-05 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.847415+0000", 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013506676 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.847562+0000", 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147739 2024-09-12T17:06:15.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.847819+0000", 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025651500000000002 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850751+0000", 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00293202 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850779+0000", 2024-09-12T17:06:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8606999999999999e-05 2024-09-12T17:06:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850864+0000", 2024-09-12T17:06:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4552e-05 2024-09-12T17:06:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850935+0000", 2024-09-12T17:06:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1066e-05 2024-09-12T17:06:15.172 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833952+0000", 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.309879578999997, 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019704071, 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.173 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.174 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.174 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 50 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833952+0000", 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833952+0000", 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833953+0000", 2024-09-12T17:06:15.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0640000000000001e-06 2024-09-12T17:06:15.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834044+0000", 2024-09-12T17:06:15.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1192000000000004e-05 2024-09-12T17:06:15.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834058+0000", 2024-09-12T17:06:15.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.348e-05 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834066+0000", 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7269999999999996e-06 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849344+0000", 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015277469 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849467+0000", 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012350499999999999 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849674+0000", 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020653800000000001 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853306+0000", 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036320189999999998 2024-09-12T17:06:15.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853421+0000", 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011495200000000001 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853493+0000", 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1695999999999999e-05 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853656+0000", 2024-09-12T17:06:15.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016342900000000001 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.834084+0000", 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.309747010000002, 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019740911, 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.180 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 51 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834084+0000", 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834084+0000", 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834085+0000", 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834103+0000", 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7723e-05 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834115+0000", 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2023e-05 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834125+0000", 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5459999999999997e-06 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.851062+0000", 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016937163000000002 2024-09-12T17:06:15.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.851313+0000", 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025102499999999999 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.851589+0000", 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027657700000000002 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853401+0000", 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018117999999999999 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853667+0000", 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026570800000000002 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853768+0000", 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101662 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853825+0000", 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6929999999999999e-05 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.834139+0000", 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.309692429999998, 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019918142, 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.186 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 52 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834139+0000", 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834139+0000", 2024-09-12T17:06:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834140+0000", 2024-09-12T17:06:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.13e-07 2024-09-12T17:06:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834147+0000", 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834168+0000", 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1112999999999999e-05 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834182+0000", 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.852295+0000", 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018112817 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.852428+0000", 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013252199999999999 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.852646+0000", 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021851499999999999 2024-09-12T17:06:15.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853854+0000", 2024-09-12T17:06:15.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012082079999999999 2024-09-12T17:06:15.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853922+0000", 2024-09-12T17:06:15.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7939000000000001e-05 2024-09-12T17:06:15.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.854002+0000", 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9845999999999994e-05 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.854057+0000", 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4948999999999999e-05 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.192 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:64 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 0~512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.193 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085667+0000", 2024-09-12T17:06:15.193 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.058164068000004, 2024-09-12T17:06:15.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015548268000000001, 2024-09-12T17:06:15.193 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.193 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.193 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.193 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.193 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.193 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.193 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 64 2024-09-12T17:06:15.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.193 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085667+0000", 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085667+0000", 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085669+0000", 2024-09-12T17:06:15.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.578e-06 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085677+0000", 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2989999999999997e-06 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085695+0000", 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8074e-05 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085705+0000", 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3700000000000001e-06 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085799+0000", 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4631999999999998e-05 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085888+0000", 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8164999999999994e-05 2024-09-12T17:06:15.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086005+0000", 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117886 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088869+0000", 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028639339999999998 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101160+0000", 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012290264 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101190+0000", 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0354000000000001e-05 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101216+0000", 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5712e-05 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.198 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:65 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085772+0000", 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.058059452999998, 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015620775999999999, 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.199 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.200 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 65 2024-09-12T17:06:15.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.200 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085772+0000", 2024-09-12T17:06:15.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085772+0000", 2024-09-12T17:06:15.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085773+0000", 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2440000000000001e-06 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085780+0000", 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.204e-06 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085794+0000", 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3899e-05 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085803+0000", 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2449999999999998e-06 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086444+0000", 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00064089500000000005 2024-09-12T17:06:15.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086582+0000", 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013844399999999999 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086738+0000", 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015597300000000001 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090637+0000", 2024-09-12T17:06:15.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003898721 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101279+0000", 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010641958 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101354+0000", 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5264000000000003e-05 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101393+0000", 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8928999999999999e-05 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:66 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085836+0000", 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.057995742000003, 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015663347000000001, 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.205 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.206 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.206 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.206 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.206 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.206 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 66 2024-09-12T17:06:15.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.206 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085836+0000", 2024-09-12T17:06:15.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085836+0000", 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085837+0000", 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.06e-06 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085908+0000", 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0735999999999995e-05 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085921+0000", 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346000000000001e-05 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085929+0000", 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4139999999999994e-06 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.087208+0000", 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012785369999999999 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.087330+0000", 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000122027 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.087534+0000", 2024-09-12T17:06:15.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020403199999999999 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091533+0000", 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039988439999999997 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101448+0000", 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0099155319999999995 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101477+0000", 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9082e-05 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101499+0000", 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1736999999999999e-05 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.211 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085949+0000", 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.057882370000002, 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015624106, 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 67 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085949+0000", 2024-09-12T17:06:15.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085949+0000", 2024-09-12T17:06:15.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085950+0000", 2024-09-12T17:06:15.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4499999999999995e-07 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085956+0000", 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085969+0000", 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2529e-05 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085976+0000", 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0230000000000004e-06 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088269+0000", 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022934219999999998 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088376+0000", 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010649699999999999 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088487+0000", 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011079899999999999 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093209+0000", 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047220589999999998 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101526+0000", 2024-09-12T17:06:15.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083176799999999992 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101553+0000", 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7223e-05 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101573+0000", 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9731000000000001e-05 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086238+0000", 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.057593314999998, 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015404706000000001, 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 68 2024-09-12T17:06:15.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.219 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086238+0000", 2024-09-12T17:06:15.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086238+0000", 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086240+0000", 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1210000000000001e-06 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086248+0000", 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0269999999999995e-06 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086263+0000", 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5047e-05 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086273+0000", 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.577e-06 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088933+0000", 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026599700000000002 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089062+0000", 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012944700000000001 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089246+0000", 2024-09-12T17:06:15.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018397199999999999 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093213+0000", 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039662960000000002 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101598+0000", 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083858449999999994 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101624+0000", 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5857e-05 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101643+0000", 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8547e-05 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.224 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.057529969999997, 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015412403, 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 69 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.61e-07 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086429+0000", 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012675800000000001 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086444+0000", 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5310000000000001e-05 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086457+0000", 2024-09-12T17:06:15.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2317000000000001e-05 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089748+0000", 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032910679999999999 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089817+0000", 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9136999999999999e-05 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089924+0000", 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107611 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093216+0000", 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032914419999999999 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101668+0000", 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0084523629999999992 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101694+0000", 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6202000000000001e-05 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101714+0000", 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9434000000000001e-05 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086485+0000", 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.057346223000003, 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015302071, 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 70 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086485+0000", 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086485+0000", 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086486+0000", 2024-09-12T17:06:15.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1170000000000001e-06 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086493+0000", 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5740000000000001e-06 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086505+0000", 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1562999999999999e-05 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086512+0000", 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8499999999999994e-06 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090668+0000", 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041558280000000003 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090802+0000", 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013367199999999999 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090997+0000", 2024-09-12T17:06:15.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019551400000000001 2024-09-12T17:06:15.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094672+0000", 2024-09-12T17:06:15.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036750749999999999 2024-09-12T17:06:15.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101741+0000", 2024-09-12T17:06:15.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0070688280000000001 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101768+0000", 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6676e-05 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101787+0000", 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9374000000000001e-05 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.236 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086529+0000", 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.057302083000003, 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015328430000000001, 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 71 2024-09-12T17:06:15.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086529+0000", 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086529+0000", 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086530+0000", 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2799999999999996e-07 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086534+0000", 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.104e-06 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086552+0000", 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7716000000000001e-05 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086569+0000", 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6966e-05 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091570+0000", 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050011869999999998 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091693+0000", 2024-09-12T17:06:15.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012295700000000001 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091871+0000", 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017795899999999999 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094676+0000", 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028055089999999999 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101811+0000", 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0071346350000000003 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101836+0000", 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4592000000000001e-05 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101858+0000", 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2177000000000001e-05 2024-09-12T17:06:15.242 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086581+0000", 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.057250054000001, 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015450432, 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.243 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 72 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086581+0000", 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086581+0000", 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086582+0000", 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8599999999999998e-07 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086664+0000", 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1930999999999999e-05 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086673+0000", 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3340000000000008e-06 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086682+0000", 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6170000000000007e-06 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.092334+0000", 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056518610000000002 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.092402+0000", 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8198e-05 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.092510+0000", 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010851 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096201+0000", 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036908919999999999 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101929+0000", 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057277259999999998 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101993+0000", 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4068999999999999e-05 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102032+0000", 2024-09-12T17:06:15.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8807999999999998e-05 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.057129854999999, 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015429554, 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.249 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 73 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5599999999999995e-07 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086709+0000", 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9659999999999999e-06 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086715+0000", 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.361e-06 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086721+0000", 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3860000000000004e-06 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093279+0000", 2024-09-12T17:06:15.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065577719999999999 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093415+0000", 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013671899999999999 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093611+0000", 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019514700000000001 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096205+0000", 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025945569999999999 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102084+0000", 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058785119999999998 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102111+0000", 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6970000000000001e-05 2024-09-12T17:06:15.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102131+0000", 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0608e-05 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.057101635999999, 2024-09-12T17:06:15.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015560805, 2024-09-12T17:06:15.256 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.256 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.256 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.256 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.256 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.256 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.256 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 74 2024-09-12T17:06:15.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.256 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:15.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:15.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8099999999999998e-07 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086733+0000", 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.65e-06 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086740+0000", 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6200000000000001e-06 2024-09-12T17:06:15.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086744+0000", 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3239999999999996e-06 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094098+0000", 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0073542909999999998 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094177+0000", 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9290999999999997e-05 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094286+0000", 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000108646 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096213+0000", 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001926587 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102201+0000", 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059879360000000001 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102250+0000", 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9882000000000001e-05 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102291+0000", 2024-09-12T17:06:15.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0197000000000002e-05 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.057079551000001, 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015655273000000001, 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.262 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 75 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:15.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3299999999999998e-07 2024-09-12T17:06:15.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086811+0000", 2024-09-12T17:06:15.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9194000000000003e-05 2024-09-12T17:06:15.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086819+0000", 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7640000000000005e-06 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086826+0000", 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.126e-06 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094745+0000", 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0079189989999999995 2024-09-12T17:06:15.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094870+0000", 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012493500000000001 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095045+0000", 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000174465 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096216+0000", 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001171014 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102355+0000", 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061392579999999999 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102383+0000", 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8308000000000001e-05 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102407+0000", 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3876999999999999e-05 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086838+0000", 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.056993282999997, 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015725032, 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:15.268 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 76 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086838+0000", 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086838+0000", 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086839+0000", 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1399999999999997e-07 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086842+0000", 2024-09-12T17:06:15.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0920000000000002e-06 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086848+0000", 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.674e-06 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086852+0000", 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8909999999999997e-06 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095627+0000", 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087745189999999997 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095713+0000", 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5958000000000006e-05 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095824+0000", 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011079 2024-09-12T17:06:15.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096550+0000", 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00072662200000000001 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102471+0000", 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059210419999999996 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:15.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102533+0000", 2024-09-12T17:06:15.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1321000000000005e-05 2024-09-12T17:06:15.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:15.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:15.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:15.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102563+0000", 2024-09-12T17:06:15.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0608999999999998e-05 2024-09-12T17:06:15.274 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.274 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.274 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.274 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:15.274 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:15.274 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:15.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:06:15.276 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:15.273+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:15.377 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:15.373+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:15.413 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:15.413 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:15.414 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:15.414 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:15.427 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:06:15.519 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:15.517+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:15.578 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:15.573+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:15.600 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:15.601 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:15.601 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:15.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:06:15.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T17:06:15.703 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:15.701+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:15.780 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:15.777+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:15.784 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:64 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'40)", 2024-09-12T17:06:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.696629309000002, 2024-09-12T17:06:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014733802000000001, 2024-09-12T17:06:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084341+0000", 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9700000000000002e-06 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084353+0000", 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2279999999999999e-05 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084382+0000", 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9179e-05 2024-09-12T17:06:15.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084395+0000", 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.322e-05 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084525+0000", 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129789 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084582+0000", 2024-09-12T17:06:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6486000000000001e-05 2024-09-12T17:06:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099005+0000", 2024-09-12T17:06:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014423689 2024-09-12T17:06:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099073+0000", 2024-09-12T17:06:15.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7188999999999997e-05 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:65 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'40)", 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.695808309, 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013950562, 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.790 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085162+0000", 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0099999999999998e-06 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085174+0000", 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2223e-05 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085222+0000", 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8029999999999999e-05 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085237+0000", 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4666e-05 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085428+0000", 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019164900000000001 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085488+0000", 2024-09-12T17:06:15.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0149000000000003e-05 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099075+0000", 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013587042000000001 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099110+0000", 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4792999999999997e-05 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:66 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.695016189, 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013198259, 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:15.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:15.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085954+0000", 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0530000000000001e-06 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086013+0000", 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8854000000000003e-05 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086045+0000", 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2672999999999997e-05 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086058+0000", 2024-09-12T17:06:15.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.306e-05 2024-09-12T17:06:15.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086438+0000", 2024-09-12T17:06:15.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037959300000000001 2024-09-12T17:06:15.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086495+0000", 2024-09-12T17:06:15.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6679999999999999e-05 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099115+0000", 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012620256 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099150+0000", 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5089999999999998e-05 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:67 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'45, mlcod=17'40)", 2024-09-12T17:06:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.694099309000002, 2024-09-12T17:06:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012332911, 2024-09-12T17:06:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.800 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086871+0000", 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.063e-06 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086884+0000", 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.294e-05 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086970+0000", 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6312999999999998e-05 2024-09-12T17:06:15.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086990+0000", 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9602999999999998e-05 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087863+0000", 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087312999999999996 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087915+0000", 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2516000000000003e-05 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099152+0000", 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011237 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099202+0000", 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9345999999999998e-05 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.804 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'46, mlcod=17'40)", 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.693380353999999, 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011670056, 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087590+0000", 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.956e-06 2024-09-12T17:06:15.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087602+0000", 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1939999999999999e-05 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087630+0000", 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8736000000000001e-05 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087652+0000", 2024-09-12T17:06:15.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1693000000000001e-05 2024-09-12T17:06:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088864+0000", 2024-09-12T17:06:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001211578 2024-09-12T17:06:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088939+0000", 2024-09-12T17:06:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5885999999999998e-05 2024-09-12T17:06:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099206+0000", 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010266287000000001 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099258+0000", 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.198e-05 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'47, mlcod=17'40)", 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.692639026999998, 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010963379000000001, 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088331+0000", 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088388+0000", 2024-09-12T17:06:15.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7274000000000001e-05 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088418+0000", 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9609000000000001e-05 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088439+0000", 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0820000000000001e-05 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090024+0000", 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001585588 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090090+0000", 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5660000000000005e-05 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099260+0000", 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091697050000000002 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099292+0000", 2024-09-12T17:06:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2750000000000003e-05 2024-09-12T17:06:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.814 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'48, mlcod=17'40)", 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.691559712, 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0099341629999999993, 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089410+0000", 2024-09-12T17:06:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9740000000000001e-06 2024-09-12T17:06:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089424+0000", 2024-09-12T17:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4036000000000001e-05 2024-09-12T17:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089466+0000", 2024-09-12T17:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1563000000000002e-05 2024-09-12T17:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089492+0000", 2024-09-12T17:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5812999999999998e-05 2024-09-12T17:06:15.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091523+0000", 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002030895 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091564+0000", 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1263000000000001e-05 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099294+0000", 2024-09-12T17:06:15.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0077302400000000002 2024-09-12T17:06:15.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099342+0000", 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8378999999999999e-05 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:71 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'49, mlcod=17'40)", 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.690752703999998, 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0092012150000000004, 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.822 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090217+0000", 2024-09-12T17:06:15.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:15.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090229+0000", 2024-09-12T17:06:15.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:15.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090261+0000", 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1986999999999997e-05 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090280+0000", 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8536e-05 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092530+0000", 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022498959999999999 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092588+0000", 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8276000000000002e-05 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099345+0000", 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006757028 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099417+0000", 2024-09-12T17:06:15.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1645999999999998e-05 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:72 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'50, mlcod=17'40)", 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.690084452999997, 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085677930000000006, 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090885+0000", 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3799999999999999e-06 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090938+0000", 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3013000000000002e-05 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090965+0000", 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6610000000000001e-05 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090979+0000", 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4113e-05 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093482+0000", 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025028870000000001 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093573+0000", 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0989999999999994e-05 2024-09-12T17:06:15.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099418+0000", 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058459109999999996 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099451+0000", 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2889000000000003e-05 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:73 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'51, mlcod=17'40)", 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.688972292000003, 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075262419999999998, 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:15.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091998+0000", 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.894e-06 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092010+0000", 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2176e-05 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092043+0000", 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3226999999999999e-05 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092062+0000", 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9453000000000002e-05 2024-09-12T17:06:15.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.095140+0000", 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00307792 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.095196+0000", 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6008999999999999e-05 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099453+0000", 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042563899999999997 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099522+0000", 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9172999999999997e-05 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:74 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'52, mlcod=17'40)", 2024-09-12T17:06:15.836 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.688366979999998, 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0069855890000000004, 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092603+0000", 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0099999999999998e-06 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092618+0000", 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.469e-05 2024-09-12T17:06:15.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092647+0000", 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9107000000000001e-05 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092660+0000", 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.347e-05 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.096074+0000", 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034132300000000002 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.096158+0000", 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4863000000000004e-05 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099524+0000", 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033656670000000001 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099587+0000", 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2551999999999993e-05 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:75 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'40)", 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.687540886000001, 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006221725, 2024-09-12T17:06:15.841 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093429+0000", 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1299999999999999e-06 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093522+0000", 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2236000000000003e-05 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093562+0000", 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0386000000000003e-05 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093576+0000", 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4154e-05 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.097039+0000", 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034632629999999998 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.097092+0000", 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2918999999999999e-05 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099591+0000", 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024984310000000002 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099649+0000", 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8205999999999998e-05 2024-09-12T17:06:15.845 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:76 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'40)", 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.686816055000001, 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057612949999999996, 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094154+0000", 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2699999999999999e-06 2024-09-12T17:06:15.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094169+0000", 2024-09-12T17:06:15.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4296e-05 2024-09-12T17:06:15.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094203+0000", 2024-09-12T17:06:15.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3980000000000003e-05 2024-09-12T17:06:15.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094220+0000", 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7337e-05 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.098459+0000", 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004238917 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.098495+0000", 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6662999999999998e-05 2024-09-12T17:06:15.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099861+0000", 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013660359999999999 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099913+0000", 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1795999999999997e-05 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:77 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'55, mlcod=17'53)", 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.679465852, 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030906760000000001, 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:15.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101504+0000", 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.353e-06 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101585+0000", 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1576000000000006e-05 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101614+0000", 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9133e-05 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101627+0000", 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3253e-05 2024-09-12T17:06:15.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101727+0000", 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9569999999999997e-05 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101764+0000", 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6495999999999998e-05 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.104506+0000", 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027422660000000001 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.104593+0000", 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7028999999999996e-05 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:15.855 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:15.856 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.196491632000001, 2024-09-12T17:06:15.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036836849999999999, 2024-09-12T17:06:15.856 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.856 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.856 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:15.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:15.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:15.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 206 2024-09-12T17:06:15.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.856 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584480+0000", 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4860000000000002e-06 2024-09-12T17:06:15.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584496+0000", 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5883999999999999e-05 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584534+0000", 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8089000000000001e-05 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584551+0000", 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7220000000000001e-05 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584691+0000", 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013991599999999999 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584957+0000", 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000266161 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.585389+0000", 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00043172399999999997 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.587593+0000", 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022045160000000001 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.587984+0000", 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039048099999999998 2024-09-12T17:06:15.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588073+0000", 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8648999999999998e-05 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588160+0000", 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7559000000000007e-05 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.179083126999998, 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039464799999999996, 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 210 2024-09-12T17:06:15.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601887+0000", 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5170000000000002e-06 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601899+0000", 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1897e-05 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601930+0000", 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0190000000000001e-05 2024-09-12T17:06:15.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601945+0000", 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5075999999999999e-05 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.602115+0000", 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016993600000000001 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.602470+0000", 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000355554 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.603208+0000", 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073791700000000004 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.604956+0000", 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00174832 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605676+0000", 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071966100000000002 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605762+0000", 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6159e-05 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605831+0000", 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9252999999999996e-05 2024-09-12T17:06:15.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.149098480999999, 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033897799999999998, 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:15.868 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 218 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:15.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631872+0000", 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9469999999999999e-06 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631884+0000", 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1823e-05 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631916+0000", 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1319999999999998e-05 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631931+0000", 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5299e-05 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632074+0000", 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142922 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632301+0000", 2024-09-12T17:06:15.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022715600000000001 2024-09-12T17:06:15.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:15.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632716+0000", 2024-09-12T17:06:15.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041482900000000002 2024-09-12T17:06:15.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.634244+0000", 2024-09-12T17:06:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001528242 2024-09-12T17:06:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635103+0000", 2024-09-12T17:06:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085923399999999995 2024-09-12T17:06:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635189+0000", 2024-09-12T17:06:15.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5405e-05 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635259+0000", 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0603000000000001e-05 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:15.874 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.134130097, 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033001250000000001, 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 222 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:15.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:15.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646841+0000", 2024-09-12T17:06:15.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9969999999999999e-06 2024-09-12T17:06:15.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646853+0000", 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2500000000000001e-05 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646884+0000", 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.048e-05 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646899+0000", 2024-09-12T17:06:15.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4810000000000001e-05 2024-09-12T17:06:15.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647031+0000", 2024-09-12T17:06:15.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013203499999999999 2024-09-12T17:06:15.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647248+0000", 2024-09-12T17:06:15.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021723200000000001 2024-09-12T17:06:15.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647648+0000", 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040051000000000003 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.649222+0000", 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015737150000000001 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.649984+0000", 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076208000000000005 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.650070+0000", 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6032999999999994e-05 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.650138+0000", 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7732999999999997e-05 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.880 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.104242434, 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041653740000000003, 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:15.881 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 230 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676728+0000", 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4899999999999999e-06 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676739+0000", 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1226000000000001e-05 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676770+0000", 2024-09-12T17:06:15.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0297000000000001e-05 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676784+0000", 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4796e-05 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676940+0000", 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015539300000000001 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.677328+0000", 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038856699999999998 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.678139+0000", 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081085 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.679704+0000", 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015644109999999999 2024-09-12T17:06:15.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680598+0000", 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00089426999999999996 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680767+0000", 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016875500000000001 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680891+0000", 2024-09-12T17:06:15.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012431899999999999 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.826371936000001, 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033901650000000001, 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 712 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:15.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954598+0000", 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6249999999999999e-06 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954605+0000", 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7219999999999999e-06 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954625+0000", 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0013e-05 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954635+0000", 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2310000000000002e-06 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954787+0000", 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015215399999999999 2024-09-12T17:06:15.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.955172+0000", 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038501699999999998 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.955729+0000", 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055745600000000001 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.956989+0000", 2024-09-12T17:06:15.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012593179999999999 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957706+0000", 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000717477 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957868+0000", 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016208300000000001 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:15.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:15.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957986+0000", 2024-09-12T17:06:15.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118069 2024-09-12T17:06:15.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.893 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:15.893 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:15.893 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:15.895 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:06:15.895 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:15.893+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:15.995 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:15.993+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:16.059 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:16.059 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:16.059 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:16.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:06:16.105 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:06:16.120 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:16.117+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:16.197 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:16.193+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:16.255 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:16.255 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:16.255 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:16.273 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:06:16.284 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:16.284 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:16.302 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:16.303 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:16.303 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:16.297+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:16.319 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:16.319 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:16.335 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:16.336 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:16.356 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:16.357 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:16.377 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:16.377 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:16.398 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:16.397+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:16.399 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:16.399 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:16.399 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:16.399 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:16.414 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:06:16.421 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:16.422 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:16.499 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:16.497+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:16.538 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:16.538 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:16.552 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:06:16.600 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:16.597+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:16.678 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:16.678 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:16.692 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T17:06:16.694 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:06:16.700 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:16.701+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:16.802 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:16.801+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:16.880 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:16.881 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:16.896 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:06:16.902 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:16.901+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:17.003 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:17.001+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:17.025 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:17.025 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:17.040 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:06:17.104 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:17.105+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:17.204 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:17.204 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:17.205 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:17.205+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:17.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:06:17.306 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:17.301+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:17.345 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:17.345 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:17.360 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:06:17.408 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:17.404+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:17.497 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:17.497 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:17.509 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:17.508+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:17.513 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:06:17.609 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:17.605+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:17.678 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:17.679 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:17.695 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:06:17.710 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:17.705+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:17.811 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:17.808+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:17.823 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:17.823 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:17.837 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:06:17.912 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:17.909+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:18.011 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:18.011 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:18.013 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:18.009+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:18.026 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:06:18.114 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:18.112+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:18.145 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:18.145 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:18.160 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:06:18.215 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:18.213+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:18.316 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:18.312+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:18.329 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:18.329 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:18.344 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:06:18.418 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:18.413+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:18.441 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:06:18.503 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:18.504 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:18.518 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:06:18.519 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:18.513+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:18.600 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:18.600 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:18.617 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:18.617 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:18.618 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:18.616+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:18.634 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:18.634 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:18.647 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:18.647 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:18.652 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:18.653 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:18.662 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:06:18.672 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:18.672 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:18.693 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:18.694 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:18.712 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T17:06:18.712 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:18.713 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:18.731 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:18.731 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:18.749 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:18.748+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:18.821 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:18.817+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:18.846 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:06:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:06:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:06:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:06:18.846 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.306763923999998, 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.040278856000000002, 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 46 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537089+0000", 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3000000000000002e-06 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537103+0000", 2024-09-12T17:06:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4097000000000001e-05 2024-09-12T17:06:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537137+0000", 2024-09-12T17:06:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4079999999999999e-05 2024-09-12T17:06:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537162+0000", 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4579999999999998e-05 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537327+0000", 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000165081 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537344+0000", 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7447000000000001e-05 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.552576+0000", 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015231339 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.552597+0000", 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0934e-05 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.572608+0000", 2024-09-12T17:06:18.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020010917 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.572902+0000", 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029482400000000001 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.573205+0000", 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030300900000000003 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.576854+0000", 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003648966 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577088+0000", 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023368099999999999 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577216+0000", 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012821600000000001 2024-09-12T17:06:18.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577365+0000", 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014838500000000001 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94117020027008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.577764+0000", 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.266085834999998, 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026568799999999999, 2024-09-12T17:06:18.854 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 47 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577764+0000", 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577764+0000", 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577767+0000", 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8289999999999999e-06 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577778+0000", 2024-09-12T17:06:18.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1415e-05 2024-09-12T17:06:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577803+0000", 2024-09-12T17:06:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5341999999999999e-05 2024-09-12T17:06:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577837+0000", 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3825000000000002e-05 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577938+0000", 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100301 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.578111+0000", 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017378399999999999 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.578414+0000", 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030282399999999999 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.579488+0000", 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001074242 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.580119+0000", 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00063073299999999997 2024-09-12T17:06:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.580242+0000", 2024-09-12T17:06:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012259900000000001 2024-09-12T17:06:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.580421+0000", 2024-09-12T17:06:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017898600000000001 2024-09-12T17:06:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.860 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.586577+0000", 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.257272761999999, 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023422579999999998, 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:18.861 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 54 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586577+0000", 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586577+0000", 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586579+0000", 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4940000000000002e-06 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586591+0000", 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1116e-05 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586625+0000", 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4779e-05 2024-09-12T17:06:18.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586641+0000", 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5466999999999999e-05 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586743+0000", 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010244 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.586882+0000", 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000139121 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.587026+0000", 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014360299999999999 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.587909+0000", 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00088268000000000005 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.588722+0000", 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081364700000000002 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.588802+0000", 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9661999999999997e-05 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.588919+0000", 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117249 2024-09-12T17:06:18.866 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94117020030464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.589104+0000", 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.254745461999999, 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0024774900000000002, 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:18.867 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 55 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589104+0000", 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589104+0000", 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589106+0000", 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0269999999999998e-06 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589117+0000", 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0647e-05 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589144+0000", 2024-09-12T17:06:18.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6916000000000001e-05 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589160+0000", 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6123000000000001e-05 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589267+0000", 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107373 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589400+0000", 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000132762 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.589651+0000", 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025080799999999999 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.590859+0000", 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001208317 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.591421+0000", 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056174100000000004 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.591495+0000", 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4245000000000005e-05 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.591582+0000", 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6531000000000002e-05 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.872 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:191 6.5 e33/30 6:a2ace8b3:::data_log.0:head v 33'1, mlcod=0'0)", 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.682203+0000", 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.161646835999999, 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017792789999999999, 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682203+0000", 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682203+0000", 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682205+0000", 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0829999999999998e-06 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682219+0000", 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4413000000000001e-05 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682254+0000", 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4659000000000001e-05 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682274+0000", 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9959999999999999e-05 2024-09-12T17:06:18.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682455+0000", 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018075900000000001 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.682508+0000", 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2785999999999999e-05 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.683904+0000", 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001396696 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.683982+0000", 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7923000000000006e-05 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:209 6.3 e36/30 6:c60da066:gc::gc.4:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.601065+0000", 2024-09-12T17:06:18.877 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.242784833000002, 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021210780000000002, 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601065+0000", 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601065+0000", 2024-09-12T17:06:18.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601066+0000", 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1399999999999996e-07 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601077+0000", 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1253000000000001e-05 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601115+0000", 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7902999999999999e-05 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601139+0000", 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3913e-05 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601323+0000", 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018393899999999999 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.601373+0000", 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9873000000000002e-05 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.603095+0000", 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017221859999999999 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.603186+0000", 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1197000000000001e-05 2024-09-12T17:06:18.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:217 6.15 e36/30 6:ab569f81:gc::gc.12:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.631481+0000", 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.212368440999999, 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018198859999999999, 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631481+0000", 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631481+0000", 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631483+0000", 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.823e-06 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631496+0000", 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.313e-05 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631525+0000", 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8297e-05 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631539+0000", 2024-09-12T17:06:18.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4212999999999999e-05 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631683+0000", 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143883 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.631740+0000", 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7315000000000003e-05 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.633227+0000", 2024-09-12T17:06:18.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001486596 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.633301+0000", 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.4629000000000007e-05 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:221 6.3 e36/30 6:c623b173:gc::gc.16:head v 36'3, mlcod=36'1)", 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.646376+0000", 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.197473666, 2024-09-12T17:06:18.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018164660000000001, 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646376+0000", 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646376+0000", 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646378+0000", 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646390+0000", 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.153e-05 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646418+0000", 2024-09-12T17:06:18.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8133e-05 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646431+0000", 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3044000000000001e-05 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646574+0000", 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014290200000000001 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.646637+0000", 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3736000000000001e-05 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.648113+0000", 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014753189999999999 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.648192+0000", 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9841999999999999e-05 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.890 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:226 6.a e36/30 6:5127e642:gc::gc.21:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.665705+0000", 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.178144948, 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001702823, 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665705+0000", 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665705+0000", 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665705+0000", 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9299999999999998e-07 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665712+0000", 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0230000000000004e-06 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665739+0000", 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7007000000000001e-05 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665753+0000", 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3226e-05 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665871+0000", 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118529 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.665900+0000", 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9073000000000001e-05 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.667322+0000", 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001421919 2024-09-12T17:06:18.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.667408+0000", 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5452999999999997e-05 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:303 6.1 e36/30 6:856b9b26:reshard::reshard.0000000002:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.721622+0000", 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.122227707, 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001801743, 2024-09-12T17:06:18.895 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721622+0000", 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721622+0000", 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721623+0000", 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.37e-07 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721632+0000", 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8300000000000002e-06 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721659+0000", 2024-09-12T17:06:18.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7503000000000001e-05 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721677+0000", 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8050000000000002e-05 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721804+0000", 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000127262 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.721849+0000", 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4496000000000002e-05 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723309+0000", 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014601760000000001 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.723424+0000", 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000114689 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:318 6.1 e36/30 6:856b9b26:reshard::reshard.0000000002:head v 36'2, mlcod=0'0)", 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.724965+0000", 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.118884772000001, 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001908412, 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.900 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724965+0000", 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724965+0000", 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724967+0000", 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1069999999999999e-06 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.724979+0000", 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.183e-05 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725006+0000", 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7432000000000001e-05 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725020+0000", 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3573e-05 2024-09-12T17:06:18.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725179+0000", 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015895899999999999 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.725236+0000", 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7163999999999997e-05 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.726797+0000", 2024-09-12T17:06:18.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015610439999999999 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.726873+0000", 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6303000000000005e-05 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:350 6.5 e36/30 6:a60f9269:lc::lua_package_allowlist:head v 36'2, mlcod=0'0)", 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.732394+0000", 2024-09-12T17:06:18.904 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.111455676999999, 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033606479999999999, 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732394+0000", 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732394+0000", 2024-09-12T17:06:18.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732396+0000", 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2199999999999999e-06 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732411+0000", 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4450000000000001e-05 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732445+0000", 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4427000000000001e-05 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732465+0000", 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0047e-05 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732619+0000", 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015389200000000001 2024-09-12T17:06:18.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.732677+0000", 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7671999999999999e-05 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735650+0000", 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002973594 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735755+0000", 2024-09-12T17:06:18.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010434599999999999 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:360 6.3 e36/30 6:c3a682d4:reshard::reshard.0000000004:head v 36'4, mlcod=36'2)", 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.735399+0000", 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.108450726000001, 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017447630000000001, 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.909 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735399+0000", 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735399+0000", 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735432+0000", 2024-09-12T17:06:18.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3420000000000002e-05 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735446+0000", 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3196e-05 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735473+0000", 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6950000000000001e-05 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735494+0000", 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1282999999999999e-05 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735638+0000", 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000144635 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.735691+0000", 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2176999999999999e-05 2024-09-12T17:06:18.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737025+0000", 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001334163 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737144+0000", 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011893899999999999 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:368 6.5 e36/30 6:a60f9269:lc::lua_package_allowlist:head v 36'3, mlcod=33'1)", 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.737977+0000", 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.105872401999999, 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017574159999999999, 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737977+0000", 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737977+0000", 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737979+0000", 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0159999999999998e-06 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.737993+0000", 2024-09-12T17:06:18.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3937000000000001e-05 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738029+0000", 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5302999999999997e-05 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738047+0000", 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8919999999999998e-05 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738203+0000", 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015550500000000001 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738258+0000", 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5303000000000002e-05 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739627+0000", 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013687160000000001 2024-09-12T17:06:18.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739735+0000", 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107716 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:374 6.c e36/30 6:3677c228:::obj_delete_at_hint.0000000006:head v 36'1, mlcod=0'0)", 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.738951+0000", 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.104898667000001, 2024-09-12T17:06:18.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019538120000000001, 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738951+0000", 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738951+0000", 2024-09-12T17:06:18.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738953+0000", 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.12e-06 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738967+0000", 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4324e-05 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.738996+0000", 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8572999999999999e-05 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739017+0000", 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0826e-05 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739175+0000", 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000157675 2024-09-12T17:06:18.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.739223+0000", 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8059999999999997e-05 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.740818+0000", 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015950910000000001 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.740905+0000", 2024-09-12T17:06:18.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7143000000000002e-05 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:433 6.a e36/30 6:50d64734:::obj_delete_at_hint.0000000009:head v 36'5, mlcod=36'3)", 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.760784+0000", 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.083066026000001, 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018873760000000001, 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.923 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760784+0000", 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760784+0000", 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760786+0000", 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.39e-06 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760828+0000", 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1814000000000003e-05 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760862+0000", 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3682e-05 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760881+0000", 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9017000000000001e-05 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.761032+0000", 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000151142 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.761095+0000", 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2860000000000005e-05 2024-09-12T17:06:18.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762570+0000", 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001475315 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762671+0000", 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010115600000000001 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:461 6.1 e36/30 6:80b6fe23:reshard::reshard.0000000011:head v 36'3, mlcod=36'1)", 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.775384+0000", 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.068465348, 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002057835, 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775384+0000", 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775384+0000", 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775386+0000", 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.849e-06 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775397+0000", 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1197e-05 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775424+0000", 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.633e-05 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775440+0000", 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.643e-05 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775581+0000", 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141309 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.775647+0000", 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5321999999999996e-05 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.777337+0000", 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001690422 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.777442+0000", 2024-09-12T17:06:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010497600000000001 2024-09-12T17:06:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.932 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:466 6.1 e36/30 6:80b6fe23:reshard::reshard.0000000011:head v 36'4, mlcod=36'2)", 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.778592+0000", 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.065258106000002, 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018789340000000001, 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778592+0000", 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778592+0000", 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778594+0000", 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.317e-06 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778608+0000", 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3876999999999999e-05 2024-09-12T17:06:18.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778633+0000", 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5282999999999998e-05 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778650+0000", 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6731e-05 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778876+0000", 2024-09-12T17:06:18.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022571099999999999 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.778907+0000", 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1906000000000003e-05 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.780381+0000", 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014737979999999999 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.780471+0000", 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9310999999999999e-05 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:754 6.a e36/30 6:576130b8:::obj_delete_at_hint.0000000059:head v 36'8, mlcod=36'6)", 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.056368+0000", 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.787481617000001, 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001746404, 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.937 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056368+0000", 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056368+0000", 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056370+0000", 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1119999999999999e-06 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056384+0000", 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3935e-05 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056416+0000", 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1544999999999997e-05 2024-09-12T17:06:18.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056433+0000", 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7108999999999998e-05 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056590+0000", 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015706699999999999 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.056660+0000", 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0396999999999997e-05 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.058012+0000", 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013513990000000001 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.058114+0000", 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010284 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.941 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:928 6.1e e36/30 6:7adbb485:::obj_delete_at_hint.0000000117:head v 36'9, mlcod=36'7)", 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.477128+0000", 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.366721527999999, 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00171068, 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:18.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477128+0000", 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477128+0000", 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477130+0000", 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.317e-06 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477143+0000", 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2276000000000001e-05 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477172+0000", 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8966999999999999e-05 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477185+0000", 2024-09-12T17:06:18.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2996999999999999e-05 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477348+0000", 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016369900000000001 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.477410+0000", 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1384999999999996e-05 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:18.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.478750+0000", 2024-09-12T17:06:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013406869999999999 2024-09-12T17:06:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.478839+0000", 2024-09-12T17:06:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8351999999999997e-05 2024-09-12T17:06:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:18.946 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:18.946 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:18.948 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:06:18.948 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:18.945+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:19.049 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:19.045+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:19.122 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:19.123 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:19.123 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:06:19.123 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:19.137 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:06:19.150 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:19.145+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:19.250 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:19.245+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:19.256 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:19.256 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:19.256 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:19.256 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:19.256 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:19.272 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:06:19.351 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:19.349+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:19.401 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:19.402 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:06:19.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:06:19.402 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:06:19.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.402 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.402 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:06:19.402 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.222116147999998, 2024-09-12T17:06:19.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.51115267600000003, 2024-09-12T17:06:19.403 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.403 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.403 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.403 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.403 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.403 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.403 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T17:06:19.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.403 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:06:19.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:06:19.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178732+0000", 2024-09-12T17:06:19.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:06:19.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178746+0000", 2024-09-12T17:06:19.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4273e-05 2024-09-12T17:06:19.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178768+0000", 2024-09-12T17:06:19.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2246e-05 2024-09-12T17:06:19.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178786+0000", 2024-09-12T17:06:19.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7354e-05 2024-09-12T17:06:19.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.179126+0000", 2024-09-12T17:06:19.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034083699999999998 2024-09-12T17:06:19.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T17:06:19.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.179140+0000", 2024-09-12T17:06:19.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3879999999999999e-05 2024-09-12T17:06:19.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.686346+0000", 2024-09-12T17:06:19.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.50720528799999998 2024-09-12T17:06:19.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.686808+0000", 2024-09-12T17:06:19.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046207300000000002 2024-09-12T17:06:19.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.687360+0000", 2024-09-12T17:06:19.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055267599999999999 2024-09-12T17:06:19.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689052+0000", 2024-09-12T17:06:19.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016913329999999999 2024-09-12T17:06:19.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689665+0000", 2024-09-12T17:06:19.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00061308200000000004 2024-09-12T17:06:19.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689763+0000", 2024-09-12T17:06:19.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8048999999999996e-05 2024-09-12T17:06:19.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.410 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689882+0000", 2024-09-12T17:06:19.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119252 2024-09-12T17:06:19.410 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.410 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.410 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.410 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.411 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833597+0000", 2024-09-12T17:06:19.411 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.567248487000001, 2024-09-12T17:06:19.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015512720000000001, 2024-09-12T17:06:19.411 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.411 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.411 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.411 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.411 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.411 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.411 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 47 2024-09-12T17:06:19.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.411 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833597+0000", 2024-09-12T17:06:19.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833597+0000", 2024-09-12T17:06:19.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833598+0000", 2024-09-12T17:06:19.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1299999999999999e-07 2024-09-12T17:06:19.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833744+0000", 2024-09-12T17:06:19.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145702 2024-09-12T17:06:19.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833768+0000", 2024-09-12T17:06:19.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4947e-05 2024-09-12T17:06:19.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833789+0000", 2024-09-12T17:06:19.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0177e-05 2024-09-12T17:06:19.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.844353+0000", 2024-09-12T17:06:19.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010564634999999999 2024-09-12T17:06:19.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.844518+0000", 2024-09-12T17:06:19.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016429199999999999 2024-09-12T17:06:19.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.844857+0000", 2024-09-12T17:06:19.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033895399999999998 2024-09-12T17:06:19.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.848742+0000", 2024-09-12T17:06:19.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003885983 2024-09-12T17:06:19.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.848899+0000", 2024-09-12T17:06:19.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000156572 2024-09-12T17:06:19.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849017+0000", 2024-09-12T17:06:19.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117852 2024-09-12T17:06:19.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849110+0000", 2024-09-12T17:06:19.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2893000000000007e-05 2024-09-12T17:06:19.417 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.417 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.417 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833827+0000", 2024-09-12T17:06:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.567018159, 2024-09-12T17:06:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015427058, 2024-09-12T17:06:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.418 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 48 2024-09-12T17:06:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833827+0000", 2024-09-12T17:06:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833827+0000", 2024-09-12T17:06:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833828+0000", 2024-09-12T17:06:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.08e-06 2024-09-12T17:06:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833836+0000", 2024-09-12T17:06:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0700000000000001e-06 2024-09-12T17:06:19.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833848+0000", 2024-09-12T17:06:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2622999999999999e-05 2024-09-12T17:06:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833857+0000", 2024-09-12T17:06:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8899999999999996e-06 2024-09-12T17:06:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.846379+0000", 2024-09-12T17:06:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012521607000000001 2024-09-12T17:06:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.846536+0000", 2024-09-12T17:06:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000157732 2024-09-12T17:06:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.846727+0000", 2024-09-12T17:06:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190669 2024-09-12T17:06:19.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.848846+0000", 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021189199999999998 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849137+0000", 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029135400000000002 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849200+0000", 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3102999999999995e-05 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849254+0000", 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.401e-05 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.425 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.566974053000003, 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017063485, 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 49 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5700000000000002e-07 2024-09-12T17:06:19.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833878+0000", 2024-09-12T17:06:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3800000000000002e-06 2024-09-12T17:06:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833887+0000", 2024-09-12T17:06:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369999999999992e-06 2024-09-12T17:06:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833908+0000", 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0435999999999999e-05 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.847415+0000", 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013506676 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.847562+0000", 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147739 2024-09-12T17:06:19.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.847819+0000", 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025651500000000002 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850751+0000", 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00293202 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850779+0000", 2024-09-12T17:06:19.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8606999999999999e-05 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850864+0000", 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4552e-05 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850935+0000", 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1066e-05 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.431 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833952+0000", 2024-09-12T17:06:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.566893659999998, 2024-09-12T17:06:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019704071, 2024-09-12T17:06:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.432 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 50 2024-09-12T17:06:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833952+0000", 2024-09-12T17:06:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833952+0000", 2024-09-12T17:06:19.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833953+0000", 2024-09-12T17:06:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0640000000000001e-06 2024-09-12T17:06:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834044+0000", 2024-09-12T17:06:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1192000000000004e-05 2024-09-12T17:06:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834058+0000", 2024-09-12T17:06:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.348e-05 2024-09-12T17:06:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834066+0000", 2024-09-12T17:06:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7269999999999996e-06 2024-09-12T17:06:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849344+0000", 2024-09-12T17:06:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015277469 2024-09-12T17:06:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849467+0000", 2024-09-12T17:06:19.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012350499999999999 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849674+0000", 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020653800000000001 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853306+0000", 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036320189999999998 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853421+0000", 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011495200000000001 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853493+0000", 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1695999999999999e-05 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853656+0000", 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016342900000000001 2024-09-12T17:06:19.438 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.834084+0000", 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.566761091000004, 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019740911, 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.439 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 51 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834084+0000", 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834084+0000", 2024-09-12T17:06:19.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834085+0000", 2024-09-12T17:06:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T17:06:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834103+0000", 2024-09-12T17:06:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7723e-05 2024-09-12T17:06:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834115+0000", 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2023e-05 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834125+0000", 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5459999999999997e-06 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.851062+0000", 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016937163000000002 2024-09-12T17:06:19.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.851313+0000", 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025102499999999999 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.851589+0000", 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027657700000000002 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853401+0000", 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018117999999999999 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853667+0000", 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026570800000000002 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853768+0000", 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101662 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853825+0000", 2024-09-12T17:06:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6929999999999999e-05 2024-09-12T17:06:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.834139+0000", 2024-09-12T17:06:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.566706511, 2024-09-12T17:06:19.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019918142, 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 52 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834139+0000", 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834139+0000", 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834140+0000", 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.13e-07 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834147+0000", 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834168+0000", 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1112999999999999e-05 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834182+0000", 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.852295+0000", 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018112817 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.852428+0000", 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013252199999999999 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.852646+0000", 2024-09-12T17:06:19.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021851499999999999 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853854+0000", 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012082079999999999 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853922+0000", 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7939000000000001e-05 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.854002+0000", 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9845999999999994e-05 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.854057+0000", 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4948999999999999e-05 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.451 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:64 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 0~512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085667+0000", 2024-09-12T17:06:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.315178148999998, 2024-09-12T17:06:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015548268000000001, 2024-09-12T17:06:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 64 2024-09-12T17:06:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.452 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085667+0000", 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085667+0000", 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085669+0000", 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.578e-06 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085677+0000", 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2989999999999997e-06 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085695+0000", 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8074e-05 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085705+0000", 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3700000000000001e-06 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085799+0000", 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4631999999999998e-05 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085888+0000", 2024-09-12T17:06:19.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8164999999999994e-05 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086005+0000", 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117886 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088869+0000", 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028639339999999998 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101160+0000", 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012290264 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101190+0000", 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0354000000000001e-05 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101216+0000", 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5712e-05 2024-09-12T17:06:19.457 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:65 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085772+0000", 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.315073534, 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015620775999999999, 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.458 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 65 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085772+0000", 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085772+0000", 2024-09-12T17:06:19.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085773+0000", 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2440000000000001e-06 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085780+0000", 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.204e-06 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085794+0000", 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3899e-05 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085803+0000", 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2449999999999998e-06 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086444+0000", 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00064089500000000005 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086582+0000", 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013844399999999999 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086738+0000", 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015597300000000001 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090637+0000", 2024-09-12T17:06:19.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003898721 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101279+0000", 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010641958 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101354+0000", 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5264000000000003e-05 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101393+0000", 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8928999999999999e-05 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:66 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085836+0000", 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.315009822999997, 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015663347000000001, 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 66 2024-09-12T17:06:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085836+0000", 2024-09-12T17:06:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085836+0000", 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085837+0000", 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.06e-06 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085908+0000", 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0735999999999995e-05 2024-09-12T17:06:19.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085921+0000", 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346000000000001e-05 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085929+0000", 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4139999999999994e-06 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.087208+0000", 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012785369999999999 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.087330+0000", 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000122027 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.087534+0000", 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020403199999999999 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091533+0000", 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039988439999999997 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101448+0000", 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0099155319999999995 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101477+0000", 2024-09-12T17:06:19.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9082e-05 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101499+0000", 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1736999999999999e-05 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085949+0000", 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.314896451000003, 2024-09-12T17:06:19.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015624106, 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 67 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085949+0000", 2024-09-12T17:06:19.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085949+0000", 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085950+0000", 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4499999999999995e-07 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085956+0000", 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085969+0000", 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2529e-05 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085976+0000", 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0230000000000004e-06 2024-09-12T17:06:19.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088269+0000", 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022934219999999998 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088376+0000", 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010649699999999999 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088487+0000", 2024-09-12T17:06:19.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011079899999999999 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093209+0000", 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047220589999999998 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101526+0000", 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083176799999999992 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101553+0000", 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7223e-05 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101573+0000", 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9731000000000001e-05 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.476 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086238+0000", 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.314607396, 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015404706000000001, 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 68 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086238+0000", 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086238+0000", 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086240+0000", 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1210000000000001e-06 2024-09-12T17:06:19.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086248+0000", 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0269999999999995e-06 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086263+0000", 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5047e-05 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086273+0000", 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.577e-06 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088933+0000", 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026599700000000002 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089062+0000", 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012944700000000001 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089246+0000", 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018397199999999999 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093213+0000", 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039662960000000002 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101598+0000", 2024-09-12T17:06:19.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083858449999999994 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101624+0000", 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5857e-05 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101643+0000", 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8547e-05 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.482 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.314544050999999, 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015412403, 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.483 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 69 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.61e-07 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086429+0000", 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012675800000000001 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086444+0000", 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5310000000000001e-05 2024-09-12T17:06:19.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086457+0000", 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2317000000000001e-05 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089748+0000", 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032910679999999999 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089817+0000", 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9136999999999999e-05 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089924+0000", 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107611 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093216+0000", 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032914419999999999 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101668+0000", 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0084523629999999992 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101694+0000", 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6202000000000001e-05 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101714+0000", 2024-09-12T17:06:19.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9434000000000001e-05 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086485+0000", 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.314360303999997, 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015302071, 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.489 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 70 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086485+0000", 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086485+0000", 2024-09-12T17:06:19.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086486+0000", 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1170000000000001e-06 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086493+0000", 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5740000000000001e-06 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086505+0000", 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1562999999999999e-05 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086512+0000", 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8499999999999994e-06 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090668+0000", 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041558280000000003 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090802+0000", 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013367199999999999 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090997+0000", 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019551400000000001 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094672+0000", 2024-09-12T17:06:19.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036750749999999999 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101741+0000", 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0070688280000000001 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101768+0000", 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6676e-05 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101787+0000", 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9374000000000001e-05 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086529+0000", 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.314316163999997, 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015328430000000001, 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.495 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 71 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086529+0000", 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086529+0000", 2024-09-12T17:06:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086530+0000", 2024-09-12T17:06:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2799999999999996e-07 2024-09-12T17:06:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086534+0000", 2024-09-12T17:06:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.104e-06 2024-09-12T17:06:19.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086552+0000", 2024-09-12T17:06:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7716000000000001e-05 2024-09-12T17:06:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086569+0000", 2024-09-12T17:06:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6966e-05 2024-09-12T17:06:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091570+0000", 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050011869999999998 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091693+0000", 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012295700000000001 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091871+0000", 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017795899999999999 2024-09-12T17:06:19.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094676+0000", 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028055089999999999 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101811+0000", 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0071346350000000003 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101836+0000", 2024-09-12T17:06:19.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4592000000000001e-05 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101858+0000", 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2177000000000001e-05 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086581+0000", 2024-09-12T17:06:19.504 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.314264135000002, 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015450432, 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 72 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086581+0000", 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086581+0000", 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086582+0000", 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8599999999999998e-07 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086664+0000", 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1930999999999999e-05 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086673+0000", 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3340000000000008e-06 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086682+0000", 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6170000000000007e-06 2024-09-12T17:06:19.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.092334+0000", 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056518610000000002 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.092402+0000", 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8198e-05 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.092510+0000", 2024-09-12T17:06:19.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010851 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096201+0000", 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036908919999999999 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101929+0000", 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057277259999999998 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101993+0000", 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4068999999999999e-05 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102032+0000", 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8807999999999998e-05 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.510 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.314143936000001, 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015429554, 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 73 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:19.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5599999999999995e-07 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086709+0000", 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9659999999999999e-06 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086715+0000", 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.361e-06 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086721+0000", 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3860000000000004e-06 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093279+0000", 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065577719999999999 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093415+0000", 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013671899999999999 2024-09-12T17:06:19.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093611+0000", 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019514700000000001 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096205+0000", 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025945569999999999 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102084+0000", 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058785119999999998 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102111+0000", 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6970000000000001e-05 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102131+0000", 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0608e-05 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.516 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.314115717, 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015560805, 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.517 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 74 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8099999999999998e-07 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086733+0000", 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.65e-06 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086740+0000", 2024-09-12T17:06:19.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6200000000000001e-06 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086744+0000", 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3239999999999996e-06 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094098+0000", 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0073542909999999998 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094177+0000", 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9290999999999997e-05 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094286+0000", 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000108646 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096213+0000", 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001926587 2024-09-12T17:06:19.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102201+0000", 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059879360000000001 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102250+0000", 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9882000000000001e-05 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102291+0000", 2024-09-12T17:06:19.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0197000000000002e-05 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.314093632000002, 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015655273000000001, 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.523 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 75 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3299999999999998e-07 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086811+0000", 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9194000000000003e-05 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086819+0000", 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7640000000000005e-06 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086826+0000", 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.126e-06 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094745+0000", 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0079189989999999995 2024-09-12T17:06:19.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094870+0000", 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012493500000000001 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095045+0000", 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000174465 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096216+0000", 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001171014 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102355+0000", 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061392579999999999 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102383+0000", 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8308000000000001e-05 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102407+0000", 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3876999999999999e-05 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086838+0000", 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.314007363999998, 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015725032, 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:19.529 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 76 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086838+0000", 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086838+0000", 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086839+0000", 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1399999999999997e-07 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086842+0000", 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0920000000000002e-06 2024-09-12T17:06:19.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086848+0000", 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.674e-06 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086852+0000", 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8909999999999997e-06 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095627+0000", 2024-09-12T17:06:19.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087745189999999997 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095713+0000", 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5958000000000006e-05 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095824+0000", 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011079 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:19.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096550+0000", 2024-09-12T17:06:19.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00072662200000000001 2024-09-12T17:06:19.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:19.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102471+0000", 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059210419999999996 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102533+0000", 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1321000000000005e-05 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102563+0000", 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0608999999999998e-05 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.535 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.536 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.536 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:19.536 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:19.536 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:19.537 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:19.536+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:19.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:06:19.638 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:19.633+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:19.672 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:19.673 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:19.673 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:19.673 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:19.687 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:06:19.690 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T17:06:19.739 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:19.736+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:19.825 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:19.825 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:19.825 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:19.825 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:19.825 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:19.840 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:06:19.840 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:19.836+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:19.941 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:19.937+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:19.970 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:64 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'40)", 2024-09-12T17:06:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.88167997, 2024-09-12T17:06:19.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014733802000000001, 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:19.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084341+0000", 2024-09-12T17:06:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9700000000000002e-06 2024-09-12T17:06:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084353+0000", 2024-09-12T17:06:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2279999999999999e-05 2024-09-12T17:06:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084382+0000", 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9179e-05 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084395+0000", 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.322e-05 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084525+0000", 2024-09-12T17:06:19.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129789 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084582+0000", 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6486000000000001e-05 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099005+0000", 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014423689 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099073+0000", 2024-09-12T17:06:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7188999999999997e-05 2024-09-12T17:06:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:65 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'40)", 2024-09-12T17:06:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.880858969999998, 2024-09-12T17:06:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013950562, 2024-09-12T17:06:19.975 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:19.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085162+0000", 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0099999999999998e-06 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085174+0000", 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2223e-05 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:19.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085222+0000", 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8029999999999999e-05 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085237+0000", 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4666e-05 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085428+0000", 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019164900000000001 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085488+0000", 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0149000000000003e-05 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099075+0000", 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013587042000000001 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099110+0000", 2024-09-12T17:06:19.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4792999999999997e-05 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:66 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.880066849999999, 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013198259, 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.980 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085954+0000", 2024-09-12T17:06:19.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0530000000000001e-06 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086013+0000", 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8854000000000003e-05 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086045+0000", 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2672999999999997e-05 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086058+0000", 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.306e-05 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086438+0000", 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037959300000000001 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086495+0000", 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6679999999999999e-05 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099115+0000", 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012620256 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099150+0000", 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5089999999999998e-05 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:67 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'45, mlcod=17'40)", 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.87914997, 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012332911, 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:19.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086871+0000", 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.063e-06 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:19.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086884+0000", 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.294e-05 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086970+0000", 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6312999999999998e-05 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086990+0000", 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9602999999999998e-05 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087863+0000", 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087312999999999996 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087915+0000", 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2516000000000003e-05 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099152+0000", 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011237 2024-09-12T17:06:19.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099202+0000", 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9345999999999998e-05 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'46, mlcod=17'40)", 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.878431014999997, 2024-09-12T17:06:19.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011670056, 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:19.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087590+0000", 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.956e-06 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087602+0000", 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1939999999999999e-05 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:19.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087630+0000", 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8736000000000001e-05 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087652+0000", 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1693000000000001e-05 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088864+0000", 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001211578 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088939+0000", 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5885999999999998e-05 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099206+0000", 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010266287000000001 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099258+0000", 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.198e-05 2024-09-12T17:06:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'47, mlcod=17'40)", 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.877689687999997, 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010963379000000001, 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:19.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088331+0000", 2024-09-12T17:06:19.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088388+0000", 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7274000000000001e-05 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088418+0000", 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9609000000000001e-05 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088439+0000", 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0820000000000001e-05 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090024+0000", 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001585588 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090090+0000", 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5660000000000005e-05 2024-09-12T17:06:19.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099260+0000", 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091697050000000002 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099292+0000", 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2750000000000003e-05 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:19.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'48, mlcod=17'40)", 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.876610372999998, 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0099341629999999993, 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:19.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089410+0000", 2024-09-12T17:06:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9740000000000001e-06 2024-09-12T17:06:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089424+0000", 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4036000000000001e-05 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089466+0000", 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1563000000000002e-05 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089492+0000", 2024-09-12T17:06:20.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5812999999999998e-05 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091523+0000", 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002030895 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091564+0000", 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1263000000000001e-05 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099294+0000", 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0077302400000000002 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099342+0000", 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8378999999999999e-05 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:71 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'49, mlcod=17'40)", 2024-09-12T17:06:20.003 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.875803365000003, 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0092012150000000004, 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090217+0000", 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090229+0000", 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:20.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090261+0000", 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1986999999999997e-05 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090280+0000", 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8536e-05 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092530+0000", 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022498959999999999 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092588+0000", 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8276000000000002e-05 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099345+0000", 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006757028 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099417+0000", 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1645999999999998e-05 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:72 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'50, mlcod=17'40)", 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.875135114000003, 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085677930000000006, 2024-09-12T17:06:20.008 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090885+0000", 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3799999999999999e-06 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090938+0000", 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3013000000000002e-05 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090965+0000", 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6610000000000001e-05 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090979+0000", 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4113e-05 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093482+0000", 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025028870000000001 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093573+0000", 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0989999999999994e-05 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099418+0000", 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058459109999999996 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099451+0000", 2024-09-12T17:06:20.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2889000000000003e-05 2024-09-12T17:06:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:73 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'51, mlcod=17'40)", 2024-09-12T17:06:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.874022953000001, 2024-09-12T17:06:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075262419999999998, 2024-09-12T17:06:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.013 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.014 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:20.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:20.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091998+0000", 2024-09-12T17:06:20.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.894e-06 2024-09-12T17:06:20.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092010+0000", 2024-09-12T17:06:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2176e-05 2024-09-12T17:06:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092043+0000", 2024-09-12T17:06:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3226999999999999e-05 2024-09-12T17:06:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092062+0000", 2024-09-12T17:06:20.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9453000000000002e-05 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.095140+0000", 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00307792 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.095196+0000", 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6008999999999999e-05 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099453+0000", 2024-09-12T17:06:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042563899999999997 2024-09-12T17:06:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099522+0000", 2024-09-12T17:06:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9172999999999997e-05 2024-09-12T17:06:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:74 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'52, mlcod=17'40)", 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.873417641000003, 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0069855890000000004, 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:20.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092603+0000", 2024-09-12T17:06:20.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0099999999999998e-06 2024-09-12T17:06:20.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092618+0000", 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.469e-05 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092647+0000", 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9107000000000001e-05 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092660+0000", 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.347e-05 2024-09-12T17:06:20.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.096074+0000", 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034132300000000002 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.096158+0000", 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4863000000000004e-05 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099524+0000", 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033656670000000001 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099587+0000", 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2551999999999993e-05 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:75 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'40)", 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:20.023 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.872591546999999, 2024-09-12T17:06:20.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006221725, 2024-09-12T17:06:20.024 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.024 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.024 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.024 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:20.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093429+0000", 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1299999999999999e-06 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093522+0000", 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2236000000000003e-05 2024-09-12T17:06:20.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093562+0000", 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0386000000000003e-05 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093576+0000", 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4154e-05 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.097039+0000", 2024-09-12T17:06:20.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034632629999999998 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.097092+0000", 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2918999999999999e-05 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099591+0000", 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024984310000000002 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099649+0000", 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8205999999999998e-05 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:76 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'40)", 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.871866716, 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057612949999999996, 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094154+0000", 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2699999999999999e-06 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094169+0000", 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4296e-05 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094203+0000", 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3980000000000003e-05 2024-09-12T17:06:20.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094220+0000", 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7337e-05 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.098459+0000", 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004238917 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.098495+0000", 2024-09-12T17:06:20.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6662999999999998e-05 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099861+0000", 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013660359999999999 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099913+0000", 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1795999999999997e-05 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:77 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'55, mlcod=17'53)", 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.864516512999998, 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030906760000000001, 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:20.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:20.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101504+0000", 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.353e-06 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101585+0000", 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1576000000000006e-05 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101614+0000", 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9133e-05 2024-09-12T17:06:20.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101627+0000", 2024-09-12T17:06:20.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3253e-05 2024-09-12T17:06:20.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101727+0000", 2024-09-12T17:06:20.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9569999999999997e-05 2024-09-12T17:06:20.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101764+0000", 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6495999999999998e-05 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.104506+0000", 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027422660000000001 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.104593+0000", 2024-09-12T17:06:20.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7028999999999996e-05 2024-09-12T17:06:20.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.040 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.040 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:20.040 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:20.040 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.381542292999999, 2024-09-12T17:06:20.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036836849999999999, 2024-09-12T17:06:20.040 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.040 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.040 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 206 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584480+0000", 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4860000000000002e-06 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584496+0000", 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5883999999999999e-05 2024-09-12T17:06:20.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584534+0000", 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8089000000000001e-05 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584551+0000", 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7220000000000001e-05 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584691+0000", 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013991599999999999 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584957+0000", 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000266161 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.585389+0000", 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00043172399999999997 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.587593+0000", 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022045160000000001 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.587984+0000", 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039048099999999998 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588073+0000", 2024-09-12T17:06:20.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8648999999999998e-05 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588160+0000", 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7559000000000007e-05 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.364133788, 2024-09-12T17:06:20.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039464799999999996, 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 210 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:20.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601887+0000", 2024-09-12T17:06:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5170000000000002e-06 2024-09-12T17:06:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601899+0000", 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1897e-05 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601930+0000", 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0190000000000001e-05 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601945+0000", 2024-09-12T17:06:20.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5075999999999999e-05 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.602115+0000", 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016993600000000001 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.602470+0000", 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000355554 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:20.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.603208+0000", 2024-09-12T17:06:20.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073791700000000004 2024-09-12T17:06:20.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.604956+0000", 2024-09-12T17:06:20.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00174832 2024-09-12T17:06:20.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605676+0000", 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071966100000000002 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605762+0000", 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6159e-05 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605831+0000", 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9252999999999996e-05 2024-09-12T17:06:20.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.053 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.053 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.053 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:20.053 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.334149142000001, 2024-09-12T17:06:20.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033897799999999998, 2024-09-12T17:06:20.053 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.053 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 218 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631872+0000", 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9469999999999999e-06 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631884+0000", 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1823e-05 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631916+0000", 2024-09-12T17:06:20.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1319999999999998e-05 2024-09-12T17:06:20.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631931+0000", 2024-09-12T17:06:20.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5299e-05 2024-09-12T17:06:20.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632074+0000", 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142922 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632301+0000", 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022715600000000001 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632716+0000", 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041482900000000002 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.634244+0000", 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001528242 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635103+0000", 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085923399999999995 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635189+0000", 2024-09-12T17:06:20.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5405e-05 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635259+0000", 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0603000000000001e-05 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:20.059 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.319180758000002, 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033001250000000001, 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 222 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646841+0000", 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9969999999999999e-06 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646853+0000", 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2500000000000001e-05 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646884+0000", 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.048e-05 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646899+0000", 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4810000000000001e-05 2024-09-12T17:06:20.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647031+0000", 2024-09-12T17:06:20.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013203499999999999 2024-09-12T17:06:20.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647248+0000", 2024-09-12T17:06:20.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021723200000000001 2024-09-12T17:06:20.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647648+0000", 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040051000000000003 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.649222+0000", 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015737150000000001 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.649984+0000", 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076208000000000005 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.650070+0000", 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6032999999999994e-05 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.650138+0000", 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7732999999999997e-05 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.065 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.289293095000001, 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041653740000000003, 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.066 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 230 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676728+0000", 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4899999999999999e-06 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676739+0000", 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1226000000000001e-05 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676770+0000", 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0297000000000001e-05 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676784+0000", 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4796e-05 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676940+0000", 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015539300000000001 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.677328+0000", 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038856699999999998 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.678139+0000", 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081085 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.679704+0000", 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015644109999999999 2024-09-12T17:06:20.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680598+0000", 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00089426999999999996 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680767+0000", 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016875500000000001 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680891+0000", 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012431899999999999 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.011422596999999, 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033901650000000001, 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 712 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954598+0000", 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6249999999999999e-06 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954605+0000", 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7219999999999999e-06 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954625+0000", 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0013e-05 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954635+0000", 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2310000000000002e-06 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954787+0000", 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015215399999999999 2024-09-12T17:06:20.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.955172+0000", 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038501699999999998 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.955729+0000", 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055745600000000001 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.956989+0000", 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012593179999999999 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957706+0000", 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000717477 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957868+0000", 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016208300000000001 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957986+0000", 2024-09-12T17:06:20.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118069 2024-09-12T17:06:20.078 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.078 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.078 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.078 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.078 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.078 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:20.080 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:06:20.080 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:20.080+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:20.181 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:20.176+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:20.255 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:20.255 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:20.255 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:20.255 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:20.271 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:06:20.281 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:20.280+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:20.382 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:20.380+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:20.396 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:20.396 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:20.396 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:20.396 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:20.396 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:20.411 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:06:20.483 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:20.481+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:20.539 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:20.539 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.009739201999999, 2024-09-12T17:06:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:06:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.540 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:06:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:06:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:06:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:06:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:06:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:06:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:06:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:06:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:06:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:06:20.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:06:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:06:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:06:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:06:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:06:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:06:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:06:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:20.546 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.852107006000001, 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:06:20.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:06:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:06:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:06:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:06:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:06:20.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:06:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:06:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:06:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:06:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.942013212999999, 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.553 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:06:20.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:06:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:06:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:06:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:06:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:06:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:06:20.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:20.559 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.926122471999999, 2024-09-12T17:06:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:06:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:06:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:06:20.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:06:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:06:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:06:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:06:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:06:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:06:20.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.565 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.900653802000001, 2024-09-12T17:06:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:06:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:06:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:20.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:06:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:06:20.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:06:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:06:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:06:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:06:20.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:06:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:06:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:06:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:06:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:06:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:06:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:06:20.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:06:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:06:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:06:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:06:20.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:06:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:06:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:06:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:06:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:06:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.881692700999999, 2024-09-12T17:06:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:06:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.575 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:06:20.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:06:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:06:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:06:20.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.583 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.847137401000001, 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:06:20.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:06:20.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.589 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.590 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.590 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:20.590 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.533917987999999, 2024-09-12T17:06:20.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:06:20.590 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.590 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.590 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.590 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:20.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:06:20.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:06:20.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:06:20.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:20.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:06:20.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:06:20.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:06:20.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:06:20.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:06:20.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:06:20.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:06:20.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:06:20.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:06:20.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:06:20.596 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.596 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.596 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.596 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.596 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:20.596 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.52902662, 2024-09-12T17:06:20.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:06:20.597 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.597 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.597 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.597 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.597 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.597 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.597 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:06:20.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.597 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:20.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:20.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:06:20.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:06:20.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:06:20.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:06:20.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:06:20.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:06:20.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:06:20.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:06:20.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:06:20.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:06:20.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:06:20.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:06:20.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:06:20.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:06:20.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:06:20.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:06:20.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:06:20.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:06:20.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.604 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.490051161, 2024-09-12T17:06:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:06:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.605 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.606 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.606 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.606 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:06:20.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.606 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:20.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:20.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:06:20.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:20.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:06:20.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:06:20.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:06:20.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:06:20.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:06:20.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:06:20.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:06:20.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:06:20.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:06:20.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:06:20.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:06:20.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:06:20.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:06:20.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:06:20.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:06:20.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:06:20.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:06:20.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:06:20.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:06:20.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:06:20.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.614 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.614 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.614 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.614 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:20.614 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.486153186999999, 2024-09-12T17:06:20.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:06:20.614 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:06:20.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:06:20.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:06:20.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:06:20.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.620 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.621 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:20.621 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.417393955000001, 2024-09-12T17:06:20.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:06:20.621 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.621 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.621 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.621 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.621 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:06:20.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.621 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:06:20.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:06:20.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.626 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.381549940999999, 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:06:20.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:20.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:06:20.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:06:20.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:06:20.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:06:20.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:06:20.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:06:20.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.361362570000001, 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:06:20.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.634 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:20.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:20.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:06:20.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:06:20.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:06:20.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:06:20.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:06:20.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:06:20.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:06:20.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:06:20.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:06:20.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:06:20.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.356468207999999, 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:06:20.640 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:06:20.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.641 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:20.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:20.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:06:20.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:06:20.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:06:20.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:06:20.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:06:20.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:06:20.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:06:20.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:06:20.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:06:20.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:06:20.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:06:20.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:06:20.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:06:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:06:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:06:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:06:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:06:20.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:06:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:06:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:06:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:06:20.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:06:20.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.648 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.648 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.648 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:20.648 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.294500053, 2024-09-12T17:06:20.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:06:20.649 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.649 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.649 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:06:20.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.649 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:20.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:20.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:06:20.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:06:20.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:06:20.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:06:20.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:06:20.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.290093278000001, 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.655 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:06:20.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.656 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:20.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:06:20.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:06:20.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:06:20.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:06:20.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:06:20.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:06:20.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:06:20.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:06:20.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:06:20.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:20.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.122693936000001, 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:06:20.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:06:20.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:06:20.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:06:20.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:06:20.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:06:20.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:06:20.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:06:20.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:06:20.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:06:20.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:06:20.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:06:20.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:06:20.668 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.668 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.668 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.669 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.669 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:20.669 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.091918903, 2024-09-12T17:06:20.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:06:20.669 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:06:20.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.670 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:20.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:20.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:06:20.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:20.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:06:20.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:06:20.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:06:20.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:06:20.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:06:20.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:06:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:06:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:06:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:06:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:06:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.675 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.676 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:20.676 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:20.676 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.087006647999999, 2024-09-12T17:06:20.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:06:20.676 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:20.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:20.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:20.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:20.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:20.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:20.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:06:20.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.677 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:20.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:20.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:20.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:20.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:20.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:20.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:20.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:06:20.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:06:20.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:20.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:06:20.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:06:20.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:20.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:06:20.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:06:20.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:20.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:06:20.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:06:20.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:20.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:06:20.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:06:20.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:20.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:06:20.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:06:20.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:20.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:06:20.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:06:20.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:20.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:06:20.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:06:20.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:20.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:06:20.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:06:20.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:20.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:06:20.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:06:20.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:20.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:20.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:20.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:06:20.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:06:20.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.684 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:20.684 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:20.684 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:20.686 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:06:20.686 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:20.681+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:20.750 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:06:20.815 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:20.813+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:20.861 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:20.861 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:20.861 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:20.877 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:06:20.887 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:20.888+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:20.918 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:20.918 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:20.935 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:20.935 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:20.952 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:20.952 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:20.969 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:20.969 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:20.988 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:20.984+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:20.990 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:20.991 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:21.011 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:21.011 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:21.034 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:21.034 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:21.036 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:21.036 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:21.051 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:06:21.056 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:21.057 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:21.089 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:21.088+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:21.176 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:21.176 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:21.189 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:21.188+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:21.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:06:21.290 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:21.285+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:21.321 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:21.321 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:21.336 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:06:21.391 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:21.388+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:21.492 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:21.489+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:21.504 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:21.504 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:21.518 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:06:21.603 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:21.601+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:21.688 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:21.689 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:21.694 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:21.692+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:21.703 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:06:21.714 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T17:06:21.795 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:21.793+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:21.838 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:21.838 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:21.854 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:06:21.901 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:21.900+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:21.982 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:21.982 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:21.997 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:06:21.997 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:21.993+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:22.098 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:22.097+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:22.187 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:06:22.233 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:22.232+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:22.301 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:22.297+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:22.314 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:22.315 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:22.329 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:06:22.417 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:22.416+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:22.502 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:22.502 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:22.503 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:22.500+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:22.517 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:06:22.603 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:22.601+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:22.695 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:22.695 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:22.704 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:22.701+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:22.709 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:06:22.715 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T17:06:22.804 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:22.800+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:22.838 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:22.838 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:22.853 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:06:22.905 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:22.901+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:23.006 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:23.001+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:23.028 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:23.028 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:23.042 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:06:23.077 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:06:23.106 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:23.104+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:23.171 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:23.171 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:23.188 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:06:23.229 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:23.228+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:23.237 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:23.238 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:23.254 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:23.255 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:23.272 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:23.272 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:23.288 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:23.289 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:23.308 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:23.305+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:23.308 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:23.309 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:23.329 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:23.350 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:23.350 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:23.353 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:23.353 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:23.368 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:06:23.369 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:23.369 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:23.413 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:23.412+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:23.489 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:23.489 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:23.489 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:23.489 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:23.489 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:23.504 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:06:23.511 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:23.505+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:23.612 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:23.608+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:23.675 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:23.676 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:06:23.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:06:23.676 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:06:23.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.677 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.677 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:06:23.677 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 48.493948394999997, 2024-09-12T17:06:23.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.51115267600000003, 2024-09-12T17:06:23.677 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.677 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.678 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.678 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.678 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.678 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.678 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T17:06:23.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.678 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:06:23.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:06:23.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178732+0000", 2024-09-12T17:06:23.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:06:23.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178746+0000", 2024-09-12T17:06:23.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4273e-05 2024-09-12T17:06:23.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178768+0000", 2024-09-12T17:06:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2246e-05 2024-09-12T17:06:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178786+0000", 2024-09-12T17:06:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7354e-05 2024-09-12T17:06:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.179126+0000", 2024-09-12T17:06:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034083699999999998 2024-09-12T17:06:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T17:06:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.179140+0000", 2024-09-12T17:06:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3879999999999999e-05 2024-09-12T17:06:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.686346+0000", 2024-09-12T17:06:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.50720528799999998 2024-09-12T17:06:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.686808+0000", 2024-09-12T17:06:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046207300000000002 2024-09-12T17:06:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.687360+0000", 2024-09-12T17:06:23.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055267599999999999 2024-09-12T17:06:23.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689052+0000", 2024-09-12T17:06:23.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016913329999999999 2024-09-12T17:06:23.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689665+0000", 2024-09-12T17:06:23.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00061308200000000004 2024-09-12T17:06:23.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689763+0000", 2024-09-12T17:06:23.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8048999999999996e-05 2024-09-12T17:06:23.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689882+0000", 2024-09-12T17:06:23.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119252 2024-09-12T17:06:23.685 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.685 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.685 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.686 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.686 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833597+0000", 2024-09-12T17:06:23.686 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.839080733999999, 2024-09-12T17:06:23.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015512720000000001, 2024-09-12T17:06:23.686 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.686 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.686 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.686 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.686 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.687 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.687 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 47 2024-09-12T17:06:23.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.687 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833597+0000", 2024-09-12T17:06:23.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833597+0000", 2024-09-12T17:06:23.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833598+0000", 2024-09-12T17:06:23.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1299999999999999e-07 2024-09-12T17:06:23.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833744+0000", 2024-09-12T17:06:23.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145702 2024-09-12T17:06:23.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833768+0000", 2024-09-12T17:06:23.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4947e-05 2024-09-12T17:06:23.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833789+0000", 2024-09-12T17:06:23.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0177e-05 2024-09-12T17:06:23.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.844353+0000", 2024-09-12T17:06:23.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010564634999999999 2024-09-12T17:06:23.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.844518+0000", 2024-09-12T17:06:23.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016429199999999999 2024-09-12T17:06:23.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.844857+0000", 2024-09-12T17:06:23.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033895399999999998 2024-09-12T17:06:23.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.848742+0000", 2024-09-12T17:06:23.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003885983 2024-09-12T17:06:23.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.848899+0000", 2024-09-12T17:06:23.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000156572 2024-09-12T17:06:23.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849017+0000", 2024-09-12T17:06:23.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117852 2024-09-12T17:06:23.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849110+0000", 2024-09-12T17:06:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2893000000000007e-05 2024-09-12T17:06:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833827+0000", 2024-09-12T17:06:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.838850405999999, 2024-09-12T17:06:23.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015427058, 2024-09-12T17:06:23.694 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.694 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.694 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.694 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.694 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.694 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.694 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 48 2024-09-12T17:06:23.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.694 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833827+0000", 2024-09-12T17:06:23.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833827+0000", 2024-09-12T17:06:23.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833828+0000", 2024-09-12T17:06:23.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.08e-06 2024-09-12T17:06:23.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833836+0000", 2024-09-12T17:06:23.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0700000000000001e-06 2024-09-12T17:06:23.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833848+0000", 2024-09-12T17:06:23.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2622999999999999e-05 2024-09-12T17:06:23.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833857+0000", 2024-09-12T17:06:23.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8899999999999996e-06 2024-09-12T17:06:23.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.846379+0000", 2024-09-12T17:06:23.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012521607000000001 2024-09-12T17:06:23.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.846536+0000", 2024-09-12T17:06:23.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000157732 2024-09-12T17:06:23.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.846727+0000", 2024-09-12T17:06:23.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190669 2024-09-12T17:06:23.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.848846+0000", 2024-09-12T17:06:23.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0021189199999999998 2024-09-12T17:06:23.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849137+0000", 2024-09-12T17:06:23.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029135400000000002 2024-09-12T17:06:23.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849200+0000", 2024-09-12T17:06:23.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3102999999999995e-05 2024-09-12T17:06:23.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.700 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.700 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849254+0000", 2024-09-12T17:06:23.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.401e-05 2024-09-12T17:06:23.700 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.701 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.701 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.701 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.701 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:23.701 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.838806300000002, 2024-09-12T17:06:23.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017063485, 2024-09-12T17:06:23.701 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.702 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.702 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.702 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.702 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.702 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.702 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 49 2024-09-12T17:06:23.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.702 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:23.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:23.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833872+0000", 2024-09-12T17:06:23.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5700000000000002e-07 2024-09-12T17:06:23.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833878+0000", 2024-09-12T17:06:23.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3800000000000002e-06 2024-09-12T17:06:23.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.705 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833887+0000", 2024-09-12T17:06:23.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8369999999999992e-06 2024-09-12T17:06:23.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.705 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.705 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833908+0000", 2024-09-12T17:06:23.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0435999999999999e-05 2024-09-12T17:06:23.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.847415+0000", 2024-09-12T17:06:23.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013506676 2024-09-12T17:06:23.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.847562+0000", 2024-09-12T17:06:23.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147739 2024-09-12T17:06:23.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.847819+0000", 2024-09-12T17:06:23.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025651500000000002 2024-09-12T17:06:23.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850751+0000", 2024-09-12T17:06:23.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00293202 2024-09-12T17:06:23.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850779+0000", 2024-09-12T17:06:23.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8606999999999999e-05 2024-09-12T17:06:23.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850864+0000", 2024-09-12T17:06:23.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4552e-05 2024-09-12T17:06:23.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.850935+0000", 2024-09-12T17:06:23.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1066e-05 2024-09-12T17:06:23.709 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.709 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.709 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.710 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.710 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.833952+0000", 2024-09-12T17:06:23.710 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.838725906999997, 2024-09-12T17:06:23.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019704071, 2024-09-12T17:06:23.710 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.710 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.711 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.711 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.711 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.711 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.711 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 50 2024-09-12T17:06:23.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.711 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.711 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.711 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.711 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833952+0000", 2024-09-12T17:06:23.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.711 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833952+0000", 2024-09-12T17:06:23.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.833953+0000", 2024-09-12T17:06:23.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0640000000000001e-06 2024-09-12T17:06:23.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834044+0000", 2024-09-12T17:06:23.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1192000000000004e-05 2024-09-12T17:06:23.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834058+0000", 2024-09-12T17:06:23.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.348e-05 2024-09-12T17:06:23.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834066+0000", 2024-09-12T17:06:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7269999999999996e-06 2024-09-12T17:06:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849344+0000", 2024-09-12T17:06:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015277469 2024-09-12T17:06:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849467+0000", 2024-09-12T17:06:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012350499999999999 2024-09-12T17:06:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.849674+0000", 2024-09-12T17:06:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020653800000000001 2024-09-12T17:06:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853306+0000", 2024-09-12T17:06:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036320189999999998 2024-09-12T17:06:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853421+0000", 2024-09-12T17:06:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011495200000000001 2024-09-12T17:06:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853493+0000", 2024-09-12T17:06:23.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1695999999999999e-05 2024-09-12T17:06:23.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.718 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853656+0000", 2024-09-12T17:06:23.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016342900000000001 2024-09-12T17:06:23.718 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.718 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.718 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.718 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.718 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.719 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.834084+0000", 2024-09-12T17:06:23.719 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.838593338000003, 2024-09-12T17:06:23.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019740911, 2024-09-12T17:06:23.719 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.719 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.719 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.719 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.719 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.719 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.720 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 51 2024-09-12T17:06:23.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.720 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834084+0000", 2024-09-12T17:06:23.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834084+0000", 2024-09-12T17:06:23.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834085+0000", 2024-09-12T17:06:23.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.54e-07 2024-09-12T17:06:23.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834103+0000", 2024-09-12T17:06:23.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7723e-05 2024-09-12T17:06:23.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834115+0000", 2024-09-12T17:06:23.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2023e-05 2024-09-12T17:06:23.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834125+0000", 2024-09-12T17:06:23.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5459999999999997e-06 2024-09-12T17:06:23.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.851062+0000", 2024-09-12T17:06:23.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016937163000000002 2024-09-12T17:06:23.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.851313+0000", 2024-09-12T17:06:23.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025102499999999999 2024-09-12T17:06:23.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.851589+0000", 2024-09-12T17:06:23.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027657700000000002 2024-09-12T17:06:23.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.724 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853401+0000", 2024-09-12T17:06:23.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0018117999999999999 2024-09-12T17:06:23.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.724 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853667+0000", 2024-09-12T17:06:23.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026570800000000002 2024-09-12T17:06:23.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853768+0000", 2024-09-12T17:06:23.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101662 2024-09-12T17:06:23.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853825+0000", 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6929999999999999e-05 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.834139+0000", 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.838538757999999, 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019918142, 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.726 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.727 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.727 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.727 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.727 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 52 2024-09-12T17:06:23.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.727 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834139+0000", 2024-09-12T17:06:23.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834139+0000", 2024-09-12T17:06:23.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834140+0000", 2024-09-12T17:06:23.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.13e-07 2024-09-12T17:06:23.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834147+0000", 2024-09-12T17:06:23.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8700000000000003e-06 2024-09-12T17:06:23.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834168+0000", 2024-09-12T17:06:23.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1112999999999999e-05 2024-09-12T17:06:23.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.834182+0000", 2024-09-12T17:06:23.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:23.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.852295+0000", 2024-09-12T17:06:23.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018112817 2024-09-12T17:06:23.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.852428+0000", 2024-09-12T17:06:23.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013252199999999999 2024-09-12T17:06:23.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.852646+0000", 2024-09-12T17:06:23.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021851499999999999 2024-09-12T17:06:23.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.731 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.731 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853854+0000", 2024-09-12T17:06:23.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012082079999999999 2024-09-12T17:06:23.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.853922+0000", 2024-09-12T17:06:23.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7939000000000001e-05 2024-09-12T17:06:23.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.854002+0000", 2024-09-12T17:06:23.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9845999999999994e-05 2024-09-12T17:06:23.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.854057+0000", 2024-09-12T17:06:23.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4948999999999999e-05 2024-09-12T17:06:23.733 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.733 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.733 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.733 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:64 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 0~512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.733 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085667+0000", 2024-09-12T17:06:23.734 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.587010395999997, 2024-09-12T17:06:23.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015548268000000001, 2024-09-12T17:06:23.734 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.734 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.734 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.734 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.734 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.734 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.734 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 64 2024-09-12T17:06:23.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.734 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085667+0000", 2024-09-12T17:06:23.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085667+0000", 2024-09-12T17:06:23.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085669+0000", 2024-09-12T17:06:23.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.578e-06 2024-09-12T17:06:23.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085677+0000", 2024-09-12T17:06:23.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2989999999999997e-06 2024-09-12T17:06:23.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085695+0000", 2024-09-12T17:06:23.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8074e-05 2024-09-12T17:06:23.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.737 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085705+0000", 2024-09-12T17:06:23.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3700000000000001e-06 2024-09-12T17:06:23.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.737 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085799+0000", 2024-09-12T17:06:23.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4631999999999998e-05 2024-09-12T17:06:23.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085888+0000", 2024-09-12T17:06:23.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8164999999999994e-05 2024-09-12T17:06:23.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086005+0000", 2024-09-12T17:06:23.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117886 2024-09-12T17:06:23.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088869+0000", 2024-09-12T17:06:23.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028639339999999998 2024-09-12T17:06:23.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101160+0000", 2024-09-12T17:06:23.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012290264 2024-09-12T17:06:23.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101190+0000", 2024-09-12T17:06:23.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0354000000000001e-05 2024-09-12T17:06:23.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101216+0000", 2024-09-12T17:06:23.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5712e-05 2024-09-12T17:06:23.741 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.741 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.741 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.742 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:65 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.742 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085772+0000", 2024-09-12T17:06:23.742 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.586905780999999, 2024-09-12T17:06:23.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015620775999999999, 2024-09-12T17:06:23.742 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.742 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.742 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.742 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.743 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.743 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.743 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 65 2024-09-12T17:06:23.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.743 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.743 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085772+0000", 2024-09-12T17:06:23.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085772+0000", 2024-09-12T17:06:23.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085773+0000", 2024-09-12T17:06:23.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2440000000000001e-06 2024-09-12T17:06:23.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085780+0000", 2024-09-12T17:06:23.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.204e-06 2024-09-12T17:06:23.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085794+0000", 2024-09-12T17:06:23.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3899e-05 2024-09-12T17:06:23.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085803+0000", 2024-09-12T17:06:23.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2449999999999998e-06 2024-09-12T17:06:23.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086444+0000", 2024-09-12T17:06:23.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00064089500000000005 2024-09-12T17:06:23.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086582+0000", 2024-09-12T17:06:23.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013844399999999999 2024-09-12T17:06:23.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086738+0000", 2024-09-12T17:06:23.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015597300000000001 2024-09-12T17:06:23.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090637+0000", 2024-09-12T17:06:23.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003898721 2024-09-12T17:06:23.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101279+0000", 2024-09-12T17:06:23.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010641958 2024-09-12T17:06:23.749 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.750 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.750 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101354+0000", 2024-09-12T17:06:23.750 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5264000000000003e-05 2024-09-12T17:06:23.750 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.750 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.751 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.751 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101393+0000", 2024-09-12T17:06:23.751 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8928999999999999e-05 2024-09-12T17:06:23.751 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.751 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.752 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.752 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.752 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.752 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:66 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.752 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085836+0000", 2024-09-12T17:06:23.752 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.586842070000003, 2024-09-12T17:06:23.752 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015663347000000001, 2024-09-12T17:06:23.752 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.752 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.752 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.753 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.753 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.753 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.753 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 66 2024-09-12T17:06:23.753 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.753 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.753 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.753 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.753 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085836+0000", 2024-09-12T17:06:23.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085836+0000", 2024-09-12T17:06:23.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.754 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.754 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.754 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.754 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085837+0000", 2024-09-12T17:06:23.754 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.06e-06 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085908+0000", 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0735999999999995e-05 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085921+0000", 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346000000000001e-05 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.755 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085929+0000", 2024-09-12T17:06:23.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4139999999999994e-06 2024-09-12T17:06:23.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.087208+0000", 2024-09-12T17:06:23.756 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012785369999999999 2024-09-12T17:06:23.756 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.756 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.756 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.756 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.087330+0000", 2024-09-12T17:06:23.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000122027 2024-09-12T17:06:23.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.087534+0000", 2024-09-12T17:06:23.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020403199999999999 2024-09-12T17:06:23.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.757 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.757 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.757 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091533+0000", 2024-09-12T17:06:23.757 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039988439999999997 2024-09-12T17:06:23.757 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101448+0000", 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0099155319999999995 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101477+0000", 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9082e-05 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.758 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101499+0000", 2024-09-12T17:06:23.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1736999999999999e-05 2024-09-12T17:06:23.759 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.759 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.759 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.759 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.759 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.759 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:67 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.759 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.085949+0000", 2024-09-12T17:06:23.759 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.586728698000002, 2024-09-12T17:06:23.759 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015624106, 2024-09-12T17:06:23.759 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.760 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.760 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.760 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.760 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.760 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.760 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 67 2024-09-12T17:06:23.760 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.760 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.760 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.760 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.760 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085949+0000", 2024-09-12T17:06:23.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085949+0000", 2024-09-12T17:06:23.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.761 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.761 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.761 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.761 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085950+0000", 2024-09-12T17:06:23.761 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4499999999999995e-07 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085956+0000", 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085969+0000", 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2529e-05 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.762 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.085976+0000", 2024-09-12T17:06:23.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0230000000000004e-06 2024-09-12T17:06:23.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088269+0000", 2024-09-12T17:06:23.763 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0022934219999999998 2024-09-12T17:06:23.763 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.763 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.763 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.763 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088376+0000", 2024-09-12T17:06:23.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010649699999999999 2024-09-12T17:06:23.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088487+0000", 2024-09-12T17:06:23.764 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011079899999999999 2024-09-12T17:06:23.764 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.764 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.764 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.764 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093209+0000", 2024-09-12T17:06:23.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047220589999999998 2024-09-12T17:06:23.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.765 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101526+0000", 2024-09-12T17:06:23.765 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083176799999999992 2024-09-12T17:06:23.765 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.765 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.765 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101553+0000", 2024-09-12T17:06:23.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7223e-05 2024-09-12T17:06:23.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.766 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.766 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.766 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101573+0000", 2024-09-12T17:06:23.766 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9731000000000001e-05 2024-09-12T17:06:23.766 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.766 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.766 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.766 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.767 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.767 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:68 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.767 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086238+0000", 2024-09-12T17:06:23.767 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.586439642999999, 2024-09-12T17:06:23.767 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015404706000000001, 2024-09-12T17:06:23.767 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.767 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.767 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.767 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.767 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.767 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.767 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 68 2024-09-12T17:06:23.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.768 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086238+0000", 2024-09-12T17:06:23.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.768 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.768 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.768 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.768 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086238+0000", 2024-09-12T17:06:23.768 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.769 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.769 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086240+0000", 2024-09-12T17:06:23.769 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1210000000000001e-06 2024-09-12T17:06:23.769 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.769 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086248+0000", 2024-09-12T17:06:23.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0269999999999995e-06 2024-09-12T17:06:23.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.770 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086263+0000", 2024-09-12T17:06:23.770 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5047e-05 2024-09-12T17:06:23.770 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.770 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.770 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086273+0000", 2024-09-12T17:06:23.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.577e-06 2024-09-12T17:06:23.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.088933+0000", 2024-09-12T17:06:23.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026599700000000002 2024-09-12T17:06:23.771 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.771 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.771 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.771 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089062+0000", 2024-09-12T17:06:23.771 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012944700000000001 2024-09-12T17:06:23.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.772 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.772 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089246+0000", 2024-09-12T17:06:23.772 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018397199999999999 2024-09-12T17:06:23.772 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.772 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093213+0000", 2024-09-12T17:06:23.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039662960000000002 2024-09-12T17:06:23.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.773 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101598+0000", 2024-09-12T17:06:23.773 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083858449999999994 2024-09-12T17:06:23.773 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.773 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.773 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101624+0000", 2024-09-12T17:06:23.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5857e-05 2024-09-12T17:06:23.774 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.774 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.774 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.774 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101643+0000", 2024-09-12T17:06:23.774 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8547e-05 2024-09-12T17:06:23.774 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.775 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.775 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.775 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.775 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.775 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:69 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.775 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:23.775 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.586376297999998, 2024-09-12T17:06:23.775 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015412403, 2024-09-12T17:06:23.775 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.775 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.776 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.776 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.776 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.776 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.776 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 69 2024-09-12T17:06:23.776 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.776 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.776 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.776 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:23.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.777 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:23.777 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.777 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.777 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.777 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086302+0000", 2024-09-12T17:06:23.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.61e-07 2024-09-12T17:06:23.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.778 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086429+0000", 2024-09-12T17:06:23.778 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012675800000000001 2024-09-12T17:06:23.778 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.778 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.778 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086444+0000", 2024-09-12T17:06:23.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5310000000000001e-05 2024-09-12T17:06:23.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.779 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086457+0000", 2024-09-12T17:06:23.779 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2317000000000001e-05 2024-09-12T17:06:23.779 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.779 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.779 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089748+0000", 2024-09-12T17:06:23.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032910679999999999 2024-09-12T17:06:23.780 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.780 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.780 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.780 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089817+0000", 2024-09-12T17:06:23.780 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9136999999999999e-05 2024-09-12T17:06:23.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.089924+0000", 2024-09-12T17:06:23.781 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107611 2024-09-12T17:06:23.781 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.781 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.781 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.781 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093216+0000", 2024-09-12T17:06:23.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032914419999999999 2024-09-12T17:06:23.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.782 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101668+0000", 2024-09-12T17:06:23.782 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0084523629999999992 2024-09-12T17:06:23.782 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.782 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.782 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101694+0000", 2024-09-12T17:06:23.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6202000000000001e-05 2024-09-12T17:06:23.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.783 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.783 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101714+0000", 2024-09-12T17:06:23.783 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9434000000000001e-05 2024-09-12T17:06:23.783 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.783 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.783 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.783 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.783 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.784 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:70 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.784 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086485+0000", 2024-09-12T17:06:23.784 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.586192551000003, 2024-09-12T17:06:23.784 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015302071, 2024-09-12T17:06:23.784 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.784 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.784 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.784 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.784 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.784 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.785 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 70 2024-09-12T17:06:23.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.785 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086485+0000", 2024-09-12T17:06:23.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.785 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.785 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.785 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.785 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086485+0000", 2024-09-12T17:06:23.785 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086486+0000", 2024-09-12T17:06:23.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1170000000000001e-06 2024-09-12T17:06:23.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.786 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.786 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086493+0000", 2024-09-12T17:06:23.786 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5740000000000001e-06 2024-09-12T17:06:23.786 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.786 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086505+0000", 2024-09-12T17:06:23.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1562999999999999e-05 2024-09-12T17:06:23.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086512+0000", 2024-09-12T17:06:23.787 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8499999999999994e-06 2024-09-12T17:06:23.787 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.787 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.787 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.787 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090668+0000", 2024-09-12T17:06:23.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041558280000000003 2024-09-12T17:06:23.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090802+0000", 2024-09-12T17:06:23.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013367199999999999 2024-09-12T17:06:23.788 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.788 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.788 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.788 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.090997+0000", 2024-09-12T17:06:23.788 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019551400000000001 2024-09-12T17:06:23.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094672+0000", 2024-09-12T17:06:23.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036750749999999999 2024-09-12T17:06:23.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.789 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.789 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.789 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101741+0000", 2024-09-12T17:06:23.789 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0070688280000000001 2024-09-12T17:06:23.789 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101768+0000", 2024-09-12T17:06:23.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6676e-05 2024-09-12T17:06:23.790 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.790 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.790 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.790 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101787+0000", 2024-09-12T17:06:23.790 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9374000000000001e-05 2024-09-12T17:06:23.790 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.790 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.791 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.791 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.791 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.791 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:71 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.791 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086529+0000", 2024-09-12T17:06:23.791 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.586148411000003, 2024-09-12T17:06:23.791 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015328430000000001, 2024-09-12T17:06:23.791 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.791 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.791 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.792 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.792 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.792 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.792 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 71 2024-09-12T17:06:23.792 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.792 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.792 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086529+0000", 2024-09-12T17:06:23.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.793 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.793 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.793 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.793 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086529+0000", 2024-09-12T17:06:23.793 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.794 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086530+0000", 2024-09-12T17:06:23.794 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2799999999999996e-07 2024-09-12T17:06:23.794 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.794 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.794 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086534+0000", 2024-09-12T17:06:23.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.104e-06 2024-09-12T17:06:23.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.795 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086552+0000", 2024-09-12T17:06:23.795 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7716000000000001e-05 2024-09-12T17:06:23.795 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.795 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.795 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086569+0000", 2024-09-12T17:06:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6966e-05 2024-09-12T17:06:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091570+0000", 2024-09-12T17:06:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050011869999999998 2024-09-12T17:06:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.796 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091693+0000", 2024-09-12T17:06:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012295700000000001 2024-09-12T17:06:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.091871+0000", 2024-09-12T17:06:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017795899999999999 2024-09-12T17:06:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.797 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094676+0000", 2024-09-12T17:06:23.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028055089999999999 2024-09-12T17:06:23.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101811+0000", 2024-09-12T17:06:23.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0071346350000000003 2024-09-12T17:06:23.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.798 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.798 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.798 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101836+0000", 2024-09-12T17:06:23.798 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4592000000000001e-05 2024-09-12T17:06:23.798 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.799 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.799 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101858+0000", 2024-09-12T17:06:23.799 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2177000000000001e-05 2024-09-12T17:06:23.799 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.799 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.799 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.799 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.799 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.799 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:72 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.799 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086581+0000", 2024-09-12T17:06:23.799 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.586096382000001, 2024-09-12T17:06:23.800 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015450432, 2024-09-12T17:06:23.800 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.800 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.800 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.800 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.800 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.800 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.800 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 72 2024-09-12T17:06:23.800 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.800 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086581+0000", 2024-09-12T17:06:23.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.801 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.801 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.801 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.801 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086581+0000", 2024-09-12T17:06:23.801 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086582+0000", 2024-09-12T17:06:23.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.8599999999999998e-07 2024-09-12T17:06:23.802 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.802 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.802 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.802 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086664+0000", 2024-09-12T17:06:23.802 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1930999999999999e-05 2024-09-12T17:06:23.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086673+0000", 2024-09-12T17:06:23.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3340000000000008e-06 2024-09-12T17:06:23.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.803 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.803 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.803 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086682+0000", 2024-09-12T17:06:23.803 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6170000000000007e-06 2024-09-12T17:06:23.803 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.092334+0000", 2024-09-12T17:06:23.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056518610000000002 2024-09-12T17:06:23.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.804 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.804 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.092402+0000", 2024-09-12T17:06:23.804 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8198e-05 2024-09-12T17:06:23.804 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.804 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.092510+0000", 2024-09-12T17:06:23.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010851 2024-09-12T17:06:23.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096201+0000", 2024-09-12T17:06:23.805 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036908919999999999 2024-09-12T17:06:23.805 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.805 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.805 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.805 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101929+0000", 2024-09-12T17:06:23.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057277259999999998 2024-09-12T17:06:23.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.806 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.806 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.806 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.101993+0000", 2024-09-12T17:06:23.806 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.4068999999999999e-05 2024-09-12T17:06:23.806 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.807 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.807 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102032+0000", 2024-09-12T17:06:23.807 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8807999999999998e-05 2024-09-12T17:06:23.807 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.807 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.807 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.807 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.807 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.807 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:73 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.807 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:23.808 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.585976183, 2024-09-12T17:06:23.808 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015429554, 2024-09-12T17:06:23.808 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.808 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.808 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.808 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.808 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.808 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.808 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 73 2024-09-12T17:06:23.808 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.808 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:23.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.809 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.809 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:23.809 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.809 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.809 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086702+0000", 2024-09-12T17:06:23.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5599999999999995e-07 2024-09-12T17:06:23.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.810 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.810 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086709+0000", 2024-09-12T17:06:23.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9659999999999999e-06 2024-09-12T17:06:23.810 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086715+0000", 2024-09-12T17:06:23.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.361e-06 2024-09-12T17:06:23.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086721+0000", 2024-09-12T17:06:23.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3860000000000004e-06 2024-09-12T17:06:23.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093279+0000", 2024-09-12T17:06:23.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065577719999999999 2024-09-12T17:06:23.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093415+0000", 2024-09-12T17:06:23.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013671899999999999 2024-09-12T17:06:23.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.093611+0000", 2024-09-12T17:06:23.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019514700000000001 2024-09-12T17:06:23.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096205+0000", 2024-09-12T17:06:23.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025945569999999999 2024-09-12T17:06:23.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102084+0000", 2024-09-12T17:06:23.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058785119999999998 2024-09-12T17:06:23.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102111+0000", 2024-09-12T17:06:23.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6970000000000001e-05 2024-09-12T17:06:23.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102131+0000", 2024-09-12T17:06:23.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0608e-05 2024-09-12T17:06:23.815 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.815 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.815 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.817 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.817 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:23.817 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.585947963999999, 2024-09-12T17:06:23.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015560805, 2024-09-12T17:06:23.817 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.817 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.817 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.817 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.817 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.818 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.818 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 74 2024-09-12T17:06:23.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.818 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:23.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:23.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086730+0000", 2024-09-12T17:06:23.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8099999999999998e-07 2024-09-12T17:06:23.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086733+0000", 2024-09-12T17:06:23.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.65e-06 2024-09-12T17:06:23.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086740+0000", 2024-09-12T17:06:23.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6200000000000001e-06 2024-09-12T17:06:23.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086744+0000", 2024-09-12T17:06:23.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3239999999999996e-06 2024-09-12T17:06:23.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094098+0000", 2024-09-12T17:06:23.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0073542909999999998 2024-09-12T17:06:23.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094177+0000", 2024-09-12T17:06:23.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9290999999999997e-05 2024-09-12T17:06:23.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094286+0000", 2024-09-12T17:06:23.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000108646 2024-09-12T17:06:23.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096213+0000", 2024-09-12T17:06:23.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001926587 2024-09-12T17:06:23.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102201+0000", 2024-09-12T17:06:23.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059879360000000001 2024-09-12T17:06:23.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102250+0000", 2024-09-12T17:06:23.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9882000000000001e-05 2024-09-12T17:06:23.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102291+0000", 2024-09-12T17:06:23.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0197000000000002e-05 2024-09-12T17:06:23.825 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.825 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.825 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.825 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.585925879000001, 2024-09-12T17:06:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015655273000000001, 2024-09-12T17:06:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 75 2024-09-12T17:06:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.826 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086752+0000", 2024-09-12T17:06:23.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3299999999999998e-07 2024-09-12T17:06:23.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086811+0000", 2024-09-12T17:06:23.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9194000000000003e-05 2024-09-12T17:06:23.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086819+0000", 2024-09-12T17:06:23.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7640000000000005e-06 2024-09-12T17:06:23.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086826+0000", 2024-09-12T17:06:23.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.126e-06 2024-09-12T17:06:23.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094745+0000", 2024-09-12T17:06:23.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0079189989999999995 2024-09-12T17:06:23.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.094870+0000", 2024-09-12T17:06:23.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012493500000000001 2024-09-12T17:06:23.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095045+0000", 2024-09-12T17:06:23.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000174465 2024-09-12T17:06:23.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096216+0000", 2024-09-12T17:06:23.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001171014 2024-09-12T17:06:23.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102355+0000", 2024-09-12T17:06:23.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061392579999999999 2024-09-12T17:06:23.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102383+0000", 2024-09-12T17:06:23.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8308000000000001e-05 2024-09-12T17:06:23.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102407+0000", 2024-09-12T17:06:23.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3876999999999999e-05 2024-09-12T17:06:23.832 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.832 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.832 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.833 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:06:23.833 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:36.086838+0000", 2024-09-12T17:06:23.833 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 47.585839610999997, 2024-09-12T17:06:23.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015725032, 2024-09-12T17:06:23.833 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:23.833 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:23.833 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:23.833 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:23.833 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:06:23.833 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:06:23.834 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 76 2024-09-12T17:06:23.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.834 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:23.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:23.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086838+0000", 2024-09-12T17:06:23.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:23.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086838+0000", 2024-09-12T17:06:23.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:23.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:23.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086839+0000", 2024-09-12T17:06:23.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1399999999999997e-07 2024-09-12T17:06:23.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:23.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086842+0000", 2024-09-12T17:06:23.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0920000000000002e-06 2024-09-12T17:06:23.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:23.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086848+0000", 2024-09-12T17:06:23.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.674e-06 2024-09-12T17:06:23.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:23.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.086852+0000", 2024-09-12T17:06:23.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8909999999999997e-06 2024-09-12T17:06:23.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:23.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095627+0000", 2024-09-12T17:06:23.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087745189999999997 2024-09-12T17:06:23.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:23.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095713+0000", 2024-09-12T17:06:23.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.5958000000000006e-05 2024-09-12T17:06:23.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:23.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.095824+0000", 2024-09-12T17:06:23.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011079 2024-09-12T17:06:23.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:23.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.096550+0000", 2024-09-12T17:06:23.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00072662200000000001 2024-09-12T17:06:23.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:23.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102471+0000", 2024-09-12T17:06:23.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059210419999999996 2024-09-12T17:06:23.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:23.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102533+0000", 2024-09-12T17:06:23.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.1321000000000005e-05 2024-09-12T17:06:23.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:23.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:23.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:23.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:36.102563+0000", 2024-09-12T17:06:23.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0608999999999998e-05 2024-09-12T17:06:23.840 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.840 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.840 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.840 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:23.840 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:23.840 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:23.842 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:06:23.842 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:23.837+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:23.943 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:23.941+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:23.982 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:23.983 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:23.983 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:23.983 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:23.998 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:06:24.083 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:24.081+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:24.145 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:24.144+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:24.164 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:24.164 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:24.164 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:24.164 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:24.164 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:24.180 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:06:24.267 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:24.265+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:24.340 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:64 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'40)", 2024-09-12T17:06:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.251345178000001, 2024-09-12T17:06:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014733802000000001, 2024-09-12T17:06:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.340 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084341+0000", 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9700000000000002e-06 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084353+0000", 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2279999999999999e-05 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084382+0000", 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9179e-05 2024-09-12T17:06:24.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084395+0000", 2024-09-12T17:06:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.322e-05 2024-09-12T17:06:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084525+0000", 2024-09-12T17:06:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129789 2024-09-12T17:06:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084582+0000", 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6486000000000001e-05 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099005+0000", 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014423689 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099073+0000", 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7188999999999997e-05 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.344 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:65 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'40)", 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.250524177999999, 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013950562, 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085162+0000", 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0099999999999998e-06 2024-09-12T17:06:24.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085174+0000", 2024-09-12T17:06:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2223e-05 2024-09-12T17:06:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085222+0000", 2024-09-12T17:06:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8029999999999999e-05 2024-09-12T17:06:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085237+0000", 2024-09-12T17:06:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4666e-05 2024-09-12T17:06:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085428+0000", 2024-09-12T17:06:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019164900000000001 2024-09-12T17:06:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085488+0000", 2024-09-12T17:06:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0149000000000003e-05 2024-09-12T17:06:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099075+0000", 2024-09-12T17:06:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013587042000000001 2024-09-12T17:06:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099110+0000", 2024-09-12T17:06:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4792999999999997e-05 2024-09-12T17:06:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.351 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:66 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T17:06:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.249732057999999, 2024-09-12T17:06:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013198259, 2024-09-12T17:06:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.352 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085954+0000", 2024-09-12T17:06:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0530000000000001e-06 2024-09-12T17:06:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086013+0000", 2024-09-12T17:06:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8854000000000003e-05 2024-09-12T17:06:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086045+0000", 2024-09-12T17:06:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2672999999999997e-05 2024-09-12T17:06:24.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086058+0000", 2024-09-12T17:06:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.306e-05 2024-09-12T17:06:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086438+0000", 2024-09-12T17:06:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037959300000000001 2024-09-12T17:06:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086495+0000", 2024-09-12T17:06:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6679999999999999e-05 2024-09-12T17:06:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099115+0000", 2024-09-12T17:06:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012620256 2024-09-12T17:06:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099150+0000", 2024-09-12T17:06:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5089999999999998e-05 2024-09-12T17:06:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.358 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:67 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'45, mlcod=17'40)", 2024-09-12T17:06:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.248815178000001, 2024-09-12T17:06:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012332911, 2024-09-12T17:06:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.359 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:24.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086871+0000", 2024-09-12T17:06:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.063e-06 2024-09-12T17:06:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086884+0000", 2024-09-12T17:06:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.294e-05 2024-09-12T17:06:24.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086970+0000", 2024-09-12T17:06:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6312999999999998e-05 2024-09-12T17:06:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086990+0000", 2024-09-12T17:06:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9602999999999998e-05 2024-09-12T17:06:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087863+0000", 2024-09-12T17:06:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087312999999999996 2024-09-12T17:06:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087915+0000", 2024-09-12T17:06:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2516000000000003e-05 2024-09-12T17:06:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099152+0000", 2024-09-12T17:06:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011237 2024-09-12T17:06:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099202+0000", 2024-09-12T17:06:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9345999999999998e-05 2024-09-12T17:06:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'46, mlcod=17'40)", 2024-09-12T17:06:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.248096222999997, 2024-09-12T17:06:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011670056, 2024-09-12T17:06:24.367 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:24.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:24.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087590+0000", 2024-09-12T17:06:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.956e-06 2024-09-12T17:06:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087602+0000", 2024-09-12T17:06:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1939999999999999e-05 2024-09-12T17:06:24.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087630+0000", 2024-09-12T17:06:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8736000000000001e-05 2024-09-12T17:06:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087652+0000", 2024-09-12T17:06:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1693000000000001e-05 2024-09-12T17:06:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088864+0000", 2024-09-12T17:06:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001211578 2024-09-12T17:06:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088939+0000", 2024-09-12T17:06:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5885999999999998e-05 2024-09-12T17:06:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099206+0000", 2024-09-12T17:06:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010266287000000001 2024-09-12T17:06:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099258+0000", 2024-09-12T17:06:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.198e-05 2024-09-12T17:06:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'47, mlcod=17'40)", 2024-09-12T17:06:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.247354895999997, 2024-09-12T17:06:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010963379000000001, 2024-09-12T17:06:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088331+0000", 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088388+0000", 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7274000000000001e-05 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088418+0000", 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9609000000000001e-05 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088439+0000", 2024-09-12T17:06:24.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0820000000000001e-05 2024-09-12T17:06:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090024+0000", 2024-09-12T17:06:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001585588 2024-09-12T17:06:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090090+0000", 2024-09-12T17:06:24.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5660000000000005e-05 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099260+0000", 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091697050000000002 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099292+0000", 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2750000000000003e-05 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.383 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'48, mlcod=17'40)", 2024-09-12T17:06:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.246275580999999, 2024-09-12T17:06:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0099341629999999993, 2024-09-12T17:06:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:24.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:24.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089410+0000", 2024-09-12T17:06:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9740000000000001e-06 2024-09-12T17:06:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089424+0000", 2024-09-12T17:06:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4036000000000001e-05 2024-09-12T17:06:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089466+0000", 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1563000000000002e-05 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089492+0000", 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5812999999999998e-05 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091523+0000", 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002030895 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091564+0000", 2024-09-12T17:06:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1263000000000001e-05 2024-09-12T17:06:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099294+0000", 2024-09-12T17:06:24.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0077302400000000002 2024-09-12T17:06:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099342+0000", 2024-09-12T17:06:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8378999999999999e-05 2024-09-12T17:06:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:71 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'49, mlcod=17'40)", 2024-09-12T17:06:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.245468572999997, 2024-09-12T17:06:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0092012150000000004, 2024-09-12T17:06:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.391 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090217+0000", 2024-09-12T17:06:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090229+0000", 2024-09-12T17:06:24.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090261+0000", 2024-09-12T17:06:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1986999999999997e-05 2024-09-12T17:06:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090280+0000", 2024-09-12T17:06:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8536e-05 2024-09-12T17:06:24.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092530+0000", 2024-09-12T17:06:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022498959999999999 2024-09-12T17:06:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092588+0000", 2024-09-12T17:06:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8276000000000002e-05 2024-09-12T17:06:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099345+0000", 2024-09-12T17:06:24.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006757028 2024-09-12T17:06:24.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099417+0000", 2024-09-12T17:06:24.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1645999999999998e-05 2024-09-12T17:06:24.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.400 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:72 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'50, mlcod=17'40)", 2024-09-12T17:06:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:24.401 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.244800322000003, 2024-09-12T17:06:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085677930000000006, 2024-09-12T17:06:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090885+0000", 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3799999999999999e-06 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090938+0000", 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3013000000000002e-05 2024-09-12T17:06:24.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090965+0000", 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6610000000000001e-05 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090979+0000", 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4113e-05 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093482+0000", 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025028870000000001 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093573+0000", 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0989999999999994e-05 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099418+0000", 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058459109999999996 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099451+0000", 2024-09-12T17:06:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2889000000000003e-05 2024-09-12T17:06:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:73 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'51, mlcod=17'40)", 2024-09-12T17:06:24.406 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.243688161000001, 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075262419999999998, 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091998+0000", 2024-09-12T17:06:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.894e-06 2024-09-12T17:06:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092010+0000", 2024-09-12T17:06:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2176e-05 2024-09-12T17:06:24.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092043+0000", 2024-09-12T17:06:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3226999999999999e-05 2024-09-12T17:06:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092062+0000", 2024-09-12T17:06:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9453000000000002e-05 2024-09-12T17:06:24.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.095140+0000", 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00307792 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.095196+0000", 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6008999999999999e-05 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099453+0000", 2024-09-12T17:06:24.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042563899999999997 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099522+0000", 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9172999999999997e-05 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:74 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'52, mlcod=17'40)", 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:24.411 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.243082848999997, 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0069855890000000004, 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092603+0000", 2024-09-12T17:06:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0099999999999998e-06 2024-09-12T17:06:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092618+0000", 2024-09-12T17:06:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.469e-05 2024-09-12T17:06:24.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092647+0000", 2024-09-12T17:06:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9107000000000001e-05 2024-09-12T17:06:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092660+0000", 2024-09-12T17:06:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.347e-05 2024-09-12T17:06:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.096074+0000", 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034132300000000002 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.096158+0000", 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4863000000000004e-05 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099524+0000", 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033656670000000001 2024-09-12T17:06:24.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099587+0000", 2024-09-12T17:06:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2551999999999993e-05 2024-09-12T17:06:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:75 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'40)", 2024-09-12T17:06:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:24.416 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.242256755, 2024-09-12T17:06:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006221725, 2024-09-12T17:06:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093429+0000", 2024-09-12T17:06:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1299999999999999e-06 2024-09-12T17:06:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093522+0000", 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2236000000000003e-05 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093562+0000", 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0386000000000003e-05 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093576+0000", 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4154e-05 2024-09-12T17:06:24.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.097039+0000", 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034632629999999998 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.097092+0000", 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2918999999999999e-05 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099591+0000", 2024-09-12T17:06:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024984310000000002 2024-09-12T17:06:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099649+0000", 2024-09-12T17:06:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8205999999999998e-05 2024-09-12T17:06:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:76 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'40)", 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.241531924, 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057612949999999996, 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094154+0000", 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2699999999999999e-06 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094169+0000", 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4296e-05 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094203+0000", 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3980000000000003e-05 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094220+0000", 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7337e-05 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.098459+0000", 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004238917 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.098495+0000", 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6662999999999998e-05 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099861+0000", 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013660359999999999 2024-09-12T17:06:24.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099913+0000", 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1795999999999997e-05 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:77 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'55, mlcod=17'53)", 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.234181720999999, 2024-09-12T17:06:24.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030906760000000001, 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101504+0000", 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.353e-06 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101585+0000", 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1576000000000006e-05 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101614+0000", 2024-09-12T17:06:24.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9133e-05 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101627+0000", 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3253e-05 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101727+0000", 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9569999999999997e-05 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101764+0000", 2024-09-12T17:06:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6495999999999998e-05 2024-09-12T17:06:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.104506+0000", 2024-09-12T17:06:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027422660000000001 2024-09-12T17:06:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.104593+0000", 2024-09-12T17:06:24.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7028999999999996e-05 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.751207501, 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036836849999999999, 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.433 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 206 2024-09-12T17:06:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584480+0000", 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4860000000000002e-06 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584496+0000", 2024-09-12T17:06:24.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5883999999999999e-05 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584534+0000", 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8089000000000001e-05 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584551+0000", 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7220000000000001e-05 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584691+0000", 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013991599999999999 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584957+0000", 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000266161 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.585389+0000", 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00043172399999999997 2024-09-12T17:06:24.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.587593+0000", 2024-09-12T17:06:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022045160000000001 2024-09-12T17:06:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.587984+0000", 2024-09-12T17:06:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039048099999999998 2024-09-12T17:06:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588073+0000", 2024-09-12T17:06:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8648999999999998e-05 2024-09-12T17:06:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588160+0000", 2024-09-12T17:06:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7559000000000007e-05 2024-09-12T17:06:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.733798996000001, 2024-09-12T17:06:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039464799999999996, 2024-09-12T17:06:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:24.440 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 210 2024-09-12T17:06:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601887+0000", 2024-09-12T17:06:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5170000000000002e-06 2024-09-12T17:06:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601899+0000", 2024-09-12T17:06:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1897e-05 2024-09-12T17:06:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601930+0000", 2024-09-12T17:06:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0190000000000001e-05 2024-09-12T17:06:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601945+0000", 2024-09-12T17:06:24.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5075999999999999e-05 2024-09-12T17:06:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.602115+0000", 2024-09-12T17:06:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016993600000000001 2024-09-12T17:06:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.602470+0000", 2024-09-12T17:06:24.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000355554 2024-09-12T17:06:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.603208+0000", 2024-09-12T17:06:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073791700000000004 2024-09-12T17:06:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.604956+0000", 2024-09-12T17:06:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00174832 2024-09-12T17:06:24.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605676+0000", 2024-09-12T17:06:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071966100000000002 2024-09-12T17:06:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605762+0000", 2024-09-12T17:06:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6159e-05 2024-09-12T17:06:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605831+0000", 2024-09-12T17:06:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9252999999999996e-05 2024-09-12T17:06:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:24.447 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.703814350000002, 2024-09-12T17:06:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033897799999999998, 2024-09-12T17:06:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 218 2024-09-12T17:06:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631872+0000", 2024-09-12T17:06:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9469999999999999e-06 2024-09-12T17:06:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631884+0000", 2024-09-12T17:06:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1823e-05 2024-09-12T17:06:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631916+0000", 2024-09-12T17:06:24.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1319999999999998e-05 2024-09-12T17:06:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631931+0000", 2024-09-12T17:06:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5299e-05 2024-09-12T17:06:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632074+0000", 2024-09-12T17:06:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142922 2024-09-12T17:06:24.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632301+0000", 2024-09-12T17:06:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022715600000000001 2024-09-12T17:06:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632716+0000", 2024-09-12T17:06:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041482900000000002 2024-09-12T17:06:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.634244+0000", 2024-09-12T17:06:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001528242 2024-09-12T17:06:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635103+0000", 2024-09-12T17:06:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085923399999999995 2024-09-12T17:06:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635189+0000", 2024-09-12T17:06:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5405e-05 2024-09-12T17:06:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635259+0000", 2024-09-12T17:06:24.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0603000000000001e-05 2024-09-12T17:06:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.688845965999999, 2024-09-12T17:06:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033001250000000001, 2024-09-12T17:06:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 222 2024-09-12T17:06:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646841+0000", 2024-09-12T17:06:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9969999999999999e-06 2024-09-12T17:06:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646853+0000", 2024-09-12T17:06:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2500000000000001e-05 2024-09-12T17:06:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646884+0000", 2024-09-12T17:06:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.048e-05 2024-09-12T17:06:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646899+0000", 2024-09-12T17:06:24.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4810000000000001e-05 2024-09-12T17:06:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647031+0000", 2024-09-12T17:06:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013203499999999999 2024-09-12T17:06:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647248+0000", 2024-09-12T17:06:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021723200000000001 2024-09-12T17:06:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647648+0000", 2024-09-12T17:06:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040051000000000003 2024-09-12T17:06:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.649222+0000", 2024-09-12T17:06:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015737150000000001 2024-09-12T17:06:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.649984+0000", 2024-09-12T17:06:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076208000000000005 2024-09-12T17:06:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.650070+0000", 2024-09-12T17:06:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6032999999999994e-05 2024-09-12T17:06:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.650138+0000", 2024-09-12T17:06:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7732999999999997e-05 2024-09-12T17:06:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.658958302999999, 2024-09-12T17:06:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041653740000000003, 2024-09-12T17:06:24.462 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 230 2024-09-12T17:06:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:24.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:24.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676728+0000", 2024-09-12T17:06:24.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4899999999999999e-06 2024-09-12T17:06:24.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676739+0000", 2024-09-12T17:06:24.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1226000000000001e-05 2024-09-12T17:06:24.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676770+0000", 2024-09-12T17:06:24.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0297000000000001e-05 2024-09-12T17:06:24.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676784+0000", 2024-09-12T17:06:24.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4796e-05 2024-09-12T17:06:24.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676940+0000", 2024-09-12T17:06:24.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015539300000000001 2024-09-12T17:06:24.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.677328+0000", 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038856699999999998 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.678139+0000", 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081085 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.679704+0000", 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015644109999999999 2024-09-12T17:06:24.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680598+0000", 2024-09-12T17:06:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00089426999999999996 2024-09-12T17:06:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680767+0000", 2024-09-12T17:06:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016875500000000001 2024-09-12T17:06:24.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680891+0000", 2024-09-12T17:06:24.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012431899999999999 2024-09-12T17:06:24.469 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.469 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.469 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.469 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:24.469 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:24.470 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.381087805, 2024-09-12T17:06:24.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033901650000000001, 2024-09-12T17:06:24.470 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.470 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:24.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:24.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:24.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 712 2024-09-12T17:06:24.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.470 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954598+0000", 2024-09-12T17:06:24.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6249999999999999e-06 2024-09-12T17:06:24.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954605+0000", 2024-09-12T17:06:24.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7219999999999999e-06 2024-09-12T17:06:24.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954625+0000", 2024-09-12T17:06:24.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0013e-05 2024-09-12T17:06:24.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954635+0000", 2024-09-12T17:06:24.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2310000000000002e-06 2024-09-12T17:06:24.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954787+0000", 2024-09-12T17:06:24.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015215399999999999 2024-09-12T17:06:24.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.955172+0000", 2024-09-12T17:06:24.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038501699999999998 2024-09-12T17:06:24.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:24.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.955729+0000", 2024-09-12T17:06:24.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055745600000000001 2024-09-12T17:06:24.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:24.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.956989+0000", 2024-09-12T17:06:24.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012593179999999999 2024-09-12T17:06:24.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:24.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957706+0000", 2024-09-12T17:06:24.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000717477 2024-09-12T17:06:24.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957868+0000", 2024-09-12T17:06:24.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016208300000000001 2024-09-12T17:06:24.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957986+0000", 2024-09-12T17:06:24.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118069 2024-09-12T17:06:24.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.476 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.477 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.477 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.477 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:24.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:06:24.479 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:24.473+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:24.579 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:24.576+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:24.652 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:24.653 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:24.653 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:24.653 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:24.666 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:06:24.711 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:24.709+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:24.742 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T17:06:24.781 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:24.780+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:24.786 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:24.786 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:24.786 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:24.786 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:24.786 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:24.800 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:06:24.882 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:24.880+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:24.964 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:24.964 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:24.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:24.964 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:24.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.964 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:24.964 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:24.964 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.433750113999999, 2024-09-12T17:06:24.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:06:24.964 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:24.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:24.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:24.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:24.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:06:24.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.965 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:24.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:24.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:06:24.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:06:24.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:06:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:06:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:06:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:06:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.970 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:24.970 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:24.970 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.276117918000001, 2024-09-12T17:06:24.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:06:24.970 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:24.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:24.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:24.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:06:24.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.971 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:24.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:24.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:06:24.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:24.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:06:24.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:06:24.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:24.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:06:24.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:06:24.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:06:24.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:06:24.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:06:24.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:06:24.976 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.976 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.976 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.366024124999999, 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.977 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:06:24.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:24.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:06:24.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:06:24.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:24.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:06:24.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:06:24.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.982 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.983 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.983 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:24.983 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:24.983 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.350133383999999, 2024-09-12T17:06:24.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:06:24.983 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.983 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:24.984 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:24.984 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:24.984 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:06:24.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.984 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:24.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:06:24.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:06:24.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:24.989 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.324664714000001, 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:06:24.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:24.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.996 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:24.996 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:24.996 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.305703612999999, 2024-09-12T17:06:24.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:06:24.996 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:24.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:24.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:24.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:24.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:24.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:24.996 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:06:24.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:06:24.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:06:25.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:25.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:06:25.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:06:25.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:06:25.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:06:25.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:06:25.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.002 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.002 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.002 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:25.002 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.271148313000001, 2024-09-12T17:06:25.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:06:25.002 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:06:25.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.003 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:25.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:06:25.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:06:25.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:06:25.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:06:25.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:06:25.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:06:25.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:25.008 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.957928899999999, 2024-09-12T17:06:25.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:06:25.009 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.009 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.009 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.009 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.009 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.009 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.009 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:06:25.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.009 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:25.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:06:25.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.953037532, 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:06:25.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.016 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:25.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:25.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:06:25.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:06:25.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.914062073, 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:06:25.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.910164098999999, 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.028 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.028 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.028 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.028 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.028 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:06:25.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.028 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:25.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:06:25.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:06:25.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:06:25.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:06:25.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:06:25.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:06:25.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:06:25.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:06:25.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:06:25.033 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.033 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.841404867000001, 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:06:25.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.035 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:25.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:25.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:06:25.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:06:25.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:06:25.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:25.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:06:25.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:06:25.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:06:25.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:06:25.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:06:25.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:06:25.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:06:25.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:06:25.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:06:25.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:06:25.042 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.042 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.805560852999999, 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.043 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:06:25.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.785373482000001, 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.049 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:06:25.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:06:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:06:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:06:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:06:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:06:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:06:25.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:06:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:06:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:06:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:06:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.780479119999999, 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.055 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:06:25.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:06:25.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:06:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:06:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:06:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:06:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:06:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:06:25.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.718510965, 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.062 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:25.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:06:25.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.71410419, 2024-09-12T17:06:25.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:06:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:06:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:06:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:06:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:06:25.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:06:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:06:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:06:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:06:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:06:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:06:25.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.074 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.546704848000001, 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.075 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:06:25.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:06:25.080 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.515929815, 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:06:25.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 25.511017559999999, 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:25.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:25.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:25.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:06:25.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:25.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.092 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:25.093 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:25.093 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:25.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:06:25.095 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:25.089+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:25.195 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:25.192+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:25.252 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:25.252 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:25.252 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:25.252 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:25.266 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:06:25.297 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:25.296+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:25.388 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:06:25.400 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:25.400 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:25.400 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:25.400 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:25.400 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:25.410 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:25.405+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:25.416 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:06:25.498 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:25.496+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:25.526 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:25.526 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:25.543 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:25.543 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:25.561 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:25.561 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:25.577 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:25.578 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:25.598 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:25.599 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:25.599 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:25.599 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:25.599 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:25.597+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:25.612 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:06:25.620 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:25.620 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:25.640 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:25.641 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:25.661 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:25.661 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:25.700 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:25.696+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:25.727 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T17:06:25.751 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:25.751 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:25.764 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:06:25.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:25.805+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:25.901 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:25.900+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:25.927 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:25.928 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:25.941 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:06:26.002 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:25.997+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:26.055 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:26.055 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:26.069 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:06:26.111 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:26.109+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:26.204 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:26.200+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:26.208 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:26.208 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:26.223 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:06:26.306 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:26.301+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:26.393 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:26.393 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:26.406 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:26.401+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:26.408 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:06:26.507 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:26.505+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:26.535 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:26.535 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:26.551 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:06:26.608 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:26.605+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:26.679 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:26.679 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:26.694 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:06:26.709 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:26.705+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:26.810 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:26.805+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:26.820 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:26.821 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:26.836 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:06:26.911 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:26.908+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:26.962 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:26.962 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:26.977 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:06:27.011 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:27.009+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:27.113 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:27.109+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:27.148 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:27.148 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:27.163 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:06:27.213 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:27.209+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:27.291 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:27.291 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:27.306 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:06:27.314 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:27.309+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:27.415 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:27.413+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:27.433 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:27.433 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:27.448 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:06:27.517 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:27.512+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:27.579 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:27.579 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:27.594 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:06:27.617 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:27.613+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:27.678 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:06:27.723 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:27.721+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:27.748 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T17:06:27.768 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:27.768 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:27.784 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:06:27.829 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:27.828+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:27.855 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:27.855 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:27.886 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:27.886 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:27.904 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:27.904 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:27.910 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:27.910 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:27.918 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:27.916+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:27.923 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:27.923 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:27.924 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:06:27.955 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:27.955 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:27.984 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:27.984 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:28.006 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:28.006 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:28.019 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:28.017+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:28.027 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:28.027 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:28.048 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:28.048 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:28.048 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:28.049 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:28.063 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:06:28.121 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:28.116+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:28.222 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:28.217+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:28.222 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:28.223 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:28.223 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:28.223 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:28.223 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:28.236 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:06:28.323 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:28.320+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:28.395 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:28.395 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:28.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:28.396 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:28.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.396 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:64 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'40)", 2024-09-12T17:06:28.396 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:28.396 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.307842549, 2024-09-12T17:06:28.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014733802000000001, 2024-09-12T17:06:28.396 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.396 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.396 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.396 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084341+0000", 2024-09-12T17:06:28.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9700000000000002e-06 2024-09-12T17:06:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084353+0000", 2024-09-12T17:06:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2279999999999999e-05 2024-09-12T17:06:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084382+0000", 2024-09-12T17:06:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9179e-05 2024-09-12T17:06:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084395+0000", 2024-09-12T17:06:28.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.322e-05 2024-09-12T17:06:28.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084525+0000", 2024-09-12T17:06:28.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129789 2024-09-12T17:06:28.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084582+0000", 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6486000000000001e-05 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099005+0000", 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014423689 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099073+0000", 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7188999999999997e-05 2024-09-12T17:06:28.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:65 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'40)", 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.307021548999998, 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013950562, 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085162+0000", 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0099999999999998e-06 2024-09-12T17:06:28.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085174+0000", 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2223e-05 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085222+0000", 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8029999999999999e-05 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085237+0000", 2024-09-12T17:06:28.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4666e-05 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085428+0000", 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019164900000000001 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085488+0000", 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0149000000000003e-05 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099075+0000", 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013587042000000001 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099110+0000", 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4792999999999997e-05 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.405 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:66 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.306229428999998, 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013198259, 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085954+0000", 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0530000000000001e-06 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086013+0000", 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8854000000000003e-05 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086045+0000", 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2672999999999997e-05 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086058+0000", 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.306e-05 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086438+0000", 2024-09-12T17:06:28.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037959300000000001 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086495+0000", 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6679999999999999e-05 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099115+0000", 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012620256 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099150+0000", 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5089999999999998e-05 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:67 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'45, mlcod=17'40)", 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.305312549, 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012332911, 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.410 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086871+0000", 2024-09-12T17:06:28.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.063e-06 2024-09-12T17:06:28.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086884+0000", 2024-09-12T17:06:28.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.294e-05 2024-09-12T17:06:28.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086970+0000", 2024-09-12T17:06:28.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6312999999999998e-05 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086990+0000", 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9602999999999998e-05 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087863+0000", 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087312999999999996 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087915+0000", 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2516000000000003e-05 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099152+0000", 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011237 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099202+0000", 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9345999999999998e-05 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.414 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'46, mlcod=17'40)", 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.304593594000004, 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011670056, 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:28.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:28.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087590+0000", 2024-09-12T17:06:28.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.956e-06 2024-09-12T17:06:28.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087602+0000", 2024-09-12T17:06:28.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1939999999999999e-05 2024-09-12T17:06:28.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087630+0000", 2024-09-12T17:06:28.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8736000000000001e-05 2024-09-12T17:06:28.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087652+0000", 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1693000000000001e-05 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088864+0000", 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001211578 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088939+0000", 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5885999999999998e-05 2024-09-12T17:06:28.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099206+0000", 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010266287000000001 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099258+0000", 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.198e-05 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.420 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'47, mlcod=17'40)", 2024-09-12T17:06:28.420 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:28.420 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.303852267000003, 2024-09-12T17:06:28.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010963379000000001, 2024-09-12T17:06:28.420 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.420 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.420 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.420 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088331+0000", 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088388+0000", 2024-09-12T17:06:28.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7274000000000001e-05 2024-09-12T17:06:28.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088418+0000", 2024-09-12T17:06:28.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9609000000000001e-05 2024-09-12T17:06:28.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088439+0000", 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0820000000000001e-05 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090024+0000", 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001585588 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090090+0000", 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5660000000000005e-05 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099260+0000", 2024-09-12T17:06:28.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091697050000000002 2024-09-12T17:06:28.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099292+0000", 2024-09-12T17:06:28.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2750000000000003e-05 2024-09-12T17:06:28.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.424 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.424 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'48, mlcod=17'40)", 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.302772951999998, 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0099341629999999993, 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089410+0000", 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9740000000000001e-06 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089424+0000", 2024-09-12T17:06:28.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4036000000000001e-05 2024-09-12T17:06:28.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089466+0000", 2024-09-12T17:06:28.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1563000000000002e-05 2024-09-12T17:06:28.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089492+0000", 2024-09-12T17:06:28.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5812999999999998e-05 2024-09-12T17:06:28.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091523+0000", 2024-09-12T17:06:28.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002030895 2024-09-12T17:06:28.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091564+0000", 2024-09-12T17:06:28.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1263000000000001e-05 2024-09-12T17:06:28.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099294+0000", 2024-09-12T17:06:28.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0077302400000000002 2024-09-12T17:06:28.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099342+0000", 2024-09-12T17:06:28.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8378999999999999e-05 2024-09-12T17:06:28.429 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.429 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.429 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:71 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'49, mlcod=17'40)", 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.301965944000003, 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0092012150000000004, 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:28.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090217+0000", 2024-09-12T17:06:28.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:28.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090229+0000", 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090261+0000", 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1986999999999997e-05 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090280+0000", 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8536e-05 2024-09-12T17:06:28.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092530+0000", 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022498959999999999 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092588+0000", 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8276000000000002e-05 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099345+0000", 2024-09-12T17:06:28.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006757028 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099417+0000", 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1645999999999998e-05 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:72 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'50, mlcod=17'40)", 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:28.434 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.301297693000002, 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085677930000000006, 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:28.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090885+0000", 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3799999999999999e-06 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090938+0000", 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3013000000000002e-05 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090965+0000", 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6610000000000001e-05 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090979+0000", 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4113e-05 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093482+0000", 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025028870000000001 2024-09-12T17:06:28.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093573+0000", 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0989999999999994e-05 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099418+0000", 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058459109999999996 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099451+0000", 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2889000000000003e-05 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:73 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'51, mlcod=17'40)", 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.300185532, 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075262419999999998, 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.439 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.440 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:28.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:28.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091998+0000", 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.894e-06 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092010+0000", 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2176e-05 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092043+0000", 2024-09-12T17:06:28.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3226999999999999e-05 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092062+0000", 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9453000000000002e-05 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.095140+0000", 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00307792 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.095196+0000", 2024-09-12T17:06:28.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6008999999999999e-05 2024-09-12T17:06:28.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099453+0000", 2024-09-12T17:06:28.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042563899999999997 2024-09-12T17:06:28.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099522+0000", 2024-09-12T17:06:28.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9172999999999997e-05 2024-09-12T17:06:28.443 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:74 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'52, mlcod=17'40)", 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.299580220000003, 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0069855890000000004, 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:28.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:28.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092603+0000", 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0099999999999998e-06 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092618+0000", 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.469e-05 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092647+0000", 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9107000000000001e-05 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092660+0000", 2024-09-12T17:06:28.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.347e-05 2024-09-12T17:06:28.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.096074+0000", 2024-09-12T17:06:28.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034132300000000002 2024-09-12T17:06:28.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.096158+0000", 2024-09-12T17:06:28.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4863000000000004e-05 2024-09-12T17:06:28.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099524+0000", 2024-09-12T17:06:28.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033656670000000001 2024-09-12T17:06:28.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099587+0000", 2024-09-12T17:06:28.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2551999999999993e-05 2024-09-12T17:06:28.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.449 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.449 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:75 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'40)", 2024-09-12T17:06:28.449 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:28.449 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.298754125999999, 2024-09-12T17:06:28.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006221725, 2024-09-12T17:06:28.449 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093429+0000", 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1299999999999999e-06 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093522+0000", 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2236000000000003e-05 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093562+0000", 2024-09-12T17:06:28.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0386000000000003e-05 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093576+0000", 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4154e-05 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.097039+0000", 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034632629999999998 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.097092+0000", 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2918999999999999e-05 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099591+0000", 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024984310000000002 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099649+0000", 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8205999999999998e-05 2024-09-12T17:06:28.453 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:76 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'40)", 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.298029294999999, 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057612949999999996, 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094154+0000", 2024-09-12T17:06:28.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2699999999999999e-06 2024-09-12T17:06:28.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094169+0000", 2024-09-12T17:06:28.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4296e-05 2024-09-12T17:06:28.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094203+0000", 2024-09-12T17:06:28.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3980000000000003e-05 2024-09-12T17:06:28.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094220+0000", 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7337e-05 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.098459+0000", 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004238917 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.098495+0000", 2024-09-12T17:06:28.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6662999999999998e-05 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099861+0000", 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013660359999999999 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099913+0000", 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1795999999999997e-05 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:77 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'55, mlcod=17'53)", 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.290679091999998, 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030906760000000001, 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101504+0000", 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.353e-06 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101585+0000", 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1576000000000006e-05 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101614+0000", 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9133e-05 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101627+0000", 2024-09-12T17:06:28.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3253e-05 2024-09-12T17:06:28.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101727+0000", 2024-09-12T17:06:28.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9569999999999997e-05 2024-09-12T17:06:28.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101764+0000", 2024-09-12T17:06:28.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6495999999999998e-05 2024-09-12T17:06:28.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.104506+0000", 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027422660000000001 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.104593+0000", 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7028999999999996e-05 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.807704871999999, 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036836849999999999, 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 206 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.464 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584480+0000", 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4860000000000002e-06 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584496+0000", 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5883999999999999e-05 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584534+0000", 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8089000000000001e-05 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584551+0000", 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7220000000000001e-05 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584691+0000", 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013991599999999999 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584957+0000", 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000266161 2024-09-12T17:06:28.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:28.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.585389+0000", 2024-09-12T17:06:28.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00043172399999999997 2024-09-12T17:06:28.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:28.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.587593+0000", 2024-09-12T17:06:28.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022045160000000001 2024-09-12T17:06:28.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:28.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.587984+0000", 2024-09-12T17:06:28.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039048099999999998 2024-09-12T17:06:28.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588073+0000", 2024-09-12T17:06:28.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8648999999999998e-05 2024-09-12T17:06:28.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588160+0000", 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7559000000000007e-05 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.790296367, 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039464799999999996, 2024-09-12T17:06:28.470 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 210 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601887+0000", 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5170000000000002e-06 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601899+0000", 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1897e-05 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601930+0000", 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0190000000000001e-05 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601945+0000", 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5075999999999999e-05 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.602115+0000", 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016993600000000001 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.602470+0000", 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000355554 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.603208+0000", 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073791700000000004 2024-09-12T17:06:28.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.604956+0000", 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00174832 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605676+0000", 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071966100000000002 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605762+0000", 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6159e-05 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605831+0000", 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9252999999999996e-05 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:28.476 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.760311721000001, 2024-09-12T17:06:28.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033897799999999998, 2024-09-12T17:06:28.477 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.477 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:28.477 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:28.477 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:28.477 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 218 2024-09-12T17:06:28.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.477 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:28.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:28.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631872+0000", 2024-09-12T17:06:28.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9469999999999999e-06 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631884+0000", 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1823e-05 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631916+0000", 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1319999999999998e-05 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631931+0000", 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5299e-05 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632074+0000", 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142922 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632301+0000", 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022715600000000001 2024-09-12T17:06:28.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632716+0000", 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041482900000000002 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.634244+0000", 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001528242 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:28.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635103+0000", 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085923399999999995 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635189+0000", 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5405e-05 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635259+0000", 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0603000000000001e-05 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.745343337000001, 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033001250000000001, 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 222 2024-09-12T17:06:28.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646841+0000", 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9969999999999999e-06 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646853+0000", 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2500000000000001e-05 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646884+0000", 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.048e-05 2024-09-12T17:06:28.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646899+0000", 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4810000000000001e-05 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647031+0000", 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013203499999999999 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647248+0000", 2024-09-12T17:06:28.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021723200000000001 2024-09-12T17:06:28.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:28.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647648+0000", 2024-09-12T17:06:28.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040051000000000003 2024-09-12T17:06:28.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:28.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.649222+0000", 2024-09-12T17:06:28.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015737150000000001 2024-09-12T17:06:28.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:28.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.649984+0000", 2024-09-12T17:06:28.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076208000000000005 2024-09-12T17:06:28.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.650070+0000", 2024-09-12T17:06:28.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6032999999999994e-05 2024-09-12T17:06:28.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.650138+0000", 2024-09-12T17:06:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7732999999999997e-05 2024-09-12T17:06:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.715455674000001, 2024-09-12T17:06:28.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041653740000000003, 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 230 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:28.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676728+0000", 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4899999999999999e-06 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676739+0000", 2024-09-12T17:06:28.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1226000000000001e-05 2024-09-12T17:06:28.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676770+0000", 2024-09-12T17:06:28.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0297000000000001e-05 2024-09-12T17:06:28.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676784+0000", 2024-09-12T17:06:28.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4796e-05 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676940+0000", 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015539300000000001 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.677328+0000", 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038856699999999998 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.678139+0000", 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081085 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.679704+0000", 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015644109999999999 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680598+0000", 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00089426999999999996 2024-09-12T17:06:28.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680767+0000", 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016875500000000001 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680891+0000", 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012431899999999999 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.437585175999999, 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033901650000000001, 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 712 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954598+0000", 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6249999999999999e-06 2024-09-12T17:06:28.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954605+0000", 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7219999999999999e-06 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954625+0000", 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0013e-05 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954635+0000", 2024-09-12T17:06:28.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2310000000000002e-06 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954787+0000", 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015215399999999999 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.955172+0000", 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038501699999999998 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.955729+0000", 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055745600000000001 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.956989+0000", 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012593179999999999 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957706+0000", 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000717477 2024-09-12T17:06:28.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957868+0000", 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016208300000000001 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957986+0000", 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118069 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:28.502 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:28.502 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:28.503 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:06:28.503 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:28.497+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:28.604 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:28.601+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:28.672 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:28.672 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:28.673 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:28.673 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:28.686 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:06:28.727 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:28.725+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:28.754 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T17:06:28.806 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:28.804+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:28.857 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:28.857 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:28.857 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:28.857 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:28.872 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:06:28.906 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:28.904+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:28.996 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:28.996 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:28.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:28.996 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:28.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.996 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.467053118999999, 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:28.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:06:28.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:28.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.309420922999998, 2024-09-12T17:06:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:06:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:06:29.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:06:29.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:06:29.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.39932713, 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.009 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.009 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.009 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:06:29.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.009 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:29.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:06:29.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:06:29.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:06:29.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:06:29.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:06:29.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:06:29.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:06:29.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:06:29.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:06:29.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:06:29.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.383436389, 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:29.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:29.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:06:29.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:06:29.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:06:29.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:06:29.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:06:29.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:06:29.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:06:29.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:06:29.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:06:29.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:06:29.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:06:29.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:06:29.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:06:29.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:06:29.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:06:29.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:06:29.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.357967719000001, 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.021 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:06:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:06:29.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:06:29.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:06:29.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:06:29.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.028 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.028 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:29.028 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.339006617999999, 2024-09-12T17:06:29.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:06:29.028 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.028 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.028 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.028 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.028 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.028 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:06:29.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:06:29.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:06:29.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:06:29.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:06:29.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:06:29.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:06:29.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:06:29.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:06:29.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:06:29.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:06:29.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:06:29.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.304451318000002, 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:06:29.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.035 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:29.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:06:29.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:06:29.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:06:29.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:06:29.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:06:29.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:06:29.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.041 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.041 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:29.041 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.991231904999999, 2024-09-12T17:06:29.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:06:29.041 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.041 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:06:29.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.042 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:29.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:29.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:06:29.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:29.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:06:29.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:06:29.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:06:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:06:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:06:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:06:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:06:29.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:06:29.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:06:29.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:06:29.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:06:29.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:06:29.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.986340537, 2024-09-12T17:06:29.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:06:29.048 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:06:29.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.048 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:06:29.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:06:29.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:06:29.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:06:29.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:06:29.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:06:29.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.947365078000001, 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.054 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:06:29.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:06:29.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.943467104, 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.060 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.061 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:06:29.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.061 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:29.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:29.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:06:29.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:06:29.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:06:29.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:06:29.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:06:29.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:06:29.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:06:29.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:06:29.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.066 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.874707871999998, 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:29.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:29.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:06:29.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:06:29.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:06:29.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:06:29.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.838863858, 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:06:29.073 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:06:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:06:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:06:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:06:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:06:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:06:29.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:29.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:06:29.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:06:29.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:06:29.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:06:29.079 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.079 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.079 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.080 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.080 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:29.080 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.818676487000001, 2024-09-12T17:06:29.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:06:29.080 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.080 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.080 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.080 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.080 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.080 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.080 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:06:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:06:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:06:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:06:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:06:29.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:06:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:06:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:06:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:06:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:06:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:06:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:06:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.813782124999999, 2024-09-12T17:06:29.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:29.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:06:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:06:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:06:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:06:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:06:29.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:06:29.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:06:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:06:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:06:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:06:29.092 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.751813970000001, 2024-09-12T17:06:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:06:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.093 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:06:29.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.747407195000001, 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.099 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:06:29.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:06:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:06:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:06:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:06:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:06:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:06:29.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.580007853000001, 2024-09-12T17:06:29.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:06:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:06:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:06:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:06:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:06:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:06:29.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:06:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:06:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:06:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:06:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:06:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:06:29.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.54923282, 2024-09-12T17:06:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:06:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.112 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:06:29.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:06:29.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 29.544320565, 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:06:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:06:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:06:29.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:06:29.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:06:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:06:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:06:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:06:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.124 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.124 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:29.126 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:06:29.126 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:29.121+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:29.226 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:29.221+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:29.289 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:29.289 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:29.289 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:29.290 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:29.303 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:06:29.327 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:29.324+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:29.429 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:29.424+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:29.465 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:29.465 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:29.465 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:29.465 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:29.465 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:29.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:06:29.530 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:29.528+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:29.600 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:29.600 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:29.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:29.600 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:29.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.600 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:29.601 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:29.601 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.995758103999997, 2024-09-12T17:06:29.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027134059999999998, 2024-09-12T17:06:29.601 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:29.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:29.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 42 2024-09-12T17:06:29.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.602 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:29.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:29.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600336+0000", 2024-09-12T17:06:29.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1270000000000001e-06 2024-09-12T17:06:29.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600346+0000", 2024-09-12T17:06:29.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.499e-06 2024-09-12T17:06:29.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600370+0000", 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4411000000000001e-05 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600386+0000", 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6205000000000002e-05 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600471+0000", 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5013999999999996e-05 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600569+0000", 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7663000000000003e-05 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600677+0000", 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108571 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.601918+0000", 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012408090000000001 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.602976+0000", 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001058217 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603016+0000", 2024-09-12T17:06:29.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9894000000000001e-05 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603047+0000", 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0995999999999999e-05 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.014702507999999, 2024-09-12T17:06:29.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002848798, 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 52 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:29.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581393+0000", 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4070000000000002e-06 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581405+0000", 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581439+0000", 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3966e-05 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581457+0000", 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7842999999999998e-05 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581567+0000", 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011048900000000001 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581754+0000", 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018672099999999999 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581913+0000", 2024-09-12T17:06:29.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015923700000000001 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.583010+0000", 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001096947 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584083+0000", 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010725730000000001 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584168+0000", 2024-09-12T17:06:29.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4981999999999994e-05 2024-09-12T17:06:29.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584238+0000", 2024-09-12T17:06:29.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0747000000000006e-05 2024-09-12T17:06:29.613 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.613 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.613 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.896447856999998, 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003254804, 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 236 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.614 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699647+0000", 2024-09-12T17:06:29.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1300000000000001e-06 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699660+0000", 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2326e-05 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699694+0000", 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4552999999999999e-05 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699710+0000", 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5573000000000002e-05 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699835+0000", 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012534300000000001 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700050+0000", 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214565 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700448+0000", 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039816999999999999 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702129+0000", 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001680874 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702721+0000", 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00059224199999999999 2024-09-12T17:06:29.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702804+0000", 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3071999999999993e-05 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702899+0000", 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4956000000000004e-05 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.884007329999999, 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026770299999999999, 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 271 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.620 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712086+0000", 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3510000000000001e-06 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712092+0000", 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5670000000000002e-06 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712105+0000", 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3438000000000001e-05 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712112+0000", 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6229999999999999e-06 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712181+0000", 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9323e-05 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712327+0000", 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014620900000000001 2024-09-12T17:06:29.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:29.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712530+0000", 2024-09-12T17:06:29.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020267700000000001 2024-09-12T17:06:29.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.713251+0000", 2024-09-12T17:06:29.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072110800000000004 2024-09-12T17:06:29.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714674+0000", 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001423021 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714718+0000", 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4459000000000002e-05 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714762+0000", 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3254000000000003e-05 2024-09-12T17:06:29.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:287 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.880780847, 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034654030000000001, 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 287 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715312+0000", 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1340000000000001e-06 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715318+0000", 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8409999999999996e-06 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715332+0000", 2024-09-12T17:06:29.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4265e-05 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715342+0000", 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3360000000000001e-06 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715412+0000", 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9980000000000004e-05 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715511+0000", 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9197000000000006e-05 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715663+0000", 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152347 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.716287+0000", 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00062330100000000004 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718705+0000", 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002418505 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718743+0000", 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7645999999999998e-05 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718777+0000", 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3850999999999998e-05 2024-09-12T17:06:29.631 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.571300994000001, 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028821710000000002, 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 742 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:29.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024794+0000", 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7669999999999999e-06 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024805+0000", 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1093e-05 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024836+0000", 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1136000000000001e-05 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024852+0000", 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6140000000000001e-05 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024989+0000", 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000136422 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025219+0000", 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008499999999999 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025545+0000", 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032645100000000001 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.026827+0000", 2024-09-12T17:06:29.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00128202 2024-09-12T17:06:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027470+0000", 2024-09-12T17:06:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00064248199999999999 2024-09-12T17:06:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027556+0000", 2024-09-12T17:06:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6533000000000007e-05 2024-09-12T17:06:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027673+0000", 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117042 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.567564783000002, 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002617173, 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 744 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028529+0000", 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8500000000000001e-06 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028540+0000", 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-05 2024-09-12T17:06:29.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028565+0000", 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5083e-05 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028577+0000", 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2434e-05 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028679+0000", 2024-09-12T17:06:29.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101489 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028800+0000", 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012089199999999999 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.029070+0000", 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000270358 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030114+0000", 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001043832 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030994+0000", 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087969000000000003 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031082+0000", 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7825999999999996e-05 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031144+0000", 2024-09-12T17:06:29.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2829000000000004e-05 2024-09-12T17:06:29.644 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.644 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.644 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.644 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.644 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:29.644 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.528402658000001, 2024-09-12T17:06:29.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027655549999999998, 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 760 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:29.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067692+0000", 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4200000000000001e-06 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067706+0000", 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.382e-05 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067739+0000", 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3253000000000002e-05 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067763+0000", 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4026e-05 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067912+0000", 2024-09-12T17:06:29.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014959199999999999 2024-09-12T17:06:29.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068127+0000", 2024-09-12T17:06:29.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021487500000000001 2024-09-12T17:06:29.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:29.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068438+0000", 2024-09-12T17:06:29.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031070400000000003 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.069550+0000", 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011116159999999999 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070301+0000", 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075135000000000002 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070390+0000", 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8516000000000004e-05 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070455+0000", 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5382999999999994e-05 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.650 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.392180429, 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031165260000000001, 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 817 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:29.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:29.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203915+0000", 2024-09-12T17:06:29.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.146e-06 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203926+0000", 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1379999999999999e-05 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203958+0000", 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2239000000000001e-05 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203973+0000", 2024-09-12T17:06:29.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.47e-05 2024-09-12T17:06:29.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204156+0000", 2024-09-12T17:06:29.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018277899999999999 2024-09-12T17:06:29.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204392+0000", 2024-09-12T17:06:29.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000236658 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204705+0000", 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000312248 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.205983+0000", 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001278387 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206726+0000", 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074269799999999997 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206909+0000", 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018368200000000001 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.207028+0000", 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118609 2024-09-12T17:06:29.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.657 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.657 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.657 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:29.657 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.387898779, 2024-09-12T17:06:29.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003050269, 2024-09-12T17:06:29.657 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 819 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:29.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208196+0000", 2024-09-12T17:06:29.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4569999999999999e-06 2024-09-12T17:06:29.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208207+0000", 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208241+0000", 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3936000000000002e-05 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208256+0000", 2024-09-12T17:06:29.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5917e-05 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208383+0000", 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012605200000000001 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208602+0000", 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219908 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.209077+0000", 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047489299999999999 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210285+0000", 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012075110000000001 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210979+0000", 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069376099999999999 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211131+0000", 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151915 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211243+0000", 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112989 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.663 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.333153055, 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0035006659999999999, 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 841 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262942+0000", 2024-09-12T17:06:29.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6900000000000001e-06 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262953+0000", 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1323e-05 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262989+0000", 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5617000000000001e-05 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263006+0000", 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7713000000000001e-05 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263177+0000", 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170249 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263551+0000", 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037421999999999998 2024-09-12T17:06:29.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.264122+0000", 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057113200000000002 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.265539+0000", 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001417012 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266170+0000", 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063154599999999997 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266330+0000", 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926800000000001 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266440+0000", 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010989600000000001 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.328452068000001, 2024-09-12T17:06:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032057850000000001, 2024-09-12T17:06:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 843 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267642+0000", 2024-09-12T17:06:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:06:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267653+0000", 2024-09-12T17:06:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0664e-05 2024-09-12T17:06:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267687+0000", 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4112999999999997e-05 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267703+0000", 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5673000000000001e-05 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267832+0000", 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012896500000000001 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268054+0000", 2024-09-12T17:06:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022279600000000001 2024-09-12T17:06:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268561+0000", 2024-09-12T17:06:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050617200000000005 2024-09-12T17:06:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.269801+0000", 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012401269999999999 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270562+0000", 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076129699999999997 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270716+0000", 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000154339 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270846+0000", 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930600000000001 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.317620408, 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033822100000000001, 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 847 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278474+0000", 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4930000000000001e-06 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278485+0000", 2024-09-12T17:06:29.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1313e-05 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278518+0000", 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2517000000000001e-05 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278533+0000", 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939999999999999e-05 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278689+0000", 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015628899999999999 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279066+0000", 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000377337 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279610+0000", 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00054380900000000002 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281130+0000", 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001519488 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281583+0000", 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00045297300000000001 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281738+0000", 2024-09-12T17:06:29.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015484900000000001 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281854+0000", 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116202 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.313004904, 2024-09-12T17:06:29.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883554, 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 849 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283090+0000", 2024-09-12T17:06:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283102+0000", 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.204e-05 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283136+0000", 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3983000000000003e-05 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283152+0000", 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6082999999999998e-05 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283278+0000", 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000126212 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283505+0000", 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022724900000000001 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283971+0000", 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046550600000000003 2024-09-12T17:06:29.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285223+0000", 2024-09-12T17:06:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012519370000000001 2024-09-12T17:06:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285811+0000", 2024-09-12T17:06:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058819199999999997 2024-09-12T17:06:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285904+0000", 2024-09-12T17:06:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3410000000000002e-05 2024-09-12T17:06:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285971+0000", 2024-09-12T17:06:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6391999999999997e-05 2024-09-12T17:06:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.26505199, 2024-09-12T17:06:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033550770000000001, 2024-09-12T17:06:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.689 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 868 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331043+0000", 2024-09-12T17:06:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:06:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331054+0000", 2024-09-12T17:06:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.131e-05 2024-09-12T17:06:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331086+0000", 2024-09-12T17:06:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-12T17:06:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331101+0000", 2024-09-12T17:06:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5016e-05 2024-09-12T17:06:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331253+0000", 2024-09-12T17:06:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151929 2024-09-12T17:06:29.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331616+0000", 2024-09-12T17:06:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036285100000000003 2024-09-12T17:06:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.332174+0000", 2024-09-12T17:06:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055856199999999997 2024-09-12T17:06:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.333700+0000", 2024-09-12T17:06:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015259480000000001 2024-09-12T17:06:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334120+0000", 2024-09-12T17:06:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042021700000000002 2024-09-12T17:06:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334280+0000", 2024-09-12T17:06:29.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159949 2024-09-12T17:06:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334395+0000", 2024-09-12T17:06:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114679 2024-09-12T17:06:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.695 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.260594199, 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003066923, 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 870 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335500+0000", 2024-09-12T17:06:29.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4040000000000002e-06 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335511+0000", 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.045e-05 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335542+0000", 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1542999999999999e-05 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335558+0000", 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.535e-05 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335698+0000", 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014063899999999999 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335930+0000", 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000231435 2024-09-12T17:06:29.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.336392+0000", 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046211199999999998 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.337568+0000", 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001176671 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338407+0000", 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083885399999999999 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338491+0000", 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4159000000000005e-05 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338565+0000", 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3306000000000006e-05 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.172405456, 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027821550000000001, 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 907 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423690+0000", 2024-09-12T17:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-12T17:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423702+0000", 2024-09-12T17:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2404e-05 2024-09-12T17:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423735+0000", 2024-09-12T17:06:29.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3062999999999998e-05 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423750+0000", 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4912999999999999e-05 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423919+0000", 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016838899999999999 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424160+0000", 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024105099999999999 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424492+0000", 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033261100000000002 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.425785+0000", 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001292397 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426322+0000", 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00053743200000000001 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426403+0000", 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0898999999999999e-05 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426469+0000", 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5720000000000001e-05 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.707 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.073239768000001, 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029674670000000001, 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.708 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 949 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522855+0000", 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522871+0000", 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5950000000000001e-05 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522906+0000", 2024-09-12T17:06:29.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316000000000001e-05 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522924+0000", 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8326999999999999e-05 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523047+0000", 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123609 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523282+0000", 2024-09-12T17:06:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234465 2024-09-12T17:06:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523606+0000", 2024-09-12T17:06:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032453099999999997 2024-09-12T17:06:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.524804+0000", 2024-09-12T17:06:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011977509999999999 2024-09-12T17:06:29.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525626+0000", 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082216400000000001 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525743+0000", 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116679 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525820+0000", 2024-09-12T17:06:29.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6631999999999994e-05 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.059516093999999, 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030602540000000001, 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.714 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 955 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:29.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536578+0000", 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536590+0000", 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1250000000000001e-05 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536624+0000", 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4227000000000003e-05 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536646+0000", 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2195999999999999e-05 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536794+0000", 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014799600000000001 2024-09-12T17:06:29.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537005+0000", 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021096799999999999 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537489+0000", 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048413599999999997 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.538940+0000", 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001451262 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539441+0000", 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050002300000000005 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539535+0000", 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4526999999999998e-05 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539636+0000", 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010111900000000001 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.055258760000001, 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030889300000000001, 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:29.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 957 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540836+0000", 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540862+0000", 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999999e-05 2024-09-12T17:06:29.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540891+0000", 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9595999999999999e-05 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540906+0000", 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4919999999999999e-05 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541052+0000", 2024-09-12T17:06:29.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014583900000000001 2024-09-12T17:06:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541232+0000", 2024-09-12T17:06:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180259 2024-09-12T17:06:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541500+0000", 2024-09-12T17:06:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026788799999999998 2024-09-12T17:06:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.542483+0000", 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000983142 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543756+0000", 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001272977 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543842+0000", 2024-09-12T17:06:29.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5748999999999995e-05 2024-09-12T17:06:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543922+0000", 2024-09-12T17:06:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0000000000000007e-05 2024-09-12T17:06:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:29.726 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:29.726 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:29.728 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:06:29.728 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:29.723+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:29.829 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:29.823+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:29.853 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:29.853 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:29.853 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:29.853 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:29.866 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:06:29.930 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:29.927+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:29.995 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:29.995 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:29.995 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:29.995 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:29.995 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:30.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:06:30.031 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:30.027+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:30.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:06:30.132 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:30.129+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:30.135 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:30.135 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-12T17:06:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.588052496000003, 2024-09-12T17:06:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011583833, 2024-09-12T17:06:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.136 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 44 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:30.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544942+0000", 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.653e-06 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544957+0000", 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5654e-05 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544993+0000", 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5936000000000003e-05 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.545017+0000", 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3283000000000001e-05 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549277+0000", 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042606800000000002 2024-09-12T17:06:30.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549301+0000", 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3260000000000001e-05 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556317+0000", 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070164620000000002 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556522+0000", 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020490499999999999 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.544586949999999, 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054133180000000003, 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.141 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 207 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588408+0000", 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588428+0000", 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9910000000000001e-05 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588467+0000", 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588483+0000", 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6443000000000002e-05 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588659+0000", 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569499999999999 2024-09-12T17:06:30.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589033+0000", 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037374100000000003 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589729+0000", 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069659400000000003 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593394+0000", 2024-09-12T17:06:30.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036653279999999998 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593661+0000", 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026662499999999999 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593743+0000", 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1428999999999996e-05 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593817+0000", 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4475999999999996e-05 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.508366250000002, 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034289839999999999, 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.147 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 216 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624628+0000", 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2399999999999999e-06 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624641+0000", 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3743e-05 2024-09-12T17:06:30.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624675+0000", 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3277e-05 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624690+0000", 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5812999999999999e-05 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624847+0000", 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156269 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625092+0000", 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024499500000000002 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625494+0000", 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040263000000000001 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.626934+0000", 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001439159 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627890+0000", 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095619599999999998 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627978+0000", 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8446e-05 2024-09-12T17:06:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.628053+0000", 2024-09-12T17:06:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5216000000000006e-05 2024-09-12T17:06:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.153 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.466858006999999, 2024-09-12T17:06:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003364985, 2024-09-12T17:06:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 227 2024-09-12T17:06:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.154 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666135+0000", 2024-09-12T17:06:30.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.644e-06 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666147+0000", 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1960000000000001e-05 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666179+0000", 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1813000000000002e-05 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666195+0000", 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5679999999999999e-05 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666342+0000", 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147312 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666559+0000", 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021664199999999999 2024-09-12T17:06:30.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.667037+0000", 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047816200000000002 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.668796+0000", 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017590010000000001 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669346+0000", 2024-09-12T17:06:30.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055024499999999999 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669433+0000", 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6650000000000006e-05 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669498+0000", 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4875999999999993e-05 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.459650748000001, 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031932409999999999, 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 229 2024-09-12T17:06:30.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673342+0000", 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3499999999999999e-06 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673354+0000", 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1739999999999999e-05 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673386+0000", 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1782000000000002e-05 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673400+0000", 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4663e-05 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673577+0000", 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017662900000000001 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673783+0000", 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020620799999999999 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.674174+0000", 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039082100000000002 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.675441+0000", 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001267177 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676382+0000", 2024-09-12T17:06:30.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094087900000000004 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676468+0000", 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5762999999999999e-05 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676533+0000", 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5228999999999995e-05 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.451907824999999, 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0037357380000000002, 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 231 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.166 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681085+0000", 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681096+0000", 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0866000000000001e-05 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681126+0000", 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9977000000000001e-05 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681140+0000", 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4195999999999999e-05 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681288+0000", 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014765199999999999 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681637+0000", 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034917100000000001 2024-09-12T17:06:30.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.682358+0000", 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072050800000000002 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684139+0000", 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017812399999999999 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684543+0000", 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040413299999999999 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684703+0000", 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160075 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684819+0000", 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011553300000000001 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.171 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:374 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.397030395000002, 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031135910000000002, 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.172 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 374 2024-09-12T17:06:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:30.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735961+0000", 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0979999999999999e-06 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735968+0000", 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735981+0000", 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3164e-05 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735989+0000", 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8010000000000004e-06 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736041+0000", 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800999999999998e-05 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736137+0000", 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5497999999999999e-05 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736303+0000", 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016580100000000001 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736802+0000", 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049966599999999996 2024-09-12T17:06:30.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739015+0000", 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022122919999999998 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739047+0000", 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2678000000000001e-05 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739074+0000", 2024-09-12T17:06:30.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6594e-05 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.171585652000001, 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029096640000000002, 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.178 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 715 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:30.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961407+0000", 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961419+0000", 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.117e-05 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961450+0000", 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1463e-05 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961465+0000", 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961576+0000", 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111016 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961785+0000", 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020865599999999999 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.962105+0000", 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031996699999999999 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.963189+0000", 2024-09-12T17:06:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010845519999999999 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964163+0000", 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097355800000000002 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964252+0000", 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8996e-05 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964315+0000", 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2773000000000004e-05 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.137315095999998, 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883207, 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.184 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 730 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995678+0000", 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995689+0000", 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1316e-05 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995722+0000", 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995745+0000", 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3496999999999999e-05 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995902+0000", 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156446 2024-09-12T17:06:30.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996113+0000", 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021091099999999999 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996444+0000", 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000330785 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.997558+0000", 2024-09-12T17:06:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001114681 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998420+0000", 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086125299999999998 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998497+0000", 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7919999999999999e-05 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998559+0000", 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1319e-05 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.118833532, 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002862248, 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 738 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014159+0000", 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014168+0000", 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.653e-06 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014191+0000", 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3706e-05 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014213+0000", 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2050000000000001e-05 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014363+0000", 2024-09-12T17:06:30.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014956299999999999 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014485+0000", 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000122132 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014770+0000", 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000284911 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.015864+0000", 2024-09-12T17:06:30.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010942180000000001 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016864+0000", 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00099982299999999994 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016951+0000", 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6476000000000003e-05 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.017019+0000", 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8756000000000004e-05 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.036512154, 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032495950000000001, 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 772 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096481+0000", 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4399999999999999e-06 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096492+0000", 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1513e-05 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096522+0000", 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9156e-05 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096536+0000", 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4347e-05 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096681+0000", 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145348 2024-09-12T17:06:30.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096896+0000", 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214489 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.097208+0000", 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031215099999999999 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.098332+0000", 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001123635 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099583+0000", 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00125179 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099663+0000", 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9703000000000006e-05 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099728+0000", 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5023000000000004e-05 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.964770195, 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028771949999999999, 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 802 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168223+0000", 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4499999999999998e-06 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168234+0000", 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168265+0000", 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0777e-05 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168279+0000", 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4525999999999999e-05 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168397+0000", 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118063 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168616+0000", 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000218505 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168970+0000", 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00035427400000000002 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170038+0000", 2024-09-12T17:06:30.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001067571 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170897+0000", 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085934399999999995 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170983+0000", 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6179000000000003e-05 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.171098+0000", 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114576 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.905970368999998, 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033328609999999999, 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.208 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 826 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227023+0000", 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227035+0000", 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227067+0000", 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2305999999999999e-05 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227082+0000", 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.485e-05 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227247+0000", 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016483900000000001 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227630+0000", 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038350100000000001 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.228201+0000", 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057026799999999997 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.229556+0000", 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013553300000000001 2024-09-12T17:06:30.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230084+0000", 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00052805599999999995 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230238+0000", 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015438499999999999 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230353+0000", 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114809 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.846697013, 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033407710000000002, 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.214 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 850 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286296+0000", 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286307+0000", 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1287000000000001e-05 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286339+0000", 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1331999999999997e-05 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286353+0000", 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4517e-05 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286504+0000", 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015038200000000001 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286897+0000", 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039326399999999999 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.287451+0000", 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055426900000000003 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.288825+0000", 2024-09-12T17:06:30.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013741160000000001 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289484+0000", 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00065819499999999998 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289570+0000", 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6383000000000003e-05 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289634+0000", 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4505999999999995e-05 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.808705096000001, 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002894237, 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 865 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324288+0000", 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2469999999999998e-06 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324299+0000", 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0823e-05 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324330+0000", 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1846e-05 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324350+0000", 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9077e-05 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324463+0000", 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011367200000000001 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324693+0000", 2024-09-12T17:06:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008800000000001 2024-09-12T17:06:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.325000+0000", 2024-09-12T17:06:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030629499999999999 2024-09-12T17:06:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.326117+0000", 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011175709999999999 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327026+0000", 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00090879000000000003 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327113+0000", 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7093000000000001e-05 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327180+0000", 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6735000000000004e-05 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.794191598000001, 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030741359999999999, 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 871 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338802+0000", 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338831+0000", 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9356000000000002e-05 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338868+0000", 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7357000000000002e-05 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338883+0000", 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4932999999999999e-05 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339036+0000", 2024-09-12T17:06:30.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152423 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339264+0000", 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022814100000000001 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339593+0000", 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032943099999999998 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.340783+0000", 2024-09-12T17:06:30.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011898740000000001 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341724+0000", 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094134600000000002 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341809+0000", 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4155999999999999e-05 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341873+0000", 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4605999999999998e-05 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.736699538, 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003093649, 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 895 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396294+0000", 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3999999999999999e-06 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396307+0000", 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3468999999999999e-05 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396338+0000", 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1433000000000002e-05 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396353+0000", 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4557e-05 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396496+0000", 2024-09-12T17:06:30.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014275900000000001 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396719+0000", 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022317499999999999 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.397052+0000", 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033263699999999999 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.398211+0000", 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011593350000000001 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399235+0000", 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010241219999999999 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399321+0000", 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5789000000000001e-05 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399385+0000", 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3973000000000006e-05 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.730212481999999, 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029302239999999999, 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 898 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402780+0000", 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9269999999999999e-06 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402789+0000", 2024-09-12T17:06:30.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7069999999999998e-06 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402830+0000", 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1470000000000001e-05 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402846+0000", 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5319e-05 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402938+0000", 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2289999999999999e-05 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403134+0000", 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000196014 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403437+0000", 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030337199999999999 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.404507+0000", 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001069492 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405432+0000", 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092532900000000002 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405590+0000", 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158018 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405708+0000", 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118286 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.644805220999999, 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030817499999999999, 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 934 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488188+0000", 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8040000000000002e-06 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488201+0000", 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2893e-05 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488233+0000", 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2085999999999997e-05 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488248+0000", 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4976e-05 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488415+0000", 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016677900000000001 2024-09-12T17:06:30.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488650+0000", 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234875 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488961+0000", 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031078799999999999 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.490177+0000", 2024-09-12T17:06:30.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001216607 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491119+0000", 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000941806 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491202+0000", 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3349000000000004e-05 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491267+0000", 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4787000000000002e-05 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 30.633986240999999, 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031107489999999999, 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:30.250 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 939 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:30.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499007+0000", 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3970000000000001e-06 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499018+0000", 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0969e-05 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499052+0000", 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3896999999999997e-05 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499068+0000", 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6552999999999999e-05 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499200+0000", 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013206599999999999 2024-09-12T17:06:30.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499438+0000", 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023806500000000001 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499922+0000", 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048369599999999998 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501326+0000", 2024-09-12T17:06:30.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014036560000000001 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501962+0000", 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063623100000000001 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502048+0000", 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5636999999999993e-05 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:30.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502115+0000", 2024-09-12T17:06:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7582000000000004e-05 2024-09-12T17:06:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:30.256 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:30.256 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:30.258 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:06:30.258 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:30.258 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:30.258 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:30.259 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:30.259 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:30.259 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:30.260 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:30.260 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:30.260 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:30.253+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:30.273 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:30.274 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:30.294 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:30.294 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:30.314 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:30.314 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:30.332 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:30.391 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:30.389+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:30.395 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:30.395 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:30.409 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:06:30.459 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:30.457+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:30.529 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:30.529 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:30.544 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:06:30.590 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:30.587+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:30.661 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:30.655+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:30.666 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:30.666 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:30.681 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:06:30.777 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T17:06:30.778 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:30.775+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:30.862 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:30.862 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:30.862 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:30.857+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:30.876 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:06:30.963 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:30.959+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:31.042 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:31.042 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:31.058 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:06:31.064 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:31.061+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:31.165 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:31.161+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:31.229 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:31.229 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:31.243 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:06:31.267 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:31.261+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:31.363 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:31.363 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:31.368 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:31.365+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:31.378 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:06:31.469 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:31.465+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:31.505 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:31.505 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:31.520 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:06:31.570 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:31.567+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:31.647 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:31.647 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:31.662 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:06:31.672 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:31.669+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:31.769 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T17:06:31.772 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:31.769+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:31.839 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:31.840 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:31.854 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:06:31.901 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:31.899+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:31.974 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:31.971+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:31.980 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:31.980 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:31.995 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:06:32.085 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:32.083+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:32.168 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:32.168 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:32.176 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:32.171+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:32.182 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:06:32.277 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:32.273+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:32.308 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:32.308 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:32.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:06:32.351 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:06:32.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:32.405+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:32.478 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:32.478 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:32.479 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:32.473+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:32.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:06:32.506 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:32.506 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:32.526 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:32.526 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:32.544 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:32.544 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:32.561 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:32.561 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:32.579 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:32.577+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:32.584 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:32.585 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:32.606 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:32.607 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:32.625 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:64 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'42, mlcod=17'40)", 2024-09-12T17:06:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.534507185999999, 2024-09-12T17:06:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014733802000000001, 2024-09-12T17:06:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084339+0000", 2024-09-12T17:06:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084341+0000", 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9700000000000002e-06 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084353+0000", 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2279999999999999e-05 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084382+0000", 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9179e-05 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084395+0000", 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.322e-05 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084525+0000", 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129789 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.084582+0000", 2024-09-12T17:06:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6486000000000001e-05 2024-09-12T17:06:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099005+0000", 2024-09-12T17:06:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014423689 2024-09-12T17:06:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099073+0000", 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7188999999999997e-05 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:65 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'43, mlcod=17'40)", 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.533686185999997, 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013950562, 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085160+0000", 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085162+0000", 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0099999999999998e-06 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085174+0000", 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2223e-05 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085222+0000", 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8029999999999999e-05 2024-09-12T17:06:32.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085237+0000", 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4666e-05 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085428+0000", 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019164900000000001 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085488+0000", 2024-09-12T17:06:32.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.0149000000000003e-05 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099075+0000", 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013587042000000001 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099110+0000", 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4792999999999997e-05 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:66 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'44, mlcod=17'40)", 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.532894065999997, 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013198259, 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085952+0000", 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.085954+0000", 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0530000000000001e-06 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086013+0000", 2024-09-12T17:06:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8854000000000003e-05 2024-09-12T17:06:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086045+0000", 2024-09-12T17:06:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2672999999999997e-05 2024-09-12T17:06:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086058+0000", 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.306e-05 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086438+0000", 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037959300000000001 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086495+0000", 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6679999999999999e-05 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099115+0000", 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012620256 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099150+0000", 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5089999999999998e-05 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.639 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:67 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'45, mlcod=17'40)", 2024-09-12T17:06:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.531977185999999, 2024-09-12T17:06:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012332911, 2024-09-12T17:06:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086869+0000", 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086871+0000", 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.063e-06 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086884+0000", 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.294e-05 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086970+0000", 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6312999999999998e-05 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.086990+0000", 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9602999999999998e-05 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087863+0000", 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087312999999999996 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087915+0000", 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2516000000000003e-05 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099152+0000", 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011237 2024-09-12T17:06:32.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099202+0000", 2024-09-12T17:06:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9345999999999998e-05 2024-09-12T17:06:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:68 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'46, mlcod=17'40)", 2024-09-12T17:06:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:32.644 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.531258231000002, 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011670056, 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087588+0000", 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087590+0000", 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.956e-06 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087602+0000", 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1939999999999999e-05 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087630+0000", 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8736000000000001e-05 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.087652+0000", 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1693000000000001e-05 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088864+0000", 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001211578 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088939+0000", 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5885999999999998e-05 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099206+0000", 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010266287000000001 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099258+0000", 2024-09-12T17:06:32.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.198e-05 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:69 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'47, mlcod=17'40)", 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.530516904000002, 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010963379000000001, 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088329+0000", 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088331+0000", 2024-09-12T17:06:32.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.973e-06 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088388+0000", 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7274000000000001e-05 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088418+0000", 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9609000000000001e-05 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.088439+0000", 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0820000000000001e-05 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090024+0000", 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001585588 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090090+0000", 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5660000000000005e-05 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099260+0000", 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091697050000000002 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099292+0000", 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2750000000000003e-05 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.653 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:70 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'48, mlcod=17'40)", 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.529437588999997, 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0099341629999999993, 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089408+0000", 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089410+0000", 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9740000000000001e-06 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089424+0000", 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4036000000000001e-05 2024-09-12T17:06:32.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089466+0000", 2024-09-12T17:06:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1563000000000002e-05 2024-09-12T17:06:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.089492+0000", 2024-09-12T17:06:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5812999999999998e-05 2024-09-12T17:06:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091523+0000", 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002030895 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091564+0000", 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1263000000000001e-05 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099294+0000", 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0077302400000000002 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099342+0000", 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8378999999999999e-05 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:71 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'49, mlcod=17'40)", 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.528630581000002, 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0092012150000000004, 2024-09-12T17:06:32.658 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090215+0000", 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090217+0000", 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090229+0000", 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090261+0000", 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1986999999999997e-05 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090280+0000", 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8536e-05 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092530+0000", 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022498959999999999 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092588+0000", 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8276000000000002e-05 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099345+0000", 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006757028 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099417+0000", 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1645999999999998e-05 2024-09-12T17:06:32.662 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:72 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'50, mlcod=17'40)", 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.527962330000001, 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085677930000000006, 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090884+0000", 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090885+0000", 2024-09-12T17:06:32.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3799999999999999e-06 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090938+0000", 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3013000000000002e-05 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090965+0000", 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6610000000000001e-05 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.090979+0000", 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4113e-05 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093482+0000", 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025028870000000001 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093573+0000", 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0989999999999994e-05 2024-09-12T17:06:32.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099418+0000", 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058459109999999996 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099451+0000", 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2889000000000003e-05 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:73 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'51, mlcod=17'40)", 2024-09-12T17:06:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.526850168999999, 2024-09-12T17:06:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075262419999999998, 2024-09-12T17:06:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.668 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091996+0000", 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.091998+0000", 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.894e-06 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092010+0000", 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2176e-05 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092043+0000", 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3226999999999999e-05 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092062+0000", 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9453000000000002e-05 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.095140+0000", 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00307792 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.095196+0000", 2024-09-12T17:06:32.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6008999999999999e-05 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099453+0000", 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042563899999999997 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099522+0000", 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9172999999999997e-05 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:74 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'52, mlcod=17'40)", 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.526244857000002, 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0069855890000000004, 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092601+0000", 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092603+0000", 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0099999999999998e-06 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092618+0000", 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.469e-05 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092647+0000", 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9107000000000001e-05 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.092660+0000", 2024-09-12T17:06:32.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.347e-05 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.096074+0000", 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034132300000000002 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.096158+0000", 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4863000000000004e-05 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099524+0000", 2024-09-12T17:06:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033656670000000001 2024-09-12T17:06:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099587+0000", 2024-09-12T17:06:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2551999999999993e-05 2024-09-12T17:06:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:75 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'53, mlcod=17'40)", 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.525418762999998, 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006221725, 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093427+0000", 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093429+0000", 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1299999999999999e-06 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093522+0000", 2024-09-12T17:06:32.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2236000000000003e-05 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093562+0000", 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0386000000000003e-05 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.093576+0000", 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4154e-05 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.097039+0000", 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034632629999999998 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.097092+0000", 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2918999999999999e-05 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099591+0000", 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024984310000000002 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099649+0000", 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8205999999999998e-05 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:76 1.0 e17/16 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 17'54, mlcod=17'40)", 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.524693931999998, 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057612949999999996, 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.682 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094152+0000", 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094154+0000", 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2699999999999999e-06 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094169+0000", 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4296e-05 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094203+0000", 2024-09-12T17:06:32.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3980000000000003e-05 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.094220+0000", 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7337e-05 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.098459+0000", 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004238917 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.098495+0000", 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6662999999999998e-05 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099861+0000", 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013660359999999999 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.099913+0000", 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1795999999999997e-05 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.686 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4216.0:77 1.0 e17/16 1:30306672:devicehealth::main.db.0000000000000000:head v 17'55, mlcod=17'53)", 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.517343728999997, 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030906760000000001, 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101502+0000", 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101504+0000", 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.353e-06 2024-09-12T17:06:32.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101585+0000", 2024-09-12T17:06:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1576000000000006e-05 2024-09-12T17:06:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101614+0000", 2024-09-12T17:06:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9133e-05 2024-09-12T17:06:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101627+0000", 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3253e-05 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101727+0000", 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9569999999999997e-05 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.101764+0000", 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6495999999999998e-05 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.104506+0000", 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027422660000000001 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:36.104593+0000", 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7028999999999996e-05 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.691 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.034369509000001, 2024-09-12T17:06:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036836849999999999, 2024-09-12T17:06:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 206 2024-09-12T17:06:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.692 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584476+0000", 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584480+0000", 2024-09-12T17:06:32.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4860000000000002e-06 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584496+0000", 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5883999999999999e-05 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584534+0000", 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8089000000000001e-05 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584551+0000", 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7220000000000001e-05 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584691+0000", 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013991599999999999 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.584957+0000", 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000266161 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.585389+0000", 2024-09-12T17:06:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00043172399999999997 2024-09-12T17:06:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.587593+0000", 2024-09-12T17:06:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022045160000000001 2024-09-12T17:06:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:32.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.587984+0000", 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039048099999999998 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588073+0000", 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8648999999999998e-05 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588160+0000", 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7559000000000007e-05 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.016961004000002, 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039464799999999996, 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:32.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 210 2024-09-12T17:06:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601885+0000", 2024-09-12T17:06:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601887+0000", 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5170000000000002e-06 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601899+0000", 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1897e-05 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601930+0000", 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0190000000000001e-05 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.601945+0000", 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5075999999999999e-05 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.602115+0000", 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016993600000000001 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.602470+0000", 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000355554 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.603208+0000", 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073791700000000004 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.604956+0000", 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00174832 2024-09-12T17:06:32.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605676+0000", 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071966100000000002 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605762+0000", 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6159e-05 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.605831+0000", 2024-09-12T17:06:32.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9252999999999996e-05 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.986976358, 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033897799999999998, 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 218 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631870+0000", 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631872+0000", 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9469999999999999e-06 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631884+0000", 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1823e-05 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631916+0000", 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1319999999999998e-05 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.631931+0000", 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5299e-05 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632074+0000", 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142922 2024-09-12T17:06:32.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632301+0000", 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022715600000000001 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.632716+0000", 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041482900000000002 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:32.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.634244+0000", 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001528242 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635103+0000", 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085923399999999995 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635189+0000", 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5405e-05 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635259+0000", 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0603000000000001e-05 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:222 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.972007974, 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033001250000000001, 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 222 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646838+0000", 2024-09-12T17:06:32.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646841+0000", 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9969999999999999e-06 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646853+0000", 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2500000000000001e-05 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646884+0000", 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.048e-05 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.646899+0000", 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4810000000000001e-05 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647031+0000", 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013203499999999999 2024-09-12T17:06:32.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647248+0000", 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021723200000000001 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.647648+0000", 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040051000000000003 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:32.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.649222+0000", 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015737150000000001 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.649984+0000", 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076208000000000005 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.650070+0000", 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6032999999999994e-05 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.650138+0000", 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7732999999999997e-05 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:230 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.942120310999996, 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041653740000000003, 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 230 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676726+0000", 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676728+0000", 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4899999999999999e-06 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676739+0000", 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1226000000000001e-05 2024-09-12T17:06:32.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676770+0000", 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0297000000000001e-05 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676784+0000", 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4796e-05 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676940+0000", 2024-09-12T17:06:32.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015539300000000001 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.677328+0000", 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038856699999999998 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.678139+0000", 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081085 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.679704+0000", 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015644109999999999 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680598+0000", 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00089426999999999996 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680767+0000", 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016875500000000001 2024-09-12T17:06:32.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.680891+0000", 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012431899999999999 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:712 6.16 6:6f6aba0e:::obj_delete_at_hint.0000000045:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.664249812999998, 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033901650000000001, 2024-09-12T17:06:32.722 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 712 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954596+0000", 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954598+0000", 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6249999999999999e-06 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:32.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954605+0000", 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7219999999999999e-06 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954625+0000", 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0013e-05 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954635+0000", 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2310000000000002e-06 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.954787+0000", 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015215399999999999 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.955172+0000", 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038501699999999998 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.955729+0000", 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055745600000000001 2024-09-12T17:06:32.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.956989+0000", 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012593179999999999 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957706+0000", 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000717477 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:32.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957868+0000", 2024-09-12T17:06:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016208300000000001 2024-09-12T17:06:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.957986+0000", 2024-09-12T17:06:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118069 2024-09-12T17:06:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:32.728 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:32.728 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:32.730 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:06:32.730 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:32.731 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:32.731 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:32.732 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:32.732 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:32.725+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:32.831 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:32.825+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:32.896 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:32.896 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:32.896 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:32.896 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:32.910 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:06:32.932 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:32.931+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:33.034 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:33.029+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:33.085 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:33.085 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:33.085 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:33.085 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:33.085 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:33.098 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:06:33.139 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:33.137+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:33.238 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:33.233+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:33.261 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.731718532000002, 2024-09-12T17:06:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:06:33.261 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:06:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:06:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:06:33.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:33.266 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.574086336000001, 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:06:33.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:06:33.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.663992542999999, 2024-09-12T17:06:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:06:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.273 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:06:33.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.278 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.648101801999999, 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.279 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:06:33.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.622633131999997, 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.285 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:33.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:06:33.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.603672031000002, 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.291 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:06:33.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:06:33.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.297 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.569116731000001, 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:06:33.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.255897318000002, 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.304 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:06:33.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:06:33.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:06:33.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:06:33.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:06:33.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:06:33.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:06:33.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:06:33.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:06:33.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:06:33.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.25100595, 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.310 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:06:33.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.212030491, 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:06:33.316 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.317 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.317 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:06:33.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.317 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:33.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:06:33.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.322 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.208132517000003, 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:06:33.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:06:33.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:06:33.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:06:33.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:06:33.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:06:33.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:06:33.328 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.328 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.139373284999998, 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.329 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:06:33.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:06:33.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.103529270999999, 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:06:33.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:06:33.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:06:33.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:06:33.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:06:33.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:06:33.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:06:33.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:33.341 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.083341900000001, 2024-09-12T17:06:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:06:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:06:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:06:33.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:06:33.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:06:33.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:06:33.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:06:33.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:06:33.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:06:33.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:06:33.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:06:33.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:06:33.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:06:33.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:06:33.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:06:33.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:06:33.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:06:33.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.078447537999999, 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:33.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:06:33.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:06:33.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:06:33.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:06:33.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:06:33.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:06:33.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:06:33.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.354 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.354 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.354 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.354 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:33.354 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.016479382999997, 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:06:33.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:06:33.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:06:33.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:06:33.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:06:33.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:06:33.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:06:33.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.361 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.361 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:33.361 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.012072607999997, 2024-09-12T17:06:33.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:06:33.361 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.361 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.361 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.361 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.361 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.361 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:06:33.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:06:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:06:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:06:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:06:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:06:33.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:06:33.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.844673266000001, 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:06:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:06:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:06:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:06:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:06:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:06:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:06:33.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.813898233000003, 2024-09-12T17:06:33.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:33.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:06:33.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:06:33.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.379 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.808985978000003, 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:06:33.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.385 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:33.387 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:06:33.387 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:33.383+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:33.487 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:33.485+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:33.560 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:33.560 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:33.560 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:33.561 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:33.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:06:33.588 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:33.583+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:33.689 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:33.687+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:33.736 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:33.736 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:33.737 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:33.750 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:06:33.790 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:33.787+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:33.796 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T17:06:33.883 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.279625015000001, 2024-09-12T17:06:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027134059999999998, 2024-09-12T17:06:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.884 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 42 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600336+0000", 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1270000000000001e-06 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600346+0000", 2024-09-12T17:06:33.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.499e-06 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600370+0000", 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4411000000000001e-05 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600386+0000", 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6205000000000002e-05 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600471+0000", 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5013999999999996e-05 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600569+0000", 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7663000000000003e-05 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600677+0000", 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108571 2024-09-12T17:06:33.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.601918+0000", 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012408090000000001 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.602976+0000", 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001058217 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603016+0000", 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9894000000000001e-05 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603047+0000", 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0995999999999999e-05 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:33.890 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.298569419000003, 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002848798, 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 52 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581393+0000", 2024-09-12T17:06:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4070000000000002e-06 2024-09-12T17:06:33.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581405+0000", 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581439+0000", 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3966e-05 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581457+0000", 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7842999999999998e-05 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581567+0000", 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011048900000000001 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581754+0000", 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018672099999999999 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581913+0000", 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015923700000000001 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.583010+0000", 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001096947 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584083+0000", 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010725730000000001 2024-09-12T17:06:33.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584168+0000", 2024-09-12T17:06:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4981999999999994e-05 2024-09-12T17:06:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584238+0000", 2024-09-12T17:06:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0747000000000006e-05 2024-09-12T17:06:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.896 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.180314768000002, 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003254804, 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.897 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 236 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699647+0000", 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1300000000000001e-06 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699660+0000", 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2326e-05 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699694+0000", 2024-09-12T17:06:33.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4552999999999999e-05 2024-09-12T17:06:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699710+0000", 2024-09-12T17:06:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5573000000000002e-05 2024-09-12T17:06:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699835+0000", 2024-09-12T17:06:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012534300000000001 2024-09-12T17:06:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700050+0000", 2024-09-12T17:06:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214565 2024-09-12T17:06:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700448+0000", 2024-09-12T17:06:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039816999999999999 2024-09-12T17:06:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702129+0000", 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001680874 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702721+0000", 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00059224199999999999 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702804+0000", 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3071999999999993e-05 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702899+0000", 2024-09-12T17:06:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4956000000000004e-05 2024-09-12T17:06:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.167874241, 2024-09-12T17:06:33.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026770299999999999, 2024-09-12T17:06:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 271 2024-09-12T17:06:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712086+0000", 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3510000000000001e-06 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712092+0000", 2024-09-12T17:06:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5670000000000002e-06 2024-09-12T17:06:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712105+0000", 2024-09-12T17:06:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3438000000000001e-05 2024-09-12T17:06:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712112+0000", 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6229999999999999e-06 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712181+0000", 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9323e-05 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712327+0000", 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014620900000000001 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712530+0000", 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020267700000000001 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.713251+0000", 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072110800000000004 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714674+0000", 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001423021 2024-09-12T17:06:33.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714718+0000", 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4459000000000002e-05 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714762+0000", 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3254000000000003e-05 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:287 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.164647758000001, 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034654030000000001, 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 287 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.910 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715312+0000", 2024-09-12T17:06:33.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1340000000000001e-06 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715318+0000", 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8409999999999996e-06 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715332+0000", 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4265e-05 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715342+0000", 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3360000000000001e-06 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715412+0000", 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9980000000000004e-05 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715511+0000", 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9197000000000006e-05 2024-09-12T17:06:33.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715663+0000", 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152347 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.716287+0000", 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00062330100000000004 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718705+0000", 2024-09-12T17:06:33.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002418505 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718743+0000", 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7645999999999998e-05 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718777+0000", 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3850999999999998e-05 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.915 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.855167905000002, 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028821710000000002, 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.916 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 742 2024-09-12T17:06:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024794+0000", 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7669999999999999e-06 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024805+0000", 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1093e-05 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024836+0000", 2024-09-12T17:06:33.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1136000000000001e-05 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024852+0000", 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6140000000000001e-05 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024989+0000", 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000136422 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025219+0000", 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008499999999999 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025545+0000", 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032645100000000001 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.026827+0000", 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00128202 2024-09-12T17:06:33.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027470+0000", 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00064248199999999999 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027556+0000", 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6533000000000007e-05 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027673+0000", 2024-09-12T17:06:33.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117042 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.851431693999999, 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002617173, 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.922 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 744 2024-09-12T17:06:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028529+0000", 2024-09-12T17:06:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8500000000000001e-06 2024-09-12T17:06:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028540+0000", 2024-09-12T17:06:33.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-05 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028565+0000", 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5083e-05 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028577+0000", 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2434e-05 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028679+0000", 2024-09-12T17:06:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101489 2024-09-12T17:06:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028800+0000", 2024-09-12T17:06:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012089199999999999 2024-09-12T17:06:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:33.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.029070+0000", 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000270358 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030114+0000", 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001043832 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030994+0000", 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087969000000000003 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031082+0000", 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7825999999999996e-05 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031144+0000", 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2829000000000004e-05 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.928 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.812269569000001, 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027655549999999998, 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 760 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067692+0000", 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4200000000000001e-06 2024-09-12T17:06:33.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067706+0000", 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.382e-05 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067739+0000", 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3253000000000002e-05 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067763+0000", 2024-09-12T17:06:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4026e-05 2024-09-12T17:06:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067912+0000", 2024-09-12T17:06:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014959199999999999 2024-09-12T17:06:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068127+0000", 2024-09-12T17:06:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021487500000000001 2024-09-12T17:06:33.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068438+0000", 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031070400000000003 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.069550+0000", 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011116159999999999 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070301+0000", 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075135000000000002 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070390+0000", 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8516000000000004e-05 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070455+0000", 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5382999999999994e-05 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.934 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.676047339999997, 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031165260000000001, 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.935 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 817 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203915+0000", 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.146e-06 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203926+0000", 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1379999999999999e-05 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203958+0000", 2024-09-12T17:06:33.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2239000000000001e-05 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203973+0000", 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.47e-05 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204156+0000", 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018277899999999999 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204392+0000", 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000236658 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204705+0000", 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000312248 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.205983+0000", 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001278387 2024-09-12T17:06:33.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206726+0000", 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074269799999999997 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206909+0000", 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018368200000000001 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.207028+0000", 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118609 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.671765690000001, 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003050269, 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.941 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 819 2024-09-12T17:06:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208196+0000", 2024-09-12T17:06:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4569999999999999e-06 2024-09-12T17:06:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208207+0000", 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208241+0000", 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3936000000000002e-05 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208256+0000", 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5917e-05 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208383+0000", 2024-09-12T17:06:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012605200000000001 2024-09-12T17:06:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208602+0000", 2024-09-12T17:06:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219908 2024-09-12T17:06:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:33.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.209077+0000", 2024-09-12T17:06:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047489299999999999 2024-09-12T17:06:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210285+0000", 2024-09-12T17:06:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012075110000000001 2024-09-12T17:06:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210979+0000", 2024-09-12T17:06:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069376099999999999 2024-09-12T17:06:33.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211131+0000", 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151915 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211243+0000", 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112989 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.617019966000001, 2024-09-12T17:06:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0035006659999999999, 2024-09-12T17:06:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.948 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 841 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262942+0000", 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6900000000000001e-06 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262953+0000", 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1323e-05 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262989+0000", 2024-09-12T17:06:33.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5617000000000001e-05 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263006+0000", 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7713000000000001e-05 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263177+0000", 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170249 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263551+0000", 2024-09-12T17:06:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037421999999999998 2024-09-12T17:06:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.264122+0000", 2024-09-12T17:06:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057113200000000002 2024-09-12T17:06:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.265539+0000", 2024-09-12T17:06:33.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001417012 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266170+0000", 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063154599999999997 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266330+0000", 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926800000000001 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266440+0000", 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010989600000000001 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.612318979000001, 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032057850000000001, 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.954 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 843 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267642+0000", 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267653+0000", 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0664e-05 2024-09-12T17:06:33.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267687+0000", 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4112999999999997e-05 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267703+0000", 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5673000000000001e-05 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267832+0000", 2024-09-12T17:06:33.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012896500000000001 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268054+0000", 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022279600000000001 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268561+0000", 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050617200000000005 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.269801+0000", 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012401269999999999 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270562+0000", 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076129699999999997 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270716+0000", 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000154339 2024-09-12T17:06:33.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270846+0000", 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930600000000001 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.601487319, 2024-09-12T17:06:33.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033822100000000001, 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 847 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:33.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278474+0000", 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4930000000000001e-06 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278485+0000", 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1313e-05 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278518+0000", 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2517000000000001e-05 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278533+0000", 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939999999999999e-05 2024-09-12T17:06:33.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278689+0000", 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015628899999999999 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279066+0000", 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000377337 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:33.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279610+0000", 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00054380900000000002 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281130+0000", 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001519488 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281583+0000", 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00045297300000000001 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281738+0000", 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015484900000000001 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281854+0000", 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116202 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.966 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.596871815, 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883554, 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 849 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283090+0000", 2024-09-12T17:06:33.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283102+0000", 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.204e-05 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283136+0000", 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3983000000000003e-05 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283152+0000", 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6082999999999998e-05 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283278+0000", 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000126212 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283505+0000", 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022724900000000001 2024-09-12T17:06:33.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283971+0000", 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046550600000000003 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285223+0000", 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012519370000000001 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285811+0000", 2024-09-12T17:06:33.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058819199999999997 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285904+0000", 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3410000000000002e-05 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285971+0000", 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6391999999999997e-05 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.548918901, 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033550770000000001, 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 868 2024-09-12T17:06:33.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331043+0000", 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331054+0000", 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.131e-05 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331086+0000", 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331101+0000", 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5016e-05 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331253+0000", 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151929 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331616+0000", 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036285100000000003 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.332174+0000", 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055856199999999997 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.333700+0000", 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015259480000000001 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334120+0000", 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042021700000000002 2024-09-12T17:06:33.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334280+0000", 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159949 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334395+0000", 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114679 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.978 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.54446111, 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003066923, 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 870 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335500+0000", 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4040000000000002e-06 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335511+0000", 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.045e-05 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335542+0000", 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1542999999999999e-05 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335558+0000", 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.535e-05 2024-09-12T17:06:33.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335698+0000", 2024-09-12T17:06:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014063899999999999 2024-09-12T17:06:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335930+0000", 2024-09-12T17:06:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000231435 2024-09-12T17:06:33.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.336392+0000", 2024-09-12T17:06:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046211199999999998 2024-09-12T17:06:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.337568+0000", 2024-09-12T17:06:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001176671 2024-09-12T17:06:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338407+0000", 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083885399999999999 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338491+0000", 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4159000000000005e-05 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338565+0000", 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3306000000000006e-05 2024-09-12T17:06:33.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.456272366999997, 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027821550000000001, 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 907 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:33.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423690+0000", 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423702+0000", 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2404e-05 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423735+0000", 2024-09-12T17:06:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3062999999999998e-05 2024-09-12T17:06:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423750+0000", 2024-09-12T17:06:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4912999999999999e-05 2024-09-12T17:06:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423919+0000", 2024-09-12T17:06:33.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016838899999999999 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424160+0000", 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024105099999999999 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424492+0000", 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033261100000000002 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.425785+0000", 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001292397 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426322+0000", 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00053743200000000001 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426403+0000", 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0898999999999999e-05 2024-09-12T17:06:33.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426469+0000", 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5720000000000001e-05 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.357106678999997, 2024-09-12T17:06:33.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029674670000000001, 2024-09-12T17:06:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 949 2024-09-12T17:06:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522855+0000", 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522871+0000", 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5950000000000001e-05 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522906+0000", 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316000000000001e-05 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522924+0000", 2024-09-12T17:06:33.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8326999999999999e-05 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523047+0000", 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123609 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523282+0000", 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234465 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:33.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523606+0000", 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032453099999999997 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.524804+0000", 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011977509999999999 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525626+0000", 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082216400000000001 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525743+0000", 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116679 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525820+0000", 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6631999999999994e-05 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.343383005, 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030602540000000001, 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 955 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.998 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536578+0000", 2024-09-12T17:06:33.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536590+0000", 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1250000000000001e-05 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536624+0000", 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4227000000000003e-05 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536646+0000", 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2195999999999999e-05 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536794+0000", 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014799600000000001 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537005+0000", 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021096799999999999 2024-09-12T17:06:34.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537489+0000", 2024-09-12T17:06:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048413599999999997 2024-09-12T17:06:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.538940+0000", 2024-09-12T17:06:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001451262 2024-09-12T17:06:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539441+0000", 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050002300000000005 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539535+0000", 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4526999999999998e-05 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539636+0000", 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010111900000000001 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.339125670999998, 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030889300000000001, 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 957 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540836+0000", 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540862+0000", 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999999e-05 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540891+0000", 2024-09-12T17:06:34.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9595999999999999e-05 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540906+0000", 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4919999999999999e-05 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541052+0000", 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014583900000000001 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541232+0000", 2024-09-12T17:06:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180259 2024-09-12T17:06:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541500+0000", 2024-09-12T17:06:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026788799999999998 2024-09-12T17:06:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.542483+0000", 2024-09-12T17:06:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000983142 2024-09-12T17:06:34.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543756+0000", 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001272977 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543842+0000", 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5748999999999995e-05 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543922+0000", 2024-09-12T17:06:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0000000000000007e-05 2024-09-12T17:06:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.010 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.010 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:34.011 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:06:34.012 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:34.011+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:34.112 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:34.109+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:34.136 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:34.136 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:34.137 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:34.149 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:06:34.213 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:34.207+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:34.309 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:34.309 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:34.310 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:34.310 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:34.314 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:34.311+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:34.323 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:06:34.415 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:34.409+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:34.449 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:34.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-12T17:06:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.899666361999998, 2024-09-12T17:06:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011583833, 2024-09-12T17:06:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:34.450 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 44 2024-09-12T17:06:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:34.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544942+0000", 2024-09-12T17:06:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.653e-06 2024-09-12T17:06:34.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544957+0000", 2024-09-12T17:06:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5654e-05 2024-09-12T17:06:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544993+0000", 2024-09-12T17:06:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5936000000000003e-05 2024-09-12T17:06:34.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.545017+0000", 2024-09-12T17:06:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3283000000000001e-05 2024-09-12T17:06:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549277+0000", 2024-09-12T17:06:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042606800000000002 2024-09-12T17:06:34.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549301+0000", 2024-09-12T17:06:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3260000000000001e-05 2024-09-12T17:06:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556317+0000", 2024-09-12T17:06:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070164620000000002 2024-09-12T17:06:34.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556522+0000", 2024-09-12T17:06:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020490499999999999 2024-09-12T17:06:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:34.457 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.856200815999998, 2024-09-12T17:06:34.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054133180000000003, 2024-09-12T17:06:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 207 2024-09-12T17:06:34.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588408+0000", 2024-09-12T17:06:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T17:06:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588428+0000", 2024-09-12T17:06:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9910000000000001e-05 2024-09-12T17:06:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588467+0000", 2024-09-12T17:06:34.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588483+0000", 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6443000000000002e-05 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588659+0000", 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569499999999999 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589033+0000", 2024-09-12T17:06:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037374100000000003 2024-09-12T17:06:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589729+0000", 2024-09-12T17:06:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069659400000000003 2024-09-12T17:06:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593394+0000", 2024-09-12T17:06:34.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036653279999999998 2024-09-12T17:06:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593661+0000", 2024-09-12T17:06:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026662499999999999 2024-09-12T17:06:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593743+0000", 2024-09-12T17:06:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1428999999999996e-05 2024-09-12T17:06:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593817+0000", 2024-09-12T17:06:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4475999999999996e-05 2024-09-12T17:06:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.819980115999996, 2024-09-12T17:06:34.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034289839999999999, 2024-09-12T17:06:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 216 2024-09-12T17:06:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624628+0000", 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2399999999999999e-06 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624641+0000", 2024-09-12T17:06:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3743e-05 2024-09-12T17:06:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624675+0000", 2024-09-12T17:06:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3277e-05 2024-09-12T17:06:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624690+0000", 2024-09-12T17:06:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5812999999999999e-05 2024-09-12T17:06:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624847+0000", 2024-09-12T17:06:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156269 2024-09-12T17:06:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625092+0000", 2024-09-12T17:06:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024499500000000002 2024-09-12T17:06:34.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625494+0000", 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040263000000000001 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.626934+0000", 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001439159 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627890+0000", 2024-09-12T17:06:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095619599999999998 2024-09-12T17:06:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627978+0000", 2024-09-12T17:06:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8446e-05 2024-09-12T17:06:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.628053+0000", 2024-09-12T17:06:34.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5216000000000006e-05 2024-09-12T17:06:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.778471873000001, 2024-09-12T17:06:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003364985, 2024-09-12T17:06:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.474 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 227 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666135+0000", 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.644e-06 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666147+0000", 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1960000000000001e-05 2024-09-12T17:06:34.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666179+0000", 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1813000000000002e-05 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666195+0000", 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5679999999999999e-05 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666342+0000", 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147312 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666559+0000", 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021664199999999999 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.667037+0000", 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047816200000000002 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.668796+0000", 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017590010000000001 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669346+0000", 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055024499999999999 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669433+0000", 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6650000000000006e-05 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669498+0000", 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4875999999999993e-05 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.771264614000003, 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031932409999999999, 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 229 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673342+0000", 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3499999999999999e-06 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673354+0000", 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1739999999999999e-05 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673386+0000", 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1782000000000002e-05 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673400+0000", 2024-09-12T17:06:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4663e-05 2024-09-12T17:06:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673577+0000", 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017662900000000001 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673783+0000", 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020620799999999999 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.674174+0000", 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039082100000000002 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.675441+0000", 2024-09-12T17:06:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001267177 2024-09-12T17:06:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676382+0000", 2024-09-12T17:06:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094087900000000004 2024-09-12T17:06:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676468+0000", 2024-09-12T17:06:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5762999999999999e-05 2024-09-12T17:06:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676533+0000", 2024-09-12T17:06:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5228999999999995e-05 2024-09-12T17:06:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.488 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.763521691000001, 2024-09-12T17:06:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0037357380000000002, 2024-09-12T17:06:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.489 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 231 2024-09-12T17:06:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681085+0000", 2024-09-12T17:06:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:06:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681096+0000", 2024-09-12T17:06:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0866000000000001e-05 2024-09-12T17:06:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681126+0000", 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9977000000000001e-05 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681140+0000", 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4195999999999999e-05 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681288+0000", 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014765199999999999 2024-09-12T17:06:34.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681637+0000", 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034917100000000001 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.682358+0000", 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072050800000000002 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684139+0000", 2024-09-12T17:06:34.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017812399999999999 2024-09-12T17:06:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684543+0000", 2024-09-12T17:06:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040413299999999999 2024-09-12T17:06:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684703+0000", 2024-09-12T17:06:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160075 2024-09-12T17:06:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684819+0000", 2024-09-12T17:06:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011553300000000001 2024-09-12T17:06:34.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:374 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.708644261000003, 2024-09-12T17:06:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031135910000000002, 2024-09-12T17:06:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.498 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 374 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735961+0000", 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0979999999999999e-06 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735968+0000", 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735981+0000", 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3164e-05 2024-09-12T17:06:34.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735989+0000", 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8010000000000004e-06 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736041+0000", 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800999999999998e-05 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736137+0000", 2024-09-12T17:06:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5497999999999999e-05 2024-09-12T17:06:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736303+0000", 2024-09-12T17:06:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016580100000000001 2024-09-12T17:06:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736802+0000", 2024-09-12T17:06:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049966599999999996 2024-09-12T17:06:34.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739015+0000", 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022122919999999998 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739047+0000", 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2678000000000001e-05 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739074+0000", 2024-09-12T17:06:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6594e-05 2024-09-12T17:06:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.483199517999999, 2024-09-12T17:06:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029096640000000002, 2024-09-12T17:06:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 715 2024-09-12T17:06:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:34.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961407+0000", 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961419+0000", 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.117e-05 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961450+0000", 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1463e-05 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961465+0000", 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-12T17:06:34.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961576+0000", 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111016 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961785+0000", 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020865599999999999 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:34.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.962105+0000", 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031996699999999999 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.963189+0000", 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010845519999999999 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964163+0000", 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097355800000000002 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964252+0000", 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8996e-05 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964315+0000", 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2773000000000004e-05 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.448928961999997, 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883207, 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 730 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.511 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995678+0000", 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995689+0000", 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1316e-05 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995722+0000", 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995745+0000", 2024-09-12T17:06:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3496999999999999e-05 2024-09-12T17:06:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995902+0000", 2024-09-12T17:06:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156446 2024-09-12T17:06:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996113+0000", 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021091099999999999 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996444+0000", 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000330785 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.997558+0000", 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001114681 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998420+0000", 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086125299999999998 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998497+0000", 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7919999999999999e-05 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998559+0000", 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1319e-05 2024-09-12T17:06:34.516 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.430447397999998, 2024-09-12T17:06:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002862248, 2024-09-12T17:06:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 738 2024-09-12T17:06:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014159+0000", 2024-09-12T17:06:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:34.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014168+0000", 2024-09-12T17:06:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.653e-06 2024-09-12T17:06:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014191+0000", 2024-09-12T17:06:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3706e-05 2024-09-12T17:06:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014213+0000", 2024-09-12T17:06:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2050000000000001e-05 2024-09-12T17:06:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014363+0000", 2024-09-12T17:06:34.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014956299999999999 2024-09-12T17:06:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014485+0000", 2024-09-12T17:06:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000122132 2024-09-12T17:06:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014770+0000", 2024-09-12T17:06:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000284911 2024-09-12T17:06:34.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.015864+0000", 2024-09-12T17:06:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010942180000000001 2024-09-12T17:06:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016864+0000", 2024-09-12T17:06:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00099982299999999994 2024-09-12T17:06:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016951+0000", 2024-09-12T17:06:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6476000000000003e-05 2024-09-12T17:06:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.017019+0000", 2024-09-12T17:06:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8756000000000004e-05 2024-09-12T17:06:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:34.525 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.348126020000002, 2024-09-12T17:06:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032495950000000001, 2024-09-12T17:06:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.526 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 772 2024-09-12T17:06:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096481+0000", 2024-09-12T17:06:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4399999999999999e-06 2024-09-12T17:06:34.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096492+0000", 2024-09-12T17:06:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1513e-05 2024-09-12T17:06:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096522+0000", 2024-09-12T17:06:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9156e-05 2024-09-12T17:06:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096536+0000", 2024-09-12T17:06:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4347e-05 2024-09-12T17:06:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096681+0000", 2024-09-12T17:06:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145348 2024-09-12T17:06:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096896+0000", 2024-09-12T17:06:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214489 2024-09-12T17:06:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.097208+0000", 2024-09-12T17:06:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031215099999999999 2024-09-12T17:06:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.098332+0000", 2024-09-12T17:06:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001123635 2024-09-12T17:06:34.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099583+0000", 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00125179 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099663+0000", 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9703000000000006e-05 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099728+0000", 2024-09-12T17:06:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5023000000000004e-05 2024-09-12T17:06:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.276384061000002, 2024-09-12T17:06:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028771949999999999, 2024-09-12T17:06:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.534 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 802 2024-09-12T17:06:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:34.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168223+0000", 2024-09-12T17:06:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4499999999999998e-06 2024-09-12T17:06:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168234+0000", 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168265+0000", 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0777e-05 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168279+0000", 2024-09-12T17:06:34.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4525999999999999e-05 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168397+0000", 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118063 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168616+0000", 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000218505 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168970+0000", 2024-09-12T17:06:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00035427400000000002 2024-09-12T17:06:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170038+0000", 2024-09-12T17:06:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001067571 2024-09-12T17:06:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170897+0000", 2024-09-12T17:06:34.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085934399999999995 2024-09-12T17:06:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170983+0000", 2024-09-12T17:06:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6179000000000003e-05 2024-09-12T17:06:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.171098+0000", 2024-09-12T17:06:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114576 2024-09-12T17:06:34.540 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.217584234999997, 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033328609999999999, 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.541 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 826 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:34.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227023+0000", 2024-09-12T17:06:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:06:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227035+0000", 2024-09-12T17:06:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227067+0000", 2024-09-12T17:06:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2305999999999999e-05 2024-09-12T17:06:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227082+0000", 2024-09-12T17:06:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.485e-05 2024-09-12T17:06:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227247+0000", 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016483900000000001 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227630+0000", 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038350100000000001 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.228201+0000", 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057026799999999997 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.229556+0000", 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013553300000000001 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230084+0000", 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00052805599999999995 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230238+0000", 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015438499999999999 2024-09-12T17:06:34.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230353+0000", 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114809 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.158310878999998, 2024-09-12T17:06:34.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033407710000000002, 2024-09-12T17:06:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 850 2024-09-12T17:06:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286296+0000", 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286307+0000", 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1287000000000001e-05 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286339+0000", 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1331999999999997e-05 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286353+0000", 2024-09-12T17:06:34.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4517e-05 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286504+0000", 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015038200000000001 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286897+0000", 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039326399999999999 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:34.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.287451+0000", 2024-09-12T17:06:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055426900000000003 2024-09-12T17:06:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.288825+0000", 2024-09-12T17:06:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013741160000000001 2024-09-12T17:06:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289484+0000", 2024-09-12T17:06:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00065819499999999998 2024-09-12T17:06:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289570+0000", 2024-09-12T17:06:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6383000000000003e-05 2024-09-12T17:06:34.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289634+0000", 2024-09-12T17:06:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4505999999999995e-05 2024-09-12T17:06:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.554 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.120318961999999, 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002894237, 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.555 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 865 2024-09-12T17:06:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324288+0000", 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2469999999999998e-06 2024-09-12T17:06:34.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324299+0000", 2024-09-12T17:06:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0823e-05 2024-09-12T17:06:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324330+0000", 2024-09-12T17:06:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1846e-05 2024-09-12T17:06:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324350+0000", 2024-09-12T17:06:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9077e-05 2024-09-12T17:06:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324463+0000", 2024-09-12T17:06:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011367200000000001 2024-09-12T17:06:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324693+0000", 2024-09-12T17:06:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008800000000001 2024-09-12T17:06:34.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.325000+0000", 2024-09-12T17:06:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030629499999999999 2024-09-12T17:06:34.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.326117+0000", 2024-09-12T17:06:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011175709999999999 2024-09-12T17:06:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327026+0000", 2024-09-12T17:06:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00090879000000000003 2024-09-12T17:06:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327113+0000", 2024-09-12T17:06:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7093000000000001e-05 2024-09-12T17:06:34.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327180+0000", 2024-09-12T17:06:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6735000000000004e-05 2024-09-12T17:06:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:34.564 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.105805463999999, 2024-09-12T17:06:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030741359999999999, 2024-09-12T17:06:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 871 2024-09-12T17:06:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338802+0000", 2024-09-12T17:06:34.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338831+0000", 2024-09-12T17:06:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9356000000000002e-05 2024-09-12T17:06:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338868+0000", 2024-09-12T17:06:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7357000000000002e-05 2024-09-12T17:06:34.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338883+0000", 2024-09-12T17:06:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4932999999999999e-05 2024-09-12T17:06:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339036+0000", 2024-09-12T17:06:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152423 2024-09-12T17:06:34.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339264+0000", 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022814100000000001 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339593+0000", 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032943099999999998 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.340783+0000", 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011898740000000001 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341724+0000", 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094134600000000002 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341809+0000", 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4155999999999999e-05 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341873+0000", 2024-09-12T17:06:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4605999999999998e-05 2024-09-12T17:06:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.048313403999998, 2024-09-12T17:06:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003093649, 2024-09-12T17:06:34.571 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 895 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396294+0000", 2024-09-12T17:06:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3999999999999999e-06 2024-09-12T17:06:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396307+0000", 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3468999999999999e-05 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396338+0000", 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1433000000000002e-05 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396353+0000", 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4557e-05 2024-09-12T17:06:34.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396496+0000", 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014275900000000001 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396719+0000", 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022317499999999999 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:34.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.397052+0000", 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033263699999999999 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.398211+0000", 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011593350000000001 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399235+0000", 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010241219999999999 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399321+0000", 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5789000000000001e-05 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399385+0000", 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3973000000000006e-05 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.577 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 35.041826348000001, 2024-09-12T17:06:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029302239999999999, 2024-09-12T17:06:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 898 2024-09-12T17:06:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.578 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402780+0000", 2024-09-12T17:06:34.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9269999999999999e-06 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402789+0000", 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7069999999999998e-06 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402830+0000", 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1470000000000001e-05 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402846+0000", 2024-09-12T17:06:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5319e-05 2024-09-12T17:06:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402938+0000", 2024-09-12T17:06:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2289999999999999e-05 2024-09-12T17:06:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403134+0000", 2024-09-12T17:06:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000196014 2024-09-12T17:06:34.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403437+0000", 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030337199999999999 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.404507+0000", 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001069492 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405432+0000", 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092532900000000002 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405590+0000", 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158018 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405708+0000", 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118286 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.583 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.956419087, 2024-09-12T17:06:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030817499999999999, 2024-09-12T17:06:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.584 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 934 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488188+0000", 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8040000000000002e-06 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488201+0000", 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2893e-05 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488233+0000", 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2085999999999997e-05 2024-09-12T17:06:34.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488248+0000", 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4976e-05 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488415+0000", 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016677900000000001 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488650+0000", 2024-09-12T17:06:34.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234875 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488961+0000", 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031078799999999999 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.490177+0000", 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001216607 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491119+0000", 2024-09-12T17:06:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000941806 2024-09-12T17:06:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491202+0000", 2024-09-12T17:06:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3349000000000004e-05 2024-09-12T17:06:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491267+0000", 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4787000000000002e-05 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 34.945600106999997, 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031107489999999999, 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:34.590 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 939 2024-09-12T17:06:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:34.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:34.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499007+0000", 2024-09-12T17:06:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3970000000000001e-06 2024-09-12T17:06:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499018+0000", 2024-09-12T17:06:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0969e-05 2024-09-12T17:06:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499052+0000", 2024-09-12T17:06:34.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3896999999999997e-05 2024-09-12T17:06:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499068+0000", 2024-09-12T17:06:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6552999999999999e-05 2024-09-12T17:06:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:34.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499200+0000", 2024-09-12T17:06:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013206599999999999 2024-09-12T17:06:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499438+0000", 2024-09-12T17:06:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023806500000000001 2024-09-12T17:06:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499922+0000", 2024-09-12T17:06:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048369599999999998 2024-09-12T17:06:34.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501326+0000", 2024-09-12T17:06:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014036560000000001 2024-09-12T17:06:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501962+0000", 2024-09-12T17:06:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063623100000000001 2024-09-12T17:06:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502048+0000", 2024-09-12T17:06:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5636999999999993e-05 2024-09-12T17:06:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502115+0000", 2024-09-12T17:06:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7582000000000004e-05 2024-09-12T17:06:34.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:34.598 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:34.598 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:34.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:06:34.601 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:34.595+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:34.701 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:34.695+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:34.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:06:34.736 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:34.736 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:06:34.736 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:34.750 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:06:34.793 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T17:06:34.841 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:34.839+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:34.891 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:34.891 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:34.902 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:34.897+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:34.907 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:34.908 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:34.921 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:34.921 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:34.921 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:34.925 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:34.926 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:34.936 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:06:34.943 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:34.944 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:34.963 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:34.963 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:34.981 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:34.981 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:34.999 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:34.999 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:35.003 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:34.997+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:35.015 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:35.016 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:35.104 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:35.101+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:35.106 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:35.107 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:35.122 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:06:35.205 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:35.201+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:35.250 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:35.250 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:35.264 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:06:35.306 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:35.301+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:35.394 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:35.394 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:35.407 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:35.405+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:35.409 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:06:35.508 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:35.503+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:35.539 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:35.539 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:35.555 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:06:35.642 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:35.639+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:35.710 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:35.707+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:35.726 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:35.726 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:35.741 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:06:35.834 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:35.831+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:35.912 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:35.909+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:35.913 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:35.914 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:35.928 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:06:36.014 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:36.011+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:36.096 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:36.096 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:36.111 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:06:36.114 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:36.109+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:36.215 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:36.211+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:36.279 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:36.279 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:36.294 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:06:36.338 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:36.335+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:36.417 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:36.411+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:36.462 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:36.462 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:36.477 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:06:36.517 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:36.513+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:36.618 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:36.613+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:36.641 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:36.641 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:36.656 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:06:36.720 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:36.717+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:36.784 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:36.784 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:36.798 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:06:36.820 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T17:06:36.821 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:36.815+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:36.922 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:36.919+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:36.989 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:36.989 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:37.009 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:06:37.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:06:37.052 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:37.049+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:37.124 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:37.119+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:37.169 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:37.169 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:37.187 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:06:37.231 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:37.229+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:37.237 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:37.238 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:37.255 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:37.255 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:37.272 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:37.272 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:37.288 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:37.289 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:37.325 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:37.325 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:37.326 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:37.323+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:37.352 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:37.353 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:37.353 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:37.353 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:37.354 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:37.354 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:37.370 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:06:37.388 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:37.388 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:37.421 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:37.421 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:37.426 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:37.421+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:37.498 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:37.498 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:37.498 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:37.498 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:37.498 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:37.511 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:06:37.559 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:37.557+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:37.628 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:37.629 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:37.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:37.629 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:37.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.629 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:37.629 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:37.629 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 46.099219294999997, 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:37.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:37.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:06:37.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:06:37.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:06:37.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:06:37.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:06:37.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:06:37.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:37.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.634 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.941587099000003, 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:06:37.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.031493306000002, 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:06:37.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:06:37.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:06:37.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:06:37.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:06:37.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:06:37.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.647 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.015602565000002, 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:06:37.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:06:37.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:06:37.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:06:37.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:06:37.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:06:37.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.654 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.654 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.654 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.654 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:37.654 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.990133895, 2024-09-12T17:06:37.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:06:37.654 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.655 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.655 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.655 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:06:37.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.655 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:37.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:37.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:06:37.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:06:37.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:06:37.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:06:37.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:06:37.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:06:37.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:06:37.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:06:37.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:06:37.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:06:37.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.971172793999997, 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:06:37.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:06:37.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:06:37.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:06:37.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:06:37.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:06:37.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.667 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.668 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:37.668 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.936617494000004, 2024-09-12T17:06:37.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:06:37.668 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.668 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.668 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.668 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.668 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:06:37.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.669 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:37.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:37.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:06:37.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:06:37.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:06:37.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:06:37.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:06:37.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:06:37.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:06:37.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:06:37.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:06:37.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:06:37.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:06:37.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:06:37.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:06:37.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:06:37.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:06:37.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:06:37.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:06:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:06:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:06:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:06:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.623398080999998, 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:06:37.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:06:37.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.618506713000002, 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:06:37.683 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:06:37.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:06:37.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:37.689 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.579531254000003, 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:37.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:06:37.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.695 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.575633279999998, 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:06:37.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:06:37.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:06:37.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:06:37.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:06:37.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:06:37.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:06:37.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.702 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.702 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:37.702 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.506874048, 2024-09-12T17:06:37.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:06:37.702 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.703 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.703 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:06:37.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.703 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:37.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:06:37.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:06:37.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:06:37.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:06:37.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:06:37.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:37.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:06:37.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:06:37.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:06:37.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:06:37.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:06:37.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:06:37.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.708 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.709 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.709 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:37.709 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.471030034000002, 2024-09-12T17:06:37.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:06:37.709 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.709 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.709 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.709 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:06:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:06:37.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:06:37.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:06:37.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:06:37.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:06:37.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:37.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:06:37.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:06:37.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:06:37.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:06:37.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:06:37.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.716 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.716 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:37.716 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.450842663000003, 2024-09-12T17:06:37.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:06:37.716 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:06:37.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:06:37.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:06:37.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.445948301000001, 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:06:37.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.383980145999999, 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:37.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:06:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:06:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:06:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:06:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:06:37.736 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.379573370999999, 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.737 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:06:37.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:06:37.742 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.212174029000003, 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.743 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:06:37.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.181398995999999, 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.749 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:06:37.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.176486740999998, 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:37.755 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:37.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:06:37.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:37.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:06:37.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:06:37.761 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.761 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.761 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.761 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:37.761 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:37.761 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:37.762 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T17:06:37.762 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T17:06:37.762 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T17:06:37.762 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2024-09-12T17:06:37.764 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:06:37.764 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:37.757+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:37.804 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T17:06:37.875 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:37.873+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:37.964 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:37.959+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:37.980 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:37.980 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:37.980 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:37.980 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:37.998 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:06:38.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:38.085+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:38.166 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:38.161+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:38.194 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:38.194 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:38.195 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:38.195 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:38.212 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:06:38.400 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-12T17:06:38.253+0000 7fd39ca3b640 -1 mon.a@0(leader).osd e50 definitely_dead 0 2024-09-12T17:06:38.401 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:38.397+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:38.505 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:38.501+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:38.515 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:38.516 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:38.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:38.516 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:38.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.516 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:38.516 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:38.516 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 46.911845171000003, 2024-09-12T17:06:38.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027134059999999998, 2024-09-12T17:06:38.517 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.517 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.517 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:38.517 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:38.517 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 42 2024-09-12T17:06:38.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.517 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600336+0000", 2024-09-12T17:06:38.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1270000000000001e-06 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600346+0000", 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.499e-06 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600370+0000", 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4411000000000001e-05 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600386+0000", 2024-09-12T17:06:38.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6205000000000002e-05 2024-09-12T17:06:38.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600471+0000", 2024-09-12T17:06:38.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5013999999999996e-05 2024-09-12T17:06:38.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600569+0000", 2024-09-12T17:06:38.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7663000000000003e-05 2024-09-12T17:06:38.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:38.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600677+0000", 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108571 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.601918+0000", 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012408090000000001 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.602976+0000", 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001058217 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603016+0000", 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9894000000000001e-05 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603047+0000", 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0995999999999999e-05 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.523 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:38.524 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:38.524 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.930789574999999, 2024-09-12T17:06:38.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002848798, 2024-09-12T17:06:38.524 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.524 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.524 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.525 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.525 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.525 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.525 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 52 2024-09-12T17:06:38.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.525 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:38.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:38.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581393+0000", 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4070000000000002e-06 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581405+0000", 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581439+0000", 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3966e-05 2024-09-12T17:06:38.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581457+0000", 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7842999999999998e-05 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581567+0000", 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011048900000000001 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581754+0000", 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018672099999999999 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581913+0000", 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015923700000000001 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.583010+0000", 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001096947 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584083+0000", 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010725730000000001 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584168+0000", 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4981999999999994e-05 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584238+0000", 2024-09-12T17:06:38.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0747000000000006e-05 2024-09-12T17:06:38.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.531 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.531 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.531 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.531 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:38.531 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.812534923999998, 2024-09-12T17:06:38.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003254804, 2024-09-12T17:06:38.531 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.531 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.531 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.532 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.532 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.532 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.532 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 236 2024-09-12T17:06:38.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.532 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.532 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:38.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:38.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699647+0000", 2024-09-12T17:06:38.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1300000000000001e-06 2024-09-12T17:06:38.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699660+0000", 2024-09-12T17:06:38.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2326e-05 2024-09-12T17:06:38.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699694+0000", 2024-09-12T17:06:38.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4552999999999999e-05 2024-09-12T17:06:38.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699710+0000", 2024-09-12T17:06:38.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5573000000000002e-05 2024-09-12T17:06:38.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699835+0000", 2024-09-12T17:06:38.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012534300000000001 2024-09-12T17:06:38.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700050+0000", 2024-09-12T17:06:38.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214565 2024-09-12T17:06:38.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:38.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700448+0000", 2024-09-12T17:06:38.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039816999999999999 2024-09-12T17:06:38.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702129+0000", 2024-09-12T17:06:38.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001680874 2024-09-12T17:06:38.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702721+0000", 2024-09-12T17:06:38.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00059224199999999999 2024-09-12T17:06:38.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702804+0000", 2024-09-12T17:06:38.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3071999999999993e-05 2024-09-12T17:06:38.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702899+0000", 2024-09-12T17:06:38.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4956000000000004e-05 2024-09-12T17:06:38.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.538 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.539 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.539 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:38.539 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.800094397000002, 2024-09-12T17:06:38.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026770299999999999, 2024-09-12T17:06:38.539 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.539 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.539 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.539 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.539 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.539 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 271 2024-09-12T17:06:38.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.540 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:38.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:38.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712086+0000", 2024-09-12T17:06:38.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3510000000000001e-06 2024-09-12T17:06:38.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712092+0000", 2024-09-12T17:06:38.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5670000000000002e-06 2024-09-12T17:06:38.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712105+0000", 2024-09-12T17:06:38.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3438000000000001e-05 2024-09-12T17:06:38.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712112+0000", 2024-09-12T17:06:38.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6229999999999999e-06 2024-09-12T17:06:38.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712181+0000", 2024-09-12T17:06:38.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9323e-05 2024-09-12T17:06:38.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712327+0000", 2024-09-12T17:06:38.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014620900000000001 2024-09-12T17:06:38.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:38.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712530+0000", 2024-09-12T17:06:38.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020267700000000001 2024-09-12T17:06:38.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.713251+0000", 2024-09-12T17:06:38.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072110800000000004 2024-09-12T17:06:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714674+0000", 2024-09-12T17:06:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001423021 2024-09-12T17:06:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714718+0000", 2024-09-12T17:06:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4459000000000002e-05 2024-09-12T17:06:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714762+0000", 2024-09-12T17:06:38.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3254000000000003e-05 2024-09-12T17:06:38.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.546 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.546 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.547 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:287 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.547 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:38.547 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.796867914000003, 2024-09-12T17:06:38.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034654030000000001, 2024-09-12T17:06:38.547 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.547 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.547 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.547 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.548 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.548 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.548 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 287 2024-09-12T17:06:38.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.548 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.548 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.548 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:38.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:38.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715312+0000", 2024-09-12T17:06:38.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1340000000000001e-06 2024-09-12T17:06:38.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715318+0000", 2024-09-12T17:06:38.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8409999999999996e-06 2024-09-12T17:06:38.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715332+0000", 2024-09-12T17:06:38.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4265e-05 2024-09-12T17:06:38.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715342+0000", 2024-09-12T17:06:38.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3360000000000001e-06 2024-09-12T17:06:38.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715412+0000", 2024-09-12T17:06:38.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9980000000000004e-05 2024-09-12T17:06:38.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715511+0000", 2024-09-12T17:06:38.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9197000000000006e-05 2024-09-12T17:06:38.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.553 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:38.553 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715663+0000", 2024-09-12T17:06:38.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152347 2024-09-12T17:06:38.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.553 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.716287+0000", 2024-09-12T17:06:38.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00062330100000000004 2024-09-12T17:06:38.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718705+0000", 2024-09-12T17:06:38.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002418505 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718743+0000", 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7645999999999998e-05 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718777+0000", 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3850999999999998e-05 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.487388060999997, 2024-09-12T17:06:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028821710000000002, 2024-09-12T17:06:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.560 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 742 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024794+0000", 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7669999999999999e-06 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024805+0000", 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1093e-05 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024836+0000", 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1136000000000001e-05 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024852+0000", 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6140000000000001e-05 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024989+0000", 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000136422 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025219+0000", 2024-09-12T17:06:38.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008499999999999 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025545+0000", 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032645100000000001 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.026827+0000", 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00128202 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027470+0000", 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00064248199999999999 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027556+0000", 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6533000000000007e-05 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027673+0000", 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117042 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.565 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.483651850000001, 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002617173, 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.566 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 744 2024-09-12T17:06:38.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.567 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:38.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:38.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028529+0000", 2024-09-12T17:06:38.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8500000000000001e-06 2024-09-12T17:06:38.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028540+0000", 2024-09-12T17:06:38.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-05 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028565+0000", 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5083e-05 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028577+0000", 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2434e-05 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028679+0000", 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101489 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028800+0000", 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012089199999999999 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.029070+0000", 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000270358 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030114+0000", 2024-09-12T17:06:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001043832 2024-09-12T17:06:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030994+0000", 2024-09-12T17:06:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087969000000000003 2024-09-12T17:06:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031082+0000", 2024-09-12T17:06:38.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7825999999999996e-05 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031144+0000", 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2829000000000004e-05 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:38.572 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.444489724999997, 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027655549999999998, 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 760 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067692+0000", 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4200000000000001e-06 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067706+0000", 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.382e-05 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067739+0000", 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3253000000000002e-05 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067763+0000", 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4026e-05 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067912+0000", 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014959199999999999 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068127+0000", 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021487500000000001 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068438+0000", 2024-09-12T17:06:38.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031070400000000003 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.069550+0000", 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011116159999999999 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070301+0000", 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075135000000000002 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070390+0000", 2024-09-12T17:06:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8516000000000004e-05 2024-09-12T17:06:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070455+0000", 2024-09-12T17:06:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5382999999999994e-05 2024-09-12T17:06:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.308267495999999, 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031165260000000001, 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 817 2024-09-12T17:06:38.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203915+0000", 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.146e-06 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203926+0000", 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1379999999999999e-05 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203958+0000", 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2239000000000001e-05 2024-09-12T17:06:38.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203973+0000", 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.47e-05 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204156+0000", 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018277899999999999 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204392+0000", 2024-09-12T17:06:38.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000236658 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204705+0000", 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000312248 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.205983+0000", 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001278387 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206726+0000", 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074269799999999997 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206909+0000", 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018368200000000001 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.207028+0000", 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118609 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.584 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.585 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.585 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.585 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:38.585 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.303985846000003, 2024-09-12T17:06:38.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003050269, 2024-09-12T17:06:38.585 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.585 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 819 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208196+0000", 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4569999999999999e-06 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208207+0000", 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208241+0000", 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3936000000000002e-05 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208256+0000", 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5917e-05 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208383+0000", 2024-09-12T17:06:38.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012605200000000001 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208602+0000", 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219908 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.209077+0000", 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047489299999999999 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210285+0000", 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012075110000000001 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210979+0000", 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069376099999999999 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211131+0000", 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151915 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211243+0000", 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112989 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.249240122000003, 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0035006659999999999, 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.591 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 841 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262942+0000", 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6900000000000001e-06 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262953+0000", 2024-09-12T17:06:38.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1323e-05 2024-09-12T17:06:38.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262989+0000", 2024-09-12T17:06:38.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5617000000000001e-05 2024-09-12T17:06:38.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263006+0000", 2024-09-12T17:06:38.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7713000000000001e-05 2024-09-12T17:06:38.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263177+0000", 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170249 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263551+0000", 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037421999999999998 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.264122+0000", 2024-09-12T17:06:38.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057113200000000002 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.265539+0000", 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001417012 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266170+0000", 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063154599999999997 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266330+0000", 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926800000000001 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266440+0000", 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010989600000000001 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.597 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.244539134999997, 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032057850000000001, 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 843 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267642+0000", 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267653+0000", 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0664e-05 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267687+0000", 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4112999999999997e-05 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267703+0000", 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5673000000000001e-05 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267832+0000", 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012896500000000001 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268054+0000", 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022279600000000001 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268561+0000", 2024-09-12T17:06:38.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050617200000000005 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.269801+0000", 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012401269999999999 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270562+0000", 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076129699999999997 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270716+0000", 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000154339 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270846+0000", 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930600000000001 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.603 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.233707475000003, 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033822100000000001, 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 847 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278474+0000", 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4930000000000001e-06 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278485+0000", 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1313e-05 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278518+0000", 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2517000000000001e-05 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278533+0000", 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939999999999999e-05 2024-09-12T17:06:38.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278689+0000", 2024-09-12T17:06:38.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015628899999999999 2024-09-12T17:06:38.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279066+0000", 2024-09-12T17:06:38.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000377337 2024-09-12T17:06:38.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279610+0000", 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00054380900000000002 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281130+0000", 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001519488 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281583+0000", 2024-09-12T17:06:38.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00045297300000000001 2024-09-12T17:06:38.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281738+0000", 2024-09-12T17:06:38.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015484900000000001 2024-09-12T17:06:38.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281854+0000", 2024-09-12T17:06:38.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116202 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.229091971000003, 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883554, 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 849 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283090+0000", 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283102+0000", 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.204e-05 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283136+0000", 2024-09-12T17:06:38.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3983000000000003e-05 2024-09-12T17:06:38.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283152+0000", 2024-09-12T17:06:38.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6082999999999998e-05 2024-09-12T17:06:38.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283278+0000", 2024-09-12T17:06:38.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000126212 2024-09-12T17:06:38.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283505+0000", 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022724900000000001 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283971+0000", 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046550600000000003 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285223+0000", 2024-09-12T17:06:38.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012519370000000001 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285811+0000", 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058819199999999997 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285904+0000", 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3410000000000002e-05 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285971+0000", 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6391999999999997e-05 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.181139057000003, 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033550770000000001, 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 868 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331043+0000", 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331054+0000", 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.131e-05 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331086+0000", 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331101+0000", 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5016e-05 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331253+0000", 2024-09-12T17:06:38.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151929 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331616+0000", 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036285100000000003 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.332174+0000", 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055856199999999997 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.333700+0000", 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015259480000000001 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334120+0000", 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042021700000000002 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334280+0000", 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159949 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334395+0000", 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114679 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.176681266000003, 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003066923, 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 870 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335500+0000", 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4040000000000002e-06 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335511+0000", 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.045e-05 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335542+0000", 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1542999999999999e-05 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335558+0000", 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.535e-05 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335698+0000", 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014063899999999999 2024-09-12T17:06:38.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335930+0000", 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000231435 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.336392+0000", 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046211199999999998 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.337568+0000", 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001176671 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338407+0000", 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083885399999999999 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338491+0000", 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4159000000000005e-05 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338565+0000", 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3306000000000006e-05 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.088492522999999, 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027821550000000001, 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 907 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423690+0000", 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423702+0000", 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2404e-05 2024-09-12T17:06:38.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423735+0000", 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3062999999999998e-05 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423750+0000", 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4912999999999999e-05 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423919+0000", 2024-09-12T17:06:38.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016838899999999999 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424160+0000", 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024105099999999999 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424492+0000", 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033261100000000002 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.425785+0000", 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001292397 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426322+0000", 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00053743200000000001 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426403+0000", 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0898999999999999e-05 2024-09-12T17:06:38.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426469+0000", 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5720000000000001e-05 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.989326835, 2024-09-12T17:06:38.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029674670000000001, 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 949 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522855+0000", 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522871+0000", 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5950000000000001e-05 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522906+0000", 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316000000000001e-05 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522924+0000", 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8326999999999999e-05 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523047+0000", 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123609 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523282+0000", 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234465 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523606+0000", 2024-09-12T17:06:38.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032453099999999997 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.524804+0000", 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011977509999999999 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525626+0000", 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082216400000000001 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525743+0000", 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116679 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525820+0000", 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6631999999999994e-05 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.640 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.975603161000002, 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030602540000000001, 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 955 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536578+0000", 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536590+0000", 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1250000000000001e-05 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536624+0000", 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4227000000000003e-05 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536646+0000", 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2195999999999999e-05 2024-09-12T17:06:38.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536794+0000", 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014799600000000001 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537005+0000", 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021096799999999999 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537489+0000", 2024-09-12T17:06:38.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048413599999999997 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.538940+0000", 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001451262 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539441+0000", 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050002300000000005 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539535+0000", 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4526999999999998e-05 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539636+0000", 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010111900000000001 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:38.646 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 38.971345827, 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030889300000000001, 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 957 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:38.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540836+0000", 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540862+0000", 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999999e-05 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540891+0000", 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9595999999999999e-05 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540906+0000", 2024-09-12T17:06:38.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4919999999999999e-05 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541052+0000", 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014583900000000001 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541232+0000", 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180259 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:38.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541500+0000", 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026788799999999998 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.542483+0000", 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000983142 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543756+0000", 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001272977 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543842+0000", 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5748999999999995e-05 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543922+0000", 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0000000000000007e-05 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:38.652 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:38.654 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:06:38.654 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:38.649+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:38.758 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:38.755+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:38.806 INFO:teuthology.orchestra.run.smithi017.stderr:marked out osd.1. 2024-09-12T17:06:38.846 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:38.846 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:38.846 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:38.846 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:38.860 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:06:38.861 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:38.852+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:38.963 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:38.956+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:39.030 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:39.030 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:39.030 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:39.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:06:39.064 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:39.059+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:39.164 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:39.159+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:39.193 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:39.194 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:39.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:39.194 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:39.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.194 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-12T17:06:39.194 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:39.194 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.645805699, 2024-09-12T17:06:39.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011583833, 2024-09-12T17:06:39.194 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.194 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.194 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:39.194 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.195 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.195 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.195 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 44 2024-09-12T17:06:39.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.195 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:39.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:39.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544942+0000", 2024-09-12T17:06:39.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.653e-06 2024-09-12T17:06:39.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544957+0000", 2024-09-12T17:06:39.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5654e-05 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544993+0000", 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5936000000000003e-05 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.545017+0000", 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3283000000000001e-05 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549277+0000", 2024-09-12T17:06:39.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042606800000000002 2024-09-12T17:06:39.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:39.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549301+0000", 2024-09-12T17:06:39.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3260000000000001e-05 2024-09-12T17:06:39.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556317+0000", 2024-09-12T17:06:39.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070164620000000002 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556522+0000", 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020490499999999999 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:39.199 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.602340153, 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054133180000000003, 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 207 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:39.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588408+0000", 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588428+0000", 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9910000000000001e-05 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588467+0000", 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588483+0000", 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6443000000000002e-05 2024-09-12T17:06:39.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588659+0000", 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569499999999999 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589033+0000", 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037374100000000003 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:39.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589729+0000", 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069659400000000003 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593394+0000", 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036653279999999998 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593661+0000", 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026662499999999999 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593743+0000", 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1428999999999996e-05 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593817+0000", 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4475999999999996e-05 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.566119452999999, 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034289839999999999, 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 216 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.206 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624628+0000", 2024-09-12T17:06:39.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2399999999999999e-06 2024-09-12T17:06:39.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624641+0000", 2024-09-12T17:06:39.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3743e-05 2024-09-12T17:06:39.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624675+0000", 2024-09-12T17:06:39.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3277e-05 2024-09-12T17:06:39.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624690+0000", 2024-09-12T17:06:39.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5812999999999999e-05 2024-09-12T17:06:39.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624847+0000", 2024-09-12T17:06:39.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156269 2024-09-12T17:06:39.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625092+0000", 2024-09-12T17:06:39.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024499500000000002 2024-09-12T17:06:39.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:39.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625494+0000", 2024-09-12T17:06:39.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040263000000000001 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.626934+0000", 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001439159 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627890+0000", 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095619599999999998 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627978+0000", 2024-09-12T17:06:39.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8446e-05 2024-09-12T17:06:39.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.628053+0000", 2024-09-12T17:06:39.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5216000000000006e-05 2024-09-12T17:06:39.212 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.212 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.212 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.212 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.524611210000003, 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003364985, 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 227 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:39.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:39.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666135+0000", 2024-09-12T17:06:39.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.644e-06 2024-09-12T17:06:39.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666147+0000", 2024-09-12T17:06:39.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1960000000000001e-05 2024-09-12T17:06:39.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666179+0000", 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1813000000000002e-05 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666195+0000", 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5679999999999999e-05 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666342+0000", 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147312 2024-09-12T17:06:39.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666559+0000", 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021664199999999999 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.667037+0000", 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047816200000000002 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.668796+0000", 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017590010000000001 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669346+0000", 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055024499999999999 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669433+0000", 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6650000000000006e-05 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669498+0000", 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4875999999999993e-05 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.517403950999999, 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031932409999999999, 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.219 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 229 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673342+0000", 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3499999999999999e-06 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673354+0000", 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1739999999999999e-05 2024-09-12T17:06:39.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673386+0000", 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1782000000000002e-05 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673400+0000", 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4663e-05 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673577+0000", 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017662900000000001 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673783+0000", 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020620799999999999 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.674174+0000", 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039082100000000002 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.675441+0000", 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001267177 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676382+0000", 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094087900000000004 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676468+0000", 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5762999999999999e-05 2024-09-12T17:06:39.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676533+0000", 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5228999999999995e-05 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.509661027999996, 2024-09-12T17:06:39.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0037357380000000002, 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 231 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681085+0000", 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681096+0000", 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0866000000000001e-05 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681126+0000", 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9977000000000001e-05 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681140+0000", 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4195999999999999e-05 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681288+0000", 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014765199999999999 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681637+0000", 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034917100000000001 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.682358+0000", 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072050800000000002 2024-09-12T17:06:39.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684139+0000", 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017812399999999999 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684543+0000", 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040413299999999999 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684703+0000", 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160075 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684819+0000", 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011553300000000001 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:374 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:39.231 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.454783597999999, 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031135910000000002, 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 374 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735961+0000", 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0979999999999999e-06 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735968+0000", 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735981+0000", 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3164e-05 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735989+0000", 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8010000000000004e-06 2024-09-12T17:06:39.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736041+0000", 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800999999999998e-05 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736137+0000", 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5497999999999999e-05 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736303+0000", 2024-09-12T17:06:39.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016580100000000001 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736802+0000", 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049966599999999996 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739015+0000", 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022122919999999998 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739047+0000", 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2678000000000001e-05 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739074+0000", 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6594e-05 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.237 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.229338855000002, 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029096640000000002, 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 715 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961407+0000", 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:39.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961419+0000", 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.117e-05 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961450+0000", 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1463e-05 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961465+0000", 2024-09-12T17:06:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-12T17:06:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961576+0000", 2024-09-12T17:06:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111016 2024-09-12T17:06:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961785+0000", 2024-09-12T17:06:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020865599999999999 2024-09-12T17:06:39.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.962105+0000", 2024-09-12T17:06:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031996699999999999 2024-09-12T17:06:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.963189+0000", 2024-09-12T17:06:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010845519999999999 2024-09-12T17:06:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964163+0000", 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097355800000000002 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964252+0000", 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8996e-05 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964315+0000", 2024-09-12T17:06:39.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2773000000000004e-05 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.195068298999999, 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883207, 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.244 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 730 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:39.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995678+0000", 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995689+0000", 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1316e-05 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995722+0000", 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995745+0000", 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3496999999999999e-05 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995902+0000", 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156446 2024-09-12T17:06:39.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996113+0000", 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021091099999999999 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996444+0000", 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000330785 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.997558+0000", 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001114681 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998420+0000", 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086125299999999998 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998497+0000", 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7919999999999999e-05 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998559+0000", 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1319e-05 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.176586735000001, 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002862248, 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.250 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 738 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014159+0000", 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014168+0000", 2024-09-12T17:06:39.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.653e-06 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014191+0000", 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3706e-05 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014213+0000", 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2050000000000001e-05 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014363+0000", 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014956299999999999 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014485+0000", 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000122132 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014770+0000", 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000284911 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.015864+0000", 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010942180000000001 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016864+0000", 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00099982299999999994 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016951+0000", 2024-09-12T17:06:39.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6476000000000003e-05 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.017019+0000", 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8756000000000004e-05 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:39.256 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.094265356999998, 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032495950000000001, 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 772 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096481+0000", 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4399999999999999e-06 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096492+0000", 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1513e-05 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096522+0000", 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9156e-05 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096536+0000", 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4347e-05 2024-09-12T17:06:39.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096681+0000", 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145348 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096896+0000", 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214489 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.097208+0000", 2024-09-12T17:06:39.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031215099999999999 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.098332+0000", 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001123635 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099583+0000", 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00125179 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099663+0000", 2024-09-12T17:06:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9703000000000006e-05 2024-09-12T17:06:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099728+0000", 2024-09-12T17:06:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5023000000000004e-05 2024-09-12T17:06:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.262 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 40.022523397999997, 2024-09-12T17:06:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028771949999999999, 2024-09-12T17:06:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.263 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 802 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168223+0000", 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4499999999999998e-06 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168234+0000", 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168265+0000", 2024-09-12T17:06:39.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0777e-05 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168279+0000", 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4525999999999999e-05 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168397+0000", 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118063 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168616+0000", 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000218505 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168970+0000", 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00035427400000000002 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170038+0000", 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001067571 2024-09-12T17:06:39.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170897+0000", 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085934399999999995 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170983+0000", 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6179000000000003e-05 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.171098+0000", 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114576 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.963723571999999, 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033328609999999999, 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.269 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 826 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227023+0000", 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227035+0000", 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:39.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227067+0000", 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2305999999999999e-05 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227082+0000", 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.485e-05 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227247+0000", 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016483900000000001 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227630+0000", 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038350100000000001 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.228201+0000", 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057026799999999997 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.229556+0000", 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013553300000000001 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230084+0000", 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00052805599999999995 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230238+0000", 2024-09-12T17:06:39.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015438499999999999 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230353+0000", 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114809 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:39.275 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.904450216000001, 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033407710000000002, 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 850 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286296+0000", 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286307+0000", 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1287000000000001e-05 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286339+0000", 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1331999999999997e-05 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286353+0000", 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4517e-05 2024-09-12T17:06:39.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286504+0000", 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015038200000000001 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286897+0000", 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039326399999999999 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.287451+0000", 2024-09-12T17:06:39.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055426900000000003 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.288825+0000", 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013741160000000001 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289484+0000", 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00065819499999999998 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289570+0000", 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6383000000000003e-05 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289634+0000", 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4505999999999995e-05 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.281 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.866458299000001, 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002894237, 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 865 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324288+0000", 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2469999999999998e-06 2024-09-12T17:06:39.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324299+0000", 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0823e-05 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324330+0000", 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1846e-05 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324350+0000", 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9077e-05 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324463+0000", 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011367200000000001 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324693+0000", 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008800000000001 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.325000+0000", 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030629499999999999 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.326117+0000", 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011175709999999999 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327026+0000", 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00090879000000000003 2024-09-12T17:06:39.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327113+0000", 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7093000000000001e-05 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327180+0000", 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6735000000000004e-05 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.851944801000002, 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030741359999999999, 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 871 2024-09-12T17:06:39.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338802+0000", 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338831+0000", 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9356000000000002e-05 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338868+0000", 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7357000000000002e-05 2024-09-12T17:06:39.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338883+0000", 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4932999999999999e-05 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339036+0000", 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152423 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339264+0000", 2024-09-12T17:06:39.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022814100000000001 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339593+0000", 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032943099999999998 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.340783+0000", 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011898740000000001 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341724+0000", 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094134600000000002 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341809+0000", 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4155999999999999e-05 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341873+0000", 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4605999999999998e-05 2024-09-12T17:06:39.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.794452741000001, 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003093649, 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 895 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396294+0000", 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3999999999999999e-06 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396307+0000", 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3468999999999999e-05 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396338+0000", 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1433000000000002e-05 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396353+0000", 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4557e-05 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396496+0000", 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014275900000000001 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396719+0000", 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022317499999999999 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.397052+0000", 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033263699999999999 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.398211+0000", 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011593350000000001 2024-09-12T17:06:39.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399235+0000", 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010241219999999999 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399321+0000", 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5789000000000001e-05 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399385+0000", 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3973000000000006e-05 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.787965685000003, 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029302239999999999, 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 898 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402780+0000", 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9269999999999999e-06 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402789+0000", 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7069999999999998e-06 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402830+0000", 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1470000000000001e-05 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402846+0000", 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5319e-05 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402938+0000", 2024-09-12T17:06:39.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2289999999999999e-05 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403134+0000", 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000196014 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403437+0000", 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030337199999999999 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.404507+0000", 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001069492 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405432+0000", 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092532900000000002 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405590+0000", 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158018 2024-09-12T17:06:39.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405708+0000", 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118286 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.702558424000003, 2024-09-12T17:06:39.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030817499999999999, 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 934 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488188+0000", 2024-09-12T17:06:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8040000000000002e-06 2024-09-12T17:06:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488201+0000", 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2893e-05 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488233+0000", 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2085999999999997e-05 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488248+0000", 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4976e-05 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488415+0000", 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016677900000000001 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488650+0000", 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234875 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488961+0000", 2024-09-12T17:06:39.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031078799999999999 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.490177+0000", 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001216607 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491119+0000", 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000941806 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491202+0000", 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3349000000000004e-05 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491267+0000", 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4787000000000002e-05 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.312 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 39.691739444, 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031107489999999999, 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 939 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:39.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499007+0000", 2024-09-12T17:06:39.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3970000000000001e-06 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499018+0000", 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0969e-05 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499052+0000", 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3896999999999997e-05 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:39.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499068+0000", 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6552999999999999e-05 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499200+0000", 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013206599999999999 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499438+0000", 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023806500000000001 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499922+0000", 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048369599999999998 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501326+0000", 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014036560000000001 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501962+0000", 2024-09-12T17:06:39.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063623100000000001 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502048+0000", 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5636999999999993e-05 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502115+0000", 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7582000000000004e-05 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:39.319 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:39.319 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:39.320 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:06:39.321 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:39.316+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:39.421 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:39.416+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:39.445 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:06:39.455 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:39.455 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:39.455 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:06:39.455 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:39.470 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:06:39.522 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:39.519+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:39.592 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:39.592 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:39.592 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:39.595 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:39.595 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:39.606 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:06:39.625 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:39.625 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:39.644 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:39.645 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:39.654 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:39.651+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:39.660 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:39.660 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:39.678 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:39.678 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:39.697 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:39.697 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:39.716 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:39.716 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:39.723 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:39.720+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:39.747 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:39.747 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:39.777 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:39.777 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:39.789 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:06:39.826 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:39.820+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:39.832 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T17:06:39.925 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:39.920+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:39.926 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:39.926 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:39.942 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:06:40.027 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:40.020+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:40.070 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:40.071 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:40.085 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:06:40.129 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:40.124+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:40.206 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:40.206 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:40.222 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:06:40.229 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:40.224+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:40.330 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:40.327+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:40.350 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:40.350 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:40.365 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:06:40.430 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:40.424+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:40.524 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:40.524 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:40.532 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:40.528+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:40.539 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:06:40.632 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:40.628+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:40.667 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:40.667 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:40.682 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:06:40.733 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:40.728+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:40.801 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:40.801 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:40.816 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:06:40.835 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T17:06:40.866 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:40.863+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:40.935 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:40.932+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:40.945 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:40.945 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:40.960 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:06:41.036 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:41.032+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:41.132 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:41.132 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:41.137 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:41.131+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:41.146 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:06:41.238 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:41.235+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:41.258 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:41.258 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:41.275 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:06:41.339 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:41.335+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:41.440 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:41.435+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:41.447 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:41.465 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:06:41.541 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:41.535+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:41.585 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:41.585 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:41.603 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:06:41.647 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:41.644+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:41.733 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:41.733 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:41.743 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:41.739+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:41.748 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:06:41.763 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:06:41.844 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:41.839+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:41.945 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:41.939+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:41.964 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:41.964 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:41.982 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:06:41.993 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:41.993 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:42.024 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:42.024 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:42.046 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:42.040+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:42.055 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:42.055 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:42.086 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:42.086 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:42.119 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:42.120 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:42.143 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:42.144 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:42.147 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:42.140+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:42.158 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:42.158 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 50.628154268999999, 2024-09-12T17:06:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:06:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:06:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.159 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:06:42.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:06:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:06:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:06:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:06:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:06:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:06:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:06:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:06:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:06:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:06:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 46.470522072999998, 2024-09-12T17:06:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:06:42.164 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:06:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:06:42.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:42.170 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.560428279999996, 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:06:42.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:06:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:06:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:06:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:06:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:06:42.176 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.544537538999997, 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.177 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:06:42.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.519068869000002, 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:06:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:06:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:06:42.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:06:42.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:06:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:06:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:06:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:06:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:06:42.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.500107767999999, 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.190 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:06:42.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:06:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:06:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:06:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:06:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:06:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:06:42.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.195 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.465552467999998, 2024-09-12T17:06:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:06:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:42.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:06:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:06:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:06:42.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.202 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.152333055, 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:06:42.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:06:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:06:42.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:06:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:06:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:06:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:06:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.147441686999997, 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.210 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:06:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:06:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:06:42.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.108466227999997, 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.217 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:06:42.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:06:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:06:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:06:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:06:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:06:42.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:06:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:06:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:06:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:06:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:06:42.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.104568254, 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:06:42.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:06:42.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:06:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:06:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:06:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:06:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:06:42.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:06:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:06:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:42.229 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.035809022000002, 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:42.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:06:42.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:42.235 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.999965007999997, 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:42.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:06:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:06:42.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:42.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.241 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.979777636999998, 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.242 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:06:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:06:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:06:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:06:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:06:42.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.247 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.974883275000003, 2024-09-12T17:06:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:06:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.248 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:06:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:06:42.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:06:42.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.912915120000001, 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.254 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:06:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.255 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:42.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:06:42.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.908508345000001, 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.261 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:06:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:06:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:06:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:06:42.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.741109002999998, 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:06:42.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:06:42.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.710333970000001, 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.273 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:06:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:06:42.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.279 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 42.705421715, 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:06:42.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:06:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:06:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:06:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.285 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.285 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:42.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:06:42.287 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:42.287 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:42.288 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:42.288 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:42.289 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:42.280+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:42.387 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:42.383+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:42.488 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:42.484+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:42.500 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:42.500 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:42.500 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:42.500 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:42.517 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:06:42.589 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:42.583+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:42.690 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:42.684+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:42.728 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:42.728 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:42.728 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:42.728 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:42.729 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:42.745 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:06:42.791 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:42.787+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:42.857 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T17:06:42.904 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:42.900+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:42.961 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.961 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.357088511000001, 2024-09-12T17:06:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027134059999999998, 2024-09-12T17:06:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 42 2024-09-12T17:06:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.962 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600336+0000", 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1270000000000001e-06 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600346+0000", 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.499e-06 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600370+0000", 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4411000000000001e-05 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600386+0000", 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6205000000000002e-05 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600471+0000", 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5013999999999996e-05 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600569+0000", 2024-09-12T17:06:42.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7663000000000003e-05 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600677+0000", 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108571 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.601918+0000", 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012408090000000001 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.602976+0000", 2024-09-12T17:06:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001058217 2024-09-12T17:06:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603016+0000", 2024-09-12T17:06:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9894000000000001e-05 2024-09-12T17:06:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603047+0000", 2024-09-12T17:06:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0995999999999999e-05 2024-09-12T17:06:42.967 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.376032915000003, 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002848798, 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.968 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 52 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581393+0000", 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4070000000000002e-06 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581405+0000", 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581439+0000", 2024-09-12T17:06:42.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3966e-05 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581457+0000", 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7842999999999998e-05 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581567+0000", 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011048900000000001 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581754+0000", 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018672099999999999 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581913+0000", 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015923700000000001 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.583010+0000", 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001096947 2024-09-12T17:06:42.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584083+0000", 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010725730000000001 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584168+0000", 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4981999999999994e-05 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584238+0000", 2024-09-12T17:06:42.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0747000000000006e-05 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.257778264000002, 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003254804, 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.974 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 236 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699647+0000", 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1300000000000001e-06 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699660+0000", 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2326e-05 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699694+0000", 2024-09-12T17:06:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4552999999999999e-05 2024-09-12T17:06:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699710+0000", 2024-09-12T17:06:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5573000000000002e-05 2024-09-12T17:06:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699835+0000", 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012534300000000001 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700050+0000", 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214565 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700448+0000", 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039816999999999999 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702129+0000", 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001680874 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702721+0000", 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00059224199999999999 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702804+0000", 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3071999999999993e-05 2024-09-12T17:06:42.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702899+0000", 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4956000000000004e-05 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.245337737, 2024-09-12T17:06:42.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026770299999999999, 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 271 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:42.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712086+0000", 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3510000000000001e-06 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712092+0000", 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5670000000000002e-06 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712105+0000", 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3438000000000001e-05 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712112+0000", 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6229999999999999e-06 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712181+0000", 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9323e-05 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712327+0000", 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014620900000000001 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712530+0000", 2024-09-12T17:06:42.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020267700000000001 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.713251+0000", 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072110800000000004 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714674+0000", 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001423021 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714718+0000", 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4459000000000002e-05 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714762+0000", 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3254000000000003e-05 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:287 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.986 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.242111254000001, 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034654030000000001, 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 287 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715312+0000", 2024-09-12T17:06:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1340000000000001e-06 2024-09-12T17:06:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715318+0000", 2024-09-12T17:06:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8409999999999996e-06 2024-09-12T17:06:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715332+0000", 2024-09-12T17:06:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4265e-05 2024-09-12T17:06:42.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715342+0000", 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3360000000000001e-06 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715412+0000", 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9980000000000004e-05 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715511+0000", 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9197000000000006e-05 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715663+0000", 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152347 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.716287+0000", 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00062330100000000004 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718705+0000", 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002418505 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718743+0000", 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7645999999999998e-05 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718777+0000", 2024-09-12T17:06:42.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3850999999999998e-05 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.932631401000002, 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028821710000000002, 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:42.993 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 742 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:42.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024794+0000", 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7669999999999999e-06 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024805+0000", 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1093e-05 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024836+0000", 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1136000000000001e-05 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024852+0000", 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6140000000000001e-05 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024989+0000", 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000136422 2024-09-12T17:06:42.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025219+0000", 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008499999999999 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025545+0000", 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032645100000000001 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:42.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.026827+0000", 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00128202 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027470+0000", 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00064248199999999999 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027556+0000", 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6533000000000007e-05 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027673+0000", 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117042 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.928895189999999, 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002617173, 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:42.999 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 744 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028529+0000", 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8500000000000001e-06 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028540+0000", 2024-09-12T17:06:43.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-05 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028565+0000", 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5083e-05 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028577+0000", 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2434e-05 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028679+0000", 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101489 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028800+0000", 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012089199999999999 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.029070+0000", 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000270358 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030114+0000", 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001043832 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030994+0000", 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087969000000000003 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031082+0000", 2024-09-12T17:06:43.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7825999999999996e-05 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031144+0000", 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2829000000000004e-05 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:43.005 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.889733065000001, 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027655549999999998, 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 760 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067692+0000", 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4200000000000001e-06 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067706+0000", 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.382e-05 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067739+0000", 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3253000000000002e-05 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067763+0000", 2024-09-12T17:06:43.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4026e-05 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067912+0000", 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014959199999999999 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068127+0000", 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021487500000000001 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068438+0000", 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031070400000000003 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.069550+0000", 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011116159999999999 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070301+0000", 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075135000000000002 2024-09-12T17:06:43.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070390+0000", 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8516000000000004e-05 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070455+0000", 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5382999999999994e-05 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.753510835999997, 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031165260000000001, 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 817 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.012 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203915+0000", 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.146e-06 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203926+0000", 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1379999999999999e-05 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203958+0000", 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2239000000000001e-05 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203973+0000", 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.47e-05 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204156+0000", 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018277899999999999 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204392+0000", 2024-09-12T17:06:43.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000236658 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204705+0000", 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000312248 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.205983+0000", 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001278387 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206726+0000", 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074269799999999997 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206909+0000", 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018368200000000001 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.207028+0000", 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118609 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.017 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.749229186000001, 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003050269, 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 819 2024-09-12T17:06:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208196+0000", 2024-09-12T17:06:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4569999999999999e-06 2024-09-12T17:06:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208207+0000", 2024-09-12T17:06:43.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208241+0000", 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3936000000000002e-05 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208256+0000", 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5917e-05 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208383+0000", 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012605200000000001 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208602+0000", 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219908 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.209077+0000", 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047489299999999999 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210285+0000", 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012075110000000001 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210979+0000", 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069376099999999999 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211131+0000", 2024-09-12T17:06:43.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151915 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211243+0000", 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112989 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:43.024 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.694483462000001, 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0035006659999999999, 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 841 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:43.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262942+0000", 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6900000000000001e-06 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262953+0000", 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1323e-05 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262989+0000", 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5617000000000001e-05 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263006+0000", 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7713000000000001e-05 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263177+0000", 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170249 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263551+0000", 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037421999999999998 2024-09-12T17:06:43.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.264122+0000", 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057113200000000002 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.265539+0000", 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001417012 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266170+0000", 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063154599999999997 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266330+0000", 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926800000000001 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266440+0000", 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010989600000000001 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.689782475000001, 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032057850000000001, 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 843 2024-09-12T17:06:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267642+0000", 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267653+0000", 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0664e-05 2024-09-12T17:06:43.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267687+0000", 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4112999999999997e-05 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267703+0000", 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5673000000000001e-05 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267832+0000", 2024-09-12T17:06:43.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012896500000000001 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268054+0000", 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022279600000000001 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268561+0000", 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050617200000000005 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.269801+0000", 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012401269999999999 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270562+0000", 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076129699999999997 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270716+0000", 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000154339 2024-09-12T17:06:43.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270846+0000", 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930600000000001 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.678950815, 2024-09-12T17:06:43.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033822100000000001, 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 847 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278474+0000", 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4930000000000001e-06 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278485+0000", 2024-09-12T17:06:43.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1313e-05 2024-09-12T17:06:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278518+0000", 2024-09-12T17:06:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2517000000000001e-05 2024-09-12T17:06:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278533+0000", 2024-09-12T17:06:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939999999999999e-05 2024-09-12T17:06:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278689+0000", 2024-09-12T17:06:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015628899999999999 2024-09-12T17:06:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279066+0000", 2024-09-12T17:06:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000377337 2024-09-12T17:06:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279610+0000", 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00054380900000000002 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281130+0000", 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001519488 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281583+0000", 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00045297300000000001 2024-09-12T17:06:43.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281738+0000", 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015484900000000001 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281854+0000", 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116202 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.674335311, 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883554, 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 849 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.044 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283090+0000", 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283102+0000", 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.204e-05 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283136+0000", 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3983000000000003e-05 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283152+0000", 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6082999999999998e-05 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283278+0000", 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000126212 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283505+0000", 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022724900000000001 2024-09-12T17:06:43.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283971+0000", 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046550600000000003 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285223+0000", 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012519370000000001 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285811+0000", 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058819199999999997 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285904+0000", 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3410000000000002e-05 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285971+0000", 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6391999999999997e-05 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.049 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.626382397, 2024-09-12T17:06:43.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033550770000000001, 2024-09-12T17:06:43.051 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 868 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331043+0000", 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331054+0000", 2024-09-12T17:06:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.131e-05 2024-09-12T17:06:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331086+0000", 2024-09-12T17:06:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-12T17:06:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331101+0000", 2024-09-12T17:06:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5016e-05 2024-09-12T17:06:43.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331253+0000", 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151929 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331616+0000", 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036285100000000003 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.332174+0000", 2024-09-12T17:06:43.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055856199999999997 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.333700+0000", 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015259480000000001 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334120+0000", 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042021700000000002 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334280+0000", 2024-09-12T17:06:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159949 2024-09-12T17:06:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334395+0000", 2024-09-12T17:06:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114679 2024-09-12T17:06:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.621924606, 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003066923, 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 870 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.058 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335500+0000", 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4040000000000002e-06 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335511+0000", 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.045e-05 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335542+0000", 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1542999999999999e-05 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335558+0000", 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.535e-05 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335698+0000", 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014063899999999999 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335930+0000", 2024-09-12T17:06:43.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000231435 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.336392+0000", 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046211199999999998 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.337568+0000", 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001176671 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338407+0000", 2024-09-12T17:06:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083885399999999999 2024-09-12T17:06:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338491+0000", 2024-09-12T17:06:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4159000000000005e-05 2024-09-12T17:06:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338565+0000", 2024-09-12T17:06:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3306000000000006e-05 2024-09-12T17:06:43.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.533735862999997, 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027821550000000001, 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 907 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423690+0000", 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423702+0000", 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2404e-05 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423735+0000", 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3062999999999998e-05 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423750+0000", 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4912999999999999e-05 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423919+0000", 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016838899999999999 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424160+0000", 2024-09-12T17:06:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024105099999999999 2024-09-12T17:06:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424492+0000", 2024-09-12T17:06:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033261100000000002 2024-09-12T17:06:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.425785+0000", 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001292397 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426322+0000", 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00053743200000000001 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426403+0000", 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0898999999999999e-05 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426469+0000", 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5720000000000001e-05 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.434570174999998, 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029674670000000001, 2024-09-12T17:06:43.070 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 949 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522855+0000", 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522871+0000", 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5950000000000001e-05 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522906+0000", 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316000000000001e-05 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522924+0000", 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8326999999999999e-05 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523047+0000", 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123609 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523282+0000", 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234465 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523606+0000", 2024-09-12T17:06:43.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032453099999999997 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.524804+0000", 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011977509999999999 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525626+0000", 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082216400000000001 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525743+0000", 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116679 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525820+0000", 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6631999999999994e-05 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.076 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.420846501, 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030602540000000001, 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 955 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536578+0000", 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:43.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536590+0000", 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1250000000000001e-05 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536624+0000", 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4227000000000003e-05 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536646+0000", 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2195999999999999e-05 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536794+0000", 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014799600000000001 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537005+0000", 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021096799999999999 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537489+0000", 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048413599999999997 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.538940+0000", 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001451262 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539441+0000", 2024-09-12T17:06:43.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050002300000000005 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539535+0000", 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4526999999999998e-05 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539636+0000", 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010111900000000001 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 43.416589166999998, 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030889300000000001, 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.083 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 957 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540836+0000", 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540862+0000", 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999999e-05 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540891+0000", 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9595999999999999e-05 2024-09-12T17:06:43.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540906+0000", 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4919999999999999e-05 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541052+0000", 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014583900000000001 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541232+0000", 2024-09-12T17:06:43.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180259 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541500+0000", 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026788799999999998 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.542483+0000", 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000983142 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543756+0000", 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001272977 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543842+0000", 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5748999999999995e-05 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543922+0000", 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0000000000000007e-05 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.088 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.089 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.089 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.089 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:43.091 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:06:43.091 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:43.087+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:43.191 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:43.187+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:43.292 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:43.288+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:43.302 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:43.302 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:43.302 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:43.302 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:43.321 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:06:43.408 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:43.404+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:43.494 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:43.491+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:43.533 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:43.533 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:43.534 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:43.534 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:43.553 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:06:43.595 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:43.591+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:43.695 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:43.692+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:43.771 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-12T17:06:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 50.223183916000004, 2024-09-12T17:06:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011583833, 2024-09-12T17:06:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 44 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544942+0000", 2024-09-12T17:06:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.653e-06 2024-09-12T17:06:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544957+0000", 2024-09-12T17:06:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5654e-05 2024-09-12T17:06:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544993+0000", 2024-09-12T17:06:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5936000000000003e-05 2024-09-12T17:06:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.545017+0000", 2024-09-12T17:06:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3283000000000001e-05 2024-09-12T17:06:43.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549277+0000", 2024-09-12T17:06:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042606800000000002 2024-09-12T17:06:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549301+0000", 2024-09-12T17:06:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3260000000000001e-05 2024-09-12T17:06:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556317+0000", 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070164620000000002 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556522+0000", 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020490499999999999 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.777 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.179718370000003, 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054133180000000003, 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 207 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588408+0000", 2024-09-12T17:06:43.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588428+0000", 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9910000000000001e-05 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588467+0000", 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588483+0000", 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6443000000000002e-05 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588659+0000", 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569499999999999 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589033+0000", 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037374100000000003 2024-09-12T17:06:43.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589729+0000", 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069659400000000003 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593394+0000", 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036653279999999998 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593661+0000", 2024-09-12T17:06:43.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026662499999999999 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593743+0000", 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1428999999999996e-05 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593817+0000", 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4475999999999996e-05 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.143497670000002, 2024-09-12T17:06:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034289839999999999, 2024-09-12T17:06:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.784 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 216 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624628+0000", 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2399999999999999e-06 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624641+0000", 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3743e-05 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624675+0000", 2024-09-12T17:06:43.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3277e-05 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624690+0000", 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5812999999999999e-05 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624847+0000", 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156269 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625092+0000", 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024499500000000002 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625494+0000", 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040263000000000001 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.626934+0000", 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001439159 2024-09-12T17:06:43.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627890+0000", 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095619599999999998 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627978+0000", 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8446e-05 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.628053+0000", 2024-09-12T17:06:43.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5216000000000006e-05 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.101989426999999, 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003364985, 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.790 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 227 2024-09-12T17:06:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666135+0000", 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.644e-06 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666147+0000", 2024-09-12T17:06:43.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1960000000000001e-05 2024-09-12T17:06:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666179+0000", 2024-09-12T17:06:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1813000000000002e-05 2024-09-12T17:06:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666195+0000", 2024-09-12T17:06:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5679999999999999e-05 2024-09-12T17:06:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666342+0000", 2024-09-12T17:06:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147312 2024-09-12T17:06:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666559+0000", 2024-09-12T17:06:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021664199999999999 2024-09-12T17:06:43.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.667037+0000", 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047816200000000002 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.668796+0000", 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017590010000000001 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669346+0000", 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055024499999999999 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669433+0000", 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6650000000000006e-05 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669498+0000", 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4875999999999993e-05 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.796 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.094782168000002, 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031932409999999999, 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.797 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 229 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673342+0000", 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3499999999999999e-06 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673354+0000", 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1739999999999999e-05 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673386+0000", 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1782000000000002e-05 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673400+0000", 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4663e-05 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673577+0000", 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017662900000000001 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673783+0000", 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020620799999999999 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.674174+0000", 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039082100000000002 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.675441+0000", 2024-09-12T17:06:43.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001267177 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676382+0000", 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094087900000000004 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676468+0000", 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5762999999999999e-05 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676533+0000", 2024-09-12T17:06:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5228999999999995e-05 2024-09-12T17:06:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.087039245, 2024-09-12T17:06:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0037357380000000002, 2024-09-12T17:06:43.803 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 231 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681085+0000", 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681096+0000", 2024-09-12T17:06:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0866000000000001e-05 2024-09-12T17:06:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681126+0000", 2024-09-12T17:06:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9977000000000001e-05 2024-09-12T17:06:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681140+0000", 2024-09-12T17:06:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4195999999999999e-05 2024-09-12T17:06:43.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681288+0000", 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014765199999999999 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681637+0000", 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034917100000000001 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:43.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.682358+0000", 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072050800000000002 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684139+0000", 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017812399999999999 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684543+0000", 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040413299999999999 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684703+0000", 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160075 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684819+0000", 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011553300000000001 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.809 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:374 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 45.032161815000002, 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031135910000000002, 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 374 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735961+0000", 2024-09-12T17:06:43.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0979999999999999e-06 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735968+0000", 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735981+0000", 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3164e-05 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735989+0000", 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8010000000000004e-06 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736041+0000", 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800999999999998e-05 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736137+0000", 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5497999999999999e-05 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736303+0000", 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016580100000000001 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736802+0000", 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049966599999999996 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739015+0000", 2024-09-12T17:06:43.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022122919999999998 2024-09-12T17:06:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739047+0000", 2024-09-12T17:06:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2678000000000001e-05 2024-09-12T17:06:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739074+0000", 2024-09-12T17:06:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6594e-05 2024-09-12T17:06:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.815 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.806717071999998, 2024-09-12T17:06:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029096640000000002, 2024-09-12T17:06:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.816 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 715 2024-09-12T17:06:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961407+0000", 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961419+0000", 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.117e-05 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961450+0000", 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1463e-05 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961465+0000", 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961576+0000", 2024-09-12T17:06:43.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111016 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961785+0000", 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020865599999999999 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.962105+0000", 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031996699999999999 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.963189+0000", 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010845519999999999 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964163+0000", 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097355800000000002 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964252+0000", 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8996e-05 2024-09-12T17:06:43.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964315+0000", 2024-09-12T17:06:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2773000000000004e-05 2024-09-12T17:06:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.772446516000002, 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883207, 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 730 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.823 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995678+0000", 2024-09-12T17:06:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:06:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995689+0000", 2024-09-12T17:06:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1316e-05 2024-09-12T17:06:43.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995722+0000", 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995745+0000", 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3496999999999999e-05 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995902+0000", 2024-09-12T17:06:43.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156446 2024-09-12T17:06:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996113+0000", 2024-09-12T17:06:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021091099999999999 2024-09-12T17:06:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996444+0000", 2024-09-12T17:06:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000330785 2024-09-12T17:06:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.997558+0000", 2024-09-12T17:06:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001114681 2024-09-12T17:06:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998420+0000", 2024-09-12T17:06:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086125299999999998 2024-09-12T17:06:43.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998497+0000", 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7919999999999999e-05 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998559+0000", 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1319e-05 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.753964951999997, 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002862248, 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 738 2024-09-12T17:06:43.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014159+0000", 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014168+0000", 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.653e-06 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014191+0000", 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3706e-05 2024-09-12T17:06:43.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014213+0000", 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2050000000000001e-05 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014363+0000", 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014956299999999999 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014485+0000", 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000122132 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014770+0000", 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000284911 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.015864+0000", 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010942180000000001 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016864+0000", 2024-09-12T17:06:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00099982299999999994 2024-09-12T17:06:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016951+0000", 2024-09-12T17:06:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6476000000000003e-05 2024-09-12T17:06:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.017019+0000", 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8756000000000004e-05 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.671643574000001, 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032495950000000001, 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 772 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096481+0000", 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4399999999999999e-06 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096492+0000", 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1513e-05 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096522+0000", 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9156e-05 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096536+0000", 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4347e-05 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096681+0000", 2024-09-12T17:06:43.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145348 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096896+0000", 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214489 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.097208+0000", 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031215099999999999 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.098332+0000", 2024-09-12T17:06:43.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001123635 2024-09-12T17:06:43.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099583+0000", 2024-09-12T17:06:43.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00125179 2024-09-12T17:06:43.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099663+0000", 2024-09-12T17:06:43.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9703000000000006e-05 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099728+0000", 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5023000000000004e-05 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:43.842 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.599901615, 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028771949999999999, 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 802 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168223+0000", 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4499999999999998e-06 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168234+0000", 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168265+0000", 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0777e-05 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168279+0000", 2024-09-12T17:06:43.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4525999999999999e-05 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168397+0000", 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118063 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168616+0000", 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000218505 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168970+0000", 2024-09-12T17:06:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00035427400000000002 2024-09-12T17:06:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170038+0000", 2024-09-12T17:06:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001067571 2024-09-12T17:06:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170897+0000", 2024-09-12T17:06:43.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085934399999999995 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170983+0000", 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6179000000000003e-05 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.171098+0000", 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114576 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.541101789000002, 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033328609999999999, 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 826 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227023+0000", 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227035+0000", 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227067+0000", 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2305999999999999e-05 2024-09-12T17:06:43.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227082+0000", 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.485e-05 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227247+0000", 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016483900000000001 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227630+0000", 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038350100000000001 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.228201+0000", 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057026799999999997 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.229556+0000", 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013553300000000001 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230084+0000", 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00052805599999999995 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230238+0000", 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015438499999999999 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230353+0000", 2024-09-12T17:06:43.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114809 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.481828432999997, 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033407710000000002, 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 850 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:43.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286296+0000", 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286307+0000", 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1287000000000001e-05 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286339+0000", 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1331999999999997e-05 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286353+0000", 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4517e-05 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286504+0000", 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015038200000000001 2024-09-12T17:06:43.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286897+0000", 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039326399999999999 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.287451+0000", 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055426900000000003 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.288825+0000", 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013741160000000001 2024-09-12T17:06:43.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289484+0000", 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00065819499999999998 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289570+0000", 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6383000000000003e-05 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289634+0000", 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4505999999999995e-05 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.443836515999998, 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002894237, 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 865 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324288+0000", 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2469999999999998e-06 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324299+0000", 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0823e-05 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324330+0000", 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1846e-05 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324350+0000", 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9077e-05 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324463+0000", 2024-09-12T17:06:43.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011367200000000001 2024-09-12T17:06:43.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324693+0000", 2024-09-12T17:06:43.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008800000000001 2024-09-12T17:06:43.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:43.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.325000+0000", 2024-09-12T17:06:43.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030629499999999999 2024-09-12T17:06:43.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.326117+0000", 2024-09-12T17:06:43.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011175709999999999 2024-09-12T17:06:43.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327026+0000", 2024-09-12T17:06:43.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00090879000000000003 2024-09-12T17:06:43.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327113+0000", 2024-09-12T17:06:43.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7093000000000001e-05 2024-09-12T17:06:43.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327180+0000", 2024-09-12T17:06:43.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6735000000000004e-05 2024-09-12T17:06:43.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.868 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.868 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.429323017999998, 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030741359999999999, 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.869 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 871 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338802+0000", 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338831+0000", 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9356000000000002e-05 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338868+0000", 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7357000000000002e-05 2024-09-12T17:06:43.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338883+0000", 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4932999999999999e-05 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339036+0000", 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152423 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339264+0000", 2024-09-12T17:06:43.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022814100000000001 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339593+0000", 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032943099999999998 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.340783+0000", 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011898740000000001 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341724+0000", 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094134600000000002 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341809+0000", 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4155999999999999e-05 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341873+0000", 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4605999999999998e-05 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.874 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.371830957999997, 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003093649, 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.875 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 895 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396294+0000", 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3999999999999999e-06 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396307+0000", 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3468999999999999e-05 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396338+0000", 2024-09-12T17:06:43.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1433000000000002e-05 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396353+0000", 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4557e-05 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396496+0000", 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014275900000000001 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396719+0000", 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022317499999999999 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.397052+0000", 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033263699999999999 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.398211+0000", 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011593350000000001 2024-09-12T17:06:43.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399235+0000", 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010241219999999999 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399321+0000", 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5789000000000001e-05 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399385+0000", 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3973000000000006e-05 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.365343901999999, 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029302239999999999, 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 898 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402780+0000", 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9269999999999999e-06 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402789+0000", 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7069999999999998e-06 2024-09-12T17:06:43.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402830+0000", 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1470000000000001e-05 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402846+0000", 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5319e-05 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402938+0000", 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2289999999999999e-05 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403134+0000", 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000196014 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403437+0000", 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030337199999999999 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.404507+0000", 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001069492 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405432+0000", 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092532900000000002 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405590+0000", 2024-09-12T17:06:43.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158018 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405708+0000", 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118286 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:43.887 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.279936640999999, 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030817499999999999, 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 934 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488188+0000", 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8040000000000002e-06 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488201+0000", 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2893e-05 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488233+0000", 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2085999999999997e-05 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488248+0000", 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4976e-05 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488415+0000", 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016677900000000001 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488650+0000", 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234875 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488961+0000", 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031078799999999999 2024-09-12T17:06:43.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.490177+0000", 2024-09-12T17:06:43.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001216607 2024-09-12T17:06:43.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491119+0000", 2024-09-12T17:06:43.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000941806 2024-09-12T17:06:43.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491202+0000", 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3349000000000004e-05 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491267+0000", 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4787000000000002e-05 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:43.893 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 44.269117661000003, 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031107489999999999, 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 939 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499007+0000", 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3970000000000001e-06 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499018+0000", 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0969e-05 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499052+0000", 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3896999999999997e-05 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499068+0000", 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6552999999999999e-05 2024-09-12T17:06:43.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499200+0000", 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013206599999999999 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499438+0000", 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023806500000000001 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499922+0000", 2024-09-12T17:06:43.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048369599999999998 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501326+0000", 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014036560000000001 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501962+0000", 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063623100000000001 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:43.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502048+0000", 2024-09-12T17:06:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5636999999999993e-05 2024-09-12T17:06:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502115+0000", 2024-09-12T17:06:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7582000000000004e-05 2024-09-12T17:06:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:43.899 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:43.899 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:43.901 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:06:43.902 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T17:06:43.902 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:43.896+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:44.002 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:43.996+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:44.035 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:44.036 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:44.036 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:06:44.036 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:44.050 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:06:44.103 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:44.099+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:44.176 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:44.176 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:44.176 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:44.176 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:44.177 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:44.191 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:06:44.234 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:44.231+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:44.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:06:44.304 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:44.299+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:44.364 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:44.364 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.754152624, 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003566582, 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.365 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 211 2024-09-12T17:06:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:06:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:06:44.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608233+0000", 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.343e-06 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608248+0000", 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4747e-05 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608285+0000", 2024-09-12T17:06:44.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7239e-05 2024-09-12T17:06:44.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608302+0000", 2024-09-12T17:06:44.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6909999999999999e-05 2024-09-12T17:06:44.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608454+0000", 2024-09-12T17:06:44.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015164599999999999 2024-09-12T17:06:44.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608666+0000", 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021213499999999999 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.609092+0000", 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042601999999999999 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.610771+0000", 2024-09-12T17:06:44.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016786940000000001 2024-09-12T17:06:44.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611640+0000", 2024-09-12T17:06:44.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00086891300000000002 2024-09-12T17:06:44.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611731+0000", 2024-09-12T17:06:44.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1058999999999997e-05 2024-09-12T17:06:44.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611796+0000", 2024-09-12T17:06:44.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5876000000000004e-05 2024-09-12T17:06:44.371 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.371 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.371 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.371 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.371 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:06:44.371 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.675182606999996, 2024-09-12T17:06:44.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035636330000000001, 2024-09-12T17:06:44.372 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.372 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.372 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.372 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.372 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.372 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.372 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 232 2024-09-12T17:06:44.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.372 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:06:44.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:06:44.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687203+0000", 2024-09-12T17:06:44.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687216+0000", 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346999999999999e-05 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687250+0000", 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3992999999999998e-05 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687266+0000", 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.577e-05 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687402+0000", 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013599599999999999 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687630+0000", 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228168 2024-09-12T17:06:44.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:44.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.688057+0000", 2024-09-12T17:06:44.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042653999999999999 2024-09-12T17:06:44.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.689651+0000", 2024-09-12T17:06:44.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015945009999999999 2024-09-12T17:06:44.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690608+0000", 2024-09-12T17:06:44.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095638899999999998 2024-09-12T17:06:44.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690694+0000", 2024-09-12T17:06:44.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6119000000000007e-05 2024-09-12T17:06:44.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690764+0000", 2024-09-12T17:06:44.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9757000000000003e-05 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.654736178, 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030740059999999998, 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 241 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:06:44.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707649+0000", 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707661+0000", 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2e-05 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707693+0000", 2024-09-12T17:06:44.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2299999999999999e-05 2024-09-12T17:06:44.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707709+0000", 2024-09-12T17:06:44.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6096e-05 2024-09-12T17:06:44.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707871+0000", 2024-09-12T17:06:44.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016122200000000001 2024-09-12T17:06:44.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.708198+0000", 2024-09-12T17:06:44.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032765799999999999 2024-09-12T17:06:44.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:06:44.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.708655+0000", 2024-09-12T17:06:44.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00045698599999999999 2024-09-12T17:06:44.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710022+0000", 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013664059999999999 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710578+0000", 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055600199999999999 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710650+0000", 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2767000000000003e-05 2024-09-12T17:06:44.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710720+0000", 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9839000000000007e-05 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:434 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.601953268999999, 2024-09-12T17:06:44.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030966930000000002, 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 434 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:06:44.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760432+0000", 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4540000000000001e-06 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760443+0000", 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1123e-05 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760473+0000", 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0476000000000001e-05 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760493+0000", 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9502999999999999e-05 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760616+0000", 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123509 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760776+0000", 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000159462 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.761216+0000", 2024-09-12T17:06:44.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000440474 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762555+0000", 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338926 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763288+0000", 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00073298000000000005 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763434+0000", 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145544 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763526+0000", 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2242000000000002e-05 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:445 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.390 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.595055297999998, 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029347829999999998, 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 445 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767330+0000", 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8229999999999999e-06 2024-09-12T17:06:44.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767343+0000", 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2869e-05 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767373+0000", 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0294000000000002e-05 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767392+0000", 2024-09-12T17:06:44.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.91e-05 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767522+0000", 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000130152 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767688+0000", 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016599900000000001 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:44.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.768155+0000", 2024-09-12T17:06:44.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046654299999999998 2024-09-12T17:06:44.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.769308+0000", 2024-09-12T17:06:44.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001153165 2024-09-12T17:06:44.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770069+0000", 2024-09-12T17:06:44.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076044000000000003 2024-09-12T17:06:44.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770155+0000", 2024-09-12T17:06:44.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6493e-05 2024-09-12T17:06:44.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770262+0000", 2024-09-12T17:06:44.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010690499999999999 2024-09-12T17:06:44.396 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.396 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.565317759999999, 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039867009999999996, 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.397 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 504 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797067+0000", 2024-09-12T17:06:44.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:06:44.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797078+0000", 2024-09-12T17:06:44.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0837e-05 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797108+0000", 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9722000000000001e-05 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797127+0000", 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9539999999999999e-05 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797249+0000", 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121239 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797551+0000", 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030277400000000001 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.798161+0000", 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00060936200000000001 2024-09-12T17:06:44.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.799307+0000", 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001146588 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.800728+0000", 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014204389999999999 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.800831+0000", 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103002 2024-09-12T17:06:44.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.801051+0000", 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022061499999999999 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:626 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.483566558, 2024-09-12T17:06:44.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032539040000000002, 2024-09-12T17:06:44.404 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.404 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.404 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.404 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 626 2024-09-12T17:06:44.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.404 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878819+0000", 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6699999999999998e-06 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878831+0000", 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2882e-05 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878862+0000", 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0332999999999999e-05 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878880+0000", 2024-09-12T17:06:44.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8236999999999998e-05 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879009+0000", 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012908599999999999 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879306+0000", 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029693100000000001 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:44.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879873+0000", 2024-09-12T17:06:44.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056697200000000001 2024-09-12T17:06:44.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881172+0000", 2024-09-12T17:06:44.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001298766 2024-09-12T17:06:44.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881880+0000", 2024-09-12T17:06:44.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00070808500000000001 2024-09-12T17:06:44.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881962+0000", 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2069000000000003e-05 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882070+0000", 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107873 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.479387191000001, 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030425119999999998, 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 633 2024-09-12T17:06:44.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882997+0000", 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0530000000000001e-06 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883009+0000", 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1195e-05 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883037+0000", 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8484999999999999e-05 2024-09-12T17:06:44.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883055+0000", 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8467000000000001e-05 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883196+0000", 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014099499999999999 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883444+0000", 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000247758 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883892+0000", 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044757299999999999 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885202+0000", 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001310587 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885879+0000", 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00067645599999999998 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885945+0000", 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6575999999999994e-05 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.886038+0000", 2024-09-12T17:06:44.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2367000000000005e-05 2024-09-12T17:06:44.416 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.416 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.416 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.416 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:644 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.416 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:06:44.416 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.469389757000002, 2024-09-12T17:06:44.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030197190000000001, 2024-09-12T17:06:44.416 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.416 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 644 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892995+0000", 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1390000000000002e-06 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893004+0000", 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3729999999999999e-06 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893029+0000", 2024-09-12T17:06:44.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5058999999999998e-05 2024-09-12T17:06:44.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893041+0000", 2024-09-12T17:06:44.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1858000000000001e-05 2024-09-12T17:06:44.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893190+0000", 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014875199999999999 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893575+0000", 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038538 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.894140+0000", 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056461200000000003 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895394+0000", 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012536100000000001 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895856+0000", 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046213 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895940+0000", 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4808999999999994e-05 2024-09-12T17:06:44.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.896012+0000", 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1996999999999995e-05 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:711 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.409041064, 2024-09-12T17:06:44.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00296547, 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 711 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:06:44.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:06:44.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953343+0000", 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.046e-06 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953353+0000", 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4939999999999992e-06 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953386+0000", 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2919000000000001e-05 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953405+0000", 2024-09-12T17:06:44.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9596999999999999e-05 2024-09-12T17:06:44.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953576+0000", 2024-09-12T17:06:44.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017032500000000001 2024-09-12T17:06:44.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953828+0000", 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025190800000000001 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.954297+0000", 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046897300000000002 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.955510+0000", 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012131139999999999 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956183+0000", 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00067301800000000005 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956254+0000", 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0786999999999998e-05 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956307+0000", 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3288999999999998e-05 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.379130318999998, 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029480109999999999, 2024-09-12T17:06:44.429 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 724 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:06:44.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983255+0000", 2024-09-12T17:06:44.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4140000000000001e-06 2024-09-12T17:06:44.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983266+0000", 2024-09-12T17:06:44.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1039999999999999e-05 2024-09-12T17:06:44.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983298+0000", 2024-09-12T17:06:44.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1949000000000002e-05 2024-09-12T17:06:44.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983313+0000", 2024-09-12T17:06:44.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5296999999999999e-05 2024-09-12T17:06:44.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983416+0000", 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102921 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983578+0000", 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000162244 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983835+0000", 2024-09-12T17:06:44.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025741700000000002 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.984947+0000", 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011111949999999999 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.985915+0000", 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00096828599999999995 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.986080+0000", 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016498500000000001 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.986200+0000", 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120263 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.435 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.371522149999997, 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029804559999999998, 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 727 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990862+0000", 2024-09-12T17:06:44.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0959999999999999e-06 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990872+0000", 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1039999999999996e-06 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990897+0000", 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5626000000000002e-05 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990911+0000", 2024-09-12T17:06:44.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346000000000001e-05 2024-09-12T17:06:44.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990999+0000", 2024-09-12T17:06:44.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8887000000000005e-05 2024-09-12T17:06:44.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.991252+0000", 2024-09-12T17:06:44.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025290099999999998 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.991617+0000", 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036479399999999999 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.992803+0000", 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011859049999999999 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993677+0000", 2024-09-12T17:06:44.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00087379199999999997 2024-09-12T17:06:44.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993774+0000", 2024-09-12T17:06:44.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7343000000000006e-05 2024-09-12T17:06:44.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993841+0000", 2024-09-12T17:06:44.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6662000000000007e-05 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.256579457999997, 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035861349999999998, 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.442 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 775 2024-09-12T17:06:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:06:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105806+0000", 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9529999999999999e-06 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105818+0000", 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2447e-05 2024-09-12T17:06:44.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105851+0000", 2024-09-12T17:06:44.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2969999999999998e-05 2024-09-12T17:06:44.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105867+0000", 2024-09-12T17:06:44.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5116999999999999e-05 2024-09-12T17:06:44.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106011+0000", 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014498500000000001 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106382+0000", 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037012699999999999 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106946+0000", 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056435199999999995 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.108269+0000", 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00132256 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109120+0000", 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00085151300000000003 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109274+0000", 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015367199999999999 2024-09-12T17:06:44.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109389+0000", 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115439 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.251490597, 2024-09-12T17:06:44.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031979489999999998, 2024-09-12T17:06:44.449 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.449 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.449 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.449 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.449 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.449 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.449 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 777 2024-09-12T17:06:44.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.449 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110894+0000", 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4870000000000001e-06 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110905+0000", 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.098e-05 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110938+0000", 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110953+0000", 2024-09-12T17:06:44.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5058999999999999e-05 2024-09-12T17:06:44.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111080+0000", 2024-09-12T17:06:44.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000127033 2024-09-12T17:06:44.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111312+0000", 2024-09-12T17:06:44.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000231828 2024-09-12T17:06:44.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111791+0000", 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00047926000000000002 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.112965+0000", 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011740209999999999 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.113920+0000", 2024-09-12T17:06:44.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095542000000000001 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.114009+0000", 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8162000000000001e-05 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.114090+0000", 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1203000000000002e-05 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.454 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 45.163880923000001, 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030645529999999998, 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.455 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 814 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198504+0000", 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6630000000000002e-06 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198515+0000", 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1014e-05 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198548+0000", 2024-09-12T17:06:44.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2339999999999999e-05 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198563+0000", 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5228999999999999e-05 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198683+0000", 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120569 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198886+0000", 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020240199999999999 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.199199+0000", 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031304800000000002 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.200322+0000", 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011236309999999999 2024-09-12T17:06:44.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201410+0000", 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010880110000000001 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201494+0000", 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3863000000000007e-05 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201566+0000", 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1783e-05 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.998405067, 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030460629999999999, 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.461 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 880 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363980+0000", 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0699999999999998e-06 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363993+0000", 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2439999999999999e-05 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364026+0000", 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2886999999999999e-05 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364041+0000", 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5255999999999999e-05 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364160+0000", 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011927200000000001 2024-09-12T17:06:44.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364388+0000", 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228116 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364728+0000", 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033925999999999997 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.365909+0000", 2024-09-12T17:06:44.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001181091 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.366732+0000", 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082351699999999996 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.366907+0000", 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000174568 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.367023+0000", 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116586 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.993817305999997, 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002854625, 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.467 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 882 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:06:44.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368568+0000", 2024-09-12T17:06:44.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5799999999999999e-06 2024-09-12T17:06:44.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368579+0000", 2024-09-12T17:06:44.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.13e-05 2024-09-12T17:06:44.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368613+0000", 2024-09-12T17:06:44.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3949999999999999e-05 2024-09-12T17:06:44.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368628+0000", 2024-09-12T17:06:44.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5443000000000001e-05 2024-09-12T17:06:44.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368753+0000", 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012430899999999999 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368898+0000", 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145012 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.369195+0000", 2024-09-12T17:06:44.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029734100000000001 2024-09-12T17:06:44.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.370341+0000", 2024-09-12T17:06:44.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001145985 2024-09-12T17:06:44.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371159+0000", 2024-09-12T17:06:44.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081784999999999996 2024-09-12T17:06:44.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371309+0000", 2024-09-12T17:06:44.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014978600000000001 2024-09-12T17:06:44.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371420+0000", 2024-09-12T17:06:44.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111069 2024-09-12T17:06:44.473 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.473 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.473 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.474 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.474 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:06:44.474 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.923249409999997, 2024-09-12T17:06:44.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028637710000000002, 2024-09-12T17:06:44.474 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.474 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.474 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.474 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.474 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.474 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.474 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 913 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439136+0000", 2024-09-12T17:06:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7259999999999998e-06 2024-09-12T17:06:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439150+0000", 2024-09-12T17:06:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4419999999999999e-05 2024-09-12T17:06:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439181+0000", 2024-09-12T17:06:44.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0303000000000001e-05 2024-09-12T17:06:44.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439200+0000", 2024-09-12T17:06:44.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9313e-05 2024-09-12T17:06:44.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439316+0000", 2024-09-12T17:06:44.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115893 2024-09-12T17:06:44.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439541+0000", 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022517199999999999 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439857+0000", 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031612699999999998 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441075+0000", 2024-09-12T17:06:44.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001218114 2024-09-12T17:06:44.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441846+0000", 2024-09-12T17:06:44.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00077121100000000005 2024-09-12T17:06:44.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441931+0000", 2024-09-12T17:06:44.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4338999999999993e-05 2024-09-12T17:06:44.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441997+0000", 2024-09-12T17:06:44.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6153000000000002e-05 2024-09-12T17:06:44.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.481 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.481 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.481 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:06:44.481 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.893553822000001, 2024-09-12T17:06:44.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032820639999999999, 2024-09-12T17:06:44.481 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.481 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 925 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468831+0000", 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1459999999999999e-06 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468842+0000", 2024-09-12T17:06:44.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0727000000000001e-05 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468874+0000", 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2261999999999997e-05 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468888+0000", 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4507e-05 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469011+0000", 2024-09-12T17:06:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012317599999999999 2024-09-12T17:06:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469252+0000", 2024-09-12T17:06:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024031500000000001 2024-09-12T17:06:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469575+0000", 2024-09-12T17:06:44.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032279699999999999 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.470640+0000", 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001065262 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.471902+0000", 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001262504 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.471990+0000", 2024-09-12T17:06:44.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7552000000000005e-05 2024-09-12T17:06:44.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.472111+0000", 2024-09-12T17:06:44.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120816 2024-09-12T17:06:44.487 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.487 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.487 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.886152146999997, 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030855499999999998, 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 928 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.488 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:44.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476232+0000", 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9769999999999999e-06 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476242+0000", 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0003000000000001e-05 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476269+0000", 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6727e-05 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476288+0000", 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8649999999999999e-05 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476400+0000", 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111959 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476614+0000", 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000214465 2024-09-12T17:06:44.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476920+0000", 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030588700000000002 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.478203+0000", 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001282547 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:44.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479162+0000", 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095971299999999995 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479249+0000", 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6959000000000005e-05 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479316+0000", 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6662999999999995e-05 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.493 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.494 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.494 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:44.494 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:44.494 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:44.495 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:44.495 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:44.496 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:44.488+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:44.496 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:06:44.518 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:44.519 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:44.549 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:44.550 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:44.580 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:44.580 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:44.596 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:44.591+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:44.613 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:44.613 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:44.646 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:44.647 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:44.671 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:44.672 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:44.678 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:44.678 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:44.688 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:06:44.711 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:44.711 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:44.730 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:44.727+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:44.797 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:44.791+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:44.861 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:44.861 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:44.875 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:06:44.918 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:44.915+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:44.999 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:44.995+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:45.043 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:45.043 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:45.058 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:06:45.102 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:45.099+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:45.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:45.196+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:45.231 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:45.232 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:45.246 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:06:45.302 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:45.296+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:45.366 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:45.366 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:45.380 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:06:45.403 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:45.396+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:45.503 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:45.500+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:45.506 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:45.506 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:45.521 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:06:45.604 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:45.599+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:45.652 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:45.652 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:45.667 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:06:45.710 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:45.707+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:45.805 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:45.799+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:45.834 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:45.834 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:45.849 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:06:45.903 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T17:06:45.938 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:45.935+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:46.006 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:46.003+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:46.017 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:46.017 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:46.032 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:06:46.108 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:46.103+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:46.206 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:46.207 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:46.208 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:46.204+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:46.227 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:06:46.309 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:46.303+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:46.410 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:46.404+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:46.437 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:46.437 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:46.456 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:06:46.511 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:46.507+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:46.612 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:46.608+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:46.669 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:46.670 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:46.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:06:46.732 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:46.728+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:46.733 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:06:46.820 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:46.816+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:46.902 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:46.902 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:46.915 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:46.911+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:46.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:06:46.975 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:46.975 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:46.996 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T17:06:47.010 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:47.010 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:47.015 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:47.012+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:47.042 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:47.042 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:47.073 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:47.073 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:47.096 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:47.096 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:47.097 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:47.106 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:47.107 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:47.110 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:06:47.140 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:47.140 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:47.141 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:47.136+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:47.173 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:47.174 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:47.207 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:47.207 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:47.218 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:47.215+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:47.255 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.255 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.726050194999999, 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:06:47.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:06:47.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 51.568417998999998, 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:06:47.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:06:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:06:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:06:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:06:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:06:47.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:06:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:06:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.658324206000003, 2024-09-12T17:06:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:06:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.267 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:06:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:06:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:06:47.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:06:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:06:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:06:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:06:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:47.273 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.642433465000003, 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:47.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:06:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:06:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:06:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:06:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:06:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:06:47.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:06:47.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:06:47.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:47.279 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.616964795000001, 2024-09-12T17:06:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:06:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:06:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:06:47.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:06:47.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.285 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.598003693999999, 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.286 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:06:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:06:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:06:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:06:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:06:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:06:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:06:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:06:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:06:47.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:06:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:06:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.563448393999998, 2024-09-12T17:06:47.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:06:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:06:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:06:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:06:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:06:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:06:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:06:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:06:47.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.250228980999999, 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.299 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:06:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:06:47.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:06:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:06:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:06:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:06:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.245337612999997, 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.306 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:06:47.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:06:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:06:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:06:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:06:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:06:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:06:47.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.311 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.206362153999997, 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.312 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:06:47.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:06:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:06:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:06:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:06:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:06:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:06:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:06:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:06:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:06:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.20246418, 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:06:47.318 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:06:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:47.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:06:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:06:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:06:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:06:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:06:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:06:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:06:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:06:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:06:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:06:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.324 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.133704948000002, 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:06:47.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:06:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:06:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:06:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:06:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:06:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.097860934000003, 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:06:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:06:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:06:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:06:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:06:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:06:47.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.337 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.077673562999998, 2024-09-12T17:06:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:06:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:06:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.338 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:06:47.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:06:47.343 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.072779201000003, 2024-09-12T17:06:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:06:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.344 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:06:47.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:06:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:06:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:06:47.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:06:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:06:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:06:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:06:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:06:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.010811046000001, 2024-09-12T17:06:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:06:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:47.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:06:47.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:06:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:06:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:06:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:06:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:06:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:06:47.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:47.359 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.006404271000001, 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:47.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:06:47.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:06:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:06:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:06:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:06:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.839004928999998, 2024-09-12T17:06:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:06:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:06:47.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:06:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:06:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:06:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:06:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:06:47.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.808229896, 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.372 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:06:47.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:06:47.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:06:47.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 47.803317641, 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:06:47.378 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:47.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:06:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:06:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:06:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:06:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:06:47.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:47.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:06:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:06:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:06:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:06:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:47.384 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:47.384 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:47.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:06:47.387 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:47.380+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:47.487 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:47.480+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:47.589 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:47.584+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:47.600 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:47.600 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:47.600 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:47.618 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:06:47.704 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:47.700+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:47.769 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:47.769 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:47.770 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:47.770 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:47.783 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:06:47.791 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:47.791+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:47.891 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:47.884+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:47.992 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:47.987+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:48.001 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.396662921000001, 2024-09-12T17:06:48.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027134059999999998, 2024-09-12T17:06:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 42 2024-09-12T17:06:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600336+0000", 2024-09-12T17:06:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1270000000000001e-06 2024-09-12T17:06:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600346+0000", 2024-09-12T17:06:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.499e-06 2024-09-12T17:06:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600370+0000", 2024-09-12T17:06:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4411000000000001e-05 2024-09-12T17:06:48.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600386+0000", 2024-09-12T17:06:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6205000000000002e-05 2024-09-12T17:06:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600471+0000", 2024-09-12T17:06:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5013999999999996e-05 2024-09-12T17:06:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600569+0000", 2024-09-12T17:06:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7663000000000003e-05 2024-09-12T17:06:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600677+0000", 2024-09-12T17:06:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108571 2024-09-12T17:06:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.601918+0000", 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012408090000000001 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.602976+0000", 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001058217 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603016+0000", 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9894000000000001e-05 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603047+0000", 2024-09-12T17:06:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0995999999999999e-05 2024-09-12T17:06:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.415607325000003, 2024-09-12T17:06:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002848798, 2024-09-12T17:06:48.008 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 52 2024-09-12T17:06:48.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581393+0000", 2024-09-12T17:06:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4070000000000002e-06 2024-09-12T17:06:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581405+0000", 2024-09-12T17:06:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581439+0000", 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3966e-05 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581457+0000", 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7842999999999998e-05 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581567+0000", 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011048900000000001 2024-09-12T17:06:48.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581754+0000", 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018672099999999999 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581913+0000", 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015923700000000001 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.583010+0000", 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001096947 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584083+0000", 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010725730000000001 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584168+0000", 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4981999999999994e-05 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584238+0000", 2024-09-12T17:06:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0747000000000006e-05 2024-09-12T17:06:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.297352674000003, 2024-09-12T17:06:48.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003254804, 2024-09-12T17:06:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 236 2024-09-12T17:06:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699647+0000", 2024-09-12T17:06:48.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1300000000000001e-06 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699660+0000", 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2326e-05 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699694+0000", 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4552999999999999e-05 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699710+0000", 2024-09-12T17:06:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5573000000000002e-05 2024-09-12T17:06:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699835+0000", 2024-09-12T17:06:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012534300000000001 2024-09-12T17:06:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700050+0000", 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214565 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700448+0000", 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039816999999999999 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702129+0000", 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001680874 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702721+0000", 2024-09-12T17:06:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00059224199999999999 2024-09-12T17:06:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702804+0000", 2024-09-12T17:06:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3071999999999993e-05 2024-09-12T17:06:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702899+0000", 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4956000000000004e-05 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.284912147, 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026770299999999999, 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 271 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712086+0000", 2024-09-12T17:06:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3510000000000001e-06 2024-09-12T17:06:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712092+0000", 2024-09-12T17:06:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5670000000000002e-06 2024-09-12T17:06:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712105+0000", 2024-09-12T17:06:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3438000000000001e-05 2024-09-12T17:06:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712112+0000", 2024-09-12T17:06:48.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6229999999999999e-06 2024-09-12T17:06:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712181+0000", 2024-09-12T17:06:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9323e-05 2024-09-12T17:06:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712327+0000", 2024-09-12T17:06:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014620900000000001 2024-09-12T17:06:48.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712530+0000", 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020267700000000001 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.713251+0000", 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072110800000000004 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714674+0000", 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001423021 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714718+0000", 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4459000000000002e-05 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714762+0000", 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3254000000000003e-05 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.029 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:287 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.281685664000001, 2024-09-12T17:06:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034654030000000001, 2024-09-12T17:06:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.030 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 287 2024-09-12T17:06:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715312+0000", 2024-09-12T17:06:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1340000000000001e-06 2024-09-12T17:06:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715318+0000", 2024-09-12T17:06:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8409999999999996e-06 2024-09-12T17:06:48.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715332+0000", 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4265e-05 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715342+0000", 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3360000000000001e-06 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715412+0000", 2024-09-12T17:06:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9980000000000004e-05 2024-09-12T17:06:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715511+0000", 2024-09-12T17:06:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9197000000000006e-05 2024-09-12T17:06:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715663+0000", 2024-09-12T17:06:48.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152347 2024-09-12T17:06:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.716287+0000", 2024-09-12T17:06:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00062330100000000004 2024-09-12T17:06:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718705+0000", 2024-09-12T17:06:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002418505 2024-09-12T17:06:48.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718743+0000", 2024-09-12T17:06:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7645999999999998e-05 2024-09-12T17:06:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718777+0000", 2024-09-12T17:06:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3850999999999998e-05 2024-09-12T17:06:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.036 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.972205811000002, 2024-09-12T17:06:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028821710000000002, 2024-09-12T17:06:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.037 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 742 2024-09-12T17:06:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024794+0000", 2024-09-12T17:06:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7669999999999999e-06 2024-09-12T17:06:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024805+0000", 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1093e-05 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024836+0000", 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1136000000000001e-05 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024852+0000", 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6140000000000001e-05 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024989+0000", 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000136422 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025219+0000", 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008499999999999 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025545+0000", 2024-09-12T17:06:48.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032645100000000001 2024-09-12T17:06:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.026827+0000", 2024-09-12T17:06:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00128202 2024-09-12T17:06:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027470+0000", 2024-09-12T17:06:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00064248199999999999 2024-09-12T17:06:48.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027556+0000", 2024-09-12T17:06:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6533000000000007e-05 2024-09-12T17:06:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027673+0000", 2024-09-12T17:06:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117042 2024-09-12T17:06:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.043 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.968469599999999, 2024-09-12T17:06:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002617173, 2024-09-12T17:06:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.044 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 744 2024-09-12T17:06:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028529+0000", 2024-09-12T17:06:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8500000000000001e-06 2024-09-12T17:06:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028540+0000", 2024-09-12T17:06:48.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-05 2024-09-12T17:06:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028565+0000", 2024-09-12T17:06:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5083e-05 2024-09-12T17:06:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028577+0000", 2024-09-12T17:06:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2434e-05 2024-09-12T17:06:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028679+0000", 2024-09-12T17:06:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101489 2024-09-12T17:06:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028800+0000", 2024-09-12T17:06:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012089199999999999 2024-09-12T17:06:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:48.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.029070+0000", 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000270358 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030114+0000", 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001043832 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030994+0000", 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087969000000000003 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031082+0000", 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7825999999999996e-05 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031144+0000", 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2829000000000004e-05 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.929307475000002, 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027655549999999998, 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 760 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.051 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067692+0000", 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4200000000000001e-06 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067706+0000", 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.382e-05 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067739+0000", 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3253000000000002e-05 2024-09-12T17:06:48.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067763+0000", 2024-09-12T17:06:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4026e-05 2024-09-12T17:06:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067912+0000", 2024-09-12T17:06:48.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014959199999999999 2024-09-12T17:06:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068127+0000", 2024-09-12T17:06:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021487500000000001 2024-09-12T17:06:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:48.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068438+0000", 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031070400000000003 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.069550+0000", 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011116159999999999 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070301+0000", 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075135000000000002 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070390+0000", 2024-09-12T17:06:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8516000000000004e-05 2024-09-12T17:06:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070455+0000", 2024-09-12T17:06:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5382999999999994e-05 2024-09-12T17:06:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.793085245999997, 2024-09-12T17:06:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031165260000000001, 2024-09-12T17:06:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 817 2024-09-12T17:06:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203915+0000", 2024-09-12T17:06:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.146e-06 2024-09-12T17:06:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203926+0000", 2024-09-12T17:06:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1379999999999999e-05 2024-09-12T17:06:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203958+0000", 2024-09-12T17:06:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2239000000000001e-05 2024-09-12T17:06:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203973+0000", 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.47e-05 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204156+0000", 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018277899999999999 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204392+0000", 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000236658 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204705+0000", 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000312248 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.205983+0000", 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001278387 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206726+0000", 2024-09-12T17:06:48.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074269799999999997 2024-09-12T17:06:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206909+0000", 2024-09-12T17:06:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018368200000000001 2024-09-12T17:06:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.207028+0000", 2024-09-12T17:06:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118609 2024-09-12T17:06:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.064 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.788803596000001, 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003050269, 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.065 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 819 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208196+0000", 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4569999999999999e-06 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208207+0000", 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208241+0000", 2024-09-12T17:06:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3936000000000002e-05 2024-09-12T17:06:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208256+0000", 2024-09-12T17:06:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5917e-05 2024-09-12T17:06:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208383+0000", 2024-09-12T17:06:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012605200000000001 2024-09-12T17:06:48.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208602+0000", 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219908 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.209077+0000", 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047489299999999999 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210285+0000", 2024-09-12T17:06:48.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012075110000000001 2024-09-12T17:06:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210979+0000", 2024-09-12T17:06:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069376099999999999 2024-09-12T17:06:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211131+0000", 2024-09-12T17:06:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151915 2024-09-12T17:06:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211243+0000", 2024-09-12T17:06:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112989 2024-09-12T17:06:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.071 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.734057872000001, 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0035006659999999999, 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 841 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262942+0000", 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6900000000000001e-06 2024-09-12T17:06:48.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262953+0000", 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1323e-05 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262989+0000", 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5617000000000001e-05 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263006+0000", 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7713000000000001e-05 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263177+0000", 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170249 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263551+0000", 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037421999999999998 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.264122+0000", 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057113200000000002 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.265539+0000", 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001417012 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266170+0000", 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063154599999999997 2024-09-12T17:06:48.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266330+0000", 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926800000000001 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266440+0000", 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010989600000000001 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.729356885000001, 2024-09-12T17:06:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032057850000000001, 2024-09-12T17:06:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.078 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 843 2024-09-12T17:06:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:48.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267642+0000", 2024-09-12T17:06:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:06:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267653+0000", 2024-09-12T17:06:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0664e-05 2024-09-12T17:06:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267687+0000", 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4112999999999997e-05 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267703+0000", 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5673000000000001e-05 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267832+0000", 2024-09-12T17:06:48.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012896500000000001 2024-09-12T17:06:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268054+0000", 2024-09-12T17:06:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022279600000000001 2024-09-12T17:06:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268561+0000", 2024-09-12T17:06:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050617200000000005 2024-09-12T17:06:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.269801+0000", 2024-09-12T17:06:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012401269999999999 2024-09-12T17:06:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270562+0000", 2024-09-12T17:06:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076129699999999997 2024-09-12T17:06:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270716+0000", 2024-09-12T17:06:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000154339 2024-09-12T17:06:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270846+0000", 2024-09-12T17:06:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930600000000001 2024-09-12T17:06:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.084 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.718525225, 2024-09-12T17:06:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033822100000000001, 2024-09-12T17:06:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 847 2024-09-12T17:06:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.085 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278474+0000", 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4930000000000001e-06 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278485+0000", 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1313e-05 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278518+0000", 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2517000000000001e-05 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278533+0000", 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939999999999999e-05 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278689+0000", 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015628899999999999 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279066+0000", 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000377337 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279610+0000", 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00054380900000000002 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281130+0000", 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001519488 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281583+0000", 2024-09-12T17:06:48.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00045297300000000001 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281738+0000", 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015484900000000001 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281854+0000", 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116202 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.713909721, 2024-09-12T17:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883554, 2024-09-12T17:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.091 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 849 2024-09-12T17:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283090+0000", 2024-09-12T17:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283102+0000", 2024-09-12T17:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.204e-05 2024-09-12T17:06:48.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283136+0000", 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3983000000000003e-05 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283152+0000", 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6082999999999998e-05 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283278+0000", 2024-09-12T17:06:48.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000126212 2024-09-12T17:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283505+0000", 2024-09-12T17:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022724900000000001 2024-09-12T17:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283971+0000", 2024-09-12T17:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046550600000000003 2024-09-12T17:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285223+0000", 2024-09-12T17:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012519370000000001 2024-09-12T17:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285811+0000", 2024-09-12T17:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058819199999999997 2024-09-12T17:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285904+0000", 2024-09-12T17:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3410000000000002e-05 2024-09-12T17:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285971+0000", 2024-09-12T17:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6391999999999997e-05 2024-09-12T17:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.097 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.665956807000001, 2024-09-12T17:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033550770000000001, 2024-09-12T17:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.098 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 868 2024-09-12T17:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331043+0000", 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331054+0000", 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.131e-05 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331086+0000", 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331101+0000", 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5016e-05 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331253+0000", 2024-09-12T17:06:48.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151929 2024-09-12T17:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331616+0000", 2024-09-12T17:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036285100000000003 2024-09-12T17:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.332174+0000", 2024-09-12T17:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055856199999999997 2024-09-12T17:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.333700+0000", 2024-09-12T17:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015259480000000001 2024-09-12T17:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334120+0000", 2024-09-12T17:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042021700000000002 2024-09-12T17:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334280+0000", 2024-09-12T17:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159949 2024-09-12T17:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334395+0000", 2024-09-12T17:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114679 2024-09-12T17:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.104 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.661499016, 2024-09-12T17:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003066923, 2024-09-12T17:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 870 2024-09-12T17:06:48.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335500+0000", 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4040000000000002e-06 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335511+0000", 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.045e-05 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335542+0000", 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1542999999999999e-05 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335558+0000", 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.535e-05 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335698+0000", 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014063899999999999 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335930+0000", 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000231435 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.336392+0000", 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046211199999999998 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.337568+0000", 2024-09-12T17:06:48.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001176671 2024-09-12T17:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338407+0000", 2024-09-12T17:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083885399999999999 2024-09-12T17:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338491+0000", 2024-09-12T17:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4159000000000005e-05 2024-09-12T17:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338565+0000", 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3306000000000006e-05 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.573310272999997, 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027821550000000001, 2024-09-12T17:06:48.111 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 907 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423690+0000", 2024-09-12T17:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-12T17:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423702+0000", 2024-09-12T17:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2404e-05 2024-09-12T17:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423735+0000", 2024-09-12T17:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3062999999999998e-05 2024-09-12T17:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423750+0000", 2024-09-12T17:06:48.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4912999999999999e-05 2024-09-12T17:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423919+0000", 2024-09-12T17:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016838899999999999 2024-09-12T17:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424160+0000", 2024-09-12T17:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024105099999999999 2024-09-12T17:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424492+0000", 2024-09-12T17:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033261100000000002 2024-09-12T17:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.425785+0000", 2024-09-12T17:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001292397 2024-09-12T17:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426322+0000", 2024-09-12T17:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00053743200000000001 2024-09-12T17:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426403+0000", 2024-09-12T17:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0898999999999999e-05 2024-09-12T17:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426469+0000", 2024-09-12T17:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5720000000000001e-05 2024-09-12T17:06:48.117 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.474144584999998, 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029674670000000001, 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.118 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 949 2024-09-12T17:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522855+0000", 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522871+0000", 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5950000000000001e-05 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522906+0000", 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316000000000001e-05 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522924+0000", 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8326999999999999e-05 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523047+0000", 2024-09-12T17:06:48.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123609 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523282+0000", 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234465 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523606+0000", 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032453099999999997 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.524804+0000", 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011977509999999999 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525626+0000", 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082216400000000001 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525743+0000", 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116679 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525820+0000", 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6631999999999994e-05 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.460420911, 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030602540000000001, 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.124 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 955 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536578+0000", 2024-09-12T17:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536590+0000", 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1250000000000001e-05 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536624+0000", 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4227000000000003e-05 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536646+0000", 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2195999999999999e-05 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536794+0000", 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014799600000000001 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537005+0000", 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021096799999999999 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537489+0000", 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048413599999999997 2024-09-12T17:06:48.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.538940+0000", 2024-09-12T17:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001451262 2024-09-12T17:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539441+0000", 2024-09-12T17:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050002300000000005 2024-09-12T17:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539535+0000", 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4526999999999998e-05 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539636+0000", 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010111900000000001 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.130 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 48.456163576999998, 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030889300000000001, 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 957 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540836+0000", 2024-09-12T17:06:48.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540862+0000", 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999999e-05 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540891+0000", 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9595999999999999e-05 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540906+0000", 2024-09-12T17:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4919999999999999e-05 2024-09-12T17:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541052+0000", 2024-09-12T17:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014583900000000001 2024-09-12T17:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541232+0000", 2024-09-12T17:06:48.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180259 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541500+0000", 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026788799999999998 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.542483+0000", 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000983142 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543756+0000", 2024-09-12T17:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001272977 2024-09-12T17:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543842+0000", 2024-09-12T17:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5748999999999995e-05 2024-09-12T17:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543922+0000", 2024-09-12T17:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0000000000000007e-05 2024-09-12T17:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.137 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:48.139 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:06:48.139 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:48.135+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:48.239 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:48.232+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:48.340 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:48.338+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:48.349 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:48.350 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:48.350 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:48.350 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:48.367 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:06:48.441 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:48.438+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:48.542 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:48.536+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:48.588 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:48.588 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:48.588 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:48.608 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:06:48.652 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:48.648+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:48.744 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:48.740+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:48.826 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-12T17:06:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.277148791000002, 2024-09-12T17:06:48.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011583833, 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 44 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544942+0000", 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.653e-06 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544957+0000", 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5654e-05 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544993+0000", 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5936000000000003e-05 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.545017+0000", 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3283000000000001e-05 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549277+0000", 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042606800000000002 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549301+0000", 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3260000000000001e-05 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556317+0000", 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070164620000000002 2024-09-12T17:06:48.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556522+0000", 2024-09-12T17:06:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020490499999999999 2024-09-12T17:06:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:48.831 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 50.233683245000002, 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054133180000000003, 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 207 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588408+0000", 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588428+0000", 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9910000000000001e-05 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588467+0000", 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588483+0000", 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6443000000000002e-05 2024-09-12T17:06:48.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588659+0000", 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569499999999999 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589033+0000", 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037374100000000003 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589729+0000", 2024-09-12T17:06:48.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069659400000000003 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593394+0000", 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036653279999999998 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593661+0000", 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026662499999999999 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593743+0000", 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1428999999999996e-05 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593817+0000", 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4475999999999996e-05 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.837 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 50.197462545, 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034289839999999999, 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 216 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624628+0000", 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2399999999999999e-06 2024-09-12T17:06:48.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624641+0000", 2024-09-12T17:06:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3743e-05 2024-09-12T17:06:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624675+0000", 2024-09-12T17:06:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3277e-05 2024-09-12T17:06:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624690+0000", 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5812999999999999e-05 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624847+0000", 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156269 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625092+0000", 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024499500000000002 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625494+0000", 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040263000000000001 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.626934+0000", 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001439159 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627890+0000", 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095619599999999998 2024-09-12T17:06:48.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627978+0000", 2024-09-12T17:06:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8446e-05 2024-09-12T17:06:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.628053+0000", 2024-09-12T17:06:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5216000000000006e-05 2024-09-12T17:06:48.843 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 50.155954301999998, 2024-09-12T17:06:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003364985, 2024-09-12T17:06:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.844 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 227 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:48.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666135+0000", 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.644e-06 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666147+0000", 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1960000000000001e-05 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666179+0000", 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1813000000000002e-05 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666195+0000", 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5679999999999999e-05 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666342+0000", 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147312 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666559+0000", 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021664199999999999 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.667037+0000", 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047816200000000002 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.668796+0000", 2024-09-12T17:06:48.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017590010000000001 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669346+0000", 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055024499999999999 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669433+0000", 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6650000000000006e-05 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669498+0000", 2024-09-12T17:06:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4875999999999993e-05 2024-09-12T17:06:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:48.850 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 50.148747043, 2024-09-12T17:06:48.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031932409999999999, 2024-09-12T17:06:48.851 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.851 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.851 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.851 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.851 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 229 2024-09-12T17:06:48.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673342+0000", 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3499999999999999e-06 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673354+0000", 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1739999999999999e-05 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673386+0000", 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1782000000000002e-05 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673400+0000", 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4663e-05 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673577+0000", 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017662900000000001 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673783+0000", 2024-09-12T17:06:48.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020620799999999999 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.674174+0000", 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039082100000000002 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.675441+0000", 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001267177 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676382+0000", 2024-09-12T17:06:48.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094087900000000004 2024-09-12T17:06:48.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676468+0000", 2024-09-12T17:06:48.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5762999999999999e-05 2024-09-12T17:06:48.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676533+0000", 2024-09-12T17:06:48.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5228999999999995e-05 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 50.141004119999998, 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0037357380000000002, 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.857 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 231 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:48.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681085+0000", 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681096+0000", 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0866000000000001e-05 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681126+0000", 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9977000000000001e-05 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681140+0000", 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4195999999999999e-05 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681288+0000", 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014765199999999999 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681637+0000", 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034917100000000001 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.682358+0000", 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072050800000000002 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684139+0000", 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017812399999999999 2024-09-12T17:06:48.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684543+0000", 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040413299999999999 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684703+0000", 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160075 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684819+0000", 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011553300000000001 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:374 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 50.08612669, 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031135910000000002, 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.863 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 374 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:48.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735961+0000", 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0979999999999999e-06 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735968+0000", 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735981+0000", 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3164e-05 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735989+0000", 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8010000000000004e-06 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736041+0000", 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800999999999998e-05 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736137+0000", 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5497999999999999e-05 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736303+0000", 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016580100000000001 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736802+0000", 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049966599999999996 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739015+0000", 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022122919999999998 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739047+0000", 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2678000000000001e-05 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739074+0000", 2024-09-12T17:06:48.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6594e-05 2024-09-12T17:06:48.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.869 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.869 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.869 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.869 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:48.869 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.860681947000003, 2024-09-12T17:06:48.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029096640000000002, 2024-09-12T17:06:48.869 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.869 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.869 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 715 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961407+0000", 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961419+0000", 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.117e-05 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961450+0000", 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1463e-05 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961465+0000", 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961576+0000", 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111016 2024-09-12T17:06:48.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961785+0000", 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020865599999999999 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.962105+0000", 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031996699999999999 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.963189+0000", 2024-09-12T17:06:48.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010845519999999999 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964163+0000", 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097355800000000002 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964252+0000", 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8996e-05 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964315+0000", 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2773000000000004e-05 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.826411391000001, 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883207, 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.875 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 730 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995678+0000", 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995689+0000", 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1316e-05 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995722+0000", 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995745+0000", 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3496999999999999e-05 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995902+0000", 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156446 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996113+0000", 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021091099999999999 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996444+0000", 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000330785 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.997558+0000", 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001114681 2024-09-12T17:06:48.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998420+0000", 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086125299999999998 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998497+0000", 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7919999999999999e-05 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998559+0000", 2024-09-12T17:06:48.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1319e-05 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.807929827000002, 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002862248, 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.881 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 738 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:48.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014159+0000", 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014168+0000", 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.653e-06 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014191+0000", 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3706e-05 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014213+0000", 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2050000000000001e-05 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014363+0000", 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014956299999999999 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014485+0000", 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000122132 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014770+0000", 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000284911 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.015864+0000", 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010942180000000001 2024-09-12T17:06:48.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016864+0000", 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00099982299999999994 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016951+0000", 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6476000000000003e-05 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.017019+0000", 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8756000000000004e-05 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.725608448999999, 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032495950000000001, 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.887 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 772 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:48.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096481+0000", 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4399999999999999e-06 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096492+0000", 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1513e-05 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096522+0000", 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9156e-05 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096536+0000", 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4347e-05 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096681+0000", 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145348 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096896+0000", 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214489 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.097208+0000", 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031215099999999999 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.098332+0000", 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001123635 2024-09-12T17:06:48.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099583+0000", 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00125179 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099663+0000", 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9703000000000006e-05 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099728+0000", 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5023000000000004e-05 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.653866489999999, 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028771949999999999, 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.893 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 802 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:48.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168223+0000", 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4499999999999998e-06 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168234+0000", 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168265+0000", 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0777e-05 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168279+0000", 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4525999999999999e-05 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168397+0000", 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118063 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168616+0000", 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000218505 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168970+0000", 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00035427400000000002 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170038+0000", 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001067571 2024-09-12T17:06:48.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170897+0000", 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085934399999999995 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170983+0000", 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6179000000000003e-05 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.171098+0000", 2024-09-12T17:06:48.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114576 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.595066664000001, 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033328609999999999, 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.899 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 826 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:48.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227023+0000", 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227035+0000", 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227067+0000", 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2305999999999999e-05 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227082+0000", 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.485e-05 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227247+0000", 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016483900000000001 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227630+0000", 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038350100000000001 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.228201+0000", 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057026799999999997 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.229556+0000", 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013553300000000001 2024-09-12T17:06:48.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230084+0000", 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00052805599999999995 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230238+0000", 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015438499999999999 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230353+0000", 2024-09-12T17:06:48.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114809 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.535793308000002, 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033407710000000002, 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.905 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 850 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:48.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286296+0000", 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286307+0000", 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1287000000000001e-05 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286339+0000", 2024-09-12T17:06:48.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1331999999999997e-05 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286353+0000", 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4517e-05 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286504+0000", 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015038200000000001 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286897+0000", 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039326399999999999 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.287451+0000", 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055426900000000003 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.288825+0000", 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013741160000000001 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289484+0000", 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00065819499999999998 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289570+0000", 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6383000000000003e-05 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289634+0000", 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4505999999999995e-05 2024-09-12T17:06:48.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.497801391000003, 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002894237, 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.911 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 865 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324288+0000", 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2469999999999998e-06 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324299+0000", 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0823e-05 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324330+0000", 2024-09-12T17:06:48.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1846e-05 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324350+0000", 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9077e-05 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324463+0000", 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011367200000000001 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324693+0000", 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008800000000001 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.325000+0000", 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030629499999999999 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.326117+0000", 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011175709999999999 2024-09-12T17:06:48.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327026+0000", 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00090879000000000003 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327113+0000", 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7093000000000001e-05 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327180+0000", 2024-09-12T17:06:48.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6735000000000004e-05 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.483287893000004, 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030741359999999999, 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.917 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 871 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:48.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338802+0000", 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338831+0000", 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9356000000000002e-05 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338868+0000", 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7357000000000002e-05 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338883+0000", 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4932999999999999e-05 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339036+0000", 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152423 2024-09-12T17:06:48.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339264+0000", 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022814100000000001 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339593+0000", 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032943099999999998 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.340783+0000", 2024-09-12T17:06:48.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011898740000000001 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341724+0000", 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094134600000000002 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341809+0000", 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4155999999999999e-05 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341873+0000", 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4605999999999998e-05 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.425795833000002, 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003093649, 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.923 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 895 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:48.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396294+0000", 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3999999999999999e-06 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396307+0000", 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3468999999999999e-05 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396338+0000", 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1433000000000002e-05 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396353+0000", 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4557e-05 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396496+0000", 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014275900000000001 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396719+0000", 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022317499999999999 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.397052+0000", 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033263699999999999 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.398211+0000", 2024-09-12T17:06:48.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011593350000000001 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399235+0000", 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010241219999999999 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399321+0000", 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5789000000000001e-05 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399385+0000", 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3973000000000006e-05 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.419308776999998, 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029302239999999999, 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 898 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402780+0000", 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9269999999999999e-06 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402789+0000", 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7069999999999998e-06 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402830+0000", 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1470000000000001e-05 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402846+0000", 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5319e-05 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402938+0000", 2024-09-12T17:06:48.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2289999999999999e-05 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403134+0000", 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000196014 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403437+0000", 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030337199999999999 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.404507+0000", 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001069492 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405432+0000", 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092532900000000002 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405590+0000", 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158018 2024-09-12T17:06:48.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405708+0000", 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118286 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.333901515999997, 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030817499999999999, 2024-09-12T17:06:48.935 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 934 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488188+0000", 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8040000000000002e-06 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488201+0000", 2024-09-12T17:06:48.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2893e-05 2024-09-12T17:06:48.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488233+0000", 2024-09-12T17:06:48.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2085999999999997e-05 2024-09-12T17:06:48.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488248+0000", 2024-09-12T17:06:48.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4976e-05 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488415+0000", 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016677900000000001 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488650+0000", 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234875 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:48.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488961+0000", 2024-09-12T17:06:48.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031078799999999999 2024-09-12T17:06:48.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.490177+0000", 2024-09-12T17:06:48.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001216607 2024-09-12T17:06:48.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491119+0000", 2024-09-12T17:06:48.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000941806 2024-09-12T17:06:48.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491202+0000", 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3349000000000004e-05 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491267+0000", 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4787000000000002e-05 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 49.323082536000001, 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031107489999999999, 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 939 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.942 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:48.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499007+0000", 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3970000000000001e-06 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499018+0000", 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0969e-05 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499052+0000", 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3896999999999997e-05 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499068+0000", 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6552999999999999e-05 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499200+0000", 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013206599999999999 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499438+0000", 2024-09-12T17:06:48.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023806500000000001 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499922+0000", 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048369599999999998 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501326+0000", 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014036560000000001 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501962+0000", 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063623100000000001 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502048+0000", 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5636999999999993e-05 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502115+0000", 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7582000000000004e-05 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.947 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.948 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.948 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:48.948 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:48.948 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:48.949 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:06:48.950 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:48.946+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:49.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T17:06:49.050 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:49.046+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:49.085 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:49.086 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:06:49.086 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:49.100 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:06:49.186 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:49.182+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:49.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:06:49.252 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:49.246+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:49.276 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:06:49.352 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:49.348+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:49.434 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:49.435 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:49.451 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:06:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:06:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:06:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:06:49.451 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.838944075000001, 2024-09-12T17:06:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003566582, 2024-09-12T17:06:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 211 2024-09-12T17:06:49.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608233+0000", 2024-09-12T17:06:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.343e-06 2024-09-12T17:06:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608248+0000", 2024-09-12T17:06:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4747e-05 2024-09-12T17:06:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608285+0000", 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7239e-05 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608302+0000", 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6909999999999999e-05 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608454+0000", 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015164599999999999 2024-09-12T17:06:49.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608666+0000", 2024-09-12T17:06:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021213499999999999 2024-09-12T17:06:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.609092+0000", 2024-09-12T17:06:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042601999999999999 2024-09-12T17:06:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.610771+0000", 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016786940000000001 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611640+0000", 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00086891300000000002 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611731+0000", 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1058999999999997e-05 2024-09-12T17:06:49.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611796+0000", 2024-09-12T17:06:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5876000000000004e-05 2024-09-12T17:06:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.458 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:06:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.759974057999997, 2024-09-12T17:06:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035636330000000001, 2024-09-12T17:06:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 232 2024-09-12T17:06:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:06:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:06:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687203+0000", 2024-09-12T17:06:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T17:06:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687216+0000", 2024-09-12T17:06:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346999999999999e-05 2024-09-12T17:06:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687250+0000", 2024-09-12T17:06:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3992999999999998e-05 2024-09-12T17:06:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687266+0000", 2024-09-12T17:06:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.577e-05 2024-09-12T17:06:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687402+0000", 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013599599999999999 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687630+0000", 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228168 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.688057+0000", 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042653999999999999 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.689651+0000", 2024-09-12T17:06:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015945009999999999 2024-09-12T17:06:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690608+0000", 2024-09-12T17:06:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095638899999999998 2024-09-12T17:06:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690694+0000", 2024-09-12T17:06:49.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6119000000000007e-05 2024-09-12T17:06:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690764+0000", 2024-09-12T17:06:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9757000000000003e-05 2024-09-12T17:06:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.465 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:06:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.739527629000001, 2024-09-12T17:06:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030740059999999998, 2024-09-12T17:06:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 241 2024-09-12T17:06:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.466 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:06:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:06:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707649+0000", 2024-09-12T17:06:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:06:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707661+0000", 2024-09-12T17:06:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2e-05 2024-09-12T17:06:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707693+0000", 2024-09-12T17:06:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2299999999999999e-05 2024-09-12T17:06:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707709+0000", 2024-09-12T17:06:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6096e-05 2024-09-12T17:06:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707871+0000", 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016122200000000001 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.708198+0000", 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032765799999999999 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.708655+0000", 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00045698599999999999 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710022+0000", 2024-09-12T17:06:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013664059999999999 2024-09-12T17:06:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710578+0000", 2024-09-12T17:06:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055600199999999999 2024-09-12T17:06:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710650+0000", 2024-09-12T17:06:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2767000000000003e-05 2024-09-12T17:06:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710720+0000", 2024-09-12T17:06:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9839000000000007e-05 2024-09-12T17:06:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:434 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.473 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:06:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.68674472, 2024-09-12T17:06:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030966930000000002, 2024-09-12T17:06:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 434 2024-09-12T17:06:49.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:06:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:06:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760432+0000", 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4540000000000001e-06 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760443+0000", 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1123e-05 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760473+0000", 2024-09-12T17:06:49.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0476000000000001e-05 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760493+0000", 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9502999999999999e-05 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760616+0000", 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123509 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760776+0000", 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000159462 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.761216+0000", 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000440474 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762555+0000", 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338926 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763288+0000", 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00073298000000000005 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763434+0000", 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145544 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763526+0000", 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2242000000000002e-05 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.479 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:445 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:06:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.679846748999999, 2024-09-12T17:06:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029347829999999998, 2024-09-12T17:06:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.480 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 445 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:06:49.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767330+0000", 2024-09-12T17:06:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8229999999999999e-06 2024-09-12T17:06:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767343+0000", 2024-09-12T17:06:49.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2869e-05 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767373+0000", 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0294000000000002e-05 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767392+0000", 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.91e-05 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767522+0000", 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000130152 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767688+0000", 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016599900000000001 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.768155+0000", 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046654299999999998 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.769308+0000", 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001153165 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770069+0000", 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076044000000000003 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770155+0000", 2024-09-12T17:06:49.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6493e-05 2024-09-12T17:06:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770262+0000", 2024-09-12T17:06:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010690499999999999 2024-09-12T17:06:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.650109211, 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039867009999999996, 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 504 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.487 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797067+0000", 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797078+0000", 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0837e-05 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797108+0000", 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9722000000000001e-05 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797127+0000", 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9539999999999999e-05 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797249+0000", 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121239 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797551+0000", 2024-09-12T17:06:49.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030277400000000001 2024-09-12T17:06:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.798161+0000", 2024-09-12T17:06:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00060936200000000001 2024-09-12T17:06:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.799307+0000", 2024-09-12T17:06:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001146588 2024-09-12T17:06:49.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.800728+0000", 2024-09-12T17:06:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014204389999999999 2024-09-12T17:06:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.800831+0000", 2024-09-12T17:06:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103002 2024-09-12T17:06:49.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.801051+0000", 2024-09-12T17:06:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022061499999999999 2024-09-12T17:06:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:626 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:06:49.493 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.568358009000001, 2024-09-12T17:06:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032539040000000002, 2024-09-12T17:06:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 626 2024-09-12T17:06:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878819+0000", 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6699999999999998e-06 2024-09-12T17:06:49.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878831+0000", 2024-09-12T17:06:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2882e-05 2024-09-12T17:06:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878862+0000", 2024-09-12T17:06:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0332999999999999e-05 2024-09-12T17:06:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878880+0000", 2024-09-12T17:06:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8236999999999998e-05 2024-09-12T17:06:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879009+0000", 2024-09-12T17:06:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012908599999999999 2024-09-12T17:06:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879306+0000", 2024-09-12T17:06:49.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029693100000000001 2024-09-12T17:06:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879873+0000", 2024-09-12T17:06:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056697200000000001 2024-09-12T17:06:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881172+0000", 2024-09-12T17:06:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001298766 2024-09-12T17:06:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881880+0000", 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00070808500000000001 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881962+0000", 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2069000000000003e-05 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882070+0000", 2024-09-12T17:06:49.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107873 2024-09-12T17:06:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:06:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.564178642000002, 2024-09-12T17:06:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030425119999999998, 2024-09-12T17:06:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.500 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 633 2024-09-12T17:06:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:06:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882997+0000", 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0530000000000001e-06 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883009+0000", 2024-09-12T17:06:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1195e-05 2024-09-12T17:06:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883037+0000", 2024-09-12T17:06:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8484999999999999e-05 2024-09-12T17:06:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883055+0000", 2024-09-12T17:06:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8467000000000001e-05 2024-09-12T17:06:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883196+0000", 2024-09-12T17:06:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014099499999999999 2024-09-12T17:06:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883444+0000", 2024-09-12T17:06:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000247758 2024-09-12T17:06:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883892+0000", 2024-09-12T17:06:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044757299999999999 2024-09-12T17:06:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885202+0000", 2024-09-12T17:06:49.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001310587 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885879+0000", 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00067645599999999998 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885945+0000", 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6575999999999994e-05 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.886038+0000", 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2367000000000005e-05 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:644 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.554181208000003, 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030197190000000001, 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.507 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 644 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:06:49.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892995+0000", 2024-09-12T17:06:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1390000000000002e-06 2024-09-12T17:06:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893004+0000", 2024-09-12T17:06:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3729999999999999e-06 2024-09-12T17:06:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893029+0000", 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5058999999999998e-05 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893041+0000", 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1858000000000001e-05 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893190+0000", 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014875199999999999 2024-09-12T17:06:49.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893575+0000", 2024-09-12T17:06:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038538 2024-09-12T17:06:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.894140+0000", 2024-09-12T17:06:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056461200000000003 2024-09-12T17:06:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895394+0000", 2024-09-12T17:06:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012536100000000001 2024-09-12T17:06:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895856+0000", 2024-09-12T17:06:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046213 2024-09-12T17:06:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895940+0000", 2024-09-12T17:06:49.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4808999999999994e-05 2024-09-12T17:06:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.896012+0000", 2024-09-12T17:06:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1996999999999995e-05 2024-09-12T17:06:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:711 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.493832515000001, 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00296547, 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 711 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.514 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:06:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:06:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953343+0000", 2024-09-12T17:06:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.046e-06 2024-09-12T17:06:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953353+0000", 2024-09-12T17:06:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4939999999999992e-06 2024-09-12T17:06:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953386+0000", 2024-09-12T17:06:49.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2919000000000001e-05 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953405+0000", 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9596999999999999e-05 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953576+0000", 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017032500000000001 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953828+0000", 2024-09-12T17:06:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025190800000000001 2024-09-12T17:06:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.954297+0000", 2024-09-12T17:06:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046897300000000002 2024-09-12T17:06:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.955510+0000", 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012131139999999999 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956183+0000", 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00067301800000000005 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956254+0000", 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0786999999999998e-05 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956307+0000", 2024-09-12T17:06:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3288999999999998e-05 2024-09-12T17:06:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:06:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.463921769999999, 2024-09-12T17:06:49.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029480109999999999, 2024-09-12T17:06:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 724 2024-09-12T17:06:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983255+0000", 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4140000000000001e-06 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983266+0000", 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1039999999999999e-05 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983298+0000", 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1949000000000002e-05 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983313+0000", 2024-09-12T17:06:49.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5296999999999999e-05 2024-09-12T17:06:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983416+0000", 2024-09-12T17:06:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102921 2024-09-12T17:06:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983578+0000", 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000162244 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983835+0000", 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025741700000000002 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.984947+0000", 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011111949999999999 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.985915+0000", 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00096828599999999995 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.986080+0000", 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016498500000000001 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.986200+0000", 2024-09-12T17:06:49.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120263 2024-09-12T17:06:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:06:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.456313600999998, 2024-09-12T17:06:49.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029804559999999998, 2024-09-12T17:06:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 727 2024-09-12T17:06:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:06:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:06:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990862+0000", 2024-09-12T17:06:49.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0959999999999999e-06 2024-09-12T17:06:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990872+0000", 2024-09-12T17:06:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1039999999999996e-06 2024-09-12T17:06:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990897+0000", 2024-09-12T17:06:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5626000000000002e-05 2024-09-12T17:06:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990911+0000", 2024-09-12T17:06:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346000000000001e-05 2024-09-12T17:06:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990999+0000", 2024-09-12T17:06:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8887000000000005e-05 2024-09-12T17:06:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.991252+0000", 2024-09-12T17:06:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025290099999999998 2024-09-12T17:06:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:06:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.991617+0000", 2024-09-12T17:06:49.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036479399999999999 2024-09-12T17:06:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.992803+0000", 2024-09-12T17:06:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011859049999999999 2024-09-12T17:06:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993677+0000", 2024-09-12T17:06:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00087379199999999997 2024-09-12T17:06:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993774+0000", 2024-09-12T17:06:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7343000000000006e-05 2024-09-12T17:06:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993841+0000", 2024-09-12T17:06:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6662000000000007e-05 2024-09-12T17:06:49.536 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.537 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:06:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.341370908999998, 2024-09-12T17:06:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035861349999999998, 2024-09-12T17:06:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.538 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 775 2024-09-12T17:06:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:06:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:06:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105806+0000", 2024-09-12T17:06:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9529999999999999e-06 2024-09-12T17:06:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105818+0000", 2024-09-12T17:06:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2447e-05 2024-09-12T17:06:49.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105851+0000", 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2969999999999998e-05 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105867+0000", 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5116999999999999e-05 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106011+0000", 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014498500000000001 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106382+0000", 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037012699999999999 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106946+0000", 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056435199999999995 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.108269+0000", 2024-09-12T17:06:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00132256 2024-09-12T17:06:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109120+0000", 2024-09-12T17:06:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00085151300000000003 2024-09-12T17:06:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109274+0000", 2024-09-12T17:06:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015367199999999999 2024-09-12T17:06:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109389+0000", 2024-09-12T17:06:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115439 2024-09-12T17:06:49.545 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.546 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:06:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.336282048000001, 2024-09-12T17:06:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031979489999999998, 2024-09-12T17:06:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.547 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 777 2024-09-12T17:06:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:06:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:06:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110894+0000", 2024-09-12T17:06:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4870000000000001e-06 2024-09-12T17:06:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110905+0000", 2024-09-12T17:06:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.098e-05 2024-09-12T17:06:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110938+0000", 2024-09-12T17:06:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:06:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110953+0000", 2024-09-12T17:06:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5058999999999999e-05 2024-09-12T17:06:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111080+0000", 2024-09-12T17:06:49.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000127033 2024-09-12T17:06:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111312+0000", 2024-09-12T17:06:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000231828 2024-09-12T17:06:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111791+0000", 2024-09-12T17:06:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00047926000000000002 2024-09-12T17:06:49.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.112965+0000", 2024-09-12T17:06:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011740209999999999 2024-09-12T17:06:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.113920+0000", 2024-09-12T17:06:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095542000000000001 2024-09-12T17:06:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.114009+0000", 2024-09-12T17:06:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8162000000000001e-05 2024-09-12T17:06:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.114090+0000", 2024-09-12T17:06:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1203000000000002e-05 2024-09-12T17:06:49.554 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:06:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.248672374000002, 2024-09-12T17:06:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030645529999999998, 2024-09-12T17:06:49.555 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 814 2024-09-12T17:06:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:06:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:06:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198504+0000", 2024-09-12T17:06:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6630000000000002e-06 2024-09-12T17:06:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198515+0000", 2024-09-12T17:06:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1014e-05 2024-09-12T17:06:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198548+0000", 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2339999999999999e-05 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198563+0000", 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5228999999999999e-05 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198683+0000", 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120569 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198886+0000", 2024-09-12T17:06:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020240199999999999 2024-09-12T17:06:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.199199+0000", 2024-09-12T17:06:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031304800000000002 2024-09-12T17:06:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.200322+0000", 2024-09-12T17:06:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011236309999999999 2024-09-12T17:06:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201410+0000", 2024-09-12T17:06:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010880110000000001 2024-09-12T17:06:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201494+0000", 2024-09-12T17:06:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3863000000000007e-05 2024-09-12T17:06:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201566+0000", 2024-09-12T17:06:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1783e-05 2024-09-12T17:06:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.083196518000001, 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030460629999999999, 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 880 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.563 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:06:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:06:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363980+0000", 2024-09-12T17:06:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0699999999999998e-06 2024-09-12T17:06:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363993+0000", 2024-09-12T17:06:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2439999999999999e-05 2024-09-12T17:06:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364026+0000", 2024-09-12T17:06:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2886999999999999e-05 2024-09-12T17:06:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364041+0000", 2024-09-12T17:06:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5255999999999999e-05 2024-09-12T17:06:49.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364160+0000", 2024-09-12T17:06:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011927200000000001 2024-09-12T17:06:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364388+0000", 2024-09-12T17:06:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228116 2024-09-12T17:06:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364728+0000", 2024-09-12T17:06:49.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033925999999999997 2024-09-12T17:06:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.365909+0000", 2024-09-12T17:06:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001181091 2024-09-12T17:06:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.366732+0000", 2024-09-12T17:06:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082351699999999996 2024-09-12T17:06:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.366907+0000", 2024-09-12T17:06:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000174568 2024-09-12T17:06:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.367023+0000", 2024-09-12T17:06:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116586 2024-09-12T17:06:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:06:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.078608756999998, 2024-09-12T17:06:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002854625, 2024-09-12T17:06:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.573 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 882 2024-09-12T17:06:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:06:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:06:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368568+0000", 2024-09-12T17:06:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5799999999999999e-06 2024-09-12T17:06:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368579+0000", 2024-09-12T17:06:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.13e-05 2024-09-12T17:06:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368613+0000", 2024-09-12T17:06:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3949999999999999e-05 2024-09-12T17:06:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368628+0000", 2024-09-12T17:06:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5443000000000001e-05 2024-09-12T17:06:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368753+0000", 2024-09-12T17:06:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012430899999999999 2024-09-12T17:06:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368898+0000", 2024-09-12T17:06:49.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145012 2024-09-12T17:06:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.369195+0000", 2024-09-12T17:06:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029734100000000001 2024-09-12T17:06:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.370341+0000", 2024-09-12T17:06:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001145985 2024-09-12T17:06:49.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371159+0000", 2024-09-12T17:06:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081784999999999996 2024-09-12T17:06:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371309+0000", 2024-09-12T17:06:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014978600000000001 2024-09-12T17:06:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371420+0000", 2024-09-12T17:06:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111069 2024-09-12T17:06:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:06:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 50.008040860999998, 2024-09-12T17:06:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028637710000000002, 2024-09-12T17:06:49.580 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 913 2024-09-12T17:06:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:06:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:06:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439136+0000", 2024-09-12T17:06:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7259999999999998e-06 2024-09-12T17:06:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439150+0000", 2024-09-12T17:06:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4419999999999999e-05 2024-09-12T17:06:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439181+0000", 2024-09-12T17:06:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0303000000000001e-05 2024-09-12T17:06:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439200+0000", 2024-09-12T17:06:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9313e-05 2024-09-12T17:06:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439316+0000", 2024-09-12T17:06:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115893 2024-09-12T17:06:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439541+0000", 2024-09-12T17:06:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022517199999999999 2024-09-12T17:06:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439857+0000", 2024-09-12T17:06:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031612699999999998 2024-09-12T17:06:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441075+0000", 2024-09-12T17:06:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001218114 2024-09-12T17:06:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441846+0000", 2024-09-12T17:06:49.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00077121100000000005 2024-09-12T17:06:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441931+0000", 2024-09-12T17:06:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4338999999999993e-05 2024-09-12T17:06:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441997+0000", 2024-09-12T17:06:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6153000000000002e-05 2024-09-12T17:06:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.587 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:06:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 49.978345273000002, 2024-09-12T17:06:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032820639999999999, 2024-09-12T17:06:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.588 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 925 2024-09-12T17:06:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:06:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:06:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468831+0000", 2024-09-12T17:06:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1459999999999999e-06 2024-09-12T17:06:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468842+0000", 2024-09-12T17:06:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0727000000000001e-05 2024-09-12T17:06:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468874+0000", 2024-09-12T17:06:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2261999999999997e-05 2024-09-12T17:06:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468888+0000", 2024-09-12T17:06:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4507e-05 2024-09-12T17:06:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469011+0000", 2024-09-12T17:06:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012317599999999999 2024-09-12T17:06:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469252+0000", 2024-09-12T17:06:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024031500000000001 2024-09-12T17:06:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469575+0000", 2024-09-12T17:06:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032279699999999999 2024-09-12T17:06:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.470640+0000", 2024-09-12T17:06:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001065262 2024-09-12T17:06:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.471902+0000", 2024-09-12T17:06:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001262504 2024-09-12T17:06:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.471990+0000", 2024-09-12T17:06:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7552000000000005e-05 2024-09-12T17:06:49.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.472111+0000", 2024-09-12T17:06:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120816 2024-09-12T17:06:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.595 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:06:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 49.970943597999998, 2024-09-12T17:06:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030855499999999998, 2024-09-12T17:06:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 928 2024-09-12T17:06:49.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:06:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:06:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:49.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476232+0000", 2024-09-12T17:06:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9769999999999999e-06 2024-09-12T17:06:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476242+0000", 2024-09-12T17:06:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0003000000000001e-05 2024-09-12T17:06:49.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476269+0000", 2024-09-12T17:06:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6727e-05 2024-09-12T17:06:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476288+0000", 2024-09-12T17:06:49.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8649999999999999e-05 2024-09-12T17:06:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476400+0000", 2024-09-12T17:06:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111959 2024-09-12T17:06:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476614+0000", 2024-09-12T17:06:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000214465 2024-09-12T17:06:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476920+0000", 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030588700000000002 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.478203+0000", 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001282547 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479162+0000", 2024-09-12T17:06:49.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095971299999999995 2024-09-12T17:06:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479249+0000", 2024-09-12T17:06:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6959000000000005e-05 2024-09-12T17:06:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479316+0000", 2024-09-12T17:06:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6662999999999995e-05 2024-09-12T17:06:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.603 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:49.604 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:49.604 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:49.605 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:49.605 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:49.606 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:49.606 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:49.607 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:06:49.607 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:49.598+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:49.608 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:49.608 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:49.609 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:49.609 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:49.609 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:49.626 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:49.626 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:49.660 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:49.660 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:49.706 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:49.702+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:49.786 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:49.786 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:49.802 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:06:49.846 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:49.842+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:49.910 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:49.904+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:49.974 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:49.975 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:49.989 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:06:50.011 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:50.004+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:50.025 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T17:06:50.112 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:50.106+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:50.122 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:50.122 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:50.137 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:06:50.213 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:50.208+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:50.312 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:50.312 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:50.313 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:50.306+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:50.327 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:06:50.414 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:50.408+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:50.499 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:50.499 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:50.515 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:06:50.516 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:50.508+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:50.616 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:50.610+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:50.643 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:50.643 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:50.659 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:06:50.717 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:50.712+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:50.818 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:50.814+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:50.831 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:50.831 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:50.846 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:06:50.918 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:50.912+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:51.015 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:51.015 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:51.019 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:51.012+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:51.030 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:06:51.121 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:51.116+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:51.155 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:51.155 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:51.169 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:06:51.222 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:51.216+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:51.323 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:51.322+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:51.342 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:51.342 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:51.362 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:06:51.448 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:51.444+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:51.525 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:51.518+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:51.573 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:51.573 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:51.590 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:06:51.626 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:51.622+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:51.683 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:06:51.727 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:51.722+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:51.802 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:51.802 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:51.821 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:06:51.827 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:51.822+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:51.885 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:51.886 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:51.917 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:51.917 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:51.928 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:51.924+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:51.947 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:51.948 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:51.978 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:51.979 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:51.995 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:51.995 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:51.995 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:51.995 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:52.011 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:52.012 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:52.013 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:06:52.045 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:52.046 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:52.046 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:52.040+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:52.046 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T17:06:52.079 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:52.080 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:52.113 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:52.114 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:52.130 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:52.124+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:52.223 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:52.223 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:52.223 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:52.231 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:52.226+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:52.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:06:52.331 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:52.326+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:52.416 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.885596808000003, 2024-09-12T17:06:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:06:52.416 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:06:52.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:06:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:06:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 56.727964612000001, 2024-09-12T17:06:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:06:52.421 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:06:52.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:06:52.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.817870818999999, 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:06:52.427 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:06:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:06:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:06:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:06:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:06:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:06:52.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.801980078, 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.434 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:06:52.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.776511407999998, 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.440 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:06:52.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:06:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:06:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:06:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:06:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:06:52.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.757550307000002, 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.446 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:06:52.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:06:52.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.722995007000002, 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.452 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:06:52.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:06:52.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:06:52.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:06:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.409775594000003, 2024-09-12T17:06:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:06:52.458 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:06:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:06:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:06:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:06:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:06:52.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.464 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.404884226, 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.465 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:06:52.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.470 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.365908767000001, 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.471 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:06:52.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:06:52.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.362010793000003, 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.477 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:06:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:06:52.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:06:52.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.293251560999998, 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:06:52.483 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:06:52.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.489 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.257407547, 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:52.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:06:52.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:06:52.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:06:52.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:06:52.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:06:52.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:06:52.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.495 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.237220176000001, 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.496 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:06:52.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:06:52.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:06:52.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.232325813999999, 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.502 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:06:52.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:06:52.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:06:52.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.507 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.170357658999997, 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.508 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.509 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:06:52.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:06:52.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:06:52.513 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.165950883999997, 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.514 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:06:52.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:06:52.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:06:52.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:06:52.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:06:52.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:06:52.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:06:52.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.998551542000001, 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.520 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:06:52.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.967776508999997, 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.526 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:06:52.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 52.962864254000003, 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:52.532 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:06:52.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:52.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:06:52.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:06:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:06:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:06:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:52.538 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:52.538 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:52.540 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:06:52.540 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:52.538+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:52.641 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:52.638+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:52.713 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:52.713 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:52.714 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:52.732 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:06:52.776 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:52.772+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:52.841 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:52.834+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:52.903 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:52.903 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:52.903 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:52.903 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:52.904 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:52.921 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:06:52.942 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:52.938+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:53.031 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T17:06:53.043 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:53.036+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:53.097 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:53.097 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:53.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.494146602999997, 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027134059999999998, 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:53.098 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 42 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600336+0000", 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1270000000000001e-06 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600346+0000", 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.499e-06 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600370+0000", 2024-09-12T17:06:53.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4411000000000001e-05 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600386+0000", 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6205000000000002e-05 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600471+0000", 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5013999999999996e-05 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600569+0000", 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7663000000000003e-05 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600677+0000", 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108571 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.601918+0000", 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012408090000000001 2024-09-12T17:06:53.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.602976+0000", 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001058217 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603016+0000", 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9894000000000001e-05 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603047+0000", 2024-09-12T17:06:53.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0995999999999999e-05 2024-09-12T17:06:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.513091007, 2024-09-12T17:06:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002848798, 2024-09-12T17:06:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.104 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 52 2024-09-12T17:06:53.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.105 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:53.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:53.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581393+0000", 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4070000000000002e-06 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581405+0000", 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581439+0000", 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3966e-05 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581457+0000", 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7842999999999998e-05 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581567+0000", 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011048900000000001 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581754+0000", 2024-09-12T17:06:53.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018672099999999999 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581913+0000", 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015923700000000001 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.583010+0000", 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001096947 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584083+0000", 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010725730000000001 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584168+0000", 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4981999999999994e-05 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584238+0000", 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0747000000000006e-05 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.110 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.394836355999999, 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003254804, 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.111 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 236 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699647+0000", 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1300000000000001e-06 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699660+0000", 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2326e-05 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699694+0000", 2024-09-12T17:06:53.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4552999999999999e-05 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699710+0000", 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5573000000000002e-05 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699835+0000", 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012534300000000001 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700050+0000", 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214565 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700448+0000", 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039816999999999999 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702129+0000", 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001680874 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702721+0000", 2024-09-12T17:06:53.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00059224199999999999 2024-09-12T17:06:53.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702804+0000", 2024-09-12T17:06:53.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3071999999999993e-05 2024-09-12T17:06:53.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702899+0000", 2024-09-12T17:06:53.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4956000000000004e-05 2024-09-12T17:06:53.117 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.117 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.117 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.382395829000004, 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026770299999999999, 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 271 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712086+0000", 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3510000000000001e-06 2024-09-12T17:06:53.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712092+0000", 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5670000000000002e-06 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712105+0000", 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3438000000000001e-05 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712112+0000", 2024-09-12T17:06:53.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6229999999999999e-06 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712181+0000", 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9323e-05 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712327+0000", 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014620900000000001 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712530+0000", 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020267700000000001 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.713251+0000", 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072110800000000004 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714674+0000", 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001423021 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714718+0000", 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4459000000000002e-05 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714762+0000", 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3254000000000003e-05 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.123 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:287 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.379169345999998, 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034654030000000001, 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 287 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:53.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:53.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715312+0000", 2024-09-12T17:06:53.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1340000000000001e-06 2024-09-12T17:06:53.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715318+0000", 2024-09-12T17:06:53.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8409999999999996e-06 2024-09-12T17:06:53.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715332+0000", 2024-09-12T17:06:53.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4265e-05 2024-09-12T17:06:53.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715342+0000", 2024-09-12T17:06:53.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3360000000000001e-06 2024-09-12T17:06:53.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715412+0000", 2024-09-12T17:06:53.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9980000000000004e-05 2024-09-12T17:06:53.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715511+0000", 2024-09-12T17:06:53.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9197000000000006e-05 2024-09-12T17:06:53.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715663+0000", 2024-09-12T17:06:53.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152347 2024-09-12T17:06:53.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.716287+0000", 2024-09-12T17:06:53.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00062330100000000004 2024-09-12T17:06:53.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718705+0000", 2024-09-12T17:06:53.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002418505 2024-09-12T17:06:53.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718743+0000", 2024-09-12T17:06:53.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7645999999999998e-05 2024-09-12T17:06:53.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718777+0000", 2024-09-12T17:06:53.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3850999999999998e-05 2024-09-12T17:06:53.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.131 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.131 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.131 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.131 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:53.131 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.069689492999998, 2024-09-12T17:06:53.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028821710000000002, 2024-09-12T17:06:53.131 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.131 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 742 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024794+0000", 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7669999999999999e-06 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024805+0000", 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1093e-05 2024-09-12T17:06:53.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024836+0000", 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1136000000000001e-05 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024852+0000", 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6140000000000001e-05 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024989+0000", 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000136422 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025219+0000", 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008499999999999 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025545+0000", 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032645100000000001 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.026827+0000", 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00128202 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027470+0000", 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00064248199999999999 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027556+0000", 2024-09-12T17:06:53.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6533000000000007e-05 2024-09-12T17:06:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027673+0000", 2024-09-12T17:06:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117042 2024-09-12T17:06:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.138 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.138 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:53.138 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.065953282000002, 2024-09-12T17:06:53.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002617173, 2024-09-12T17:06:53.138 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.138 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.138 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.138 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 744 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:53.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028529+0000", 2024-09-12T17:06:53.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8500000000000001e-06 2024-09-12T17:06:53.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028540+0000", 2024-09-12T17:06:53.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-05 2024-09-12T17:06:53.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028565+0000", 2024-09-12T17:06:53.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5083e-05 2024-09-12T17:06:53.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028577+0000", 2024-09-12T17:06:53.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2434e-05 2024-09-12T17:06:53.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028679+0000", 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101489 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028800+0000", 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012089199999999999 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.029070+0000", 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000270358 2024-09-12T17:06:53.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030114+0000", 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001043832 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030994+0000", 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087969000000000003 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031082+0000", 2024-09-12T17:06:53.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7825999999999996e-05 2024-09-12T17:06:53.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031144+0000", 2024-09-12T17:06:53.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2829000000000004e-05 2024-09-12T17:06:53.144 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.144 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.144 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.026791156999998, 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027655549999999998, 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 760 2024-09-12T17:06:53.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067692+0000", 2024-09-12T17:06:53.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4200000000000001e-06 2024-09-12T17:06:53.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067706+0000", 2024-09-12T17:06:53.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.382e-05 2024-09-12T17:06:53.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067739+0000", 2024-09-12T17:06:53.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3253000000000002e-05 2024-09-12T17:06:53.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067763+0000", 2024-09-12T17:06:53.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4026e-05 2024-09-12T17:06:53.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067912+0000", 2024-09-12T17:06:53.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014959199999999999 2024-09-12T17:06:53.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068127+0000", 2024-09-12T17:06:53.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021487500000000001 2024-09-12T17:06:53.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068438+0000", 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031070400000000003 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.069550+0000", 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011116159999999999 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070301+0000", 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075135000000000002 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070390+0000", 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8516000000000004e-05 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070455+0000", 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5382999999999994e-05 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.890568928, 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031165260000000001, 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 817 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203915+0000", 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.146e-06 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203926+0000", 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1379999999999999e-05 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203958+0000", 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2239000000000001e-05 2024-09-12T17:06:53.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203973+0000", 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.47e-05 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204156+0000", 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018277899999999999 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204392+0000", 2024-09-12T17:06:53.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000236658 2024-09-12T17:06:53.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204705+0000", 2024-09-12T17:06:53.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000312248 2024-09-12T17:06:53.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.205983+0000", 2024-09-12T17:06:53.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001278387 2024-09-12T17:06:53.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206726+0000", 2024-09-12T17:06:53.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074269799999999997 2024-09-12T17:06:53.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206909+0000", 2024-09-12T17:06:53.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018368200000000001 2024-09-12T17:06:53.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.207028+0000", 2024-09-12T17:06:53.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118609 2024-09-12T17:06:53.158 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.158 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.158 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.158 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.158 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:53.158 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.886287277999998, 2024-09-12T17:06:53.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003050269, 2024-09-12T17:06:53.159 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.159 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.159 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.159 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.159 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 819 2024-09-12T17:06:53.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.160 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:53.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:53.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208196+0000", 2024-09-12T17:06:53.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4569999999999999e-06 2024-09-12T17:06:53.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208207+0000", 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208241+0000", 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3936000000000002e-05 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208256+0000", 2024-09-12T17:06:53.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5917e-05 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208383+0000", 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012605200000000001 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208602+0000", 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219908 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.209077+0000", 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047489299999999999 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210285+0000", 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012075110000000001 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210979+0000", 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069376099999999999 2024-09-12T17:06:53.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211131+0000", 2024-09-12T17:06:53.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151915 2024-09-12T17:06:53.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211243+0000", 2024-09-12T17:06:53.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112989 2024-09-12T17:06:53.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.166 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.166 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.166 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.166 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:53.166 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.831541553999998, 2024-09-12T17:06:53.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0035006659999999999, 2024-09-12T17:06:53.167 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.167 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.167 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.167 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.167 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.167 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.168 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 841 2024-09-12T17:06:53.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.168 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.168 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:53.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:53.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262942+0000", 2024-09-12T17:06:53.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6900000000000001e-06 2024-09-12T17:06:53.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262953+0000", 2024-09-12T17:06:53.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1323e-05 2024-09-12T17:06:53.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262989+0000", 2024-09-12T17:06:53.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5617000000000001e-05 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263006+0000", 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7713000000000001e-05 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263177+0000", 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170249 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.171 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263551+0000", 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037421999999999998 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.264122+0000", 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057113200000000002 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.265539+0000", 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001417012 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266170+0000", 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063154599999999997 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266330+0000", 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926800000000001 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266440+0000", 2024-09-12T17:06:53.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010989600000000001 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.826840566999998, 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032057850000000001, 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.174 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 843 2024-09-12T17:06:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267642+0000", 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267653+0000", 2024-09-12T17:06:53.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0664e-05 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267687+0000", 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4112999999999997e-05 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267703+0000", 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5673000000000001e-05 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267832+0000", 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012896500000000001 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268054+0000", 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022279600000000001 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268561+0000", 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050617200000000005 2024-09-12T17:06:53.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.269801+0000", 2024-09-12T17:06:53.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012401269999999999 2024-09-12T17:06:53.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270562+0000", 2024-09-12T17:06:53.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076129699999999997 2024-09-12T17:06:53.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270716+0000", 2024-09-12T17:06:53.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000154339 2024-09-12T17:06:53.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270846+0000", 2024-09-12T17:06:53.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930600000000001 2024-09-12T17:06:53.181 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.181 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.181 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.181 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.181 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:53.181 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.816008906999997, 2024-09-12T17:06:53.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033822100000000001, 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 847 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:53.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278474+0000", 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4930000000000001e-06 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.183 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278485+0000", 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1313e-05 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278518+0000", 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2517000000000001e-05 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278533+0000", 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939999999999999e-05 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278689+0000", 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015628899999999999 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279066+0000", 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000377337 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279610+0000", 2024-09-12T17:06:53.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00054380900000000002 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281130+0000", 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001519488 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281583+0000", 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00045297300000000001 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281738+0000", 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015484900000000001 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281854+0000", 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116202 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:53.187 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.811393402999997, 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883554, 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 849 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:53.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:53.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.189 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283090+0000", 2024-09-12T17:06:53.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:53.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283102+0000", 2024-09-12T17:06:53.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.204e-05 2024-09-12T17:06:53.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283136+0000", 2024-09-12T17:06:53.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3983000000000003e-05 2024-09-12T17:06:53.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283152+0000", 2024-09-12T17:06:53.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6082999999999998e-05 2024-09-12T17:06:53.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283278+0000", 2024-09-12T17:06:53.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000126212 2024-09-12T17:06:53.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283505+0000", 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022724900000000001 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283971+0000", 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046550600000000003 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285223+0000", 2024-09-12T17:06:53.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012519370000000001 2024-09-12T17:06:53.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285811+0000", 2024-09-12T17:06:53.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058819199999999997 2024-09-12T17:06:53.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285904+0000", 2024-09-12T17:06:53.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3410000000000002e-05 2024-09-12T17:06:53.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285971+0000", 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6391999999999997e-05 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.763440488999997, 2024-09-12T17:06:53.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033550770000000001, 2024-09-12T17:06:53.195 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.195 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.195 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.195 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.195 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.195 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.195 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 868 2024-09-12T17:06:53.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.195 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331043+0000", 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331054+0000", 2024-09-12T17:06:53.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.131e-05 2024-09-12T17:06:53.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331086+0000", 2024-09-12T17:06:53.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-12T17:06:53.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331101+0000", 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5016e-05 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331253+0000", 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151929 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331616+0000", 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036285100000000003 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:53.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.332174+0000", 2024-09-12T17:06:53.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055856199999999997 2024-09-12T17:06:53.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.333700+0000", 2024-09-12T17:06:53.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015259480000000001 2024-09-12T17:06:53.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334120+0000", 2024-09-12T17:06:53.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042021700000000002 2024-09-12T17:06:53.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334280+0000", 2024-09-12T17:06:53.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159949 2024-09-12T17:06:53.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334395+0000", 2024-09-12T17:06:53.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114679 2024-09-12T17:06:53.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.201 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.201 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.201 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:53.201 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.758982697999997, 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003066923, 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 870 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:53.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:53.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335500+0000", 2024-09-12T17:06:53.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4040000000000002e-06 2024-09-12T17:06:53.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335511+0000", 2024-09-12T17:06:53.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.045e-05 2024-09-12T17:06:53.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335542+0000", 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1542999999999999e-05 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335558+0000", 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.535e-05 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335698+0000", 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014063899999999999 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335930+0000", 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000231435 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.336392+0000", 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046211199999999998 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.337568+0000", 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001176671 2024-09-12T17:06:53.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338407+0000", 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083885399999999999 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338491+0000", 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4159000000000005e-05 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338565+0000", 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3306000000000006e-05 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.207 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.670793955000001, 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027821550000000001, 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.208 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.209 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 907 2024-09-12T17:06:53.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.209 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:53.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:53.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423690+0000", 2024-09-12T17:06:53.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-12T17:06:53.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423702+0000", 2024-09-12T17:06:53.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2404e-05 2024-09-12T17:06:53.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423735+0000", 2024-09-12T17:06:53.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3062999999999998e-05 2024-09-12T17:06:53.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423750+0000", 2024-09-12T17:06:53.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4912999999999999e-05 2024-09-12T17:06:53.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423919+0000", 2024-09-12T17:06:53.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016838899999999999 2024-09-12T17:06:53.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424160+0000", 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024105099999999999 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424492+0000", 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033261100000000002 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.425785+0000", 2024-09-12T17:06:53.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001292397 2024-09-12T17:06:53.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426322+0000", 2024-09-12T17:06:53.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00053743200000000001 2024-09-12T17:06:53.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426403+0000", 2024-09-12T17:06:53.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0898999999999999e-05 2024-09-12T17:06:53.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426469+0000", 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5720000000000001e-05 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.571628267000001, 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029674670000000001, 2024-09-12T17:06:53.215 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 949 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522855+0000", 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522871+0000", 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5950000000000001e-05 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522906+0000", 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316000000000001e-05 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522924+0000", 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8326999999999999e-05 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523047+0000", 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123609 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523282+0000", 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234465 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523606+0000", 2024-09-12T17:06:53.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032453099999999997 2024-09-12T17:06:53.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.524804+0000", 2024-09-12T17:06:53.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011977509999999999 2024-09-12T17:06:53.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525626+0000", 2024-09-12T17:06:53.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082216400000000001 2024-09-12T17:06:53.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525743+0000", 2024-09-12T17:06:53.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116679 2024-09-12T17:06:53.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525820+0000", 2024-09-12T17:06:53.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6631999999999994e-05 2024-09-12T17:06:53.221 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.221 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.222 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.222 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:53.222 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.557904593000004, 2024-09-12T17:06:53.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030602540000000001, 2024-09-12T17:06:53.222 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.222 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 955 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536578+0000", 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536590+0000", 2024-09-12T17:06:53.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1250000000000001e-05 2024-09-12T17:06:53.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536624+0000", 2024-09-12T17:06:53.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4227000000000003e-05 2024-09-12T17:06:53.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536646+0000", 2024-09-12T17:06:53.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2195999999999999e-05 2024-09-12T17:06:53.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536794+0000", 2024-09-12T17:06:53.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014799600000000001 2024-09-12T17:06:53.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537005+0000", 2024-09-12T17:06:53.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021096799999999999 2024-09-12T17:06:53.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537489+0000", 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048413599999999997 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.538940+0000", 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001451262 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539441+0000", 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050002300000000005 2024-09-12T17:06:53.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539535+0000", 2024-09-12T17:06:53.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4526999999999998e-05 2024-09-12T17:06:53.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539636+0000", 2024-09-12T17:06:53.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010111900000000001 2024-09-12T17:06:53.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.228 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.228 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.229 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.229 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:53.229 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 53.553647259000002, 2024-09-12T17:06:53.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030889300000000001, 2024-09-12T17:06:53.229 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.229 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.229 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.229 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.229 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 957 2024-09-12T17:06:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:53.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540836+0000", 2024-09-12T17:06:53.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:53.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540862+0000", 2024-09-12T17:06:53.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999999e-05 2024-09-12T17:06:53.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540891+0000", 2024-09-12T17:06:53.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9595999999999999e-05 2024-09-12T17:06:53.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540906+0000", 2024-09-12T17:06:53.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4919999999999999e-05 2024-09-12T17:06:53.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541052+0000", 2024-09-12T17:06:53.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014583900000000001 2024-09-12T17:06:53.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541232+0000", 2024-09-12T17:06:53.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180259 2024-09-12T17:06:53.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:53.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541500+0000", 2024-09-12T17:06:53.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026788799999999998 2024-09-12T17:06:53.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.542483+0000", 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000983142 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543756+0000", 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001272977 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543842+0000", 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5748999999999995e-05 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.236 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543922+0000", 2024-09-12T17:06:53.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0000000000000007e-05 2024-09-12T17:06:53.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.236 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.236 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.236 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.236 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:53.238 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:06:53.238 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:53.232+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:53.338 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:53.334+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:53.392 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:53.392 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:53.392 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:53.405 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:06:53.439 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:53.438+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:53.514 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:53.514 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:53.515 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:53.531 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:06:53.539 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:53.534+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:53.640 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:53.636+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:53.646 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:53.646 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:53.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:53.646 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.097742126999997, 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011583833, 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 44 2024-09-12T17:06:53.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.648 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:53.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:53.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544942+0000", 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.653e-06 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544957+0000", 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5654e-05 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544993+0000", 2024-09-12T17:06:53.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5936000000000003e-05 2024-09-12T17:06:53.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.545017+0000", 2024-09-12T17:06:53.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3283000000000001e-05 2024-09-12T17:06:53.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549277+0000", 2024-09-12T17:06:53.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042606800000000002 2024-09-12T17:06:53.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549301+0000", 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3260000000000001e-05 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556317+0000", 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070164620000000002 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556522+0000", 2024-09-12T17:06:53.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020490499999999999 2024-09-12T17:06:53.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.652 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.652 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:53.652 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:53.652 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.054276581000003, 2024-09-12T17:06:53.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054133180000000003, 2024-09-12T17:06:53.652 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 207 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588408+0000", 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588428+0000", 2024-09-12T17:06:53.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9910000000000001e-05 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588467+0000", 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588483+0000", 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6443000000000002e-05 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588659+0000", 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569499999999999 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589033+0000", 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037374100000000003 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589729+0000", 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069659400000000003 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593394+0000", 2024-09-12T17:06:53.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036653279999999998 2024-09-12T17:06:53.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593661+0000", 2024-09-12T17:06:53.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026662499999999999 2024-09-12T17:06:53.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593743+0000", 2024-09-12T17:06:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1428999999999996e-05 2024-09-12T17:06:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593817+0000", 2024-09-12T17:06:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4475999999999996e-05 2024-09-12T17:06:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.658 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 55.018055881000002, 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034289839999999999, 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 216 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624628+0000", 2024-09-12T17:06:53.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2399999999999999e-06 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624641+0000", 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3743e-05 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624675+0000", 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3277e-05 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624690+0000", 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5812999999999999e-05 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624847+0000", 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156269 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625092+0000", 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024499500000000002 2024-09-12T17:06:53.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625494+0000", 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040263000000000001 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.626934+0000", 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001439159 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627890+0000", 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095619599999999998 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627978+0000", 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8446e-05 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.628053+0000", 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5216000000000006e-05 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.664 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.976547638, 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003364985, 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 227 2024-09-12T17:06:53.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.666 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:53.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:53.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666135+0000", 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.644e-06 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666147+0000", 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1960000000000001e-05 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666179+0000", 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1813000000000002e-05 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666195+0000", 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5679999999999999e-05 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666342+0000", 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147312 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666559+0000", 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021664199999999999 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.667037+0000", 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047816200000000002 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.668796+0000", 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017590010000000001 2024-09-12T17:06:53.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669346+0000", 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055024499999999999 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669433+0000", 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6650000000000006e-05 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669498+0000", 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4875999999999993e-05 2024-09-12T17:06:53.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.969340379000002, 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031932409999999999, 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 229 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673342+0000", 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3499999999999999e-06 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673354+0000", 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1739999999999999e-05 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673386+0000", 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1782000000000002e-05 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673400+0000", 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4663e-05 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673577+0000", 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017662900000000001 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673783+0000", 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020620799999999999 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.674174+0000", 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039082100000000002 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.675441+0000", 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001267177 2024-09-12T17:06:53.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676382+0000", 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094087900000000004 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676468+0000", 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5762999999999999e-05 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676533+0000", 2024-09-12T17:06:53.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5228999999999995e-05 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.961597456, 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0037357380000000002, 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 231 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:53.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681085+0000", 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681096+0000", 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0866000000000001e-05 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681126+0000", 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9977000000000001e-05 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681140+0000", 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4195999999999999e-05 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681288+0000", 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014765199999999999 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681637+0000", 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034917100000000001 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.682358+0000", 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072050800000000002 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684139+0000", 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017812399999999999 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684543+0000", 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040413299999999999 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684703+0000", 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160075 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684819+0000", 2024-09-12T17:06:53.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011553300000000001 2024-09-12T17:06:53.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.683 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.683 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.683 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:374 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.683 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:53.683 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.906720026000002, 2024-09-12T17:06:53.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031135910000000002, 2024-09-12T17:06:53.683 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 374 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735961+0000", 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0979999999999999e-06 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735968+0000", 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735981+0000", 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3164e-05 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735989+0000", 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8010000000000004e-06 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736041+0000", 2024-09-12T17:06:53.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800999999999998e-05 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736137+0000", 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5497999999999999e-05 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736303+0000", 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016580100000000001 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736802+0000", 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049966599999999996 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739015+0000", 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022122919999999998 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739047+0000", 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2678000000000001e-05 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739074+0000", 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6594e-05 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.681275282999998, 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029096640000000002, 2024-09-12T17:06:53.689 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 715 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961407+0000", 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961419+0000", 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.117e-05 2024-09-12T17:06:53.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961450+0000", 2024-09-12T17:06:53.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1463e-05 2024-09-12T17:06:53.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961465+0000", 2024-09-12T17:06:53.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-12T17:06:53.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961576+0000", 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111016 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961785+0000", 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020865599999999999 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.962105+0000", 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031996699999999999 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.963189+0000", 2024-09-12T17:06:53.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010845519999999999 2024-09-12T17:06:53.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964163+0000", 2024-09-12T17:06:53.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097355800000000002 2024-09-12T17:06:53.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964252+0000", 2024-09-12T17:06:53.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8996e-05 2024-09-12T17:06:53.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964315+0000", 2024-09-12T17:06:53.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2773000000000004e-05 2024-09-12T17:06:53.696 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.696 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.647004727000002, 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883207, 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.697 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 730 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995678+0000", 2024-09-12T17:06:53.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:06:53.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995689+0000", 2024-09-12T17:06:53.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1316e-05 2024-09-12T17:06:53.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995722+0000", 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995745+0000", 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3496999999999999e-05 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995902+0000", 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156446 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996113+0000", 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021091099999999999 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996444+0000", 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000330785 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.997558+0000", 2024-09-12T17:06:53.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001114681 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998420+0000", 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086125299999999998 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998497+0000", 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7919999999999999e-05 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998559+0000", 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1319e-05 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.628523162999997, 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002862248, 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.703 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 738 2024-09-12T17:06:53.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.704 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:53.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014159+0000", 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014168+0000", 2024-09-12T17:06:53.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.653e-06 2024-09-12T17:06:53.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014191+0000", 2024-09-12T17:06:53.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3706e-05 2024-09-12T17:06:53.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014213+0000", 2024-09-12T17:06:53.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2050000000000001e-05 2024-09-12T17:06:53.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014363+0000", 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014956299999999999 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014485+0000", 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000122132 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014770+0000", 2024-09-12T17:06:53.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000284911 2024-09-12T17:06:53.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.015864+0000", 2024-09-12T17:06:53.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010942180000000001 2024-09-12T17:06:53.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016864+0000", 2024-09-12T17:06:53.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00099982299999999994 2024-09-12T17:06:53.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016951+0000", 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6476000000000003e-05 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.017019+0000", 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8756000000000004e-05 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.546201785000001, 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032495950000000001, 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 772 2024-09-12T17:06:53.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096481+0000", 2024-09-12T17:06:53.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4399999999999999e-06 2024-09-12T17:06:53.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096492+0000", 2024-09-12T17:06:53.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1513e-05 2024-09-12T17:06:53.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096522+0000", 2024-09-12T17:06:53.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9156e-05 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096536+0000", 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4347e-05 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096681+0000", 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145348 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096896+0000", 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214489 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.097208+0000", 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031215099999999999 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.098332+0000", 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001123635 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099583+0000", 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00125179 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099663+0000", 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9703000000000006e-05 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099728+0000", 2024-09-12T17:06:53.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5023000000000004e-05 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.474459826, 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028771949999999999, 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 802 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:53.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168223+0000", 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4499999999999998e-06 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168234+0000", 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168265+0000", 2024-09-12T17:06:53.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0777e-05 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168279+0000", 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4525999999999999e-05 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168397+0000", 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118063 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168616+0000", 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000218505 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168970+0000", 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00035427400000000002 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170038+0000", 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001067571 2024-09-12T17:06:53.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170897+0000", 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085934399999999995 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170983+0000", 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6179000000000003e-05 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.171098+0000", 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114576 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.415660000000003, 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033328609999999999, 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 826 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227023+0000", 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227035+0000", 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227067+0000", 2024-09-12T17:06:53.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2305999999999999e-05 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227082+0000", 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.485e-05 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227247+0000", 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016483900000000001 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227630+0000", 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038350100000000001 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.228201+0000", 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057026799999999997 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.229556+0000", 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013553300000000001 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230084+0000", 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00052805599999999995 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230238+0000", 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015438499999999999 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230353+0000", 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114809 2024-09-12T17:06:53.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.356386643999997, 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033407710000000002, 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 850 2024-09-12T17:06:53.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.729 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:53.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:53.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286296+0000", 2024-09-12T17:06:53.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T17:06:53.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286307+0000", 2024-09-12T17:06:53.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1287000000000001e-05 2024-09-12T17:06:53.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286339+0000", 2024-09-12T17:06:53.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1331999999999997e-05 2024-09-12T17:06:53.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286353+0000", 2024-09-12T17:06:53.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4517e-05 2024-09-12T17:06:53.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286504+0000", 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015038200000000001 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286897+0000", 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039326399999999999 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.287451+0000", 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055426900000000003 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.288825+0000", 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013741160000000001 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289484+0000", 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00065819499999999998 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289570+0000", 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6383000000000003e-05 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289634+0000", 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4505999999999995e-05 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.318394726999998, 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002894237, 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.735 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 865 2024-09-12T17:06:53.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.735 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:53.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324288+0000", 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2469999999999998e-06 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324299+0000", 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0823e-05 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324330+0000", 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1846e-05 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324350+0000", 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9077e-05 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324463+0000", 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011367200000000001 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324693+0000", 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008800000000001 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.325000+0000", 2024-09-12T17:06:53.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030629499999999999 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.326117+0000", 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011175709999999999 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327026+0000", 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00090879000000000003 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327113+0000", 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7093000000000001e-05 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327180+0000", 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6735000000000004e-05 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.740 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.303881228999998, 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030741359999999999, 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 871 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338802+0000", 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:53.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338831+0000", 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9356000000000002e-05 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338868+0000", 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7357000000000002e-05 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338883+0000", 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4932999999999999e-05 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339036+0000", 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152423 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339264+0000", 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022814100000000001 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339593+0000", 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032943099999999998 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.340783+0000", 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011898740000000001 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341724+0000", 2024-09-12T17:06:53.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094134600000000002 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341809+0000", 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4155999999999999e-05 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341873+0000", 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4605999999999998e-05 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.246389168999997, 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003093649, 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 895 2024-09-12T17:06:53.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.748 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:53.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:53.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396294+0000", 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3999999999999999e-06 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396307+0000", 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3468999999999999e-05 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396338+0000", 2024-09-12T17:06:53.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1433000000000002e-05 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396353+0000", 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4557e-05 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396496+0000", 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014275900000000001 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396719+0000", 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022317499999999999 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.397052+0000", 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033263699999999999 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.398211+0000", 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011593350000000001 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399235+0000", 2024-09-12T17:06:53.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010241219999999999 2024-09-12T17:06:53.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399321+0000", 2024-09-12T17:06:53.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5789000000000001e-05 2024-09-12T17:06:53.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399385+0000", 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3973000000000006e-05 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.239902112999999, 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029302239999999999, 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.753 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 898 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402780+0000", 2024-09-12T17:06:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9269999999999999e-06 2024-09-12T17:06:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402789+0000", 2024-09-12T17:06:53.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7069999999999998e-06 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402830+0000", 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1470000000000001e-05 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402846+0000", 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5319e-05 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402938+0000", 2024-09-12T17:06:53.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2289999999999999e-05 2024-09-12T17:06:53.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403134+0000", 2024-09-12T17:06:53.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000196014 2024-09-12T17:06:53.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:53.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403437+0000", 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030337199999999999 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.404507+0000", 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001069492 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405432+0000", 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092532900000000002 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405590+0000", 2024-09-12T17:06:53.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158018 2024-09-12T17:06:53.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405708+0000", 2024-09-12T17:06:53.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118286 2024-09-12T17:06:53.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.759 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.759 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.154494851999999, 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030817499999999999, 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 934 2024-09-12T17:06:53.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488188+0000", 2024-09-12T17:06:53.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8040000000000002e-06 2024-09-12T17:06:53.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488201+0000", 2024-09-12T17:06:53.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2893e-05 2024-09-12T17:06:53.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488233+0000", 2024-09-12T17:06:53.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2085999999999997e-05 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488248+0000", 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4976e-05 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488415+0000", 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016677900000000001 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488650+0000", 2024-09-12T17:06:53.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234875 2024-09-12T17:06:53.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:53.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488961+0000", 2024-09-12T17:06:53.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031078799999999999 2024-09-12T17:06:53.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.490177+0000", 2024-09-12T17:06:53.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001216607 2024-09-12T17:06:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491119+0000", 2024-09-12T17:06:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000941806 2024-09-12T17:06:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491202+0000", 2024-09-12T17:06:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3349000000000004e-05 2024-09-12T17:06:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491267+0000", 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4787000000000002e-05 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 54.143675872000003, 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031107489999999999, 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:53.766 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 939 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499007+0000", 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3970000000000001e-06 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499018+0000", 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0969e-05 2024-09-12T17:06:53.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:53.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499052+0000", 2024-09-12T17:06:53.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3896999999999997e-05 2024-09-12T17:06:53.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:53.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499068+0000", 2024-09-12T17:06:53.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6552999999999999e-05 2024-09-12T17:06:53.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499200+0000", 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013206599999999999 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499438+0000", 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023806500000000001 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499922+0000", 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048369599999999998 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501326+0000", 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014036560000000001 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501962+0000", 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063623100000000001 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502048+0000", 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5636999999999993e-05 2024-09-12T17:06:53.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:53.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:53.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:53.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502115+0000", 2024-09-12T17:06:53.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7582000000000004e-05 2024-09-12T17:06:53.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.772 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.772 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:53.772 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:53.772 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:53.774 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:06:53.774 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:53.768+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:53.874 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:53.868+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:53.911 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:53.911 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:53.911 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:06:53.911 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:53.925 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:06:53.975 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:53.968+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:54.052 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:54.052 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:54.052 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:54.068 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:06:54.076 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:54.072+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:54.138 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:06:54.184 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:54.180+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:54.194 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:54.194 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:06:54.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:06:54.195 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:06:54.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.195 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.195 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:06:54.195 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.584302645999998, 2024-09-12T17:06:54.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003566582, 2024-09-12T17:06:54.195 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.195 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.195 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.195 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.195 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.196 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.196 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 211 2024-09-12T17:06:54.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.196 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:06:54.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608233+0000", 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.343e-06 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608248+0000", 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4747e-05 2024-09-12T17:06:54.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608285+0000", 2024-09-12T17:06:54.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7239e-05 2024-09-12T17:06:54.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608302+0000", 2024-09-12T17:06:54.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6909999999999999e-05 2024-09-12T17:06:54.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608454+0000", 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015164599999999999 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608666+0000", 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021213499999999999 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.609092+0000", 2024-09-12T17:06:54.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042601999999999999 2024-09-12T17:06:54.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.610771+0000", 2024-09-12T17:06:54.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016786940000000001 2024-09-12T17:06:54.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611640+0000", 2024-09-12T17:06:54.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00086891300000000002 2024-09-12T17:06:54.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611731+0000", 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1058999999999997e-05 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611796+0000", 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5876000000000004e-05 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.202 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.202 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:06:54.202 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.505332629000002, 2024-09-12T17:06:54.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035636330000000001, 2024-09-12T17:06:54.202 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.202 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.202 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 232 2024-09-12T17:06:54.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.203 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:06:54.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:06:54.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687203+0000", 2024-09-12T17:06:54.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T17:06:54.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687216+0000", 2024-09-12T17:06:54.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346999999999999e-05 2024-09-12T17:06:54.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687250+0000", 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3992999999999998e-05 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687266+0000", 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.577e-05 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687402+0000", 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013599599999999999 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687630+0000", 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228168 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.688057+0000", 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042653999999999999 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.689651+0000", 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015945009999999999 2024-09-12T17:06:54.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690608+0000", 2024-09-12T17:06:54.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095638899999999998 2024-09-12T17:06:54.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690694+0000", 2024-09-12T17:06:54.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6119000000000007e-05 2024-09-12T17:06:54.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690764+0000", 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9757000000000003e-05 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.484886199999998, 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030740059999999998, 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.208 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 241 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707649+0000", 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707661+0000", 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2e-05 2024-09-12T17:06:54.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707693+0000", 2024-09-12T17:06:54.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2299999999999999e-05 2024-09-12T17:06:54.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707709+0000", 2024-09-12T17:06:54.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6096e-05 2024-09-12T17:06:54.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707871+0000", 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016122200000000001 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.708198+0000", 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032765799999999999 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.708655+0000", 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00045698599999999999 2024-09-12T17:06:54.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710022+0000", 2024-09-12T17:06:54.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013664059999999999 2024-09-12T17:06:54.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710578+0000", 2024-09-12T17:06:54.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055600199999999999 2024-09-12T17:06:54.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710650+0000", 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2767000000000003e-05 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710720+0000", 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9839000000000007e-05 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.214 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:434 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.432103290999997, 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030966930000000002, 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 434 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760432+0000", 2024-09-12T17:06:54.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4540000000000001e-06 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760443+0000", 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1123e-05 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760473+0000", 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0476000000000001e-05 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760493+0000", 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9502999999999999e-05 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760616+0000", 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123509 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760776+0000", 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000159462 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.761216+0000", 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000440474 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762555+0000", 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338926 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763288+0000", 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00073298000000000005 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763434+0000", 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145544 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763526+0000", 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2242000000000002e-05 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.221 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:445 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.221 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:06:54.221 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.425205320000003, 2024-09-12T17:06:54.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029347829999999998, 2024-09-12T17:06:54.221 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.221 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.221 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.221 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.221 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.221 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.221 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 445 2024-09-12T17:06:54.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767330+0000", 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8229999999999999e-06 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767343+0000", 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2869e-05 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767373+0000", 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0294000000000002e-05 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767392+0000", 2024-09-12T17:06:54.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.91e-05 2024-09-12T17:06:54.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767522+0000", 2024-09-12T17:06:54.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000130152 2024-09-12T17:06:54.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767688+0000", 2024-09-12T17:06:54.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016599900000000001 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.768155+0000", 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046654299999999998 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.769308+0000", 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001153165 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770069+0000", 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076044000000000003 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770155+0000", 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6493e-05 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770262+0000", 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010690499999999999 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.226 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:06:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.395467781999997, 2024-09-12T17:06:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039867009999999996, 2024-09-12T17:06:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.227 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.228 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 504 2024-09-12T17:06:54.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.228 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:06:54.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:06:54.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797067+0000", 2024-09-12T17:06:54.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:06:54.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797078+0000", 2024-09-12T17:06:54.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0837e-05 2024-09-12T17:06:54.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797108+0000", 2024-09-12T17:06:54.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9722000000000001e-05 2024-09-12T17:06:54.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797127+0000", 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9539999999999999e-05 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797249+0000", 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121239 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797551+0000", 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030277400000000001 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:54.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.798161+0000", 2024-09-12T17:06:54.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00060936200000000001 2024-09-12T17:06:54.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.799307+0000", 2024-09-12T17:06:54.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001146588 2024-09-12T17:06:54.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.800728+0000", 2024-09-12T17:06:54.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014204389999999999 2024-09-12T17:06:54.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.800831+0000", 2024-09-12T17:06:54.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103002 2024-09-12T17:06:54.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.801051+0000", 2024-09-12T17:06:54.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022061499999999999 2024-09-12T17:06:54.234 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.234 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.234 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.234 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:626 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.234 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:06:54.234 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.313716579999998, 2024-09-12T17:06:54.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032539040000000002, 2024-09-12T17:06:54.234 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.235 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.235 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.235 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.235 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.235 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.235 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 626 2024-09-12T17:06:54.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.235 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:06:54.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:06:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878819+0000", 2024-09-12T17:06:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6699999999999998e-06 2024-09-12T17:06:54.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878831+0000", 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2882e-05 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878862+0000", 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0332999999999999e-05 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878880+0000", 2024-09-12T17:06:54.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8236999999999998e-05 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879009+0000", 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012908599999999999 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879306+0000", 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029693100000000001 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:54.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879873+0000", 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056697200000000001 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881172+0000", 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001298766 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881880+0000", 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00070808500000000001 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881962+0000", 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2069000000000003e-05 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882070+0000", 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107873 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.240 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.241 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:06:54.241 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.309537212999999, 2024-09-12T17:06:54.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030425119999999998, 2024-09-12T17:06:54.241 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.241 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.241 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.241 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 633 2024-09-12T17:06:54.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.241 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882997+0000", 2024-09-12T17:06:54.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0530000000000001e-06 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883009+0000", 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1195e-05 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883037+0000", 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8484999999999999e-05 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883055+0000", 2024-09-12T17:06:54.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8467000000000001e-05 2024-09-12T17:06:54.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883196+0000", 2024-09-12T17:06:54.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014099499999999999 2024-09-12T17:06:54.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883444+0000", 2024-09-12T17:06:54.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000247758 2024-09-12T17:06:54.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883892+0000", 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044757299999999999 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885202+0000", 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001310587 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885879+0000", 2024-09-12T17:06:54.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00067645599999999998 2024-09-12T17:06:54.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885945+0000", 2024-09-12T17:06:54.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6575999999999994e-05 2024-09-12T17:06:54.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.886038+0000", 2024-09-12T17:06:54.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2367000000000005e-05 2024-09-12T17:06:54.246 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.247 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.247 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.247 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:644 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.247 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:06:54.247 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.299539779, 2024-09-12T17:06:54.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030197190000000001, 2024-09-12T17:06:54.247 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.247 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.247 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.247 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.248 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.248 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.248 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 644 2024-09-12T17:06:54.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.248 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:06:54.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892995+0000", 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1390000000000002e-06 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893004+0000", 2024-09-12T17:06:54.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3729999999999999e-06 2024-09-12T17:06:54.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893029+0000", 2024-09-12T17:06:54.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5058999999999998e-05 2024-09-12T17:06:54.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893041+0000", 2024-09-12T17:06:54.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1858000000000001e-05 2024-09-12T17:06:54.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893190+0000", 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014875199999999999 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893575+0000", 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038538 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.894140+0000", 2024-09-12T17:06:54.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056461200000000003 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895394+0000", 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012536100000000001 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895856+0000", 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046213 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895940+0000", 2024-09-12T17:06:54.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4808999999999994e-05 2024-09-12T17:06:54.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.896012+0000", 2024-09-12T17:06:54.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1996999999999995e-05 2024-09-12T17:06:54.253 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.253 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.253 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:711 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.239191085999998, 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00296547, 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 711 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.254 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953343+0000", 2024-09-12T17:06:54.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.046e-06 2024-09-12T17:06:54.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953353+0000", 2024-09-12T17:06:54.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4939999999999992e-06 2024-09-12T17:06:54.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953386+0000", 2024-09-12T17:06:54.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2919000000000001e-05 2024-09-12T17:06:54.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953405+0000", 2024-09-12T17:06:54.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9596999999999999e-05 2024-09-12T17:06:54.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953576+0000", 2024-09-12T17:06:54.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017032500000000001 2024-09-12T17:06:54.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953828+0000", 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025190800000000001 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.954297+0000", 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046897300000000002 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.955510+0000", 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012131139999999999 2024-09-12T17:06:54.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956183+0000", 2024-09-12T17:06:54.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00067301800000000005 2024-09-12T17:06:54.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956254+0000", 2024-09-12T17:06:54.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0786999999999998e-05 2024-09-12T17:06:54.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956307+0000", 2024-09-12T17:06:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3288999999999998e-05 2024-09-12T17:06:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:06:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.209280341000003, 2024-09-12T17:06:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029480109999999999, 2024-09-12T17:06:54.260 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.261 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.261 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.261 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 724 2024-09-12T17:06:54.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.261 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:06:54.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:06:54.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983255+0000", 2024-09-12T17:06:54.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4140000000000001e-06 2024-09-12T17:06:54.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983266+0000", 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1039999999999999e-05 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983298+0000", 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1949000000000002e-05 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983313+0000", 2024-09-12T17:06:54.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5296999999999999e-05 2024-09-12T17:06:54.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983416+0000", 2024-09-12T17:06:54.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102921 2024-09-12T17:06:54.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983578+0000", 2024-09-12T17:06:54.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000162244 2024-09-12T17:06:54.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:54.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983835+0000", 2024-09-12T17:06:54.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025741700000000002 2024-09-12T17:06:54.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.984947+0000", 2024-09-12T17:06:54.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011111949999999999 2024-09-12T17:06:54.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.985915+0000", 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00096828599999999995 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.986080+0000", 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016498500000000001 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.986200+0000", 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120263 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.266 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.201672172000002, 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029804559999999998, 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.267 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 727 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990862+0000", 2024-09-12T17:06:54.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0959999999999999e-06 2024-09-12T17:06:54.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990872+0000", 2024-09-12T17:06:54.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1039999999999996e-06 2024-09-12T17:06:54.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990897+0000", 2024-09-12T17:06:54.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5626000000000002e-05 2024-09-12T17:06:54.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990911+0000", 2024-09-12T17:06:54.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346000000000001e-05 2024-09-12T17:06:54.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990999+0000", 2024-09-12T17:06:54.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8887000000000005e-05 2024-09-12T17:06:54.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.991252+0000", 2024-09-12T17:06:54.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025290099999999998 2024-09-12T17:06:54.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:06:54.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.991617+0000", 2024-09-12T17:06:54.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036479399999999999 2024-09-12T17:06:54.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.992803+0000", 2024-09-12T17:06:54.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011859049999999999 2024-09-12T17:06:54.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993677+0000", 2024-09-12T17:06:54.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00087379199999999997 2024-09-12T17:06:54.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993774+0000", 2024-09-12T17:06:54.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7343000000000006e-05 2024-09-12T17:06:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993841+0000", 2024-09-12T17:06:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6662000000000007e-05 2024-09-12T17:06:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.273 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.086729480000002, 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035861349999999998, 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 775 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:06:54.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:06:54.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105806+0000", 2024-09-12T17:06:54.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9529999999999999e-06 2024-09-12T17:06:54.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105818+0000", 2024-09-12T17:06:54.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2447e-05 2024-09-12T17:06:54.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105851+0000", 2024-09-12T17:06:54.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2969999999999998e-05 2024-09-12T17:06:54.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105867+0000", 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5116999999999999e-05 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106011+0000", 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014498500000000001 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106382+0000", 2024-09-12T17:06:54.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037012699999999999 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106946+0000", 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056435199999999995 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.108269+0000", 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00132256 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109120+0000", 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00085151300000000003 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109274+0000", 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015367199999999999 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109389+0000", 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115439 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.279 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 55.081640618999998, 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031979489999999998, 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.280 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 777 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110894+0000", 2024-09-12T17:06:54.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4870000000000001e-06 2024-09-12T17:06:54.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110905+0000", 2024-09-12T17:06:54.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.098e-05 2024-09-12T17:06:54.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110938+0000", 2024-09-12T17:06:54.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:06:54.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110953+0000", 2024-09-12T17:06:54.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5058999999999999e-05 2024-09-12T17:06:54.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111080+0000", 2024-09-12T17:06:54.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000127033 2024-09-12T17:06:54.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111312+0000", 2024-09-12T17:06:54.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000231828 2024-09-12T17:06:54.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:54.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111791+0000", 2024-09-12T17:06:54.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00047926000000000002 2024-09-12T17:06:54.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.112965+0000", 2024-09-12T17:06:54.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011740209999999999 2024-09-12T17:06:54.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.113920+0000", 2024-09-12T17:06:54.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095542000000000001 2024-09-12T17:06:54.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.114009+0000", 2024-09-12T17:06:54.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8162000000000001e-05 2024-09-12T17:06:54.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.114090+0000", 2024-09-12T17:06:54.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1203000000000002e-05 2024-09-12T17:06:54.286 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.286 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.286 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.286 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.287 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:06:54.287 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 54.994030944999999, 2024-09-12T17:06:54.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030645529999999998, 2024-09-12T17:06:54.287 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.287 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.287 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.287 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.287 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.287 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.287 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 814 2024-09-12T17:06:54.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.287 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:06:54.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:06:54.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198504+0000", 2024-09-12T17:06:54.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6630000000000002e-06 2024-09-12T17:06:54.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198515+0000", 2024-09-12T17:06:54.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1014e-05 2024-09-12T17:06:54.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198548+0000", 2024-09-12T17:06:54.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2339999999999999e-05 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198563+0000", 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5228999999999999e-05 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198683+0000", 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120569 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198886+0000", 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020240199999999999 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.199199+0000", 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031304800000000002 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.200322+0000", 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011236309999999999 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201410+0000", 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010880110000000001 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201494+0000", 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3863000000000007e-05 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201566+0000", 2024-09-12T17:06:54.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1783e-05 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 54.828555088999998, 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030460629999999999, 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.293 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 880 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363980+0000", 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0699999999999998e-06 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363993+0000", 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2439999999999999e-05 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364026+0000", 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2886999999999999e-05 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364041+0000", 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5255999999999999e-05 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364160+0000", 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011927200000000001 2024-09-12T17:06:54.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364388+0000", 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228116 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364728+0000", 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033925999999999997 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.365909+0000", 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001181091 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.366732+0000", 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082351699999999996 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.366907+0000", 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000174568 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.367023+0000", 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116586 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 54.823967328000002, 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002854625, 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.299 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.300 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.300 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.300 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.300 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 882 2024-09-12T17:06:54.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.300 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:06:54.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368568+0000", 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5799999999999999e-06 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368579+0000", 2024-09-12T17:06:54.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.13e-05 2024-09-12T17:06:54.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368613+0000", 2024-09-12T17:06:54.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3949999999999999e-05 2024-09-12T17:06:54.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368628+0000", 2024-09-12T17:06:54.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5443000000000001e-05 2024-09-12T17:06:54.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368753+0000", 2024-09-12T17:06:54.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012430899999999999 2024-09-12T17:06:54.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368898+0000", 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145012 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.369195+0000", 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029734100000000001 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.370341+0000", 2024-09-12T17:06:54.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001145985 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371159+0000", 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081784999999999996 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371309+0000", 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014978600000000001 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371420+0000", 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111069 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 54.753399432000002, 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028637710000000002, 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.307 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.308 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.308 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.308 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 913 2024-09-12T17:06:54.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.308 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:06:54.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439136+0000", 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7259999999999998e-06 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439150+0000", 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4419999999999999e-05 2024-09-12T17:06:54.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439181+0000", 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0303000000000001e-05 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439200+0000", 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9313e-05 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439316+0000", 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115893 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439541+0000", 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022517199999999999 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439857+0000", 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031612699999999998 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441075+0000", 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001218114 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441846+0000", 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00077121100000000005 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441931+0000", 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4338999999999993e-05 2024-09-12T17:06:54.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441997+0000", 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6153000000000002e-05 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 54.723703843999999, 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032820639999999999, 2024-09-12T17:06:54.313 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 925 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468831+0000", 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1459999999999999e-06 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468842+0000", 2024-09-12T17:06:54.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0727000000000001e-05 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468874+0000", 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2261999999999997e-05 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468888+0000", 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4507e-05 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469011+0000", 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012317599999999999 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469252+0000", 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024031500000000001 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469575+0000", 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032279699999999999 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.470640+0000", 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001065262 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.471902+0000", 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001262504 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.471990+0000", 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7552000000000005e-05 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.472111+0000", 2024-09-12T17:06:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120816 2024-09-12T17:06:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:06:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 54.716302169000002, 2024-09-12T17:06:54.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030855499999999998, 2024-09-12T17:06:54.320 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:54.320 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:54.320 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:54.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:54.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:54.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:54.320 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 928 2024-09-12T17:06:54.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.320 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:54.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476232+0000", 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9769999999999999e-06 2024-09-12T17:06:54.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476242+0000", 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0003000000000001e-05 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476269+0000", 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6727e-05 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:54.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476288+0000", 2024-09-12T17:06:54.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8649999999999999e-05 2024-09-12T17:06:54.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:54.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476400+0000", 2024-09-12T17:06:54.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111959 2024-09-12T17:06:54.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:54.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476614+0000", 2024-09-12T17:06:54.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000214465 2024-09-12T17:06:54.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476920+0000", 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030588700000000002 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.478203+0000", 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001282547 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:54.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479162+0000", 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095971299999999995 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479249+0000", 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6959000000000005e-05 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479316+0000", 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6662999999999995e-05 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.325 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.326 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.326 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:54.326 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:54.326 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:54.327 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:06:54.328 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:54.320+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:54.337 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:54.338 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:54.369 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:54.369 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:54.399 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:54.400 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:54.428 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:54.424+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:54.430 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:54.430 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:54.460 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:06:54.460 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:54.463 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:54.463 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:54.474 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:06:54.495 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:54.495 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:54.525 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:54.525 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:54.528 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:54.522+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:54.557 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:54.557 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:54.601 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:54.601 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:54.616 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:06:54.658 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:54.654+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:54.730 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:54.724+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:54.789 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:54.789 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:54.803 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:06:54.832 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:54.828+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:54.922 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:54.922 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:54.933 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:54.928+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:54.937 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:06:55.033 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:55.026+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:55.065 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T17:06:55.066 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:55.066 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:55.080 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:06:55.166 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:55.162+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:55.236 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:55.230+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:55.249 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:55.250 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:55.265 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:06:55.337 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:55.332+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:55.435 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:55.435 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:55.438 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:55.434+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:55.450 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:06:55.540 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:55.534+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:55.622 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:55.623 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:55.638 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:06:55.682 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:55.678+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:55.740 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:55.736+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:55.811 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:55.811 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:55.826 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:06:55.872 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:55.868+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:55.942 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:55.934+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:55.998 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:55.999 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:56.016 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:06:56.042 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:56.038+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:56.047 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T17:06:56.143 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:56.136+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:56.217 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:56.217 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:56.234 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:06:56.276 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:56.272+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:56.345 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:56.340+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:56.444 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:56.444 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:56.446 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:56.442+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:56.462 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:06:56.548 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:56.544+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:56.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:06:56.648 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:56.642+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:56.677 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:56.677 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:56.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:06:56.749 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:56.744+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:56.785 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:56.785 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:56.817 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:56.817 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:56.850 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:56.850 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:56.851 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:56.846+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:56.872 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:56.872 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:56.873 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:56.873 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:56.881 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:56.881 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:56.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:06:56.915 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:56.915 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:56.949 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:56.949 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:56.950 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:56.944+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:56.983 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:56.983 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:57.018 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:57.018 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:57.084 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:57.080+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:57.091 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:57.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 65.560864433000006, 2024-09-12T17:06:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:06:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:57.093 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:06:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:06:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:06:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:06:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:06:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:06:57.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 61.403232236999997, 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.098 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:06:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:06:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:06:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:06:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:06:57.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.493138444000003, 2024-09-12T17:06:57.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:57.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:06:57.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.110 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.477247703000003, 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:06:57.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:06:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:06:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:06:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:06:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:06:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:06:57.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.116 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.451779033000001, 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.117 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:06:57.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:06:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:06:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:06:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:06:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:06:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:06:57.122 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.432817931999999, 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.123 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:06:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:06:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:06:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:06:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:06:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:06:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:06:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:06:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.398262631999998, 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:06:57.129 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:06:57.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:06:57.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:06:57.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:57.135 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.085043218999999, 2024-09-12T17:06:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:06:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:06:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:57.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:06:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:06:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:06:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:06:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:06:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:06:57.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:06:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:06:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:06:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:06:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:06:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:06:57.141 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.080151850999997, 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.142 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:06:57.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:06:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:06:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:06:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:06:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:06:57.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.041176391999997, 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:06:57.148 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:06:57.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.154 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.037278418, 2024-09-12T17:06:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:06:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.155 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:06:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:06:57.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:06:57.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.968519186000002, 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:06:57.161 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:06:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:57.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.164 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:06:57.165 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.166 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.167 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.932675172000003, 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.168 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.169 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:06:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:06:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:06:57.170 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:06:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:06:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:06:57.172 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:57.173 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.174 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.175 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.912487800999997, 2024-09-12T17:06:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:06:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:06:57.176 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.177 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:06:57.178 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.179 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.180 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:06:57.181 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:06:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.907593439000003, 2024-09-12T17:06:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:06:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.182 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:06:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.183 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:06:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.184 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:06:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:06:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:06:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:06:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:06:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:06:57.185 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:06:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:06:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:06:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:06:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.186 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:06:57.187 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:06:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:06:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:06:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:06:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.188 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.845625284, 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.189 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.190 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:06:57.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:06:57.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:06:57.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:57.195 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.841218509000001, 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:06:57.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:06:57.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.673819166999998, 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:06:57.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:06:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:06:57.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:06:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:06:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:06:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:06:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:06:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:06:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:06:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:06:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:06:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.643044134, 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.208 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:06:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:06:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:06:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:06:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:06:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:06:57.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.214 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 57.638131878999999, 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:06:57.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:06:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:06:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:06:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:06:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.217 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:06:57.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.220 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.221 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.221 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:57.222 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:06:57.223 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:57.218+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:57.323 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:57.316+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:57.424 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:57.420+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:57.434 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:57.434 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:57.435 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:57.435 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:57.453 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:06:57.539 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:57.536+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:57.625 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:57.620+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:57.666 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:57.666 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:57.666 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:57.666 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:57.666 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:57.685 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:06:57.726 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:57.722+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:57.826 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:57.820+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:57.900 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:57.900 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:57.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:57.900 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:57.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.900 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:06:57.900 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.295728295000004, 2024-09-12T17:06:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027134059999999998, 2024-09-12T17:06:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:06:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:06:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 42 2024-09-12T17:06:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600336+0000", 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1270000000000001e-06 2024-09-12T17:06:57.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600346+0000", 2024-09-12T17:06:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.499e-06 2024-09-12T17:06:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600370+0000", 2024-09-12T17:06:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4411000000000001e-05 2024-09-12T17:06:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600386+0000", 2024-09-12T17:06:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6205000000000002e-05 2024-09-12T17:06:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600471+0000", 2024-09-12T17:06:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5013999999999996e-05 2024-09-12T17:06:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600569+0000", 2024-09-12T17:06:57.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7663000000000003e-05 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600677+0000", 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108571 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.601918+0000", 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012408090000000001 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.602976+0000", 2024-09-12T17:06:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001058217 2024-09-12T17:06:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603016+0000", 2024-09-12T17:06:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9894000000000001e-05 2024-09-12T17:06:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603047+0000", 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0995999999999999e-05 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.314672698999999, 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002848798, 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 52 2024-09-12T17:06:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:06:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581393+0000", 2024-09-12T17:06:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4070000000000002e-06 2024-09-12T17:06:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581405+0000", 2024-09-12T17:06:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:06:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581439+0000", 2024-09-12T17:06:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3966e-05 2024-09-12T17:06:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581457+0000", 2024-09-12T17:06:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7842999999999998e-05 2024-09-12T17:06:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581567+0000", 2024-09-12T17:06:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011048900000000001 2024-09-12T17:06:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581754+0000", 2024-09-12T17:06:57.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018672099999999999 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581913+0000", 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015923700000000001 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.583010+0000", 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001096947 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584083+0000", 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010725730000000001 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584168+0000", 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4981999999999994e-05 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584238+0000", 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0747000000000006e-05 2024-09-12T17:06:57.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.196418047999998, 2024-09-12T17:06:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003254804, 2024-09-12T17:06:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 236 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:06:57.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699647+0000", 2024-09-12T17:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1300000000000001e-06 2024-09-12T17:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699660+0000", 2024-09-12T17:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2326e-05 2024-09-12T17:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699694+0000", 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4552999999999999e-05 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699710+0000", 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5573000000000002e-05 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699835+0000", 2024-09-12T17:06:57.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012534300000000001 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700050+0000", 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214565 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700448+0000", 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039816999999999999 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702129+0000", 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001680874 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702721+0000", 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00059224199999999999 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702804+0000", 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3071999999999993e-05 2024-09-12T17:06:57.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702899+0000", 2024-09-12T17:06:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4956000000000004e-05 2024-09-12T17:06:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:57.920 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.183977521000003, 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026770299999999999, 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 271 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712086+0000", 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3510000000000001e-06 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712092+0000", 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5670000000000002e-06 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712105+0000", 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3438000000000001e-05 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712112+0000", 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6229999999999999e-06 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712181+0000", 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9323e-05 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712327+0000", 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014620900000000001 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712530+0000", 2024-09-12T17:06:57.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020267700000000001 2024-09-12T17:06:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.713251+0000", 2024-09-12T17:06:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072110800000000004 2024-09-12T17:06:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714674+0000", 2024-09-12T17:06:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001423021 2024-09-12T17:06:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714718+0000", 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4459000000000002e-05 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714762+0000", 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3254000000000003e-05 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:287 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.180751037999997, 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034654030000000001, 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 287 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.927 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715312+0000", 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1340000000000001e-06 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715318+0000", 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8409999999999996e-06 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715332+0000", 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4265e-05 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715342+0000", 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3360000000000001e-06 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715412+0000", 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9980000000000004e-05 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715511+0000", 2024-09-12T17:06:57.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9197000000000006e-05 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715663+0000", 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152347 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.716287+0000", 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00062330100000000004 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718705+0000", 2024-09-12T17:06:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002418505 2024-09-12T17:06:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718743+0000", 2024-09-12T17:06:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7645999999999998e-05 2024-09-12T17:06:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718777+0000", 2024-09-12T17:06:57.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3850999999999998e-05 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.871271184999998, 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028821710000000002, 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.933 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 742 2024-09-12T17:06:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024794+0000", 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7669999999999999e-06 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024805+0000", 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1093e-05 2024-09-12T17:06:57.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024836+0000", 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1136000000000001e-05 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024852+0000", 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6140000000000001e-05 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024989+0000", 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000136422 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025219+0000", 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008499999999999 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025545+0000", 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032645100000000001 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.026827+0000", 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00128202 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027470+0000", 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00064248199999999999 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027556+0000", 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6533000000000007e-05 2024-09-12T17:06:57.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027673+0000", 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117042 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.867534974000002, 2024-09-12T17:06:57.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002617173, 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 744 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028529+0000", 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8500000000000001e-06 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028540+0000", 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-05 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028565+0000", 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5083e-05 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028577+0000", 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2434e-05 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028679+0000", 2024-09-12T17:06:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101489 2024-09-12T17:06:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028800+0000", 2024-09-12T17:06:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012089199999999999 2024-09-12T17:06:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.029070+0000", 2024-09-12T17:06:57.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000270358 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030114+0000", 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001043832 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030994+0000", 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087969000000000003 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031082+0000", 2024-09-12T17:06:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7825999999999996e-05 2024-09-12T17:06:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031144+0000", 2024-09-12T17:06:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2829000000000004e-05 2024-09-12T17:06:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.828372848999997, 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027655549999999998, 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 760 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.946 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067692+0000", 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4200000000000001e-06 2024-09-12T17:06:57.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067706+0000", 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.382e-05 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067739+0000", 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3253000000000002e-05 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067763+0000", 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4026e-05 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067912+0000", 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014959199999999999 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068127+0000", 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021487500000000001 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068438+0000", 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031070400000000003 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.069550+0000", 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011116159999999999 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070301+0000", 2024-09-12T17:06:57.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075135000000000002 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070390+0000", 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8516000000000004e-05 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070455+0000", 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5382999999999994e-05 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.69215062, 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031165260000000001, 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 817 2024-09-12T17:06:57.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:06:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203915+0000", 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.146e-06 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203926+0000", 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1379999999999999e-05 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203958+0000", 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2239000000000001e-05 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203973+0000", 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.47e-05 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204156+0000", 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018277899999999999 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204392+0000", 2024-09-12T17:06:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000236658 2024-09-12T17:06:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204705+0000", 2024-09-12T17:06:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000312248 2024-09-12T17:06:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.205983+0000", 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001278387 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206726+0000", 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074269799999999997 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206909+0000", 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018368200000000001 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.207028+0000", 2024-09-12T17:06:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118609 2024-09-12T17:06:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.687868969999997, 2024-09-12T17:06:57.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003050269, 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 819 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:06:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208196+0000", 2024-09-12T17:06:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4569999999999999e-06 2024-09-12T17:06:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208207+0000", 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208241+0000", 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3936000000000002e-05 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208256+0000", 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5917e-05 2024-09-12T17:06:57.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208383+0000", 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012605200000000001 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208602+0000", 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219908 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:57.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.209077+0000", 2024-09-12T17:06:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047489299999999999 2024-09-12T17:06:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210285+0000", 2024-09-12T17:06:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012075110000000001 2024-09-12T17:06:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210979+0000", 2024-09-12T17:06:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069376099999999999 2024-09-12T17:06:57.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211131+0000", 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151915 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211243+0000", 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112989 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.633123245999997, 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0035006659999999999, 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 841 2024-09-12T17:06:57.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262942+0000", 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6900000000000001e-06 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262953+0000", 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1323e-05 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262989+0000", 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5617000000000001e-05 2024-09-12T17:06:57.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263006+0000", 2024-09-12T17:06:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7713000000000001e-05 2024-09-12T17:06:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263177+0000", 2024-09-12T17:06:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170249 2024-09-12T17:06:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263551+0000", 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037421999999999998 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.264122+0000", 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057113200000000002 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.265539+0000", 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001417012 2024-09-12T17:06:57.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266170+0000", 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063154599999999997 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266330+0000", 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926800000000001 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266440+0000", 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010989600000000001 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.628422258999997, 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032057850000000001, 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.971 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 843 2024-09-12T17:06:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:06:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267642+0000", 2024-09-12T17:06:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:06:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267653+0000", 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0664e-05 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267687+0000", 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4112999999999997e-05 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267703+0000", 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5673000000000001e-05 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267832+0000", 2024-09-12T17:06:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012896500000000001 2024-09-12T17:06:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268054+0000", 2024-09-12T17:06:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022279600000000001 2024-09-12T17:06:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:57.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268561+0000", 2024-09-12T17:06:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050617200000000005 2024-09-12T17:06:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.269801+0000", 2024-09-12T17:06:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012401269999999999 2024-09-12T17:06:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270562+0000", 2024-09-12T17:06:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076129699999999997 2024-09-12T17:06:57.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270716+0000", 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000154339 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270846+0000", 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930600000000001 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.617590599000003, 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033822100000000001, 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 847 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.978 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:06:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278474+0000", 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4930000000000001e-06 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278485+0000", 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1313e-05 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278518+0000", 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2517000000000001e-05 2024-09-12T17:06:57.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278533+0000", 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939999999999999e-05 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278689+0000", 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015628899999999999 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279066+0000", 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000377337 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279610+0000", 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00054380900000000002 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281130+0000", 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001519488 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281583+0000", 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00045297300000000001 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281738+0000", 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015484900000000001 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281854+0000", 2024-09-12T17:06:57.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116202 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.612975095000003, 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883554, 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.984 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 849 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283090+0000", 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283102+0000", 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.204e-05 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283136+0000", 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3983000000000003e-05 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283152+0000", 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6082999999999998e-05 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283278+0000", 2024-09-12T17:06:57.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000126212 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283505+0000", 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022724900000000001 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283971+0000", 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046550600000000003 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285223+0000", 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012519370000000001 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285811+0000", 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058819199999999997 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285904+0000", 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3410000000000002e-05 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285971+0000", 2024-09-12T17:06:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6391999999999997e-05 2024-09-12T17:06:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.565022181000003, 2024-09-12T17:06:57.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033550770000000001, 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 868 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:57.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331043+0000", 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331054+0000", 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.131e-05 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331086+0000", 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331101+0000", 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5016e-05 2024-09-12T17:06:57.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331253+0000", 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151929 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331616+0000", 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036285100000000003 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:57.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.332174+0000", 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055856199999999997 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.333700+0000", 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015259480000000001 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334120+0000", 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042021700000000002 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334280+0000", 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159949 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334395+0000", 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114679 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.560564390000003, 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003066923, 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 870 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.997 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:57.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335500+0000", 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4040000000000002e-06 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335511+0000", 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.045e-05 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335542+0000", 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1542999999999999e-05 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:57.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335558+0000", 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.535e-05 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335698+0000", 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014063899999999999 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335930+0000", 2024-09-12T17:06:58.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000231435 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.336392+0000", 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046211199999999998 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.337568+0000", 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001176671 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338407+0000", 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083885399999999999 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338491+0000", 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4159000000000005e-05 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338565+0000", 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3306000000000006e-05 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.002 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.472375647, 2024-09-12T17:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027821550000000001, 2024-09-12T17:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 907 2024-09-12T17:06:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423690+0000", 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423702+0000", 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2404e-05 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423735+0000", 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3062999999999998e-05 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423750+0000", 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4912999999999999e-05 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423919+0000", 2024-09-12T17:06:58.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016838899999999999 2024-09-12T17:06:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424160+0000", 2024-09-12T17:06:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024105099999999999 2024-09-12T17:06:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424492+0000", 2024-09-12T17:06:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033261100000000002 2024-09-12T17:06:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.425785+0000", 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001292397 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426322+0000", 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00053743200000000001 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426403+0000", 2024-09-12T17:06:58.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0898999999999999e-05 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426469+0000", 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5720000000000001e-05 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:58.009 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.373209959, 2024-09-12T17:06:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029674670000000001, 2024-09-12T17:06:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 949 2024-09-12T17:06:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522855+0000", 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-12T17:06:58.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522871+0000", 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5950000000000001e-05 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522906+0000", 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316000000000001e-05 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522924+0000", 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8326999999999999e-05 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523047+0000", 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123609 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523282+0000", 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234465 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523606+0000", 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032453099999999997 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.524804+0000", 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011977509999999999 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525626+0000", 2024-09-12T17:06:58.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082216400000000001 2024-09-12T17:06:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525743+0000", 2024-09-12T17:06:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116679 2024-09-12T17:06:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525820+0000", 2024-09-12T17:06:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6631999999999994e-05 2024-09-12T17:06:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.015 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.359486285000003, 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030602540000000001, 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 955 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536578+0000", 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536590+0000", 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1250000000000001e-05 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536624+0000", 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4227000000000003e-05 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536646+0000", 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2195999999999999e-05 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536794+0000", 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014799600000000001 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537005+0000", 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021096799999999999 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537489+0000", 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048413599999999997 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.538940+0000", 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001451262 2024-09-12T17:06:58.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539441+0000", 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050002300000000005 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539535+0000", 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4526999999999998e-05 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539636+0000", 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010111900000000001 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 58.355228951000001, 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030889300000000001, 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.022 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 957 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540836+0000", 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540862+0000", 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999999e-05 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540891+0000", 2024-09-12T17:06:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9595999999999999e-05 2024-09-12T17:06:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540906+0000", 2024-09-12T17:06:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4919999999999999e-05 2024-09-12T17:06:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541052+0000", 2024-09-12T17:06:58.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014583900000000001 2024-09-12T17:06:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541232+0000", 2024-09-12T17:06:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180259 2024-09-12T17:06:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541500+0000", 2024-09-12T17:06:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026788799999999998 2024-09-12T17:06:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.542483+0000", 2024-09-12T17:06:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000983142 2024-09-12T17:06:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543756+0000", 2024-09-12T17:06:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001272977 2024-09-12T17:06:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543842+0000", 2024-09-12T17:06:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5748999999999995e-05 2024-09-12T17:06:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543922+0000", 2024-09-12T17:06:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0000000000000007e-05 2024-09-12T17:06:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.028 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.028 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:58.030 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:06:58.030 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:58.024+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:58.071 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T17:06:58.130 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:58.124+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:58.232 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:06:58.230+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:06:58.248 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:58.248 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:58.248 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:06:58.248 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:58.269 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:06:58.332 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:58.330+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:58.434 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:58.430+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:58.482 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:58.482 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:06:58.482 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:06:58.482 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:06:58.482 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:58.500 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:06:58.548 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:58.544+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:58.635 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:58.628+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:58.675 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:06:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:06:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:06:58.675 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:06:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-12T17:06:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 65.126691918999995, 2024-09-12T17:06:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011583833, 2024-09-12T17:06:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:06:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 44 2024-09-12T17:06:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:06:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544942+0000", 2024-09-12T17:06:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.653e-06 2024-09-12T17:06:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544957+0000", 2024-09-12T17:06:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5654e-05 2024-09-12T17:06:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544993+0000", 2024-09-12T17:06:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5936000000000003e-05 2024-09-12T17:06:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.545017+0000", 2024-09-12T17:06:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3283000000000001e-05 2024-09-12T17:06:58.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549277+0000", 2024-09-12T17:06:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042606800000000002 2024-09-12T17:06:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:06:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549301+0000", 2024-09-12T17:06:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3260000000000001e-05 2024-09-12T17:06:58.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556317+0000", 2024-09-12T17:06:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070164620000000002 2024-09-12T17:06:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556522+0000", 2024-09-12T17:06:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020490499999999999 2024-09-12T17:06:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:06:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.083226373000002, 2024-09-12T17:06:58.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054133180000000003, 2024-09-12T17:06:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 207 2024-09-12T17:06:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:06:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588408+0000", 2024-09-12T17:06:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T17:06:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588428+0000", 2024-09-12T17:06:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9910000000000001e-05 2024-09-12T17:06:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588467+0000", 2024-09-12T17:06:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T17:06:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588483+0000", 2024-09-12T17:06:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6443000000000002e-05 2024-09-12T17:06:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588659+0000", 2024-09-12T17:06:58.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569499999999999 2024-09-12T17:06:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589033+0000", 2024-09-12T17:06:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037374100000000003 2024-09-12T17:06:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589729+0000", 2024-09-12T17:06:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069659400000000003 2024-09-12T17:06:58.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593394+0000", 2024-09-12T17:06:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036653279999999998 2024-09-12T17:06:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593661+0000", 2024-09-12T17:06:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026662499999999999 2024-09-12T17:06:58.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593743+0000", 2024-09-12T17:06:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1428999999999996e-05 2024-09-12T17:06:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593817+0000", 2024-09-12T17:06:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4475999999999996e-05 2024-09-12T17:06:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.047005673000001, 2024-09-12T17:06:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034289839999999999, 2024-09-12T17:06:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.690 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 216 2024-09-12T17:06:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:58.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:06:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624628+0000", 2024-09-12T17:06:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2399999999999999e-06 2024-09-12T17:06:58.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624641+0000", 2024-09-12T17:06:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3743e-05 2024-09-12T17:06:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624675+0000", 2024-09-12T17:06:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3277e-05 2024-09-12T17:06:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624690+0000", 2024-09-12T17:06:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5812999999999999e-05 2024-09-12T17:06:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624847+0000", 2024-09-12T17:06:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156269 2024-09-12T17:06:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625092+0000", 2024-09-12T17:06:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024499500000000002 2024-09-12T17:06:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625494+0000", 2024-09-12T17:06:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040263000000000001 2024-09-12T17:06:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.626934+0000", 2024-09-12T17:06:58.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001439159 2024-09-12T17:06:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627890+0000", 2024-09-12T17:06:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095619599999999998 2024-09-12T17:06:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627978+0000", 2024-09-12T17:06:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8446e-05 2024-09-12T17:06:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.628053+0000", 2024-09-12T17:06:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5216000000000006e-05 2024-09-12T17:06:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:58.697 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 60.005497429999998, 2024-09-12T17:06:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003364985, 2024-09-12T17:06:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 227 2024-09-12T17:06:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:06:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666135+0000", 2024-09-12T17:06:58.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.644e-06 2024-09-12T17:06:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666147+0000", 2024-09-12T17:06:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1960000000000001e-05 2024-09-12T17:06:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666179+0000", 2024-09-12T17:06:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1813000000000002e-05 2024-09-12T17:06:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666195+0000", 2024-09-12T17:06:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5679999999999999e-05 2024-09-12T17:06:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666342+0000", 2024-09-12T17:06:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147312 2024-09-12T17:06:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666559+0000", 2024-09-12T17:06:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021664199999999999 2024-09-12T17:06:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.667037+0000", 2024-09-12T17:06:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047816200000000002 2024-09-12T17:06:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.668796+0000", 2024-09-12T17:06:58.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017590010000000001 2024-09-12T17:06:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669346+0000", 2024-09-12T17:06:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055024499999999999 2024-09-12T17:06:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669433+0000", 2024-09-12T17:06:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6650000000000006e-05 2024-09-12T17:06:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669498+0000", 2024-09-12T17:06:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4875999999999993e-05 2024-09-12T17:06:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:58.704 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.998290171000001, 2024-09-12T17:06:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031932409999999999, 2024-09-12T17:06:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 229 2024-09-12T17:06:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:06:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673342+0000", 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3499999999999999e-06 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673354+0000", 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1739999999999999e-05 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673386+0000", 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1782000000000002e-05 2024-09-12T17:06:58.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673400+0000", 2024-09-12T17:06:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4663e-05 2024-09-12T17:06:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673577+0000", 2024-09-12T17:06:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017662900000000001 2024-09-12T17:06:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673783+0000", 2024-09-12T17:06:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020620799999999999 2024-09-12T17:06:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.674174+0000", 2024-09-12T17:06:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039082100000000002 2024-09-12T17:06:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.675441+0000", 2024-09-12T17:06:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001267177 2024-09-12T17:06:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676382+0000", 2024-09-12T17:06:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094087900000000004 2024-09-12T17:06:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676468+0000", 2024-09-12T17:06:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5762999999999999e-05 2024-09-12T17:06:58.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676533+0000", 2024-09-12T17:06:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5228999999999995e-05 2024-09-12T17:06:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.711 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.990547247999999, 2024-09-12T17:06:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0037357380000000002, 2024-09-12T17:06:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 231 2024-09-12T17:06:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.712 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:06:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681085+0000", 2024-09-12T17:06:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:06:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681096+0000", 2024-09-12T17:06:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0866000000000001e-05 2024-09-12T17:06:58.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681126+0000", 2024-09-12T17:06:58.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9977000000000001e-05 2024-09-12T17:06:58.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681140+0000", 2024-09-12T17:06:58.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4195999999999999e-05 2024-09-12T17:06:58.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681288+0000", 2024-09-12T17:06:58.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014765199999999999 2024-09-12T17:06:58.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681637+0000", 2024-09-12T17:06:58.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034917100000000001 2024-09-12T17:06:58.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:58.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.682358+0000", 2024-09-12T17:06:58.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072050800000000002 2024-09-12T17:06:58.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684139+0000", 2024-09-12T17:06:58.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017812399999999999 2024-09-12T17:06:58.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684543+0000", 2024-09-12T17:06:58.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040413299999999999 2024-09-12T17:06:58.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684703+0000", 2024-09-12T17:06:58.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160075 2024-09-12T17:06:58.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684819+0000", 2024-09-12T17:06:58.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011553300000000001 2024-09-12T17:06:58.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.719 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.719 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.719 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:374 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.719 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:58.719 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.935669818000001, 2024-09-12T17:06:58.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031135910000000002, 2024-09-12T17:06:58.720 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.720 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.720 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.720 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.720 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.720 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.720 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 374 2024-09-12T17:06:58.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.720 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:58.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:06:58.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735961+0000", 2024-09-12T17:06:58.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0979999999999999e-06 2024-09-12T17:06:58.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735968+0000", 2024-09-12T17:06:58.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:06:58.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735981+0000", 2024-09-12T17:06:58.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3164e-05 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735989+0000", 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8010000000000004e-06 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736041+0000", 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800999999999998e-05 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736137+0000", 2024-09-12T17:06:58.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5497999999999999e-05 2024-09-12T17:06:58.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:58.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736303+0000", 2024-09-12T17:06:58.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016580100000000001 2024-09-12T17:06:58.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736802+0000", 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049966599999999996 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739015+0000", 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022122919999999998 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739047+0000", 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2678000000000001e-05 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739074+0000", 2024-09-12T17:06:58.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6594e-05 2024-09-12T17:06:58.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.726 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.726 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.726 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:58.726 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.710225074999997, 2024-09-12T17:06:58.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029096640000000002, 2024-09-12T17:06:58.727 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.727 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 715 2024-09-12T17:06:58.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.727 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:58.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:06:58.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961407+0000", 2024-09-12T17:06:58.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:06:58.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961419+0000", 2024-09-12T17:06:58.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.117e-05 2024-09-12T17:06:58.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961450+0000", 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1463e-05 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961465+0000", 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961576+0000", 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111016 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961785+0000", 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020865599999999999 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.962105+0000", 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031996699999999999 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.963189+0000", 2024-09-12T17:06:58.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010845519999999999 2024-09-12T17:06:58.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964163+0000", 2024-09-12T17:06:58.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097355800000000002 2024-09-12T17:06:58.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964252+0000", 2024-09-12T17:06:58.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8996e-05 2024-09-12T17:06:58.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964315+0000", 2024-09-12T17:06:58.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2773000000000004e-05 2024-09-12T17:06:58.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.733 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.733 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.733 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:58.734 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.675954519000001, 2024-09-12T17:06:58.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883207, 2024-09-12T17:06:58.734 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 730 2024-09-12T17:06:58.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.734 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:58.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:06:58.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995678+0000", 2024-09-12T17:06:58.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:06:58.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995689+0000", 2024-09-12T17:06:58.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1316e-05 2024-09-12T17:06:58.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995722+0000", 2024-09-12T17:06:58.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:06:58.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995745+0000", 2024-09-12T17:06:58.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3496999999999999e-05 2024-09-12T17:06:58.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995902+0000", 2024-09-12T17:06:58.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156446 2024-09-12T17:06:58.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996113+0000", 2024-09-12T17:06:58.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021091099999999999 2024-09-12T17:06:58.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:58.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996444+0000", 2024-09-12T17:06:58.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000330785 2024-09-12T17:06:58.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.997558+0000", 2024-09-12T17:06:58.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001114681 2024-09-12T17:06:58.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998420+0000", 2024-09-12T17:06:58.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086125299999999998 2024-09-12T17:06:58.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998497+0000", 2024-09-12T17:06:58.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7919999999999999e-05 2024-09-12T17:06:58.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998559+0000", 2024-09-12T17:06:58.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1319e-05 2024-09-12T17:06:58.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.740 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.741 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.741 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:58.741 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.657472955000003, 2024-09-12T17:06:58.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002862248, 2024-09-12T17:06:58.741 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.741 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 738 2024-09-12T17:06:58.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014159+0000", 2024-09-12T17:06:58.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:06:58.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014168+0000", 2024-09-12T17:06:58.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.653e-06 2024-09-12T17:06:58.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014191+0000", 2024-09-12T17:06:58.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3706e-05 2024-09-12T17:06:58.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014213+0000", 2024-09-12T17:06:58.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2050000000000001e-05 2024-09-12T17:06:58.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014363+0000", 2024-09-12T17:06:58.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014956299999999999 2024-09-12T17:06:58.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014485+0000", 2024-09-12T17:06:58.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000122132 2024-09-12T17:06:58.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014770+0000", 2024-09-12T17:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000284911 2024-09-12T17:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.015864+0000", 2024-09-12T17:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010942180000000001 2024-09-12T17:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016864+0000", 2024-09-12T17:06:58.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00099982299999999994 2024-09-12T17:06:58.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016951+0000", 2024-09-12T17:06:58.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6476000000000003e-05 2024-09-12T17:06:58.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.017019+0000", 2024-09-12T17:06:58.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8756000000000004e-05 2024-09-12T17:06:58.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.748 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.748 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.748 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.748 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:58.748 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.575151577, 2024-09-12T17:06:58.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032495950000000001, 2024-09-12T17:06:58.748 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.748 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 772 2024-09-12T17:06:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:06:58.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096481+0000", 2024-09-12T17:06:58.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4399999999999999e-06 2024-09-12T17:06:58.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096492+0000", 2024-09-12T17:06:58.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1513e-05 2024-09-12T17:06:58.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096522+0000", 2024-09-12T17:06:58.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9156e-05 2024-09-12T17:06:58.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096536+0000", 2024-09-12T17:06:58.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4347e-05 2024-09-12T17:06:58.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096681+0000", 2024-09-12T17:06:58.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145348 2024-09-12T17:06:58.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096896+0000", 2024-09-12T17:06:58.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214489 2024-09-12T17:06:58.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:58.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.097208+0000", 2024-09-12T17:06:58.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031215099999999999 2024-09-12T17:06:58.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.098332+0000", 2024-09-12T17:06:58.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001123635 2024-09-12T17:06:58.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099583+0000", 2024-09-12T17:06:58.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00125179 2024-09-12T17:06:58.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099663+0000", 2024-09-12T17:06:58.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9703000000000006e-05 2024-09-12T17:06:58.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099728+0000", 2024-09-12T17:06:58.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5023000000000004e-05 2024-09-12T17:06:58.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.755 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.755 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.755 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.755 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:58.755 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.503409617999999, 2024-09-12T17:06:58.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028771949999999999, 2024-09-12T17:06:58.755 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.755 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.756 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.756 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.756 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 802 2024-09-12T17:06:58.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.756 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:58.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:06:58.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168223+0000", 2024-09-12T17:06:58.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4499999999999998e-06 2024-09-12T17:06:58.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168234+0000", 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168265+0000", 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0777e-05 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168279+0000", 2024-09-12T17:06:58.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4525999999999999e-05 2024-09-12T17:06:58.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168397+0000", 2024-09-12T17:06:58.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118063 2024-09-12T17:06:58.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168616+0000", 2024-09-12T17:06:58.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000218505 2024-09-12T17:06:58.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:58.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168970+0000", 2024-09-12T17:06:58.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00035427400000000002 2024-09-12T17:06:58.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170038+0000", 2024-09-12T17:06:58.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001067571 2024-09-12T17:06:58.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170897+0000", 2024-09-12T17:06:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085934399999999995 2024-09-12T17:06:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170983+0000", 2024-09-12T17:06:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6179000000000003e-05 2024-09-12T17:06:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.171098+0000", 2024-09-12T17:06:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114576 2024-09-12T17:06:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.444609792000001, 2024-09-12T17:06:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033328609999999999, 2024-09-12T17:06:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.762 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.763 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.763 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.763 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.763 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.763 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 826 2024-09-12T17:06:58.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.763 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:58.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:06:58.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227023+0000", 2024-09-12T17:06:58.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:06:58.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227035+0000", 2024-09-12T17:06:58.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:06:58.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227067+0000", 2024-09-12T17:06:58.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2305999999999999e-05 2024-09-12T17:06:58.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227082+0000", 2024-09-12T17:06:58.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.485e-05 2024-09-12T17:06:58.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227247+0000", 2024-09-12T17:06:58.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016483900000000001 2024-09-12T17:06:58.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227630+0000", 2024-09-12T17:06:58.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038350100000000001 2024-09-12T17:06:58.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:58.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.228201+0000", 2024-09-12T17:06:58.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057026799999999997 2024-09-12T17:06:58.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.229556+0000", 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013553300000000001 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230084+0000", 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00052805599999999995 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230238+0000", 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015438499999999999 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230353+0000", 2024-09-12T17:06:58.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114809 2024-09-12T17:06:58.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.769 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.769 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.769 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:58.769 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.385336436000003, 2024-09-12T17:06:58.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033407710000000002, 2024-09-12T17:06:58.770 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 850 2024-09-12T17:06:58.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.770 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:58.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:06:58.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286296+0000", 2024-09-12T17:06:58.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T17:06:58.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286307+0000", 2024-09-12T17:06:58.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1287000000000001e-05 2024-09-12T17:06:58.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286339+0000", 2024-09-12T17:06:58.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1331999999999997e-05 2024-09-12T17:06:58.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286353+0000", 2024-09-12T17:06:58.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4517e-05 2024-09-12T17:06:58.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286504+0000", 2024-09-12T17:06:58.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015038200000000001 2024-09-12T17:06:58.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286897+0000", 2024-09-12T17:06:58.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039326399999999999 2024-09-12T17:06:58.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:06:58.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.287451+0000", 2024-09-12T17:06:58.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055426900000000003 2024-09-12T17:06:58.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.288825+0000", 2024-09-12T17:06:58.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013741160000000001 2024-09-12T17:06:58.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289484+0000", 2024-09-12T17:06:58.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00065819499999999998 2024-09-12T17:06:58.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289570+0000", 2024-09-12T17:06:58.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6383000000000003e-05 2024-09-12T17:06:58.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289634+0000", 2024-09-12T17:06:58.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4505999999999995e-05 2024-09-12T17:06:58.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.776 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.776 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.776 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.347344519000004, 2024-09-12T17:06:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002894237, 2024-09-12T17:06:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 865 2024-09-12T17:06:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.777 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:58.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:06:58.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324288+0000", 2024-09-12T17:06:58.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2469999999999998e-06 2024-09-12T17:06:58.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324299+0000", 2024-09-12T17:06:58.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0823e-05 2024-09-12T17:06:58.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324330+0000", 2024-09-12T17:06:58.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1846e-05 2024-09-12T17:06:58.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324350+0000", 2024-09-12T17:06:58.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9077e-05 2024-09-12T17:06:58.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.780 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324463+0000", 2024-09-12T17:06:58.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011367200000000001 2024-09-12T17:06:58.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324693+0000", 2024-09-12T17:06:58.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008800000000001 2024-09-12T17:06:58.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:58.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.325000+0000", 2024-09-12T17:06:58.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030629499999999999 2024-09-12T17:06:58.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.326117+0000", 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011175709999999999 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327026+0000", 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00090879000000000003 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327113+0000", 2024-09-12T17:06:58.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7093000000000001e-05 2024-09-12T17:06:58.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327180+0000", 2024-09-12T17:06:58.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6735000000000004e-05 2024-09-12T17:06:58.783 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.783 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.783 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.784 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.784 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:58.784 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.332831020999997, 2024-09-12T17:06:58.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030741359999999999, 2024-09-12T17:06:58.784 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.784 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.784 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.784 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.784 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.784 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.785 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 871 2024-09-12T17:06:58.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.785 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:58.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:06:58.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338802+0000", 2024-09-12T17:06:58.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:06:58.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338831+0000", 2024-09-12T17:06:58.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9356000000000002e-05 2024-09-12T17:06:58.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338868+0000", 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7357000000000002e-05 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338883+0000", 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4932999999999999e-05 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339036+0000", 2024-09-12T17:06:58.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152423 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339264+0000", 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022814100000000001 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339593+0000", 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032943099999999998 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.340783+0000", 2024-09-12T17:06:58.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011898740000000001 2024-09-12T17:06:58.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341724+0000", 2024-09-12T17:06:58.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094134600000000002 2024-09-12T17:06:58.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341809+0000", 2024-09-12T17:06:58.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4155999999999999e-05 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341873+0000", 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4605999999999998e-05 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:58.790 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.275338961000003, 2024-09-12T17:06:58.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003093649, 2024-09-12T17:06:58.791 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.791 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.791 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.791 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.791 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.791 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.791 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 895 2024-09-12T17:06:58.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.791 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396294+0000", 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3999999999999999e-06 2024-09-12T17:06:58.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396307+0000", 2024-09-12T17:06:58.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3468999999999999e-05 2024-09-12T17:06:58.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396338+0000", 2024-09-12T17:06:58.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1433000000000002e-05 2024-09-12T17:06:58.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396353+0000", 2024-09-12T17:06:58.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4557e-05 2024-09-12T17:06:58.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396496+0000", 2024-09-12T17:06:58.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014275900000000001 2024-09-12T17:06:58.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396719+0000", 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022317499999999999 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.397052+0000", 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033263699999999999 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.398211+0000", 2024-09-12T17:06:58.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011593350000000001 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399235+0000", 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010241219999999999 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399321+0000", 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5789000000000001e-05 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399385+0000", 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3973000000000006e-05 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.268851904999998, 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029302239999999999, 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.797 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.798 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.798 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.798 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 898 2024-09-12T17:06:58.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.798 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:58.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:06:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402780+0000", 2024-09-12T17:06:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9269999999999999e-06 2024-09-12T17:06:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402789+0000", 2024-09-12T17:06:58.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7069999999999998e-06 2024-09-12T17:06:58.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402830+0000", 2024-09-12T17:06:58.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1470000000000001e-05 2024-09-12T17:06:58.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402846+0000", 2024-09-12T17:06:58.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5319e-05 2024-09-12T17:06:58.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402938+0000", 2024-09-12T17:06:58.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2289999999999999e-05 2024-09-12T17:06:58.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403134+0000", 2024-09-12T17:06:58.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000196014 2024-09-12T17:06:58.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:06:58.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403437+0000", 2024-09-12T17:06:58.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030337199999999999 2024-09-12T17:06:58.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.404507+0000", 2024-09-12T17:06:58.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001069492 2024-09-12T17:06:58.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405432+0000", 2024-09-12T17:06:58.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092532900000000002 2024-09-12T17:06:58.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405590+0000", 2024-09-12T17:06:58.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158018 2024-09-12T17:06:58.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405708+0000", 2024-09-12T17:06:58.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118286 2024-09-12T17:06:58.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.804 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.804 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.804 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:58.804 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.183444643999998, 2024-09-12T17:06:58.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030817499999999999, 2024-09-12T17:06:58.804 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 934 2024-09-12T17:06:58.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.805 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:58.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:06:58.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488188+0000", 2024-09-12T17:06:58.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8040000000000002e-06 2024-09-12T17:06:58.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488201+0000", 2024-09-12T17:06:58.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2893e-05 2024-09-12T17:06:58.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488233+0000", 2024-09-12T17:06:58.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2085999999999997e-05 2024-09-12T17:06:58.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488248+0000", 2024-09-12T17:06:58.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4976e-05 2024-09-12T17:06:58.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488415+0000", 2024-09-12T17:06:58.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016677900000000001 2024-09-12T17:06:58.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488650+0000", 2024-09-12T17:06:58.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234875 2024-09-12T17:06:58.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:06:58.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488961+0000", 2024-09-12T17:06:58.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031078799999999999 2024-09-12T17:06:58.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.490177+0000", 2024-09-12T17:06:58.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001216607 2024-09-12T17:06:58.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491119+0000", 2024-09-12T17:06:58.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000941806 2024-09-12T17:06:58.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491202+0000", 2024-09-12T17:06:58.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3349000000000004e-05 2024-09-12T17:06:58.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491267+0000", 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4787000000000002e-05 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 59.172625664000002, 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031107489999999999, 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:06:58.814 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:58.815 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:06:58.815 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:06:58.815 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:58.815 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 939 2024-09-12T17:06:58.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.815 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:06:58.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:06:58.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:58.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499007+0000", 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3970000000000001e-06 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499018+0000", 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0969e-05 2024-09-12T17:06:58.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499052+0000", 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3896999999999997e-05 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499068+0000", 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6552999999999999e-05 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:06:58.817 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499200+0000", 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013206599999999999 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499438+0000", 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023806500000000001 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499922+0000", 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048369599999999998 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501326+0000", 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014036560000000001 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501962+0000", 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063623100000000001 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502048+0000", 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5636999999999993e-05 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:06:58.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:06:58.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:06:58.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502115+0000", 2024-09-12T17:06:58.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7582000000000004e-05 2024-09-12T17:06:58.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.820 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.820 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:06:58.820 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:06:58.820 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:06:58.822 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:06:58.822 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:06:58.816+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:06:58.922 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:58.918+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:58.957 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:58.957 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:58.957 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:06:58.957 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:58.972 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:06:59.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:06:59.043 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T17:06:59.062 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:59.058+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:59.124 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:59.118+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:59.142 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:06:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:06:59.143 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:06:59.143 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:59.157 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:06:59.242 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:06:59.242 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:06:59.242 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:06:59.238+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:06:59.273 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:06:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:06:59.303 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:06:59.303 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:06:59.326 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:06:59.322+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:06:59.328 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:06:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:06:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:06:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:06:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.328 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.716612843999997, 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003566582, 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 211 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608233+0000", 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.343e-06 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608248+0000", 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4747e-05 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608285+0000", 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7239e-05 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608302+0000", 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6909999999999999e-05 2024-09-12T17:06:59.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608454+0000", 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015164599999999999 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608666+0000", 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021213499999999999 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:59.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.609092+0000", 2024-09-12T17:06:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042601999999999999 2024-09-12T17:06:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.610771+0000", 2024-09-12T17:06:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016786940000000001 2024-09-12T17:06:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611640+0000", 2024-09-12T17:06:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00086891300000000002 2024-09-12T17:06:59.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611731+0000", 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1058999999999997e-05 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611796+0000", 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5876000000000004e-05 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.637642827000001, 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035636330000000001, 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 232 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.335 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687203+0000", 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687216+0000", 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346999999999999e-05 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687250+0000", 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3992999999999998e-05 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687266+0000", 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.577e-05 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687402+0000", 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013599599999999999 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687630+0000", 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228168 2024-09-12T17:06:59.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.688057+0000", 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042653999999999999 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.689651+0000", 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015945009999999999 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690608+0000", 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095638899999999998 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690694+0000", 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6119000000000007e-05 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690764+0000", 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9757000000000003e-05 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:06:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.617196397999997, 2024-09-12T17:06:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030740059999999998, 2024-09-12T17:06:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.341 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 241 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707649+0000", 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707661+0000", 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2e-05 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707693+0000", 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2299999999999999e-05 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707709+0000", 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6096e-05 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707871+0000", 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016122200000000001 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.708198+0000", 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032765799999999999 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.708655+0000", 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00045698599999999999 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710022+0000", 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013664059999999999 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710578+0000", 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055600199999999999 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710650+0000", 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2767000000000003e-05 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710720+0000", 2024-09-12T17:06:59.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9839000000000007e-05 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:434 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.564413489000003, 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030966930000000002, 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.347 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 434 2024-09-12T17:06:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:06:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760432+0000", 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4540000000000001e-06 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760443+0000", 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1123e-05 2024-09-12T17:06:59.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760473+0000", 2024-09-12T17:06:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0476000000000001e-05 2024-09-12T17:06:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760493+0000", 2024-09-12T17:06:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9502999999999999e-05 2024-09-12T17:06:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760616+0000", 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123509 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760776+0000", 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000159462 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.761216+0000", 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000440474 2024-09-12T17:06:59.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762555+0000", 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338926 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763288+0000", 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00073298000000000005 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763434+0000", 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145544 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763526+0000", 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2242000000000002e-05 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:445 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.353 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:06:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.557515518000002, 2024-09-12T17:06:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029347829999999998, 2024-09-12T17:06:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 445 2024-09-12T17:06:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767330+0000", 2024-09-12T17:06:59.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8229999999999999e-06 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767343+0000", 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2869e-05 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767373+0000", 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0294000000000002e-05 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767392+0000", 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.91e-05 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767522+0000", 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000130152 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767688+0000", 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016599900000000001 2024-09-12T17:06:59.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.768155+0000", 2024-09-12T17:06:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046654299999999998 2024-09-12T17:06:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.769308+0000", 2024-09-12T17:06:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001153165 2024-09-12T17:06:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770069+0000", 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076044000000000003 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770155+0000", 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6493e-05 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770262+0000", 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010690499999999999 2024-09-12T17:06:59.359 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:06:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.527777980000003, 2024-09-12T17:06:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039867009999999996, 2024-09-12T17:06:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.360 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 504 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797067+0000", 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797078+0000", 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0837e-05 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797108+0000", 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9722000000000001e-05 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797127+0000", 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9539999999999999e-05 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797249+0000", 2024-09-12T17:06:59.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121239 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797551+0000", 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030277400000000001 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.798161+0000", 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00060936200000000001 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.799307+0000", 2024-09-12T17:06:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001146588 2024-09-12T17:06:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.800728+0000", 2024-09-12T17:06:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014204389999999999 2024-09-12T17:06:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.800831+0000", 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103002 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.801051+0000", 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022061499999999999 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:626 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.446026777999997, 2024-09-12T17:06:59.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032539040000000002, 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 626 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:06:59.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878819+0000", 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6699999999999998e-06 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.368 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878831+0000", 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2882e-05 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878862+0000", 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0332999999999999e-05 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878880+0000", 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8236999999999998e-05 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879009+0000", 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012908599999999999 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879306+0000", 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029693100000000001 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879873+0000", 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056697200000000001 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881172+0000", 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001298766 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881880+0000", 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00070808500000000001 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881962+0000", 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2069000000000003e-05 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882070+0000", 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107873 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.441847410999998, 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030425119999999998, 2024-09-12T17:06:59.372 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 633 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882997+0000", 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0530000000000001e-06 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883009+0000", 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1195e-05 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883037+0000", 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8484999999999999e-05 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883055+0000", 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8467000000000001e-05 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883196+0000", 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014099499999999999 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.375 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883444+0000", 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000247758 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883892+0000", 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044757299999999999 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885202+0000", 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001310587 2024-09-12T17:06:59.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885879+0000", 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00067645599999999998 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885945+0000", 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6575999999999994e-05 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.886038+0000", 2024-09-12T17:06:59.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2367000000000005e-05 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:644 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.431849976999999, 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030197190000000001, 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.378 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 644 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:06:59.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892995+0000", 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1390000000000002e-06 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893004+0000", 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3729999999999999e-06 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893029+0000", 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5058999999999998e-05 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893041+0000", 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1858000000000001e-05 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893190+0000", 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014875199999999999 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893575+0000", 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038538 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.894140+0000", 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056461200000000003 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895394+0000", 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012536100000000001 2024-09-12T17:06:59.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895856+0000", 2024-09-12T17:06:59.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046213 2024-09-12T17:06:59.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895940+0000", 2024-09-12T17:06:59.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4808999999999994e-05 2024-09-12T17:06:59.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.896012+0000", 2024-09-12T17:06:59.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1996999999999995e-05 2024-09-12T17:06:59.384 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.384 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.384 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.384 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:711 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.384 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:06:59.384 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.371501283999997, 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00296547, 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 711 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953343+0000", 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.046e-06 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953353+0000", 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4939999999999992e-06 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953386+0000", 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2919000000000001e-05 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953405+0000", 2024-09-12T17:06:59.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9596999999999999e-05 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953576+0000", 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017032500000000001 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953828+0000", 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025190800000000001 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.954297+0000", 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046897300000000002 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.955510+0000", 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012131139999999999 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956183+0000", 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00067301800000000005 2024-09-12T17:06:59.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956254+0000", 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0786999999999998e-05 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956307+0000", 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3288999999999998e-05 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.391 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.391 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:06:59.391 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.341590539000002, 2024-09-12T17:06:59.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029480109999999999, 2024-09-12T17:06:59.391 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.391 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.391 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.391 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.391 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 724 2024-09-12T17:06:59.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.392 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:06:59.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:06:59.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983255+0000", 2024-09-12T17:06:59.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4140000000000001e-06 2024-09-12T17:06:59.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983266+0000", 2024-09-12T17:06:59.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1039999999999999e-05 2024-09-12T17:06:59.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983298+0000", 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1949000000000002e-05 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983313+0000", 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5296999999999999e-05 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983416+0000", 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102921 2024-09-12T17:06:59.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983578+0000", 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000162244 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983835+0000", 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025741700000000002 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.984947+0000", 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011111949999999999 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.985915+0000", 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00096828599999999995 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.986080+0000", 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016498500000000001 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.986200+0000", 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120263 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.333982370000001, 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029804559999999998, 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.397 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 727 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990862+0000", 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0959999999999999e-06 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990872+0000", 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1039999999999996e-06 2024-09-12T17:06:59.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990897+0000", 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5626000000000002e-05 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990911+0000", 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346000000000001e-05 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990999+0000", 2024-09-12T17:06:59.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8887000000000005e-05 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.991252+0000", 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025290099999999998 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.991617+0000", 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036479399999999999 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.992803+0000", 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011859049999999999 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993677+0000", 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00087379199999999997 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993774+0000", 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7343000000000006e-05 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993841+0000", 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6662000000000007e-05 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.219039678000001, 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035861349999999998, 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.403 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 775 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:06:59.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105806+0000", 2024-09-12T17:06:59.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9529999999999999e-06 2024-09-12T17:06:59.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105818+0000", 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2447e-05 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105851+0000", 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2969999999999998e-05 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105867+0000", 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5116999999999999e-05 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106011+0000", 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014498500000000001 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106382+0000", 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037012699999999999 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106946+0000", 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056435199999999995 2024-09-12T17:06:59.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.108269+0000", 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00132256 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109120+0000", 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00085151300000000003 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109274+0000", 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015367199999999999 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109389+0000", 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115439 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.409 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.213950816999997, 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031979489999999998, 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 777 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110894+0000", 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4870000000000001e-06 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110905+0000", 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.098e-05 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110938+0000", 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110953+0000", 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5058999999999999e-05 2024-09-12T17:06:59.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111080+0000", 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000127033 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111312+0000", 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000231828 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111791+0000", 2024-09-12T17:06:59.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00047926000000000002 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.112965+0000", 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011740209999999999 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.113920+0000", 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095542000000000001 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.114009+0000", 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8162000000000001e-05 2024-09-12T17:06:59.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.114090+0000", 2024-09-12T17:06:59.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1203000000000002e-05 2024-09-12T17:06:59.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.415 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.415 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.415 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:06:59.415 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 60.126341142999998, 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030645529999999998, 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 814 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:06:59.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198504+0000", 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6630000000000002e-06 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198515+0000", 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1014e-05 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198548+0000", 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2339999999999999e-05 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198563+0000", 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5228999999999999e-05 2024-09-12T17:06:59.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198683+0000", 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120569 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198886+0000", 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020240199999999999 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:59.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.199199+0000", 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031304800000000002 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.200322+0000", 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011236309999999999 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201410+0000", 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010880110000000001 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201494+0000", 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3863000000000007e-05 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201566+0000", 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1783e-05 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.960865286999997, 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030460629999999999, 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 880 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363980+0000", 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0699999999999998e-06 2024-09-12T17:06:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363993+0000", 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2439999999999999e-05 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364026+0000", 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2886999999999999e-05 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364041+0000", 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5255999999999999e-05 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364160+0000", 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011927200000000001 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364388+0000", 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228116 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:59.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364728+0000", 2024-09-12T17:06:59.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033925999999999997 2024-09-12T17:06:59.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.365909+0000", 2024-09-12T17:06:59.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001181091 2024-09-12T17:06:59.426 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.426 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.426 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.426 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.366732+0000", 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082351699999999996 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.366907+0000", 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000174568 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.367023+0000", 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116586 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.427 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.956277526000001, 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002854625, 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.428 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 882 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368568+0000", 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5799999999999999e-06 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368579+0000", 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.13e-05 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368613+0000", 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3949999999999999e-05 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368628+0000", 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5443000000000001e-05 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368753+0000", 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012430899999999999 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368898+0000", 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145012 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.369195+0000", 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029734100000000001 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.370341+0000", 2024-09-12T17:06:59.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001145985 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371159+0000", 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081784999999999996 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371309+0000", 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014978600000000001 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.433 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371420+0000", 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111069 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.885709630000001, 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028637710000000002, 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.434 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 913 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439136+0000", 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7259999999999998e-06 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439150+0000", 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4419999999999999e-05 2024-09-12T17:06:59.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439181+0000", 2024-09-12T17:06:59.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0303000000000001e-05 2024-09-12T17:06:59.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439200+0000", 2024-09-12T17:06:59.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9313e-05 2024-09-12T17:06:59.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439316+0000", 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115893 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439541+0000", 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022517199999999999 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439857+0000", 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031612699999999998 2024-09-12T17:06:59.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441075+0000", 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001218114 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441846+0000", 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00077121100000000005 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441931+0000", 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4338999999999993e-05 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441997+0000", 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6153000000000002e-05 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.440 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.856014041999998, 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032820639999999999, 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 925 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468831+0000", 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1459999999999999e-06 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468842+0000", 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0727000000000001e-05 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468874+0000", 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2261999999999997e-05 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468888+0000", 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4507e-05 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469011+0000", 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012317599999999999 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469252+0000", 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024031500000000001 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469575+0000", 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032279699999999999 2024-09-12T17:06:59.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.470640+0000", 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001065262 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.471902+0000", 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001262504 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.471990+0000", 2024-09-12T17:06:59.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7552000000000005e-05 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.472111+0000", 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120816 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 59.848612367000001, 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030855499999999998, 2024-09-12T17:06:59.446 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 928 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.447 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476232+0000", 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9769999999999999e-06 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476242+0000", 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0003000000000001e-05 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:06:59.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476269+0000", 2024-09-12T17:06:59.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6727e-05 2024-09-12T17:06:59.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:06:59.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476288+0000", 2024-09-12T17:06:59.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8649999999999999e-05 2024-09-12T17:06:59.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:06:59.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476400+0000", 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111959 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476614+0000", 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000214465 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476920+0000", 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030588700000000002 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.478203+0000", 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001282547 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479162+0000", 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095971299999999995 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479249+0000", 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6959000000000005e-05 2024-09-12T17:06:59.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:06:59.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:06:59.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:06:59.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479316+0000", 2024-09-12T17:06:59.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6662999999999995e-05 2024-09-12T17:06:59.452 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.452 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.452 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.452 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:06:59.452 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:06:59.452 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:06:59.453 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:06:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:06:59.454 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:06:59.454 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:06:59.455 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:06:59.455 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:06:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:06:59.456 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:06:59.456 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:06:59.456 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:06:59.448+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:06:59.464 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:06:59.464 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:06:59.554 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:59.550+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:59.633 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:59.634 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:59.648 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:06:59.655 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:59.648+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:59.756 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:06:59.752+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:06:59.821 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:59.821 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:59.836 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:06:59.882 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:06:59.878+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:06:59.958 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:06:59.952+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:06:59.963 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:06:59.963 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:06:59.979 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:00.066 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:00.062+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:00.142 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:00.142 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:00.156 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:00.160 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:00.156+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:00.261 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:00.254+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:00.317 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:00.317 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:00.331 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:00.361 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:00.356+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:00.462 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:00.458+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:00.494 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:00.494 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:00.509 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:00.563 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:00.556+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:00.664 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:00.660+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:00.671 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:00.672 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:00.686 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:00.765 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:00.760+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:00.808 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:00.809 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:00.823 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:00.870 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:00.866+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:00.943 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:00.943 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:00.958 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:07:01.002 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:00.998+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:01.069 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:01.062+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:01.072 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T17:07:01.130 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:01.130 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:01.150 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:07:01.196 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:01.192+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:01.274 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:01.270+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:01.321 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:01.321 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:01.340 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:07:01.375 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:01.374+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:01.475 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:01.472+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:01.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:07:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:01.557 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:01.576 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:01.570+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:01.577 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:07:01.677 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:01.670+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:01.692 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:01.692 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:01.724 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:01.738 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:01.739 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:01.739 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:01.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:07:01.755 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:01.755 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:01.778 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:01.774+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:01.786 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:01.786 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:01.820 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:01.820 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:01.854 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:01.854 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:01.862 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:01.862 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:01.863 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:01.863 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:01.876 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:07:01.879 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:01.874+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:01.887 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:01.888 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:01.921 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:01.921 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:01.987 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:01.984+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:02.001 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:02.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.470914065000002, 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.002 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:07:02.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.006 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:07:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 66.313281868999994, 2024-09-12T17:07:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:07:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:07:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.007 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:07:02.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.012 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.403188075999999, 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.013 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:07:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:07:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:07:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:07:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:07:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:07:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:07:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:07:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:07:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:07:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:07:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:07:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:07:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:07:02.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:07:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:07:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:07:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:07:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.019 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.387297335, 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:07:02.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:07:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:07:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:07:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:07:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:07:02.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:07:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:07:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:07:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:07:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:07:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:07:02.025 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.361828664999997, 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.026 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:02.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:07:02.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.342867564000002, 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:07:02.032 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:07:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:07:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:07:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:07:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:07:02.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:07:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:07:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:07:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:07:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:07:02.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.038 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.308312264000001, 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:07:02.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:07:02.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.044 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.995092851000003, 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.045 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:07:02.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:07:02.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.050 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.990201483, 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:07:02.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:07:02.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:07:02.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:07:02.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.056 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.951226024, 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:07:02.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:07:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:07:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:07:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:07:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:07:02.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.062 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.947328050000003, 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:07:02.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:07:02.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:07:02.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:07:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:07:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:07:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:07:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:07:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:07:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:07:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:07:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:07:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:07:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:07:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.878568817999998, 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.070 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:07:02.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:07:02.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.842724803999999, 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:07:02.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:07:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:07:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:07:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:07:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:07:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:07:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:07:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:07:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:07:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:07:02.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.822537433000001, 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:07:02.082 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:07:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:07:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:07:02.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:07:02.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:02.088 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.817643070999999, 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:07:02.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:07:02.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:07:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:07:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:07:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:07:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:07:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.755674915999997, 2024-09-12T17:07:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:07:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:07:02.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:07:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:07:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:07:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:07:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:07:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:07:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:07:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:07:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:07:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:07:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:07:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:07:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:07:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:07:02.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:07:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:07:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.751268140999997, 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:07:02.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:07:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:07:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:07:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:07:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:07:02.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.583868799000001, 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:07:02.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:07:02.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.553093766000003, 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:07:02.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:07:02.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.119 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 62.548181511000003, 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.120 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:07:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:07:02.125 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.126 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.126 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:02.127 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:07:02.128 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T17:07:02.128 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:02.120+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:02.228 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:02.226+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:02.329 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:02.324+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:02.345 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:02.345 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:02.345 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:02.363 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:07:02.448 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:02.444+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:02.531 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:02.524+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:02.572 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:02.572 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:02.573 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:02.573 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:02.573 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:02.590 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:07:02.632 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:02.628+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:02.733 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:02.728+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:02.752 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:07:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:07:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 71.149240113999994, 2024-09-12T17:07:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027134059999999998, 2024-09-12T17:07:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.753 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:07:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:07:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 42 2024-09-12T17:07:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:07:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600336+0000", 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1270000000000001e-06 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600346+0000", 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.499e-06 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600370+0000", 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4411000000000001e-05 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600386+0000", 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6205000000000002e-05 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600471+0000", 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5013999999999996e-05 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600569+0000", 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7663000000000003e-05 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600677+0000", 2024-09-12T17:07:02.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108571 2024-09-12T17:07:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.601918+0000", 2024-09-12T17:07:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012408090000000001 2024-09-12T17:07:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.602976+0000", 2024-09-12T17:07:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001058217 2024-09-12T17:07:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603016+0000", 2024-09-12T17:07:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9894000000000001e-05 2024-09-12T17:07:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603047+0000", 2024-09-12T17:07:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0995999999999999e-05 2024-09-12T17:07:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:07:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:07:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.168184518000004, 2024-09-12T17:07:02.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002848798, 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 52 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581393+0000", 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4070000000000002e-06 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581405+0000", 2024-09-12T17:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581439+0000", 2024-09-12T17:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3966e-05 2024-09-12T17:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581457+0000", 2024-09-12T17:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7842999999999998e-05 2024-09-12T17:07:02.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581567+0000", 2024-09-12T17:07:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011048900000000001 2024-09-12T17:07:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581754+0000", 2024-09-12T17:07:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018672099999999999 2024-09-12T17:07:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581913+0000", 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015923700000000001 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.583010+0000", 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001096947 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584083+0000", 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010725730000000001 2024-09-12T17:07:02.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584168+0000", 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4981999999999994e-05 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584238+0000", 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0747000000000006e-05 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:07:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.049929867000003, 2024-09-12T17:07:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003254804, 2024-09-12T17:07:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.767 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 236 2024-09-12T17:07:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:07:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:07:02.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699647+0000", 2024-09-12T17:07:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1300000000000001e-06 2024-09-12T17:07:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699660+0000", 2024-09-12T17:07:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2326e-05 2024-09-12T17:07:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699694+0000", 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4552999999999999e-05 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699710+0000", 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5573000000000002e-05 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699835+0000", 2024-09-12T17:07:02.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012534300000000001 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700050+0000", 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214565 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700448+0000", 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039816999999999999 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702129+0000", 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001680874 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702721+0000", 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00059224199999999999 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702804+0000", 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3071999999999993e-05 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702899+0000", 2024-09-12T17:07:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4956000000000004e-05 2024-09-12T17:07:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:07:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.037489339999993, 2024-09-12T17:07:02.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026770299999999999, 2024-09-12T17:07:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 271 2024-09-12T17:07:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712086+0000", 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3510000000000001e-06 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712092+0000", 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5670000000000002e-06 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712105+0000", 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3438000000000001e-05 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712112+0000", 2024-09-12T17:07:02.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6229999999999999e-06 2024-09-12T17:07:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712181+0000", 2024-09-12T17:07:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9323e-05 2024-09-12T17:07:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712327+0000", 2024-09-12T17:07:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014620900000000001 2024-09-12T17:07:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712530+0000", 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020267700000000001 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.713251+0000", 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072110800000000004 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714674+0000", 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001423021 2024-09-12T17:07:02.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714718+0000", 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4459000000000002e-05 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714762+0000", 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3254000000000003e-05 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.779 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:287 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.034262857000002, 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034654030000000001, 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 287 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.780 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715312+0000", 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1340000000000001e-06 2024-09-12T17:07:02.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715318+0000", 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8409999999999996e-06 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715332+0000", 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4265e-05 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715342+0000", 2024-09-12T17:07:02.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3360000000000001e-06 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715412+0000", 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9980000000000004e-05 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715511+0000", 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9197000000000006e-05 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715663+0000", 2024-09-12T17:07:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152347 2024-09-12T17:07:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.716287+0000", 2024-09-12T17:07:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00062330100000000004 2024-09-12T17:07:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718705+0000", 2024-09-12T17:07:02.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002418505 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718743+0000", 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7645999999999998e-05 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718777+0000", 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3850999999999998e-05 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.724783004000003, 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028821710000000002, 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 742 2024-09-12T17:07:02.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024794+0000", 2024-09-12T17:07:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7669999999999999e-06 2024-09-12T17:07:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024805+0000", 2024-09-12T17:07:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1093e-05 2024-09-12T17:07:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024836+0000", 2024-09-12T17:07:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1136000000000001e-05 2024-09-12T17:07:02.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024852+0000", 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6140000000000001e-05 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024989+0000", 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000136422 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025219+0000", 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008499999999999 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025545+0000", 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032645100000000001 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.026827+0000", 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00128202 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027470+0000", 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00064248199999999999 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027556+0000", 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6533000000000007e-05 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027673+0000", 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117042 2024-09-12T17:07:02.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.721046792999999, 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002617173, 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.792 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 744 2024-09-12T17:07:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:07:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:07:02.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028529+0000", 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8500000000000001e-06 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028540+0000", 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-05 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028565+0000", 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5083e-05 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028577+0000", 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2434e-05 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028679+0000", 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101489 2024-09-12T17:07:02.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028800+0000", 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012089199999999999 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.029070+0000", 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000270358 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030114+0000", 2024-09-12T17:07:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001043832 2024-09-12T17:07:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030994+0000", 2024-09-12T17:07:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087969000000000003 2024-09-12T17:07:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031082+0000", 2024-09-12T17:07:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7825999999999996e-05 2024-09-12T17:07:02.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031144+0000", 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2829000000000004e-05 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.681884668000002, 2024-09-12T17:07:02.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027655549999999998, 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 760 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:07:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067692+0000", 2024-09-12T17:07:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4200000000000001e-06 2024-09-12T17:07:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067706+0000", 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.382e-05 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067739+0000", 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3253000000000002e-05 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067763+0000", 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4026e-05 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067912+0000", 2024-09-12T17:07:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014959199999999999 2024-09-12T17:07:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068127+0000", 2024-09-12T17:07:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021487500000000001 2024-09-12T17:07:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:02.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068438+0000", 2024-09-12T17:07:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031070400000000003 2024-09-12T17:07:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.069550+0000", 2024-09-12T17:07:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011116159999999999 2024-09-12T17:07:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070301+0000", 2024-09-12T17:07:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075135000000000002 2024-09-12T17:07:02.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070390+0000", 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8516000000000004e-05 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070455+0000", 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5382999999999994e-05 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.545662438999997, 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031165260000000001, 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 817 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.805 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203915+0000", 2024-09-12T17:07:02.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.146e-06 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203926+0000", 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1379999999999999e-05 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203958+0000", 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2239000000000001e-05 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203973+0000", 2024-09-12T17:07:02.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.47e-05 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204156+0000", 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018277899999999999 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204392+0000", 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000236658 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204705+0000", 2024-09-12T17:07:02.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000312248 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.205983+0000", 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001278387 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206726+0000", 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074269799999999997 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206909+0000", 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018368200000000001 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.207028+0000", 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118609 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.810 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.541380789000002, 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003050269, 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 819 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:07:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:07:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208196+0000", 2024-09-12T17:07:02.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4569999999999999e-06 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208207+0000", 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208241+0000", 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3936000000000002e-05 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208256+0000", 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5917e-05 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208383+0000", 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012605200000000001 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208602+0000", 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219908 2024-09-12T17:07:02.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.209077+0000", 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047489299999999999 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210285+0000", 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012075110000000001 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210979+0000", 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069376099999999999 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211131+0000", 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151915 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211243+0000", 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112989 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.816 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.486635065000002, 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0035006659999999999, 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.817 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 841 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262942+0000", 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6900000000000001e-06 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262953+0000", 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1323e-05 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262989+0000", 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5617000000000001e-05 2024-09-12T17:07:02.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263006+0000", 2024-09-12T17:07:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7713000000000001e-05 2024-09-12T17:07:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263177+0000", 2024-09-12T17:07:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170249 2024-09-12T17:07:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263551+0000", 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037421999999999998 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.264122+0000", 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057113200000000002 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.265539+0000", 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001417012 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266170+0000", 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063154599999999997 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266330+0000", 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926800000000001 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266440+0000", 2024-09-12T17:07:02.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010989600000000001 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.481934078000002, 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032057850000000001, 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 843 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:07:02.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267642+0000", 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267653+0000", 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0664e-05 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267687+0000", 2024-09-12T17:07:02.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4112999999999997e-05 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267703+0000", 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5673000000000001e-05 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267832+0000", 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012896500000000001 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268054+0000", 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022279600000000001 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268561+0000", 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050617200000000005 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.269801+0000", 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012401269999999999 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270562+0000", 2024-09-12T17:07:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076129699999999997 2024-09-12T17:07:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270716+0000", 2024-09-12T17:07:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000154339 2024-09-12T17:07:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270846+0000", 2024-09-12T17:07:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930600000000001 2024-09-12T17:07:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:07:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.471102418000001, 2024-09-12T17:07:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033822100000000001, 2024-09-12T17:07:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.829 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 847 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278474+0000", 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4930000000000001e-06 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278485+0000", 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1313e-05 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278518+0000", 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2517000000000001e-05 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278533+0000", 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939999999999999e-05 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278689+0000", 2024-09-12T17:07:02.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015628899999999999 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279066+0000", 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000377337 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279610+0000", 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00054380900000000002 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281130+0000", 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001519488 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281583+0000", 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00045297300000000001 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281738+0000", 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015484900000000001 2024-09-12T17:07:02.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281854+0000", 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116202 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.466486914000001, 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883554, 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.835 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 849 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283090+0000", 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283102+0000", 2024-09-12T17:07:02.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.204e-05 2024-09-12T17:07:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283136+0000", 2024-09-12T17:07:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3983000000000003e-05 2024-09-12T17:07:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283152+0000", 2024-09-12T17:07:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6082999999999998e-05 2024-09-12T17:07:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283278+0000", 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000126212 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283505+0000", 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022724900000000001 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283971+0000", 2024-09-12T17:07:02.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046550600000000003 2024-09-12T17:07:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285223+0000", 2024-09-12T17:07:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012519370000000001 2024-09-12T17:07:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285811+0000", 2024-09-12T17:07:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058819199999999997 2024-09-12T17:07:02.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285904+0000", 2024-09-12T17:07:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3410000000000002e-05 2024-09-12T17:07:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285971+0000", 2024-09-12T17:07:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6391999999999997e-05 2024-09-12T17:07:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.418534000000001, 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033550770000000001, 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 868 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331043+0000", 2024-09-12T17:07:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:07:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331054+0000", 2024-09-12T17:07:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.131e-05 2024-09-12T17:07:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331086+0000", 2024-09-12T17:07:02.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331101+0000", 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5016e-05 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331253+0000", 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151929 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331616+0000", 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036285100000000003 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.332174+0000", 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055856199999999997 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.333700+0000", 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015259480000000001 2024-09-12T17:07:02.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334120+0000", 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042021700000000002 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334280+0000", 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159949 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334395+0000", 2024-09-12T17:07:02.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114679 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.414076209000001, 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003066923, 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.848 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 870 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335500+0000", 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4040000000000002e-06 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335511+0000", 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.045e-05 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335542+0000", 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1542999999999999e-05 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335558+0000", 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.535e-05 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335698+0000", 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014063899999999999 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335930+0000", 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000231435 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.336392+0000", 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046211199999999998 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.337568+0000", 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001176671 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338407+0000", 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083885399999999999 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338491+0000", 2024-09-12T17:07:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4159000000000005e-05 2024-09-12T17:07:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338565+0000", 2024-09-12T17:07:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3306000000000006e-05 2024-09-12T17:07:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.325887465999998, 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027821550000000001, 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 907 2024-09-12T17:07:02.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423690+0000", 2024-09-12T17:07:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-12T17:07:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423702+0000", 2024-09-12T17:07:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2404e-05 2024-09-12T17:07:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423735+0000", 2024-09-12T17:07:02.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3062999999999998e-05 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423750+0000", 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4912999999999999e-05 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423919+0000", 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016838899999999999 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424160+0000", 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024105099999999999 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424492+0000", 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033261100000000002 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.425785+0000", 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001292397 2024-09-12T17:07:02.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426322+0000", 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00053743200000000001 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426403+0000", 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0898999999999999e-05 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426469+0000", 2024-09-12T17:07:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5720000000000001e-05 2024-09-12T17:07:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:07:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.226721777999998, 2024-09-12T17:07:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029674670000000001, 2024-09-12T17:07:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.860 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 949 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:07:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522855+0000", 2024-09-12T17:07:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-12T17:07:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522871+0000", 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5950000000000001e-05 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522906+0000", 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316000000000001e-05 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522924+0000", 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8326999999999999e-05 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523047+0000", 2024-09-12T17:07:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123609 2024-09-12T17:07:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523282+0000", 2024-09-12T17:07:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234465 2024-09-12T17:07:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:02.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523606+0000", 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032453099999999997 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.524804+0000", 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011977509999999999 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525626+0000", 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082216400000000001 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525743+0000", 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116679 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525820+0000", 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6631999999999994e-05 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:07:02.866 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.212998104, 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030602540000000001, 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 955 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:07:02.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536578+0000", 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536590+0000", 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1250000000000001e-05 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536624+0000", 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4227000000000003e-05 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536646+0000", 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2195999999999999e-05 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536794+0000", 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014799600000000001 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537005+0000", 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021096799999999999 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537489+0000", 2024-09-12T17:07:02.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048413599999999997 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.538940+0000", 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001451262 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539441+0000", 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050002300000000005 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539535+0000", 2024-09-12T17:07:02.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4526999999999998e-05 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539636+0000", 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010111900000000001 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 63.208740769999999, 2024-09-12T17:07:02.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030889300000000001, 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 957 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:07:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540836+0000", 2024-09-12T17:07:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:07:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540862+0000", 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999999e-05 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540891+0000", 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9595999999999999e-05 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540906+0000", 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4919999999999999e-05 2024-09-12T17:07:02.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541052+0000", 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014583900000000001 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541232+0000", 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180259 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541500+0000", 2024-09-12T17:07:02.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026788799999999998 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.542483+0000", 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000983142 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543756+0000", 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001272977 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:02.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543842+0000", 2024-09-12T17:07:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5748999999999995e-05 2024-09-12T17:07:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543922+0000", 2024-09-12T17:07:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0000000000000007e-05 2024-09-12T17:07:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:02.878 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:02.878 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:02.880 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:07:02.880 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:02.876+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:02.980 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:02.976+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:03.082 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:03.078+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:03.094 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:03.094 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:03.094 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:03.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:07:03.204 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:03.200+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:03.284 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:03.278+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:03.324 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:03.325 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:03.325 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:03.342 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:07:03.384 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:03.382+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:03.485 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:03.482+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:03.557 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:03.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-12T17:07:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:07:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.008705473999996, 2024-09-12T17:07:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011583833, 2024-09-12T17:07:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:07:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.558 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 44 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:07:03.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544942+0000", 2024-09-12T17:07:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.653e-06 2024-09-12T17:07:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544957+0000", 2024-09-12T17:07:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5654e-05 2024-09-12T17:07:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544993+0000", 2024-09-12T17:07:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5936000000000003e-05 2024-09-12T17:07:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.545017+0000", 2024-09-12T17:07:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3283000000000001e-05 2024-09-12T17:07:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549277+0000", 2024-09-12T17:07:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042606800000000002 2024-09-12T17:07:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:07:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549301+0000", 2024-09-12T17:07:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3260000000000001e-05 2024-09-12T17:07:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556317+0000", 2024-09-12T17:07:03.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070164620000000002 2024-09-12T17:07:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556522+0000", 2024-09-12T17:07:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020490499999999999 2024-09-12T17:07:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:07:03.563 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.965239928000003, 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054133180000000003, 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 207 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588408+0000", 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T17:07:03.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588428+0000", 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9910000000000001e-05 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588467+0000", 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588483+0000", 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6443000000000002e-05 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588659+0000", 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569499999999999 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589033+0000", 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037374100000000003 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589729+0000", 2024-09-12T17:07:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069659400000000003 2024-09-12T17:07:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593394+0000", 2024-09-12T17:07:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036653279999999998 2024-09-12T17:07:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593661+0000", 2024-09-12T17:07:03.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026662499999999999 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593743+0000", 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1428999999999996e-05 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593817+0000", 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4475999999999996e-05 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.929019228000001, 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034289839999999999, 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 216 2024-09-12T17:07:03.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624628+0000", 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2399999999999999e-06 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624641+0000", 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3743e-05 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624675+0000", 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3277e-05 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624690+0000", 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5812999999999999e-05 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624847+0000", 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156269 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625092+0000", 2024-09-12T17:07:03.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024499500000000002 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625494+0000", 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040263000000000001 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.626934+0000", 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001439159 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627890+0000", 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095619599999999998 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627978+0000", 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8446e-05 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.628053+0000", 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5216000000000006e-05 2024-09-12T17:07:03.575 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.887510985000006, 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003364985, 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.576 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 227 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666135+0000", 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.644e-06 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666147+0000", 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1960000000000001e-05 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666179+0000", 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1813000000000002e-05 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666195+0000", 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5679999999999999e-05 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666342+0000", 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147312 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666559+0000", 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021664199999999999 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.667037+0000", 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047816200000000002 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.668796+0000", 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017590010000000001 2024-09-12T17:07:03.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669346+0000", 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055024499999999999 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669433+0000", 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6650000000000006e-05 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669498+0000", 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4875999999999993e-05 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.880303725999994, 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031932409999999999, 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.582 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 229 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:07:03.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673342+0000", 2024-09-12T17:07:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3499999999999999e-06 2024-09-12T17:07:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673354+0000", 2024-09-12T17:07:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1739999999999999e-05 2024-09-12T17:07:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673386+0000", 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1782000000000002e-05 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673400+0000", 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4663e-05 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673577+0000", 2024-09-12T17:07:03.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017662900000000001 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673783+0000", 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020620799999999999 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.674174+0000", 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039082100000000002 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.675441+0000", 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001267177 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676382+0000", 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094087900000000004 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676468+0000", 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5762999999999999e-05 2024-09-12T17:07:03.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676533+0000", 2024-09-12T17:07:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5228999999999995e-05 2024-09-12T17:07:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:07:03.588 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.872560802999999, 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0037357380000000002, 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 231 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:07:03.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681085+0000", 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681096+0000", 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0866000000000001e-05 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681126+0000", 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9977000000000001e-05 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681140+0000", 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4195999999999999e-05 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681288+0000", 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014765199999999999 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681637+0000", 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034917100000000001 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.682358+0000", 2024-09-12T17:07:03.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072050800000000002 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684139+0000", 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017812399999999999 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684543+0000", 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040413299999999999 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684703+0000", 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160075 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684819+0000", 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011553300000000001 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:374 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.594 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.817683372999994, 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031135910000000002, 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 374 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735961+0000", 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0979999999999999e-06 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735968+0000", 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735981+0000", 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3164e-05 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735989+0000", 2024-09-12T17:07:03.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8010000000000004e-06 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736041+0000", 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800999999999998e-05 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736137+0000", 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5497999999999999e-05 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736303+0000", 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016580100000000001 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736802+0000", 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049966599999999996 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739015+0000", 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022122919999999998 2024-09-12T17:07:03.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739047+0000", 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2678000000000001e-05 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739074+0000", 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6594e-05 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.592238629999997, 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029096640000000002, 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 715 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.601 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961407+0000", 2024-09-12T17:07:03.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:07:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961419+0000", 2024-09-12T17:07:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.117e-05 2024-09-12T17:07:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961450+0000", 2024-09-12T17:07:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1463e-05 2024-09-12T17:07:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961465+0000", 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961576+0000", 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111016 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961785+0000", 2024-09-12T17:07:03.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020865599999999999 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.962105+0000", 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031996699999999999 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.963189+0000", 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010845519999999999 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964163+0000", 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097355800000000002 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964252+0000", 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8996e-05 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964315+0000", 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2773000000000004e-05 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.557968074000001, 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883207, 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 730 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.607 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995678+0000", 2024-09-12T17:07:03.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995689+0000", 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1316e-05 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995722+0000", 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995745+0000", 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3496999999999999e-05 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995902+0000", 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156446 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996113+0000", 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021091099999999999 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:03.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996444+0000", 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000330785 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.997558+0000", 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001114681 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998420+0000", 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086125299999999998 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998497+0000", 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7919999999999999e-05 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998559+0000", 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1319e-05 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.539486510000003, 2024-09-12T17:07:03.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002862248, 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 738 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014159+0000", 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014168+0000", 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.653e-06 2024-09-12T17:07:03.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014191+0000", 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3706e-05 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014213+0000", 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2050000000000001e-05 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014363+0000", 2024-09-12T17:07:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014956299999999999 2024-09-12T17:07:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014485+0000", 2024-09-12T17:07:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000122132 2024-09-12T17:07:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014770+0000", 2024-09-12T17:07:03.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000284911 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.015864+0000", 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010942180000000001 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016864+0000", 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00099982299999999994 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016951+0000", 2024-09-12T17:07:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6476000000000003e-05 2024-09-12T17:07:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.017019+0000", 2024-09-12T17:07:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8756000000000004e-05 2024-09-12T17:07:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.457165132, 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032495950000000001, 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 772 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:07:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:07:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096481+0000", 2024-09-12T17:07:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4399999999999999e-06 2024-09-12T17:07:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096492+0000", 2024-09-12T17:07:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1513e-05 2024-09-12T17:07:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096522+0000", 2024-09-12T17:07:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9156e-05 2024-09-12T17:07:03.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096536+0000", 2024-09-12T17:07:03.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4347e-05 2024-09-12T17:07:03.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096681+0000", 2024-09-12T17:07:03.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145348 2024-09-12T17:07:03.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096896+0000", 2024-09-12T17:07:03.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214489 2024-09-12T17:07:03.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:03.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.097208+0000", 2024-09-12T17:07:03.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031215099999999999 2024-09-12T17:07:03.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.098332+0000", 2024-09-12T17:07:03.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001123635 2024-09-12T17:07:03.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099583+0000", 2024-09-12T17:07:03.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00125179 2024-09-12T17:07:03.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099663+0000", 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9703000000000006e-05 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099728+0000", 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5023000000000004e-05 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.625 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.385423173000007, 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028771949999999999, 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 802 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168223+0000", 2024-09-12T17:07:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4499999999999998e-06 2024-09-12T17:07:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168234+0000", 2024-09-12T17:07:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:07:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168265+0000", 2024-09-12T17:07:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0777e-05 2024-09-12T17:07:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168279+0000", 2024-09-12T17:07:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4525999999999999e-05 2024-09-12T17:07:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168397+0000", 2024-09-12T17:07:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118063 2024-09-12T17:07:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168616+0000", 2024-09-12T17:07:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000218505 2024-09-12T17:07:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168970+0000", 2024-09-12T17:07:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00035427400000000002 2024-09-12T17:07:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170038+0000", 2024-09-12T17:07:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001067571 2024-09-12T17:07:03.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170897+0000", 2024-09-12T17:07:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085934399999999995 2024-09-12T17:07:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170983+0000", 2024-09-12T17:07:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6179000000000003e-05 2024-09-12T17:07:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.171098+0000", 2024-09-12T17:07:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114576 2024-09-12T17:07:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:07:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.326623346999995, 2024-09-12T17:07:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033328609999999999, 2024-09-12T17:07:03.632 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 826 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227023+0000", 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227035+0000", 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227067+0000", 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2305999999999999e-05 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227082+0000", 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.485e-05 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227247+0000", 2024-09-12T17:07:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016483900000000001 2024-09-12T17:07:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227630+0000", 2024-09-12T17:07:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038350100000000001 2024-09-12T17:07:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:03.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.228201+0000", 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057026799999999997 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.229556+0000", 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013553300000000001 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230084+0000", 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00052805599999999995 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230238+0000", 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015438499999999999 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230353+0000", 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114809 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:07:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.267349991000003, 2024-09-12T17:07:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033407710000000002, 2024-09-12T17:07:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 850 2024-09-12T17:07:03.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:07:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:07:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286296+0000", 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286307+0000", 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1287000000000001e-05 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286339+0000", 2024-09-12T17:07:03.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1331999999999997e-05 2024-09-12T17:07:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286353+0000", 2024-09-12T17:07:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4517e-05 2024-09-12T17:07:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286504+0000", 2024-09-12T17:07:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015038200000000001 2024-09-12T17:07:03.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286897+0000", 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039326399999999999 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.287451+0000", 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055426900000000003 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.288825+0000", 2024-09-12T17:07:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013741160000000001 2024-09-12T17:07:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289484+0000", 2024-09-12T17:07:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00065819499999999998 2024-09-12T17:07:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289570+0000", 2024-09-12T17:07:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6383000000000003e-05 2024-09-12T17:07:03.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289634+0000", 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4505999999999995e-05 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.229358074000004, 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002894237, 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.645 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 865 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324288+0000", 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2469999999999998e-06 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324299+0000", 2024-09-12T17:07:03.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0823e-05 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324330+0000", 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1846e-05 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324350+0000", 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9077e-05 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324463+0000", 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011367200000000001 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324693+0000", 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008800000000001 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.325000+0000", 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030629499999999999 2024-09-12T17:07:03.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.326117+0000", 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011175709999999999 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327026+0000", 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00090879000000000003 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327113+0000", 2024-09-12T17:07:03.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7093000000000001e-05 2024-09-12T17:07:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327180+0000", 2024-09-12T17:07:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6735000000000004e-05 2024-09-12T17:07:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.651 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.214844576000004, 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030741359999999999, 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 871 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338802+0000", 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338831+0000", 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9356000000000002e-05 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338868+0000", 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7357000000000002e-05 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338883+0000", 2024-09-12T17:07:03.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4932999999999999e-05 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339036+0000", 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152423 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339264+0000", 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022814100000000001 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:03.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339593+0000", 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032943099999999998 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.340783+0000", 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011898740000000001 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341724+0000", 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094134600000000002 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341809+0000", 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4155999999999999e-05 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341873+0000", 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4605999999999998e-05 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.657 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.157352516000003, 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003093649, 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 895 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:07:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:07:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396294+0000", 2024-09-12T17:07:03.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3999999999999999e-06 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396307+0000", 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3468999999999999e-05 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396338+0000", 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1433000000000002e-05 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396353+0000", 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4557e-05 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396496+0000", 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014275900000000001 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396719+0000", 2024-09-12T17:07:03.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022317499999999999 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.397052+0000", 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033263699999999999 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.398211+0000", 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011593350000000001 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399235+0000", 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010241219999999999 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399321+0000", 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5789000000000001e-05 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399385+0000", 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3973000000000006e-05 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.150865460000006, 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029302239999999999, 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 898 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402780+0000", 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9269999999999999e-06 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402789+0000", 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7069999999999998e-06 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402830+0000", 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1470000000000001e-05 2024-09-12T17:07:03.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402846+0000", 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5319e-05 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402938+0000", 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2289999999999999e-05 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403134+0000", 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000196014 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403437+0000", 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030337199999999999 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.404507+0000", 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001069492 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405432+0000", 2024-09-12T17:07:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092532900000000002 2024-09-12T17:07:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405590+0000", 2024-09-12T17:07:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158018 2024-09-12T17:07:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405708+0000", 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118286 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.065458199000005, 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030817499999999999, 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 934 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:07:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488188+0000", 2024-09-12T17:07:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8040000000000002e-06 2024-09-12T17:07:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488201+0000", 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2893e-05 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488233+0000", 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2085999999999997e-05 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488248+0000", 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4976e-05 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488415+0000", 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016677900000000001 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488650+0000", 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234875 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488961+0000", 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031078799999999999 2024-09-12T17:07:03.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.490177+0000", 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001216607 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491119+0000", 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000941806 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491202+0000", 2024-09-12T17:07:03.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3349000000000004e-05 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491267+0000", 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4787000000000002e-05 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:07:03.676 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 64.054639218999995, 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031107489999999999, 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 939 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:03.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499007+0000", 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3970000000000001e-06 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499018+0000", 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0969e-05 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499052+0000", 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3896999999999997e-05 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499068+0000", 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6552999999999999e-05 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499200+0000", 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013206599999999999 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499438+0000", 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023806500000000001 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499922+0000", 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048369599999999998 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501326+0000", 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014036560000000001 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501962+0000", 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063623100000000001 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502048+0000", 2024-09-12T17:07:03.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5636999999999993e-05 2024-09-12T17:07:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502115+0000", 2024-09-12T17:07:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7582000000000004e-05 2024-09-12T17:07:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:03.682 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:03.682 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:03.684 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:07:03.684 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:03.678+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:03.785 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:03.780+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:03.817 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:03.817 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:03.817 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:03.817 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:03.833 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:07:03.886 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:03.880+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:03.946 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:07:03.953 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:03.953 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:03.953 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:03.953 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:03.954 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:03.968 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:07:03.991 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:03.988+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:04.087 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:04.080+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:04.092 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:07:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.480542602, 2024-09-12T17:07:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003566582, 2024-09-12T17:07:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.093 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 211 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608233+0000", 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.343e-06 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608248+0000", 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4747e-05 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608285+0000", 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7239e-05 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608302+0000", 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6909999999999999e-05 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608454+0000", 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015164599999999999 2024-09-12T17:07:04.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608666+0000", 2024-09-12T17:07:04.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021213499999999999 2024-09-12T17:07:04.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:07:04.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.609092+0000", 2024-09-12T17:07:04.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042601999999999999 2024-09-12T17:07:04.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.610771+0000", 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016786940000000001 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611640+0000", 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00086891300000000002 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611731+0000", 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1058999999999997e-05 2024-09-12T17:07:04.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611796+0000", 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5876000000000004e-05 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.401572584999997, 2024-09-12T17:07:04.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035636330000000001, 2024-09-12T17:07:04.100 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.100 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.100 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.100 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.100 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.100 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.100 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 232 2024-09-12T17:07:04.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.100 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:07:04.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:07:04.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687203+0000", 2024-09-12T17:07:04.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T17:07:04.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687216+0000", 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346999999999999e-05 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687250+0000", 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3992999999999998e-05 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687266+0000", 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.577e-05 2024-09-12T17:07:04.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687402+0000", 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013599599999999999 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687630+0000", 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228168 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:04.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.688057+0000", 2024-09-12T17:07:04.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042653999999999999 2024-09-12T17:07:04.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.689651+0000", 2024-09-12T17:07:04.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015945009999999999 2024-09-12T17:07:04.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690608+0000", 2024-09-12T17:07:04.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095638899999999998 2024-09-12T17:07:04.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690694+0000", 2024-09-12T17:07:04.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6119000000000007e-05 2024-09-12T17:07:04.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690764+0000", 2024-09-12T17:07:04.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9757000000000003e-05 2024-09-12T17:07:04.105 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.105 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.105 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.106 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.106 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:07:04.106 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.381126155999993, 2024-09-12T17:07:04.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030740059999999998, 2024-09-12T17:07:04.106 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.106 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.106 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.106 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.106 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.107 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.107 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 241 2024-09-12T17:07:04.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.107 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:07:04.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:07:04.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707649+0000", 2024-09-12T17:07:04.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:07:04.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707661+0000", 2024-09-12T17:07:04.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2e-05 2024-09-12T17:07:04.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707693+0000", 2024-09-12T17:07:04.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2299999999999999e-05 2024-09-12T17:07:04.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707709+0000", 2024-09-12T17:07:04.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6096e-05 2024-09-12T17:07:04.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707871+0000", 2024-09-12T17:07:04.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016122200000000001 2024-09-12T17:07:04.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.708198+0000", 2024-09-12T17:07:04.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032765799999999999 2024-09-12T17:07:04.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:04.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.708655+0000", 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00045698599999999999 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710022+0000", 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013664059999999999 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710578+0000", 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055600199999999999 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710650+0000", 2024-09-12T17:07:04.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2767000000000003e-05 2024-09-12T17:07:04.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.112 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.112 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710720+0000", 2024-09-12T17:07:04.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9839000000000007e-05 2024-09-12T17:07:04.112 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.112 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.112 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.113 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:434 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.113 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:07:04.113 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.328343247000006, 2024-09-12T17:07:04.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030966930000000002, 2024-09-12T17:07:04.113 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.113 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.113 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.113 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.113 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.113 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.113 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 434 2024-09-12T17:07:04.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.114 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:07:04.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:07:04.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760432+0000", 2024-09-12T17:07:04.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4540000000000001e-06 2024-09-12T17:07:04.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760443+0000", 2024-09-12T17:07:04.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1123e-05 2024-09-12T17:07:04.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760473+0000", 2024-09-12T17:07:04.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0476000000000001e-05 2024-09-12T17:07:04.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760493+0000", 2024-09-12T17:07:04.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9502999999999999e-05 2024-09-12T17:07:04.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760616+0000", 2024-09-12T17:07:04.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123509 2024-09-12T17:07:04.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760776+0000", 2024-09-12T17:07:04.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000159462 2024-09-12T17:07:04.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:04.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.761216+0000", 2024-09-12T17:07:04.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000440474 2024-09-12T17:07:04.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762555+0000", 2024-09-12T17:07:04.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338926 2024-09-12T17:07:04.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763288+0000", 2024-09-12T17:07:04.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00073298000000000005 2024-09-12T17:07:04.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763434+0000", 2024-09-12T17:07:04.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145544 2024-09-12T17:07:04.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763526+0000", 2024-09-12T17:07:04.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2242000000000002e-05 2024-09-12T17:07:04.119 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:445 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:07:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.321445276000006, 2024-09-12T17:07:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029347829999999998, 2024-09-12T17:07:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.120 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.121 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.121 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.121 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 445 2024-09-12T17:07:04.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.121 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:07:04.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:07:04.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767330+0000", 2024-09-12T17:07:04.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8229999999999999e-06 2024-09-12T17:07:04.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767343+0000", 2024-09-12T17:07:04.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2869e-05 2024-09-12T17:07:04.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767373+0000", 2024-09-12T17:07:04.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0294000000000002e-05 2024-09-12T17:07:04.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767392+0000", 2024-09-12T17:07:04.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.91e-05 2024-09-12T17:07:04.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767522+0000", 2024-09-12T17:07:04.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000130152 2024-09-12T17:07:04.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767688+0000", 2024-09-12T17:07:04.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016599900000000001 2024-09-12T17:07:04.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.768155+0000", 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046654299999999998 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.769308+0000", 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001153165 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770069+0000", 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076044000000000003 2024-09-12T17:07:04.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770155+0000", 2024-09-12T17:07:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6493e-05 2024-09-12T17:07:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770262+0000", 2024-09-12T17:07:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010690499999999999 2024-09-12T17:07:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.126 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.291707737999999, 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039867009999999996, 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 504 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.127 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797067+0000", 2024-09-12T17:07:04.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797078+0000", 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0837e-05 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797108+0000", 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9722000000000001e-05 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797127+0000", 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9539999999999999e-05 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797249+0000", 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121239 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797551+0000", 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030277400000000001 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.798161+0000", 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00060936200000000001 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.799307+0000", 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001146588 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.800728+0000", 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014204389999999999 2024-09-12T17:07:04.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.800831+0000", 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103002 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.801051+0000", 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022061499999999999 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.132 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:626 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.209956536000007, 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032539040000000002, 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 626 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878819+0000", 2024-09-12T17:07:04.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6699999999999998e-06 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878831+0000", 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2882e-05 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878862+0000", 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0332999999999999e-05 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878880+0000", 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8236999999999998e-05 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879009+0000", 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012908599999999999 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879306+0000", 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029693100000000001 2024-09-12T17:07:04.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879873+0000", 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056697200000000001 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881172+0000", 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001298766 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881880+0000", 2024-09-12T17:07:04.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00070808500000000001 2024-09-12T17:07:04.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881962+0000", 2024-09-12T17:07:04.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2069000000000003e-05 2024-09-12T17:07:04.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882070+0000", 2024-09-12T17:07:04.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107873 2024-09-12T17:07:04.138 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.205777169000001, 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030425119999999998, 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.139 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 633 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882997+0000", 2024-09-12T17:07:04.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0530000000000001e-06 2024-09-12T17:07:04.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883009+0000", 2024-09-12T17:07:04.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1195e-05 2024-09-12T17:07:04.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883037+0000", 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8484999999999999e-05 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883055+0000", 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8467000000000001e-05 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883196+0000", 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014099499999999999 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.143 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.143 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883444+0000", 2024-09-12T17:07:04.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000247758 2024-09-12T17:07:04.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:04.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883892+0000", 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044757299999999999 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885202+0000", 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001310587 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885879+0000", 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00067645599999999998 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885945+0000", 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6575999999999994e-05 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.886038+0000", 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2367000000000005e-05 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:644 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.195779735000002, 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030197190000000001, 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 644 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.147 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892995+0000", 2024-09-12T17:07:04.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1390000000000002e-06 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893004+0000", 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3729999999999999e-06 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893029+0000", 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5058999999999998e-05 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893041+0000", 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1858000000000001e-05 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893190+0000", 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014875199999999999 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893575+0000", 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038538 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.894140+0000", 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056461200000000003 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895394+0000", 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012536100000000001 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895856+0000", 2024-09-12T17:07:04.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046213 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895940+0000", 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4808999999999994e-05 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.896012+0000", 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1996999999999995e-05 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.153 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:711 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.153 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:07:04.153 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.135431041999993, 2024-09-12T17:07:04.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00296547, 2024-09-12T17:07:04.153 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.153 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.153 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.153 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.153 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.153 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.153 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 711 2024-09-12T17:07:04.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953343+0000", 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.046e-06 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953353+0000", 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4939999999999992e-06 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953386+0000", 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2919000000000001e-05 2024-09-12T17:07:04.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953405+0000", 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9596999999999999e-05 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953576+0000", 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017032500000000001 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953828+0000", 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025190800000000001 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.954297+0000", 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046897300000000002 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.955510+0000", 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012131139999999999 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956183+0000", 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00067301800000000005 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956254+0000", 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0786999999999998e-05 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956307+0000", 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3288999999999998e-05 2024-09-12T17:07:04.158 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:07:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.105520296999998, 2024-09-12T17:07:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029480109999999999, 2024-09-12T17:07:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.159 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 724 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:07:04.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983255+0000", 2024-09-12T17:07:04.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4140000000000001e-06 2024-09-12T17:07:04.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983266+0000", 2024-09-12T17:07:04.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1039999999999999e-05 2024-09-12T17:07:04.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983298+0000", 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1949000000000002e-05 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983313+0000", 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5296999999999999e-05 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983416+0000", 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102921 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983578+0000", 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000162244 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983835+0000", 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025741700000000002 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.984947+0000", 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011111949999999999 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.985915+0000", 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00096828599999999995 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.986080+0000", 2024-09-12T17:07:04.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016498500000000001 2024-09-12T17:07:04.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.986200+0000", 2024-09-12T17:07:04.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120263 2024-09-12T17:07:04.165 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.165 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.165 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.165 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.165 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 65.097912128000004, 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029804559999999998, 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 727 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990862+0000", 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0959999999999999e-06 2024-09-12T17:07:04.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990872+0000", 2024-09-12T17:07:04.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1039999999999996e-06 2024-09-12T17:07:04.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990897+0000", 2024-09-12T17:07:04.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5626000000000002e-05 2024-09-12T17:07:04.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990911+0000", 2024-09-12T17:07:04.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346000000000001e-05 2024-09-12T17:07:04.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990999+0000", 2024-09-12T17:07:04.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8887000000000005e-05 2024-09-12T17:07:04.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.169 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.169 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.991252+0000", 2024-09-12T17:07:04.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025290099999999998 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.991617+0000", 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036479399999999999 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.992803+0000", 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011859049999999999 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993677+0000", 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00087379199999999997 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993774+0000", 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7343000000000006e-05 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993841+0000", 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6662000000000007e-05 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.171 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.172 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.172 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:07:04.172 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.982969436000005, 2024-09-12T17:07:04.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035861349999999998, 2024-09-12T17:07:04.172 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.172 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.172 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.172 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 775 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105806+0000", 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9529999999999999e-06 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105818+0000", 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2447e-05 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105851+0000", 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2969999999999998e-05 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105867+0000", 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5116999999999999e-05 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106011+0000", 2024-09-12T17:07:04.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014498500000000001 2024-09-12T17:07:04.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106382+0000", 2024-09-12T17:07:04.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037012699999999999 2024-09-12T17:07:04.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.176 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:04.176 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106946+0000", 2024-09-12T17:07:04.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056435199999999995 2024-09-12T17:07:04.176 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.108269+0000", 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00132256 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109120+0000", 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00085151300000000003 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109274+0000", 2024-09-12T17:07:04.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015367199999999999 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109389+0000", 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115439 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.977880575, 2024-09-12T17:07:04.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031979489999999998, 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 777 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110894+0000", 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4870000000000001e-06 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110905+0000", 2024-09-12T17:07:04.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.098e-05 2024-09-12T17:07:04.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110938+0000", 2024-09-12T17:07:04.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:07:04.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.181 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.181 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110953+0000", 2024-09-12T17:07:04.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5058999999999999e-05 2024-09-12T17:07:04.181 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111080+0000", 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000127033 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111312+0000", 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000231828 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111791+0000", 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00047926000000000002 2024-09-12T17:07:04.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.112965+0000", 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011740209999999999 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.113920+0000", 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095542000000000001 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.114009+0000", 2024-09-12T17:07:04.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8162000000000001e-05 2024-09-12T17:07:04.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.114090+0000", 2024-09-12T17:07:04.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1203000000000002e-05 2024-09-12T17:07:04.184 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.184 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.184 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.184 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.184 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.890270900999994, 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030645529999999998, 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 814 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198504+0000", 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6630000000000002e-06 2024-09-12T17:07:04.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198515+0000", 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1014e-05 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198548+0000", 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2339999999999999e-05 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198563+0000", 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5228999999999999e-05 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198683+0000", 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120569 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198886+0000", 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020240199999999999 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:04.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.199199+0000", 2024-09-12T17:07:04.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031304800000000002 2024-09-12T17:07:04.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.200322+0000", 2024-09-12T17:07:04.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011236309999999999 2024-09-12T17:07:04.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201410+0000", 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010880110000000001 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201494+0000", 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3863000000000007e-05 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201566+0000", 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1783e-05 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.190 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:07:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.724795044999993, 2024-09-12T17:07:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030460629999999999, 2024-09-12T17:07:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.191 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 880 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:07:04.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363980+0000", 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0699999999999998e-06 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363993+0000", 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2439999999999999e-05 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364026+0000", 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2886999999999999e-05 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364041+0000", 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5255999999999999e-05 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364160+0000", 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011927200000000001 2024-09-12T17:07:04.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364388+0000", 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228116 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364728+0000", 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033925999999999997 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.365909+0000", 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001181091 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.366732+0000", 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082351699999999996 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.366907+0000", 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000174568 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.367023+0000", 2024-09-12T17:07:04.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116586 2024-09-12T17:07:04.197 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.197 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.197 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.197 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.197 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:07:04.197 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.720207283999997, 2024-09-12T17:07:04.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002854625, 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 882 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:07:04.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368568+0000", 2024-09-12T17:07:04.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5799999999999999e-06 2024-09-12T17:07:04.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368579+0000", 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.13e-05 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368613+0000", 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3949999999999999e-05 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368628+0000", 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5443000000000001e-05 2024-09-12T17:07:04.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368753+0000", 2024-09-12T17:07:04.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012430899999999999 2024-09-12T17:07:04.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368898+0000", 2024-09-12T17:07:04.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145012 2024-09-12T17:07:04.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.369195+0000", 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029734100000000001 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.370341+0000", 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001145985 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371159+0000", 2024-09-12T17:07:04.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081784999999999996 2024-09-12T17:07:04.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371309+0000", 2024-09-12T17:07:04.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014978600000000001 2024-09-12T17:07:04.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371420+0000", 2024-09-12T17:07:04.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111069 2024-09-12T17:07:04.203 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.203 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.204 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.204 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.204 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:07:04.204 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.649639387999997, 2024-09-12T17:07:04.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028637710000000002, 2024-09-12T17:07:04.204 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.204 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.204 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.204 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.204 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.205 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.205 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 913 2024-09-12T17:07:04.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.205 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:07:04.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:07:04.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439136+0000", 2024-09-12T17:07:04.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7259999999999998e-06 2024-09-12T17:07:04.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439150+0000", 2024-09-12T17:07:04.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4419999999999999e-05 2024-09-12T17:07:04.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439181+0000", 2024-09-12T17:07:04.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0303000000000001e-05 2024-09-12T17:07:04.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439200+0000", 2024-09-12T17:07:04.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9313e-05 2024-09-12T17:07:04.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439316+0000", 2024-09-12T17:07:04.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115893 2024-09-12T17:07:04.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439541+0000", 2024-09-12T17:07:04.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022517199999999999 2024-09-12T17:07:04.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:04.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439857+0000", 2024-09-12T17:07:04.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031612699999999998 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441075+0000", 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001218114 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441846+0000", 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00077121100000000005 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441931+0000", 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4338999999999993e-05 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441997+0000", 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6153000000000002e-05 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.210 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.619943800000001, 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032820639999999999, 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 925 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:07:04.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:07:04.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468831+0000", 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1459999999999999e-06 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468842+0000", 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0727000000000001e-05 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468874+0000", 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2261999999999997e-05 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468888+0000", 2024-09-12T17:07:04.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4507e-05 2024-09-12T17:07:04.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469011+0000", 2024-09-12T17:07:04.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012317599999999999 2024-09-12T17:07:04.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469252+0000", 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024031500000000001 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469575+0000", 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032279699999999999 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.470640+0000", 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001065262 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.471902+0000", 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001262504 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.471990+0000", 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7552000000000005e-05 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.472111+0000", 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120816 2024-09-12T17:07:04.216 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 64.612542125000004, 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030855499999999998, 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:04.217 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 928 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476232+0000", 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9769999999999999e-06 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476242+0000", 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0003000000000001e-05 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476269+0000", 2024-09-12T17:07:04.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6727e-05 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476288+0000", 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8649999999999999e-05 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476400+0000", 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111959 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:04.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476614+0000", 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000214465 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476920+0000", 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030588700000000002 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.478203+0000", 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001282547 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479162+0000", 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095971299999999995 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479249+0000", 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6959000000000005e-05 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479316+0000", 2024-09-12T17:07:04.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6662999999999995e-05 2024-09-12T17:07:04.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.223 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.223 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:04.223 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:04.223 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:04.223 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T17:07:04.224 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:04.225 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:04.225 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:04.226 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:04.226 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:07:04.227 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:04.227 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:04.227 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:04.220+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:04.239 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:04.239 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:04.272 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:04.272 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:04.304 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:04.305 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:04.326 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:04.320+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:04.338 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:04.338 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:04.360 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:04.361 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:04.370 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:04.371 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:04.376 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:07:04.427 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:04.422+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:04.507 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:04.507 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:04.521 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:07:04.528 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:04.524+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:04.629 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:04.624+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:04.691 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:04.705 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:04.750 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:04.746+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:04.831 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:04.826+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:04.833 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:04.833 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:04.848 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:04.931 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:04.924+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:05.009 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:05.010 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:05.024 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:05.067 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T17:07:05.076 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:05.066+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:05.139 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:05.136+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:05.147 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:05.147 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:05.162 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:05.233 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:05.228+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:05.332 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:05.332 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:05.334 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:05.326+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:05.346 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:05.438 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:05.434+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:05.521 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:05.521 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:05.536 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:05.532+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:05.537 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:05.636 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:05.632+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:05.708 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:05.708 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:05.723 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:07:05.738 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:05.730+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:05.839 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:05.834+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:05.840 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:05.840 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:05.854 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:07:05.939 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:05.932+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:05.977 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:05.977 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:05.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:07:06.080 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:06.076+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:06.142 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:06.138+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:06.159 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:06.159 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:06.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:07:06.260 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:06.256+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:06.343 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:06.342+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:06.346 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:06.346 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:06.360 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:07:06.394 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:07:06.444 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:06.438+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:06.530 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:06.531 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:06.544 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:07:06.545 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:06.538+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:06.547 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:06.547 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:06.563 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:06.563 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:06.579 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:06.596 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:06.596 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:06.617 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:06.617 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:06.637 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:06.637 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:06.646 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:06.640+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:06.655 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:07:06.655 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.125944212999997, 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:07:06.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:07:06.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:07:06.660 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 70.968312017000002, 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:07:06.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.666 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:07:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.058218224000001, 2024-09-12T17:07:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:07:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:07:06.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:07:06.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.672 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.042327482999994, 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:07:06.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:07:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:07:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:07:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:07:06.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.016858812999999, 2024-09-12T17:07:06.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:07:06.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.997897711999997, 2024-09-12T17:07:06.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:06.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:07:06.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:06.691 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.963342412000003, 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:07:06.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:07:06.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.650122999000004, 2024-09-12T17:07:06.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:06.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:07:06.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:07:06.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.645231631000001, 2024-09-12T17:07:06.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:06.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:07:06.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.606256172000002, 2024-09-12T17:07:06.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:07:06.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:06.715 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.602358198000005, 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:06.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:07:06.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:07:06.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.533598966, 2024-09-12T17:07:06.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:07:06.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:07:06.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.497754951999994, 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:07:06.727 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:07:06.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:07:06.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.477567581000002, 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:07:06.733 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:07:06.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:07:06.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.472673219000001, 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.739 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:07:06.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:07:06.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.410705063999998, 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:07:06.745 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:07:06.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:07:06.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.406298289000006, 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:07:06.751 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:07:06.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:07:06.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:06.757 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.238898946999996, 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:06.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:07:06.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:07:06.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.763 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.208123913999998, 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.764 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:07:06.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:06.769 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.203211659000004, 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:06.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.772 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:07:06.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:07:06.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:07:06.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:06.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:06.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:06.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:07:06.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:07:06.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.775 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.775 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:06.775 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:06.775 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:06.776 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:06.777 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:06.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:07:06.778 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:06.779 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:06.779 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:06.772+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:06.878 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:06.872+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:06.936 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:06.936 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:06.936 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:06.949 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:07:06.978 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:06.974+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:07.080 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:07.074+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:07.095 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T17:07:07.115 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:07.116 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:07.116 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:07.116 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:07.116 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:07.130 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:07:07.180 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:07.178+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:07.281 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:07.276+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:07.293 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:07.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.688709063000005, 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027134059999999998, 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 42 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.294 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600334+0000", 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600336+0000", 2024-09-12T17:07:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1270000000000001e-06 2024-09-12T17:07:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600346+0000", 2024-09-12T17:07:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.499e-06 2024-09-12T17:07:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600370+0000", 2024-09-12T17:07:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4411000000000001e-05 2024-09-12T17:07:07.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600386+0000", 2024-09-12T17:07:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6205000000000002e-05 2024-09-12T17:07:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600471+0000", 2024-09-12T17:07:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5013999999999996e-05 2024-09-12T17:07:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600569+0000", 2024-09-12T17:07:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7663000000000003e-05 2024-09-12T17:07:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.600677+0000", 2024-09-12T17:07:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108571 2024-09-12T17:07:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.601918+0000", 2024-09-12T17:07:07.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012408090000000001 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.602976+0000", 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001058217 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603016+0000", 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9894000000000001e-05 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.603047+0000", 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0995999999999999e-05 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 71.707653467, 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002848798, 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.300 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 52 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581389+0000", 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581393+0000", 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4070000000000002e-06 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581405+0000", 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1885999999999999e-05 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581439+0000", 2024-09-12T17:07:07.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3966e-05 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581457+0000", 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7842999999999998e-05 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581567+0000", 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011048900000000001 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581754+0000", 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018672099999999999 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.581913+0000", 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015923700000000001 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.583010+0000", 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001096947 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584083+0000", 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010725730000000001 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584168+0000", 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4981999999999994e-05 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.584238+0000", 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0747000000000006e-05 2024-09-12T17:07:07.305 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.589398815999999, 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003254804, 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.306 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 236 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699647+0000", 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1300000000000001e-06 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699660+0000", 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2326e-05 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699694+0000", 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4552999999999999e-05 2024-09-12T17:07:07.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699710+0000", 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5573000000000002e-05 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699835+0000", 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012534300000000001 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700050+0000", 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214565 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700448+0000", 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039816999999999999 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702129+0000", 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001680874 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702721+0000", 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00059224199999999999 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702804+0000", 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3071999999999993e-05 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702899+0000", 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4956000000000004e-05 2024-09-12T17:07:07.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:271 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.576958289000004, 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026770299999999999, 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.312 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 271 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712085+0000", 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712086+0000", 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3510000000000001e-06 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712092+0000", 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5670000000000002e-06 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712105+0000", 2024-09-12T17:07:07.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3438000000000001e-05 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712112+0000", 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6229999999999999e-06 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712181+0000", 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9323e-05 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712327+0000", 2024-09-12T17:07:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014620900000000001 2024-09-12T17:07:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.712530+0000", 2024-09-12T17:07:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020267700000000001 2024-09-12T17:07:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.713251+0000", 2024-09-12T17:07:07.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072110800000000004 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714674+0000", 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001423021 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714718+0000", 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4459000000000002e-05 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.714762+0000", 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3254000000000003e-05 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:287 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.573731805999998, 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034654030000000001, 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 287 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:07:07.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715312+0000", 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1340000000000001e-06 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715318+0000", 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8409999999999996e-06 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715332+0000", 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4265e-05 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715342+0000", 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3360000000000001e-06 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715412+0000", 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9980000000000004e-05 2024-09-12T17:07:07.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715511+0000", 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9197000000000006e-05 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715663+0000", 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152347 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.716287+0000", 2024-09-12T17:07:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00062330100000000004 2024-09-12T17:07:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718705+0000", 2024-09-12T17:07:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002418505 2024-09-12T17:07:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718743+0000", 2024-09-12T17:07:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7645999999999998e-05 2024-09-12T17:07:07.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718777+0000", 2024-09-12T17:07:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3850999999999998e-05 2024-09-12T17:07:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:07:07.324 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.264251952999999, 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028821710000000002, 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 742 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:07:07.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024794+0000", 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7669999999999999e-06 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024805+0000", 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1093e-05 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024836+0000", 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1136000000000001e-05 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024852+0000", 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6140000000000001e-05 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024989+0000", 2024-09-12T17:07:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000136422 2024-09-12T17:07:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025219+0000", 2024-09-12T17:07:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008499999999999 2024-09-12T17:07:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:07.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025545+0000", 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032645100000000001 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.026827+0000", 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00128202 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027470+0000", 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00064248199999999999 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027556+0000", 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6533000000000007e-05 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027673+0000", 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117042 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.330 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:744 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.260515741999995, 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002617173, 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 744 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028527+0000", 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028529+0000", 2024-09-12T17:07:07.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8500000000000001e-06 2024-09-12T17:07:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028540+0000", 2024-09-12T17:07:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0890000000000001e-05 2024-09-12T17:07:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028565+0000", 2024-09-12T17:07:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5083e-05 2024-09-12T17:07:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028577+0000", 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2434e-05 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028679+0000", 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000101489 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.028800+0000", 2024-09-12T17:07:07.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012089199999999999 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.029070+0000", 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000270358 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030114+0000", 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001043832 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.030994+0000", 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00087969000000000003 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031082+0000", 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7825999999999996e-05 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.031144+0000", 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2829000000000004e-05 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.336 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:760 6.f 6:f47f4d4d:::obj_delete_at_hint.0000000061:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.221353617000005, 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027655549999999998, 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.337 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 760 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067689+0000", 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067692+0000", 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4200000000000001e-06 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067706+0000", 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.382e-05 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067739+0000", 2024-09-12T17:07:07.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3253000000000002e-05 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067763+0000", 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4026e-05 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.067912+0000", 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014959199999999999 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068127+0000", 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021487500000000001 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.068438+0000", 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031070400000000003 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.069550+0000", 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011116159999999999 2024-09-12T17:07:07.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070301+0000", 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00075135000000000002 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070390+0000", 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8516000000000004e-05 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.070455+0000", 2024-09-12T17:07:07.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5382999999999994e-05 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.085131387999994, 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031165260000000001, 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.343 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 817 2024-09-12T17:07:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:07:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203915+0000", 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.146e-06 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203926+0000", 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1379999999999999e-05 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203958+0000", 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2239000000000001e-05 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203973+0000", 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.47e-05 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204156+0000", 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018277899999999999 2024-09-12T17:07:07.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204392+0000", 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000236658 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204705+0000", 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000312248 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.205983+0000", 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001278387 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206726+0000", 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074269799999999997 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206909+0000", 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018368200000000001 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.207028+0000", 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118609 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.080849737999998, 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003050269, 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.349 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 819 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:07:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208196+0000", 2024-09-12T17:07:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4569999999999999e-06 2024-09-12T17:07:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208207+0000", 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208241+0000", 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3936000000000002e-05 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208256+0000", 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5917e-05 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208383+0000", 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012605200000000001 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208602+0000", 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219908 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.209077+0000", 2024-09-12T17:07:07.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047489299999999999 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210285+0000", 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012075110000000001 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210979+0000", 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069376099999999999 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211131+0000", 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151915 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211243+0000", 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112989 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:07:07.355 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.026104013999998, 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0035006659999999999, 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 841 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:07:07.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262942+0000", 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6900000000000001e-06 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262953+0000", 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1323e-05 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262989+0000", 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5617000000000001e-05 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263006+0000", 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7713000000000001e-05 2024-09-12T17:07:07.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263177+0000", 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170249 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263551+0000", 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037421999999999998 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.264122+0000", 2024-09-12T17:07:07.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057113200000000002 2024-09-12T17:07:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.265539+0000", 2024-09-12T17:07:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001417012 2024-09-12T17:07:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266170+0000", 2024-09-12T17:07:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063154599999999997 2024-09-12T17:07:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266330+0000", 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926800000000001 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266440+0000", 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010989600000000001 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.021403027000005, 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032057850000000001, 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 843 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267642+0000", 2024-09-12T17:07:07.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267653+0000", 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0664e-05 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267687+0000", 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4112999999999997e-05 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267703+0000", 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5673000000000001e-05 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267832+0000", 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012896500000000001 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268054+0000", 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022279600000000001 2024-09-12T17:07:07.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268561+0000", 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050617200000000005 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.269801+0000", 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012401269999999999 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270562+0000", 2024-09-12T17:07:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076129699999999997 2024-09-12T17:07:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270716+0000", 2024-09-12T17:07:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000154339 2024-09-12T17:07:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270846+0000", 2024-09-12T17:07:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930600000000001 2024-09-12T17:07:07.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.010571366999997, 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033822100000000001, 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.368 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 847 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278474+0000", 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4930000000000001e-06 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278485+0000", 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1313e-05 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278518+0000", 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2517000000000001e-05 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278533+0000", 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939999999999999e-05 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278689+0000", 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015628899999999999 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279066+0000", 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000377337 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279610+0000", 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00054380900000000002 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281130+0000", 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001519488 2024-09-12T17:07:07.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281583+0000", 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00045297300000000001 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281738+0000", 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015484900000000001 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281854+0000", 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116202 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.005955862999997, 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883554, 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 849 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:07:07.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283090+0000", 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283102+0000", 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.204e-05 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283136+0000", 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3983000000000003e-05 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283152+0000", 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6082999999999998e-05 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283278+0000", 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000126212 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283505+0000", 2024-09-12T17:07:07.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022724900000000001 2024-09-12T17:07:07.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283971+0000", 2024-09-12T17:07:07.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046550600000000003 2024-09-12T17:07:07.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285223+0000", 2024-09-12T17:07:07.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012519370000000001 2024-09-12T17:07:07.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285811+0000", 2024-09-12T17:07:07.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058819199999999997 2024-09-12T17:07:07.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285904+0000", 2024-09-12T17:07:07.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3410000000000002e-05 2024-09-12T17:07:07.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285971+0000", 2024-09-12T17:07:07.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6391999999999997e-05 2024-09-12T17:07:07.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.380 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.958002949000004, 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033550770000000001, 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 868 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331043+0000", 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:07:07.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331054+0000", 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.131e-05 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331086+0000", 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331101+0000", 2024-09-12T17:07:07.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5016e-05 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331253+0000", 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151929 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331616+0000", 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036285100000000003 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.332174+0000", 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055856199999999997 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.333700+0000", 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015259480000000001 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334120+0000", 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042021700000000002 2024-09-12T17:07:07.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334280+0000", 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159949 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334395+0000", 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114679 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.387 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.387 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:07:07.387 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.953545157999997, 2024-09-12T17:07:07.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003066923, 2024-09-12T17:07:07.387 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 870 2024-09-12T17:07:07.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335500+0000", 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4040000000000002e-06 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335511+0000", 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.045e-05 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335542+0000", 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1542999999999999e-05 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335558+0000", 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.535e-05 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335698+0000", 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014063899999999999 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335930+0000", 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000231435 2024-09-12T17:07:07.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.336392+0000", 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046211199999999998 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.337568+0000", 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001176671 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338407+0000", 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083885399999999999 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338491+0000", 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4159000000000005e-05 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338565+0000", 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3306000000000006e-05 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.392 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.865356414999994, 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0027821550000000001, 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 907 2024-09-12T17:07:07.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423687+0000", 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423690+0000", 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2760000000000001e-06 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423702+0000", 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2404e-05 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423735+0000", 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3062999999999998e-05 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423750+0000", 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4912999999999999e-05 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.423919+0000", 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016838899999999999 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424160+0000", 2024-09-12T17:07:07.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024105099999999999 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.424492+0000", 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033261100000000002 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.425785+0000", 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001292397 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426322+0000", 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00053743200000000001 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426403+0000", 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0898999999999999e-05 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.426469+0000", 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5720000000000001e-05 2024-09-12T17:07:07.398 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.766190726999994, 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029674670000000001, 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.399 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 949 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522855+0000", 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522871+0000", 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5950000000000001e-05 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522906+0000", 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316000000000001e-05 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522924+0000", 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8326999999999999e-05 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523047+0000", 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123609 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523282+0000", 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234465 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523606+0000", 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032453099999999997 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.524804+0000", 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011977509999999999 2024-09-12T17:07:07.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525626+0000", 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082216400000000001 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525743+0000", 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116679 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525820+0000", 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6631999999999994e-05 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.752467053000004, 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030602540000000001, 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.405 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 955 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536578+0000", 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536590+0000", 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1250000000000001e-05 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536624+0000", 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4227000000000003e-05 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536646+0000", 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2195999999999999e-05 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536794+0000", 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014799600000000001 2024-09-12T17:07:07.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537005+0000", 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021096799999999999 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537489+0000", 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048413599999999997 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.538940+0000", 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001451262 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539441+0000", 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050002300000000005 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539535+0000", 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4526999999999998e-05 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539636+0000", 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010111900000000001 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 67.748209719000002, 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030889300000000001, 2024-09-12T17:07:07.411 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 957 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540836+0000", 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540862+0000", 2024-09-12T17:07:07.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999999e-05 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540891+0000", 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9595999999999999e-05 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540906+0000", 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4919999999999999e-05 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541052+0000", 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014583900000000001 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541232+0000", 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180259 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541500+0000", 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026788799999999998 2024-09-12T17:07:07.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.542483+0000", 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000983142 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543756+0000", 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001272977 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543842+0000", 2024-09-12T17:07:07.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5748999999999995e-05 2024-09-12T17:07:07.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543922+0000", 2024-09-12T17:07:07.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0000000000000007e-05 2024-09-12T17:07:07.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.417 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.417 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.417 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:07.419 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:07:07.419 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:07.418+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:07.519 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:07.516+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:07.585 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:07.585 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:07.585 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:07.599 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:07:07.644 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:07.640+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:07.721 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:07.718+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:07.757 INFO:tasks.workunit.client.0.smithi017.stderr:Updating files: 94% (12039/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-12T17:07:07.766 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:07.766 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:07.766 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:07.780 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:07:07.823 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:07.820+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:07.901 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-12T17:07:07.901 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 74.352140988000002, 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011583833, 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 44 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544942+0000", 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.653e-06 2024-09-12T17:07:07.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544957+0000", 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5654e-05 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544993+0000", 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5936000000000003e-05 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.545017+0000", 2024-09-12T17:07:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3283000000000001e-05 2024-09-12T17:07:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549277+0000", 2024-09-12T17:07:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042606800000000002 2024-09-12T17:07:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:07:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549301+0000", 2024-09-12T17:07:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3260000000000001e-05 2024-09-12T17:07:07.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556317+0000", 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070164620000000002 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556522+0000", 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020490499999999999 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 69.308675441999995, 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054133180000000003, 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 207 2024-09-12T17:07:07.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588404+0000", 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588408+0000", 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0969999999999999e-06 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588428+0000", 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9910000000000001e-05 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588467+0000", 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8980000000000003e-05 2024-09-12T17:07:07.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588483+0000", 2024-09-12T17:07:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6443000000000002e-05 2024-09-12T17:07:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.588659+0000", 2024-09-12T17:07:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017569499999999999 2024-09-12T17:07:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589033+0000", 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037374100000000003 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.589729+0000", 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069659400000000003 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593394+0000", 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036653279999999998 2024-09-12T17:07:07.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593661+0000", 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026662499999999999 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593743+0000", 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1428999999999996e-05 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.593817+0000", 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4475999999999996e-05 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 69.272454741999994, 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034289839999999999, 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.913 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 216 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624624+0000", 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624628+0000", 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2399999999999999e-06 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624641+0000", 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3743e-05 2024-09-12T17:07:07.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624675+0000", 2024-09-12T17:07:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3277e-05 2024-09-12T17:07:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624690+0000", 2024-09-12T17:07:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5812999999999999e-05 2024-09-12T17:07:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.624847+0000", 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156269 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625092+0000", 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024499500000000002 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.625494+0000", 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040263000000000001 2024-09-12T17:07:07.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.626934+0000", 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001439159 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627890+0000", 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095619599999999998 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.627978+0000", 2024-09-12T17:07:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8446e-05 2024-09-12T17:07:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.628053+0000", 2024-09-12T17:07:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5216000000000006e-05 2024-09-12T17:07:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.919 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 69.230946498999998, 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003364985, 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 227 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666133+0000", 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666135+0000", 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.644e-06 2024-09-12T17:07:07.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666147+0000", 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1960000000000001e-05 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666179+0000", 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1813000000000002e-05 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666195+0000", 2024-09-12T17:07:07.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5679999999999999e-05 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666342+0000", 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147312 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.666559+0000", 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021664199999999999 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:07.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.667037+0000", 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047816200000000002 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.668796+0000", 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017590010000000001 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669346+0000", 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055024499999999999 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669433+0000", 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6650000000000006e-05 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.669498+0000", 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4875999999999993e-05 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.925 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 69.22373924, 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031932409999999999, 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 229 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673340+0000", 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673342+0000", 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3499999999999999e-06 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673354+0000", 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1739999999999999e-05 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673386+0000", 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1782000000000002e-05 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673400+0000", 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4663e-05 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673577+0000", 2024-09-12T17:07:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017662900000000001 2024-09-12T17:07:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.673783+0000", 2024-09-12T17:07:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020620799999999999 2024-09-12T17:07:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:07.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.674174+0000", 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039082100000000002 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.675441+0000", 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001267177 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676382+0000", 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094087900000000004 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676468+0000", 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5762999999999999e-05 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.676533+0000", 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5228999999999995e-05 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 69.215996317000005, 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0037357380000000002, 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 231 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.932 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681083+0000", 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681085+0000", 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681096+0000", 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0866000000000001e-05 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681126+0000", 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9977000000000001e-05 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681140+0000", 2024-09-12T17:07:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4195999999999999e-05 2024-09-12T17:07:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681288+0000", 2024-09-12T17:07:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014765199999999999 2024-09-12T17:07:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.681637+0000", 2024-09-12T17:07:07.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034917100000000001 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.682358+0000", 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00072050800000000002 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684139+0000", 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017812399999999999 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684543+0000", 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040413299999999999 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684703+0000", 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160075 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.684819+0000", 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011553300000000001 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.937 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:374 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 69.161118887000001, 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031135910000000002, 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.938 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 374 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735960+0000", 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735961+0000", 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0979999999999999e-06 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735968+0000", 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1979999999999998e-06 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735981+0000", 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3164e-05 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.735989+0000", 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8010000000000004e-06 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736041+0000", 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2800999999999998e-05 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736137+0000", 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5497999999999999e-05 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736303+0000", 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016580100000000001 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.736802+0000", 2024-09-12T17:07:07.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049966599999999996 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739015+0000", 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022122919999999998 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739047+0000", 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2678000000000001e-05 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.739074+0000", 2024-09-12T17:07:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6594e-05 2024-09-12T17:07:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:715 6.b 6:d5ecafc5:::obj_delete_at_hint.0000000046:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:07:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.935674144000004, 2024-09-12T17:07:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029096640000000002, 2024-09-12T17:07:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 715 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961405+0000", 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961407+0000", 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961419+0000", 2024-09-12T17:07:07.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.117e-05 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961450+0000", 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1463e-05 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961465+0000", 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5082999999999999e-05 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961576+0000", 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000111016 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.961785+0000", 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020865599999999999 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.962105+0000", 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031996699999999999 2024-09-12T17:07:07.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.963189+0000", 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010845519999999999 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964163+0000", 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00097355800000000002 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964252+0000", 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8996e-05 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.964315+0000", 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2773000000000004e-05 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:730 6.13 6:cba150de:::obj_delete_at_hint.0000000051:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.950 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.901403587999994, 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883207, 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 730 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995676+0000", 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995678+0000", 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:07:07.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995689+0000", 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1316e-05 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995722+0000", 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995745+0000", 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3496999999999999e-05 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.995902+0000", 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000156446 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996113+0000", 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021091099999999999 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.996444+0000", 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000330785 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.997558+0000", 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001114681 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998420+0000", 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086125299999999998 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998497+0000", 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7919999999999999e-05 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.998559+0000", 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1319e-05 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:738 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.882922023999996, 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002862248, 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 738 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.957 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:07:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014157+0000", 2024-09-12T17:07:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014159+0000", 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9599999999999999e-06 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014168+0000", 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.653e-06 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014191+0000", 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3706e-05 2024-09-12T17:07:07.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014213+0000", 2024-09-12T17:07:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2050000000000001e-05 2024-09-12T17:07:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014363+0000", 2024-09-12T17:07:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014956299999999999 2024-09-12T17:07:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014485+0000", 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000122132 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.014770+0000", 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000284911 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.015864+0000", 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010942180000000001 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016864+0000", 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00099982299999999994 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.016951+0000", 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6476000000000003e-05 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.017019+0000", 2024-09-12T17:07:07.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8756000000000004e-05 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:772 6.6 6:63d917ed:::obj_delete_at_hint.0000000065:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.800600646000007, 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032495950000000001, 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.963 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 772 2024-09-12T17:07:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:07:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096479+0000", 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096481+0000", 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4399999999999999e-06 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096492+0000", 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1513e-05 2024-09-12T17:07:07.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096522+0000", 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9156e-05 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096536+0000", 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4347e-05 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096681+0000", 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000145348 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.096896+0000", 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214489 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.097208+0000", 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031215099999999999 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.098332+0000", 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001123635 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099583+0000", 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00125179 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099663+0000", 2024-09-12T17:07:07.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9703000000000006e-05 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.099728+0000", 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.5023000000000004e-05 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:802 6.1f 6:fce5a501:::obj_delete_at_hint.0000000075:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:07:07.969 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.728858686999999, 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028771949999999999, 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 802 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:07:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168220+0000", 2024-09-12T17:07:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168223+0000", 2024-09-12T17:07:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4499999999999998e-06 2024-09-12T17:07:07.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168234+0000", 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168265+0000", 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0777e-05 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168279+0000", 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4525999999999999e-05 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168397+0000", 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118063 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168616+0000", 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000218505 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.168970+0000", 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00035427400000000002 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170038+0000", 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001067571 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170897+0000", 2024-09-12T17:07:07.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085934399999999995 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.170983+0000", 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6179000000000003e-05 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.171098+0000", 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114576 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.670058861000001, 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033328609999999999, 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 826 2024-09-12T17:07:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:07:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227020+0000", 2024-09-12T17:07:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227023+0000", 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227035+0000", 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227067+0000", 2024-09-12T17:07:07.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2305999999999999e-05 2024-09-12T17:07:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227082+0000", 2024-09-12T17:07:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.485e-05 2024-09-12T17:07:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227247+0000", 2024-09-12T17:07:07.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016483900000000001 2024-09-12T17:07:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.227630+0000", 2024-09-12T17:07:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00038350100000000001 2024-09-12T17:07:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.228201+0000", 2024-09-12T17:07:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057026799999999997 2024-09-12T17:07:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.229556+0000", 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013553300000000001 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230084+0000", 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00052805599999999995 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230238+0000", 2024-09-12T17:07:07.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015438499999999999 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.230353+0000", 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114809 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:850 6.6 6:624175ac:::obj_delete_at_hint.0000000091:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:07:07.982 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.610785504999996, 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033407710000000002, 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 850 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286294+0000", 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286296+0000", 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.52e-06 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286307+0000", 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1287000000000001e-05 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286339+0000", 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1331999999999997e-05 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286353+0000", 2024-09-12T17:07:07.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4517e-05 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286504+0000", 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015038200000000001 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.286897+0000", 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039326399999999999 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.287451+0000", 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055426900000000003 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.288825+0000", 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013741160000000001 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289484+0000", 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00065819499999999998 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289570+0000", 2024-09-12T17:07:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6383000000000003e-05 2024-09-12T17:07:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.289634+0000", 2024-09-12T17:07:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4505999999999995e-05 2024-09-12T17:07:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:07:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.572793587999996, 2024-09-12T17:07:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002894237, 2024-09-12T17:07:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.989 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 865 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324286+0000", 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324288+0000", 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2469999999999998e-06 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324299+0000", 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0823e-05 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324330+0000", 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1846e-05 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324350+0000", 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9077e-05 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324463+0000", 2024-09-12T17:07:07.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011367200000000001 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.324693+0000", 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008800000000001 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.325000+0000", 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030629499999999999 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.326117+0000", 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011175709999999999 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327026+0000", 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00090879000000000003 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327113+0000", 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7093000000000001e-05 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.327180+0000", 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6735000000000004e-05 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:871 6.11 6:8d7f253a:::obj_delete_at_hint.0000000098:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.558280089999997, 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030741359999999999, 2024-09-12T17:07:07.995 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 871 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338799+0000", 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338802+0000", 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338831+0000", 2024-09-12T17:07:07.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9356000000000002e-05 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338868+0000", 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7357000000000002e-05 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338883+0000", 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4932999999999999e-05 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339036+0000", 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152423 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339264+0000", 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022814100000000001 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.339593+0000", 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032943099999999998 2024-09-12T17:07:07.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.340783+0000", 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011898740000000001 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341724+0000", 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00094134600000000002 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:08.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341809+0000", 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4155999999999999e-05 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.341873+0000", 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4605999999999998e-05 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.001 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.500788029999995, 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003093649, 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 895 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:08.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396291+0000", 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396294+0000", 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3999999999999999e-06 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396307+0000", 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3468999999999999e-05 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396338+0000", 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1433000000000002e-05 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396353+0000", 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4557e-05 2024-09-12T17:07:08.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396496+0000", 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014275900000000001 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.396719+0000", 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022317499999999999 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.397052+0000", 2024-09-12T17:07:08.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00033263699999999999 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.398211+0000", 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011593350000000001 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399235+0000", 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0010241219999999999 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:08.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399321+0000", 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5789000000000001e-05 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.399385+0000", 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3973000000000006e-05 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:898 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:07:08.007 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.494300973999998, 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029302239999999999, 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 898 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:07:08.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402778+0000", 2024-09-12T17:07:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402780+0000", 2024-09-12T17:07:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9269999999999999e-06 2024-09-12T17:07:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402789+0000", 2024-09-12T17:07:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7069999999999998e-06 2024-09-12T17:07:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402830+0000", 2024-09-12T17:07:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1470000000000001e-05 2024-09-12T17:07:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402846+0000", 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5319e-05 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.402938+0000", 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2289999999999999e-05 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403134+0000", 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000196014 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.403437+0000", 2024-09-12T17:07:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030337199999999999 2024-09-12T17:07:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.404507+0000", 2024-09-12T17:07:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001069492 2024-09-12T17:07:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405432+0000", 2024-09-12T17:07:08.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092532900000000002 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405590+0000", 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158018 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.405708+0000", 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118286 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:08.013 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:934 6.11 6:8cd774bc:::obj_delete_at_hint.0000000119:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.408893712999998, 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030817499999999999, 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.014 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 934 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488185+0000", 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488188+0000", 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8040000000000002e-06 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488201+0000", 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2893e-05 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488233+0000", 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2085999999999997e-05 2024-09-12T17:07:08.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488248+0000", 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4976e-05 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488415+0000", 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016677900000000001 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:08.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488650+0000", 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234875 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.488961+0000", 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031078799999999999 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.490177+0000", 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001216607 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491119+0000", 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000941806 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491202+0000", 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3349000000000004e-05 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.491267+0000", 2024-09-12T17:07:08.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4787000000000002e-05 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:939 6.1f 6:fd6b5df8:::obj_delete_at_hint.0000000120:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 68.398074733000001, 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031107489999999999, 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.020 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 939 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:08.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499004+0000", 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499007+0000", 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3970000000000001e-06 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499018+0000", 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0969e-05 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499052+0000", 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3896999999999997e-05 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499068+0000", 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6552999999999999e-05 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499200+0000", 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013206599999999999 2024-09-12T17:07:08.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499438+0000", 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023806500000000001 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.499922+0000", 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048369599999999998 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:08.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501326+0000", 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014036560000000001 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.501962+0000", 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063623100000000001 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502048+0000", 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5636999999999993e-05 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:08.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.502115+0000", 2024-09-12T17:07:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7582000000000004e-05 2024-09-12T17:07:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:08.026 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:08.026 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:08.028 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:07:08.028 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:08.024+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:08.079 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T17:07:08.128 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:08.124+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:08.164 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:08.164 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:08.164 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:08.164 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:08.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:07:08.229 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:08.222+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:08.298 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:08.299 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:08.299 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:08.299 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:08.299 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:08.313 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:07:08.330 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:08.324+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:08.431 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:08.424+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:08.486 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:08.486 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:08.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:08.486 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:08.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.486 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.486 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:07:08.486 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.873698782000005, 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003566582, 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 211 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608230+0000", 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608233+0000", 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.343e-06 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608248+0000", 2024-09-12T17:07:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4747e-05 2024-09-12T17:07:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608285+0000", 2024-09-12T17:07:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7239e-05 2024-09-12T17:07:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608302+0000", 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6909999999999999e-05 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608454+0000", 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015164599999999999 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.608666+0000", 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021213499999999999 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:07:08.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.609092+0000", 2024-09-12T17:07:08.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042601999999999999 2024-09-12T17:07:08.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.610771+0000", 2024-09-12T17:07:08.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016786940000000001 2024-09-12T17:07:08.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611640+0000", 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00086891300000000002 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611731+0000", 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1058999999999997e-05 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.611796+0000", 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5876000000000004e-05 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.492 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.493 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.493 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.493 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:07:08.493 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.794728765000002, 2024-09-12T17:07:08.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035636330000000001, 2024-09-12T17:07:08.493 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.493 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.493 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.493 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.493 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 232 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687200+0000", 2024-09-12T17:07:08.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687203+0000", 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0529999999999998e-06 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687216+0000", 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346999999999999e-05 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687250+0000", 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3992999999999998e-05 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687266+0000", 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.577e-05 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687402+0000", 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013599599999999999 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.687630+0000", 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228168 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.688057+0000", 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042653999999999999 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.689651+0000", 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015945009999999999 2024-09-12T17:07:08.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690608+0000", 2024-09-12T17:07:08.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095638899999999998 2024-09-12T17:07:08.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690694+0000", 2024-09-12T17:07:08.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6119000000000007e-05 2024-09-12T17:07:08.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.690764+0000", 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9757000000000003e-05 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:241 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.774282335999999, 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030740059999999998, 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.499 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.500 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.500 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.500 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.500 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.500 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 241 2024-09-12T17:07:08.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.500 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:07:08.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707646+0000", 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707649+0000", 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707661+0000", 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2e-05 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707693+0000", 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2299999999999999e-05 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707709+0000", 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6096e-05 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.707871+0000", 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016122200000000001 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.708198+0000", 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032765799999999999 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.708655+0000", 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00045698599999999999 2024-09-12T17:07:08.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710022+0000", 2024-09-12T17:07:08.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0013664059999999999 2024-09-12T17:07:08.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710578+0000", 2024-09-12T17:07:08.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055600199999999999 2024-09-12T17:07:08.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710650+0000", 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2767000000000003e-05 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.710720+0000", 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9839000000000007e-05 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.505 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:434 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.721499426999998, 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030966930000000002, 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 434 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760429+0000", 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760432+0000", 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4540000000000001e-06 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760443+0000", 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1123e-05 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760473+0000", 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0476000000000001e-05 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760493+0000", 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9502999999999999e-05 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760616+0000", 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000123509 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.760776+0000", 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000159462 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.761216+0000", 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000440474 2024-09-12T17:07:08.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.762555+0000", 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001338926 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763288+0000", 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00073298000000000005 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763434+0000", 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145544 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.763526+0000", 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2242000000000002e-05 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:445 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:07:08.511 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.714601455999997, 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029347829999999998, 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 445 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767327+0000", 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767330+0000", 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8229999999999999e-06 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767343+0000", 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2869e-05 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767373+0000", 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0294000000000002e-05 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767392+0000", 2024-09-12T17:07:08.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.91e-05 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767522+0000", 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000130152 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.767688+0000", 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016599900000000001 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:08.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.768155+0000", 2024-09-12T17:07:08.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046654299999999998 2024-09-12T17:07:08.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.769308+0000", 2024-09-12T17:07:08.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001153165 2024-09-12T17:07:08.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770069+0000", 2024-09-12T17:07:08.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076044000000000003 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770155+0000", 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6493e-05 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.770262+0000", 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010690499999999999 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.517 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.518 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:504 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.518 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:07:08.518 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.684863918000005, 2024-09-12T17:07:08.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039867009999999996, 2024-09-12T17:07:08.518 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.518 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.518 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.518 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.518 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.518 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 504 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797065+0000", 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797067+0000", 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5830000000000001e-06 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797078+0000", 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0837e-05 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797108+0000", 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9722000000000001e-05 2024-09-12T17:07:08.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797127+0000", 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9539999999999999e-05 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797249+0000", 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000121239 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.797551+0000", 2024-09-12T17:07:08.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030277400000000001 2024-09-12T17:07:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.798161+0000", 2024-09-12T17:07:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00060936200000000001 2024-09-12T17:07:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.799307+0000", 2024-09-12T17:07:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001146588 2024-09-12T17:07:08.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.800728+0000", 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014204389999999999 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.800831+0000", 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103002 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.801051+0000", 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022061499999999999 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:626 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.603112715999998, 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032539040000000002, 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.524 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 626 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878816+0000", 2024-09-12T17:07:08.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878819+0000", 2024-09-12T17:07:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6699999999999998e-06 2024-09-12T17:07:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878831+0000", 2024-09-12T17:07:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2882e-05 2024-09-12T17:07:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878862+0000", 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0332999999999999e-05 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.878880+0000", 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8236999999999998e-05 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879009+0000", 2024-09-12T17:07:08.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012908599999999999 2024-09-12T17:07:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879306+0000", 2024-09-12T17:07:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029693100000000001 2024-09-12T17:07:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.879873+0000", 2024-09-12T17:07:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056697200000000001 2024-09-12T17:07:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881172+0000", 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001298766 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881880+0000", 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00070808500000000001 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.881962+0000", 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.2069000000000003e-05 2024-09-12T17:07:08.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882070+0000", 2024-09-12T17:07:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000107873 2024-09-12T17:07:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:633 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:07:08.530 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.598933349000006, 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030425119999999998, 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 633 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882995+0000", 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.882997+0000", 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0530000000000001e-06 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883009+0000", 2024-09-12T17:07:08.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1195e-05 2024-09-12T17:07:08.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883037+0000", 2024-09-12T17:07:08.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8484999999999999e-05 2024-09-12T17:07:08.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883055+0000", 2024-09-12T17:07:08.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8467000000000001e-05 2024-09-12T17:07:08.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883196+0000", 2024-09-12T17:07:08.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014099499999999999 2024-09-12T17:07:08.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883444+0000", 2024-09-12T17:07:08.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000247758 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.883892+0000", 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044757299999999999 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885202+0000", 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001310587 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885879+0000", 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00067645599999999998 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.885945+0000", 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6575999999999994e-05 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.886038+0000", 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2367000000000005e-05 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.536 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:644 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.588935914999993, 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030197190000000001, 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.537 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 644 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892993+0000", 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.892995+0000", 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1390000000000002e-06 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893004+0000", 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3729999999999999e-06 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893029+0000", 2024-09-12T17:07:08.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5058999999999998e-05 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893041+0000", 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1858000000000001e-05 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893190+0000", 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014875199999999999 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.893575+0000", 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038538 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.894140+0000", 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056461200000000003 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895394+0000", 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012536100000000001 2024-09-12T17:07:08.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895856+0000", 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046213 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.895940+0000", 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4808999999999994e-05 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.896012+0000", 2024-09-12T17:07:08.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1996999999999995e-05 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:711 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.528587221999999, 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00296547, 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.543 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 711 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953341+0000", 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953343+0000", 2024-09-12T17:07:08.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.046e-06 2024-09-12T17:07:08.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953353+0000", 2024-09-12T17:07:08.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4939999999999992e-06 2024-09-12T17:07:08.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953386+0000", 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2919000000000001e-05 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953405+0000", 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9596999999999999e-05 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953576+0000", 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017032500000000001 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.953828+0000", 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025190800000000001 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.954297+0000", 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046897300000000002 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.955510+0000", 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012131139999999999 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956183+0000", 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00067301800000000005 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956254+0000", 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0786999999999998e-05 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.956307+0000", 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3288999999999998e-05 2024-09-12T17:07:08.548 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:724 6.1e 6:7a5c7c5f:::obj_delete_at_hint.0000000049:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.498676477000004, 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029480109999999999, 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.549 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 724 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983252+0000", 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983255+0000", 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4140000000000001e-06 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983266+0000", 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1039999999999999e-05 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983298+0000", 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1949000000000002e-05 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983313+0000", 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5296999999999999e-05 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983416+0000", 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102921 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983578+0000", 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000162244 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.983835+0000", 2024-09-12T17:07:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025741700000000002 2024-09-12T17:07:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.984947+0000", 2024-09-12T17:07:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011111949999999999 2024-09-12T17:07:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.985915+0000", 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00096828599999999995 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.986080+0000", 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016498500000000001 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.986200+0000", 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120263 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.554 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.491068307999996, 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0029804559999999998, 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 727 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.555 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990860+0000", 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990862+0000", 2024-09-12T17:07:08.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0959999999999999e-06 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990872+0000", 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.1039999999999996e-06 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990897+0000", 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5626000000000002e-05 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990911+0000", 2024-09-12T17:07:08.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3346000000000001e-05 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.990999+0000", 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8887000000000005e-05 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.991252+0000", 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025290099999999998 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:08.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.991617+0000", 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036479399999999999 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.992803+0000", 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011859049999999999 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993677+0000", 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00087379199999999997 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993774+0000", 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7343000000000006e-05 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:58.993841+0000", 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6662000000000007e-05 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:775 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:07:08.560 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.376125615999996, 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0035861349999999998, 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 775 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105803+0000", 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105806+0000", 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9529999999999999e-06 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105818+0000", 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2447e-05 2024-09-12T17:07:08.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105851+0000", 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2969999999999998e-05 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.105867+0000", 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5116999999999999e-05 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106011+0000", 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014498500000000001 2024-09-12T17:07:08.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106382+0000", 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037012699999999999 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.106946+0000", 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00056435199999999995 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.108269+0000", 2024-09-12T17:07:08.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00132256 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109120+0000", 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00085151300000000003 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109274+0000", 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015367199999999999 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.109389+0000", 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115439 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:777 6.1e 6:7db93595:::obj_delete_at_hint.0000000066:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.371036755000006, 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0031979489999999998, 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.566 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 777 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110892+0000", 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110894+0000", 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4870000000000001e-06 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110905+0000", 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.098e-05 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110938+0000", 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2496000000000002e-05 2024-09-12T17:07:08.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.110953+0000", 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5058999999999999e-05 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111080+0000", 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000127033 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111312+0000", 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000231828 2024-09-12T17:07:08.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.111791+0000", 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00047926000000000002 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.112965+0000", 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011740209999999999 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.113920+0000", 2024-09-12T17:07:08.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095542000000000001 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.114009+0000", 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8162000000000001e-05 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.114090+0000", 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1203000000000002e-05 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.571 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.283427080999999, 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030645529999999998, 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 814 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.572 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:07:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198502+0000", 2024-09-12T17:07:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198504+0000", 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6630000000000002e-06 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198515+0000", 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1014e-05 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198548+0000", 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2339999999999999e-05 2024-09-12T17:07:08.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198563+0000", 2024-09-12T17:07:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5228999999999999e-05 2024-09-12T17:07:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198683+0000", 2024-09-12T17:07:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120569 2024-09-12T17:07:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.198886+0000", 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020240199999999999 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.199199+0000", 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031304800000000002 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.200322+0000", 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011236309999999999 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201410+0000", 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0010880110000000001 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201494+0000", 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.3863000000000007e-05 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.201566+0000", 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.1783e-05 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.577 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.117951224999999, 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030460629999999999, 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 880 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.578 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363977+0000", 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363980+0000", 2024-09-12T17:07:08.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0699999999999998e-06 2024-09-12T17:07:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.363993+0000", 2024-09-12T17:07:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2439999999999999e-05 2024-09-12T17:07:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364026+0000", 2024-09-12T17:07:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2886999999999999e-05 2024-09-12T17:07:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364041+0000", 2024-09-12T17:07:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5255999999999999e-05 2024-09-12T17:07:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364160+0000", 2024-09-12T17:07:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011927200000000001 2024-09-12T17:07:08.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364388+0000", 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228116 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.364728+0000", 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033925999999999997 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.365909+0000", 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001181091 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.366732+0000", 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082351699999999996 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.366907+0000", 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000174568 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.367023+0000", 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116586 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:882 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.113363464000003, 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.002854625, 2024-09-12T17:07:08.584 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 882 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368565+0000", 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368568+0000", 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5799999999999999e-06 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368579+0000", 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.13e-05 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368613+0000", 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3949999999999999e-05 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368628+0000", 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5443000000000001e-05 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368753+0000", 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012430899999999999 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.368898+0000", 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145012 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.369195+0000", 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029734100000000001 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.370341+0000", 2024-09-12T17:07:08.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001145985 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371159+0000", 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081784999999999996 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371309+0000", 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014978600000000001 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.371420+0000", 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111069 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:913 6.2 6:47403372:::obj_delete_at_hint.0000000112:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.042795568000003, 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0028637710000000002, 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.590 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 913 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439133+0000", 2024-09-12T17:07:08.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439136+0000", 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7259999999999998e-06 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439150+0000", 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4419999999999999e-05 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439181+0000", 2024-09-12T17:07:08.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0303000000000001e-05 2024-09-12T17:07:08.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439200+0000", 2024-09-12T17:07:08.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9313e-05 2024-09-12T17:07:08.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439316+0000", 2024-09-12T17:07:08.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115893 2024-09-12T17:07:08.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439541+0000", 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022517199999999999 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.439857+0000", 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031612699999999998 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441075+0000", 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001218114 2024-09-12T17:07:08.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441846+0000", 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00077121100000000005 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441931+0000", 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4338999999999993e-05 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.441997+0000", 2024-09-12T17:07:08.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6153000000000002e-05 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.013099980000007, 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0032820639999999999, 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.596 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 925 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468829+0000", 2024-09-12T17:07:08.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468831+0000", 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1459999999999999e-06 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468842+0000", 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0727000000000001e-05 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468874+0000", 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2261999999999997e-05 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.468888+0000", 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4507e-05 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469011+0000", 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012317599999999999 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469252+0000", 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024031500000000001 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 1", 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.469575+0000", 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032279699999999999 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.470640+0000", 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001065262 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.471902+0000", 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001262504 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.471990+0000", 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7552000000000005e-05 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.472111+0000", 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000120816 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.601 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 69.005698304999996, 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030855499999999998, 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 928 2024-09-12T17:07:08.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476230+0000", 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:08.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476232+0000", 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9769999999999999e-06 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476242+0000", 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0003000000000001e-05 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476269+0000", 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6727e-05 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476288+0000", 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8649999999999999e-05 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476400+0000", 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111959 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476614+0000", 2024-09-12T17:07:08.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000214465 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.476920+0000", 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030588700000000002 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.478203+0000", 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001282547 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479162+0000", 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00095971299999999995 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479249+0000", 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6959000000000005e-05 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:59.479316+0000", 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6662999999999995e-05 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.607 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:08.608 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:08.608 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:08.609 INFO:tasks.workunit.client.0.smithi017.stderr:Note: switching to 'bad475c18c96ec20c5778159aa33ba72b84e9c1b'. 2024-09-12T17:07:08.609 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-12T17:07:08.609 INFO:tasks.workunit.client.0.smithi017.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T17:07:08.609 INFO:tasks.workunit.client.0.smithi017.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T17:07:08.609 INFO:tasks.workunit.client.0.smithi017.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T17:07:08.609 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-12T17:07:08.609 INFO:tasks.workunit.client.0.smithi017.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T17:07:08.609 INFO:tasks.workunit.client.0.smithi017.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T17:07:08.609 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-12T17:07:08.609 INFO:tasks.workunit.client.0.smithi017.stderr: git switch -c 2024-09-12T17:07:08.610 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-12T17:07:08.610 INFO:tasks.workunit.client.0.smithi017.stderr:Or undo this operation with: 2024-09-12T17:07:08.610 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-12T17:07:08.610 INFO:tasks.workunit.client.0.smithi017.stderr: git switch - 2024-09-12T17:07:08.610 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-12T17:07:08.610 INFO:tasks.workunit.client.0.smithi017.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T17:07:08.610 INFO:tasks.workunit.client.0.smithi017.stderr: 2024-09-12T17:07:08.610 INFO:tasks.workunit.client.0.smithi017.stderr:HEAD is now at bad475c18c9 rgw: clear output keys in RGWMetadataLister::get_next() 2024-09-12T17:07:08.611 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:07:08.611 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:08.606+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:08.613 DEBUG:teuthology.orchestra.run.smithi017:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T17:07:08.660 INFO:tasks.workunit.client.0.smithi017.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T17:07:08.664 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:07:08.664 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T17:07:08.710 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:08.704+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:08.779 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:07:08.787 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:08.788 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:08.788 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:08.788 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:08.802 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:07:08.850 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:08.850+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:08.852 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T17:07:08.856 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T17:07:08.912 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:08.908+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:08.930 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:08.930 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:08.932 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:08.932 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:08.932 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:08.932 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:08.932 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:08.945 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:07:08.946 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:08.946 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:08.963 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:08.963 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:08.982 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:08.982 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:09.000 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:09.000 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:09.013 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:09.008+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:09.020 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:09.021 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:09.038 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:09.038 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:09.057 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:09.057 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:09.114 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:09.114 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:09.120 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:09.116+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:09.129 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:09.215 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:09.214+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:09.251 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:09.624 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:09.627 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:09.627 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:09.626+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:09.628 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T17:07:09.628 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T17:07:09.628 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T17:07:09.628 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:07:09.628 INFO:tasks.workunit.client.0.smithi017.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T17:07:09.628 INFO:tasks.workunit.client.0.smithi017.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T17:07:09.628 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-09-12T17:07:09.629 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T17:07:09.676 INFO:tasks.workunit:Running workunits matching rgw/s3_multipart_upload.pl on client.0... 2024-09-12T17:07:09.678 INFO:tasks.workunit:Running workunit rgw/s3_multipart_upload.pl... 2024-09-12T17:07:09.678 DEBUG:teuthology.orchestra.run.smithi017:workunit test rgw/s3_multipart_upload.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=bad475c18c96ec20c5778159aa33ba72b84e9c1b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_multipart_upload.pl 2024-09-12T17:07:09.726 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:09.726+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:09.803 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:09.803 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:09.818 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:09.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:09.820+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:09.928 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:09.924+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:09.990 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:09.990 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:10.005 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:10.029 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:10.024+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:10.102 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T17:07:10.130 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:10.126+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:10.133 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:10.133 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:10.149 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:10.230 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:10.224+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:10.303 INFO:tasks.workunit.client.0.smithi017.stdout:Bucket Created: buck_2024_08_12_17_07_10 2024-09-12T17:07:10.303 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 1 2024-09-12T17:07:10.318 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:10.319 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:10.331 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:10.330+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:10.333 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:10.369 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records in 2024-09-12T17:07:10.369 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records out 2024-09-12T17:07:10.370 INFO:tasks.workunit.client.0.smithi017.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0649947 s, 1.6 GB/s 2024-09-12T17:07:10.432 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:10.428+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:10.505 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:10.522 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:07:10.568 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:10.564+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:10.634 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:10.634+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:10.651 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:10.651 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:10.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:07:10.756 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:10.752+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:10.835 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:10.828+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:10.851 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:10.851 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:10.873 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:07:10.916 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_10: 100Mb.1 2024-09-12T17:07:10.916 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:10.916 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 2 2024-09-12T17:07:10.936 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:10.934+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:10.986 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records in 2024-09-12T17:07:10.986 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records out 2024-09-12T17:07:10.986 INFO:tasks.workunit.client.0.smithi017.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0687874 s, 1.5 GB/s 2024-09-12T17:07:11.037 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:11.032+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:11.037 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:11.038 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:11.051 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:07:11.076 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:07:11.090 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T17:07:11.138 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:11.134+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:11.210 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:11.210 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:11.225 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:07:11.240 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:11.241 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:11.241 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:11.236+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:11.276 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:11.277 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:11.308 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:11.308 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:11.327 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:11.327 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:11.340 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:11.338+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:11.365 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:11.366 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:11.378 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:11.378 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:11.378 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:11.399 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:11.399 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:11.405 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:07:11.429 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:11.429 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:11.458 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:11.458 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:11.458 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:11.452+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:11.514 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_10: 100Mb.2 2024-09-12T17:07:11.514 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:11.514 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 3 2024-09-12T17:07:11.540 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:11.536+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:11.564 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.564 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:07:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.032409709000007, 2024-09-12T17:07:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:07:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:07:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:07:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:07:11.565 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:07:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:07:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:07:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:07:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:07:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:07:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:07:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:07:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:07:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:07:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:07:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:07:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:07:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:07:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:07:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:07:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:07:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:07:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:07:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:11.571 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 75.874777512999998, 2024-09-12T17:07:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:07:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:07:11.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:07:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:07:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:07:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:07:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:07:11.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.964683719999996, 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.578 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:07:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:07:11.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:07:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:07:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:07:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:07:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:07:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:07:11.582 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.583 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.584 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.948792979000004, 2024-09-12T17:07:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:07:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:07:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.585 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:07:11.586 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.587 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:07:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:07:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:07:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:07:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.588 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:07:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:07:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:07:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:07:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:07:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:07:11.589 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:07:11.590 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:07:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.923324308999995, 2024-09-12T17:07:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:07:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.591 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.592 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:07:11.593 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:07:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:07:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:07:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:07:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.594 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:07:11.595 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.596 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:11.597 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.904363208000007, 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.598 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:07:11.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:07:11.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.869807907999999, 2024-09-12T17:07:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:07:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:07:11.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.605 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:07:11.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.609 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.556588495, 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.610 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:07:11.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:07:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:07:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:07:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:07:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:07:11.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.551697126999997, 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.616 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:07:11.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:07:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:07:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:07:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:07:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.512721667999998, 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:07:11.622 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:07:11.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.628 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.508823694, 2024-09-12T17:07:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:07:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:07:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:07:11.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:07:11.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:07:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:07:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:07:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:07:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:07:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:07:11.634 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.440064461999995, 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.635 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:07:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:07:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:07:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:07:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:07:11.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:07:11.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:07:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:07:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:07:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.641 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.404220448000004, 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:07:11.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:07:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:07:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:07:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:07:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:07:11.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.647 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.384033076999998, 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.648 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:07:11.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:07:11.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:07:11.653 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.379138714999996, 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.654 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:07:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:07:11.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:07:11.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:07:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:07:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:11.660 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.317170559999994, 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:07:11.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:11.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:07:11.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:07:11.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:07:11.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:07:11.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:07:11.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.666 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.312763785000001, 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.667 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:07:11.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:07:11.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:07:11.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:07:11.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:07:11.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:07:11.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:07:11.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:07:11.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.673 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.673 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.673 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:11.673 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.145364443000005, 2024-09-12T17:07:11.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:07:11.673 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.674 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.674 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:07:11.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.674 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:11.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:07:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:07:11.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:07:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:07:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:07:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:07:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:07:11.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.679 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.114589409999994, 2024-09-12T17:07:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:07:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:07:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:07:11.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:07:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:07:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:07:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:07:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:07:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:07:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:07:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:07:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:07:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:11.686 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.109677155, 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:11.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:07:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:07:11.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:07:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:07:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:07:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:07:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:07:11.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:07:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:07:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:07:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:07:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:07:11.692 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.693 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:11.693 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:11.693 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:11.695 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:07:11.695 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records in 2024-09-12T17:07:11.695 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records out 2024-09-12T17:07:11.695 INFO:tasks.workunit.client.0.smithi017.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0680498 s, 1.5 GB/s 2024-09-12T17:07:11.695 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:11.688+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:11.795 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:11.794+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:11.872 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:11.872 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:11.872 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:11.872 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:11.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:07:11.896 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:11.894+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:11.997 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:11.994+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:12.045 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:12.045 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:12.045 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:12.045 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:12.046 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:12.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:07:12.108 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:12.104+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:12.147 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_10: 100Mb.3 2024-09-12T17:07:12.147 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:12.148 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 4 2024-09-12T17:07:12.191 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:12.191 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:12.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:12.191 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:12.191 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.191 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.191 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:07:12.191 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 73.487369502999996, 2024-09-12T17:07:12.191 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003254804, 2024-09-12T17:07:12.192 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.192 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.192 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.192 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.192 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 236 2024-09-12T17:07:12.192 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.192 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.192 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.192 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.192 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:07:12.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699644+0000", 2024-09-12T17:07:12.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.193 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.193 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.193 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699647+0000", 2024-09-12T17:07:12.193 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1300000000000001e-06 2024-09-12T17:07:12.193 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699660+0000", 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2326e-05 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699694+0000", 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4552999999999999e-05 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.194 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699710+0000", 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5573000000000002e-05 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.699835+0000", 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012534300000000001 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700050+0000", 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000214565 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.195 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.700448+0000", 2024-09-12T17:07:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039816999999999999 2024-09-12T17:07:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702129+0000", 2024-09-12T17:07:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001680874 2024-09-12T17:07:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.196 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702721+0000", 2024-09-12T17:07:12.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00059224199999999999 2024-09-12T17:07:12.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702804+0000", 2024-09-12T17:07:12.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.3071999999999993e-05 2024-09-12T17:07:12.197 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.197 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.197 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.197 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.702899+0000", 2024-09-12T17:07:12.197 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4956000000000004e-05 2024-09-12T17:07:12.197 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:287 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 73.471702492999995, 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034654030000000001, 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.198 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 287 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715311+0000", 2024-09-12T17:07:12.199 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715312+0000", 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1340000000000001e-06 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715318+0000", 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8409999999999996e-06 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.200 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715332+0000", 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4265e-05 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715342+0000", 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3360000000000001e-06 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715412+0000", 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9980000000000004e-05 2024-09-12T17:07:12.201 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715511+0000", 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9197000000000006e-05 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.715663+0000", 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152347 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.716287+0000", 2024-09-12T17:07:12.202 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00062330100000000004 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718705+0000", 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002418505 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718743+0000", 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7645999999999998e-05 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.203 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.718777+0000", 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3850999999999998e-05 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:742 6.f 6:f3db1134:::obj_delete_at_hint.0000000055:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 73.162222639999996, 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028821710000000002, 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.204 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 742 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.205 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024791+0000", 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024794+0000", 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7669999999999999e-06 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024805+0000", 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1093e-05 2024-09-12T17:07:12.206 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024836+0000", 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1136000000000001e-05 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024852+0000", 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6140000000000001e-05 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.024989+0000", 2024-09-12T17:07:12.207 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000136422 2024-09-12T17:07:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025219+0000", 2024-09-12T17:07:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023008499999999999 2024-09-12T17:07:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.025545+0000", 2024-09-12T17:07:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032645100000000001 2024-09-12T17:07:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.208 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.026827+0000", 2024-09-12T17:07:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00128202 2024-09-12T17:07:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027470+0000", 2024-09-12T17:07:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00064248199999999999 2024-09-12T17:07:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.209 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027556+0000", 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6533000000000007e-05 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.027673+0000", 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117042 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:07:12.210 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.983102075000005, 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031165260000000001, 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 817 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.211 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:07:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203912+0000", 2024-09-12T17:07:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203915+0000", 2024-09-12T17:07:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.146e-06 2024-09-12T17:07:12.212 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203926+0000", 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1379999999999999e-05 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203958+0000", 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2239000000000001e-05 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.213 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.203973+0000", 2024-09-12T17:07:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.47e-05 2024-09-12T17:07:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204156+0000", 2024-09-12T17:07:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018277899999999999 2024-09-12T17:07:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204392+0000", 2024-09-12T17:07:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000236658 2024-09-12T17:07:12.214 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.204705+0000", 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000312248 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.205983+0000", 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001278387 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.215 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206726+0000", 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074269799999999997 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.206909+0000", 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018368200000000001 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.207028+0000", 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118609 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.216 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.978820424999995, 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003050269, 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.217 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 819 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208193+0000", 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.218 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208196+0000", 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4569999999999999e-06 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208207+0000", 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.093e-05 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208241+0000", 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3936000000000002e-05 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.219 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208256+0000", 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5917e-05 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208383+0000", 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012605200000000001 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.208602+0000", 2024-09-12T17:07:12.220 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219908 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.209077+0000", 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047489299999999999 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210285+0000", 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012075110000000001 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.221 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.210979+0000", 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069376099999999999 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211131+0000", 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151915 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.211243+0000", 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112989 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.222 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:07:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.924074700999995, 2024-09-12T17:07:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0035006659999999999, 2024-09-12T17:07:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.223 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 841 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262939+0000", 2024-09-12T17:07:12.224 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262942+0000", 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6900000000000001e-06 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262953+0000", 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1323e-05 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.225 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.262989+0000", 2024-09-12T17:07:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5617000000000001e-05 2024-09-12T17:07:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263006+0000", 2024-09-12T17:07:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7713000000000001e-05 2024-09-12T17:07:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263177+0000", 2024-09-12T17:07:12.226 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170249 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.263551+0000", 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037421999999999998 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.264122+0000", 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057113200000000002 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.227 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.265539+0000", 2024-09-12T17:07:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001417012 2024-09-12T17:07:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266170+0000", 2024-09-12T17:07:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00063154599999999997 2024-09-12T17:07:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266330+0000", 2024-09-12T17:07:12.228 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015926800000000001 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.266440+0000", 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010989600000000001 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.919373714000002, 2024-09-12T17:07:12.229 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032057850000000001, 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 843 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:07:12.230 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267640+0000", 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267642+0000", 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.231 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267653+0000", 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0664e-05 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267687+0000", 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4112999999999997e-05 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267703+0000", 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5673000000000001e-05 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.232 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.267832+0000", 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012896500000000001 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268054+0000", 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022279600000000001 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.268561+0000", 2024-09-12T17:07:12.233 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050617200000000005 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.269801+0000", 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012401269999999999 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270562+0000", 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076129699999999997 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.234 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270716+0000", 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000154339 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.270846+0000", 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012930600000000001 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.235 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:07:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.908542053999994, 2024-09-12T17:07:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033822100000000001, 2024-09-12T17:07:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 847 2024-09-12T17:07:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.236 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:07:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278472+0000", 2024-09-12T17:07:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.237 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278474+0000", 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4930000000000001e-06 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278485+0000", 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1313e-05 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.238 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278518+0000", 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2517000000000001e-05 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278533+0000", 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939999999999999e-05 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.278689+0000", 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015628899999999999 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.239 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279066+0000", 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000377337 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.279610+0000", 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00054380900000000002 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281130+0000", 2024-09-12T17:07:12.240 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001519488 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281583+0000", 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00045297300000000001 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281738+0000", 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015484900000000001 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.241 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.281854+0000", 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116202 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.903926549999994, 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002883554, 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 849 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283087+0000", 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283090+0000", 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283102+0000", 2024-09-12T17:07:12.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.204e-05 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283136+0000", 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3983000000000003e-05 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283152+0000", 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6082999999999998e-05 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283278+0000", 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000126212 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283505+0000", 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022724900000000001 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.283971+0000", 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046550600000000003 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285223+0000", 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012519370000000001 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285811+0000", 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058819199999999997 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285904+0000", 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3410000000000002e-05 2024-09-12T17:07:12.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.285971+0000", 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6391999999999997e-05 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.855973636000002, 2024-09-12T17:07:12.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033550770000000001, 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 868 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:07:12.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331040+0000", 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331043+0000", 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7300000000000001e-06 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331054+0000", 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.131e-05 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331086+0000", 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1885999999999999e-05 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331101+0000", 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5016e-05 2024-09-12T17:07:12.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331253+0000", 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000151929 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.331616+0000", 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036285100000000003 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.332174+0000", 2024-09-12T17:07:12.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00055856199999999997 2024-09-12T17:07:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.333700+0000", 2024-09-12T17:07:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015259480000000001 2024-09-12T17:07:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334120+0000", 2024-09-12T17:07:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042021700000000002 2024-09-12T17:07:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334280+0000", 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159949 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.334395+0000", 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114679 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:870 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.851515844999994, 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003066923, 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 870 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.255 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:07:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335498+0000", 2024-09-12T17:07:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335500+0000", 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4040000000000002e-06 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335511+0000", 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.045e-05 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335542+0000", 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1542999999999999e-05 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335558+0000", 2024-09-12T17:07:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.535e-05 2024-09-12T17:07:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335698+0000", 2024-09-12T17:07:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014063899999999999 2024-09-12T17:07:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.335930+0000", 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000231435 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.336392+0000", 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046211199999999998 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.337568+0000", 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001176671 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338407+0000", 2024-09-12T17:07:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083885399999999999 2024-09-12T17:07:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338491+0000", 2024-09-12T17:07:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4159000000000005e-05 2024-09-12T17:07:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.338565+0000", 2024-09-12T17:07:12.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3306000000000006e-05 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.664161414000006, 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0029674670000000001, 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.261 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 949 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522852+0000", 2024-09-12T17:07:12.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522855+0000", 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0429999999999999e-06 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522871+0000", 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5950000000000001e-05 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522906+0000", 2024-09-12T17:07:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4316000000000001e-05 2024-09-12T17:07:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.522924+0000", 2024-09-12T17:07:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8326999999999999e-05 2024-09-12T17:07:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523047+0000", 2024-09-12T17:07:12.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123609 2024-09-12T17:07:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523282+0000", 2024-09-12T17:07:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000234465 2024-09-12T17:07:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.523606+0000", 2024-09-12T17:07:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00032453099999999997 2024-09-12T17:07:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.524804+0000", 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011977509999999999 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525626+0000", 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082216400000000001 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525743+0000", 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116679 2024-09-12T17:07:12.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.525820+0000", 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6631999999999994e-05 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.650437740000001, 2024-09-12T17:07:12.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030602540000000001, 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 955 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:07:12.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536576+0000", 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536578+0000", 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5500000000000001e-06 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536590+0000", 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1250000000000001e-05 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536624+0000", 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4227000000000003e-05 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536646+0000", 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2195999999999999e-05 2024-09-12T17:07:12.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.536794+0000", 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014799600000000001 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537005+0000", 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021096799999999999 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.537489+0000", 2024-09-12T17:07:12.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048413599999999997 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.538940+0000", 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001451262 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539441+0000", 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00050002300000000005 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539535+0000", 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4526999999999998e-05 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.539636+0000", 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010111900000000001 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.273 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:07:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 72.646180405999999, 2024-09-12T17:07:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030889300000000001, 2024-09-12T17:07:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 957 2024-09-12T17:07:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.274 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540833+0000", 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540836+0000", 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540862+0000", 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999999e-05 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540891+0000", 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9595999999999999e-05 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.540906+0000", 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4919999999999999e-05 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541052+0000", 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014583900000000001 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541232+0000", 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180259 2024-09-12T17:07:12.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.541500+0000", 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026788799999999998 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.542483+0000", 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000983142 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543756+0000", 2024-09-12T17:07:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001272977 2024-09-12T17:07:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543842+0000", 2024-09-12T17:07:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5748999999999995e-05 2024-09-12T17:07:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.543922+0000", 2024-09-12T17:07:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0000000000000007e-05 2024-09-12T17:07:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1170 3.21 3:87f83b83:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.87970118900000005, 2024-09-12T17:07:12.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019752527999999998, 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1170 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.281 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307314+0000", 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.734e-06 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308952+0000", 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016376190000000001 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308985+0000", 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3624000000000002e-05 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308999+0000", 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3127e-05 2024-09-12T17:07:12.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309087+0000", 2024-09-12T17:07:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8244000000000004e-05 2024-09-12T17:07:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309212+0000", 2024-09-12T17:07:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012551500000000001 2024-09-12T17:07:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309309+0000", 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7157000000000005e-05 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.314345+0000", 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050351900000000002 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.326922+0000", 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012577319 2024-09-12T17:07:12.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327013+0000", 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0801e-05 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327065+0000", 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2197999999999997e-05 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1173 3.1c 3:3ac09143:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.84734057299999999, 2024-09-12T17:07:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023664096999999999, 2024-09-12T17:07:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1173 2024-09-12T17:07:12.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339676+0000", 2024-09-12T17:07:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T17:07:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341224+0000", 2024-09-12T17:07:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015477679999999999 2024-09-12T17:07:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341253+0000", 2024-09-12T17:07:12.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9094999999999998e-05 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341267+0000", 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3624e-05 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341349+0000", 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1766000000000003e-05 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341485+0000", 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013647099999999999 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341587+0000", 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010150899999999999 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.345980+0000", 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043931990000000004 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363206+0000", 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017225963 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363278+0000", 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2577999999999995e-05 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363337+0000", 2024-09-12T17:07:12.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8839999999999999e-05 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1185 3.2d e63/24 3:b71e7b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_23:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.71638306799999996, 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011225964, 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.293 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470633+0000", 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8210000000000002e-06 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475312+0000", 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046786600000000003 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475342+0000", 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0179999999999999e-05 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475357+0000", 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4290999999999999e-05 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475443+0000", 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6370000000000001e-05 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475470+0000", 2024-09-12T17:07:12.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7478999999999999e-05 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.481792+0000", 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063212930000000004 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.481857+0000", 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4869999999999994e-05 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.297 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1186 3.3b e63/24 3:deebf429:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_24:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.480233+0000", 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.70678047300000002, 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0082766669999999997, 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.480233+0000", 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.480233+0000", 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.480235+0000", 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6700000000000001e-06 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.484033+0000", 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0037979350000000001 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.484048+0000", 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5173e-05 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.484056+0000", 2024-09-12T17:07:12.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1669999999999999e-06 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.484113+0000", 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6468999999999998e-05 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.484129+0000", 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6345999999999999e-05 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.488440+0000", 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043114499999999997 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.488510+0000", 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9456999999999996e-05 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1205 3.3b e63/24 3:de890aad:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_5:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.882759+0000", 2024-09-12T17:07:12.302 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.30425427999999999, 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0094663679999999993, 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.882759+0000", 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.882759+0000", 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.882762+0000", 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.323e-06 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.887755+0000", 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049936360000000001 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.887786+0000", 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0354000000000001e-05 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.887799+0000", 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3613e-05 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.887869+0000", 2024-09-12T17:07:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9868000000000003e-05 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.887888+0000", 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8958999999999999e-05 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.892148+0000", 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042597729999999997 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.892226+0000", 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7842000000000005e-05 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1207 3.2d e63/24 3:b67559cf:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_7:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.913859+0000", 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.27315419600000002, 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091979939999999993, 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.913859+0000", 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.913859+0000", 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.913862+0000", 2024-09-12T17:07:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.317e-06 2024-09-12T17:07:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.917645+0000", 2024-09-12T17:07:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0037832629999999998 2024-09-12T17:07:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.917670+0000", 2024-09-12T17:07:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5041999999999998e-05 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.917680+0000", 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0127e-05 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.917754+0000", 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3319999999999996e-05 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.917781+0000", 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.775e-05 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.922979+0000", 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051976089999999997 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.923057+0000", 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8566000000000006e-05 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.312 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:12.314 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:07:12.314 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records in 2024-09-12T17:07:12.314 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records out 2024-09-12T17:07:12.314 INFO:tasks.workunit.client.0.smithi017.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0672637 s, 1.6 GB/s 2024-09-12T17:07:12.314 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:12.310+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:12.415 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:12.414+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:12.477 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:12.477 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:12.478 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:12.478 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:12.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:07:12.515 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:12.514+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:12.616 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:12.612+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:12.629 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:12.629 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:12.629 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:12.629 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:12.630 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:12.644 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:07:12.717 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:12.714+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:12.798 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_10: 100Mb.4 2024-09-12T17:07:12.799 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:12.799 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 5 2024-09-12T17:07:12.818 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:12.818 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e31)", 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 79.268848168000005, 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011583833, 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.819 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 44 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544938+0000", 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544942+0000", 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.653e-06 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544957+0000", 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5654e-05 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.544993+0000", 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5936000000000003e-05 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.545017+0000", 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3283000000000001e-05 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549277+0000", 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042606800000000002 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.549301+0000", 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3260000000000001e-05 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556317+0000", 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070164620000000002 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:53.556522+0000", 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020490499999999999 2024-09-12T17:07:12.823 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1174 3.27 3:e7a048aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4628741380000001, 2024-09-12T17:07:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017154674000000002, 2024-09-12T17:07:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.824 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1174 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:12.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350915+0000", 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9500000000000001e-06 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352415+0000", 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001500234 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352436+0000", 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0662999999999999e-05 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352446+0000", 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8630000000000003e-06 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352517+0000", 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1267999999999996e-05 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352657+0000", 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140252 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352747+0000", 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9744e-05 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.357398+0000", 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004650469 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.367954+0000", 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010556592 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.368017+0000", 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3237000000000005e-05 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.368067+0000", 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9401999999999999e-05 2024-09-12T17:07:12.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1175 3.27 3:e584c994:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4514454729999999, 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017138075999999999, 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1175 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362344+0000", 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1209999999999998e-06 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363815+0000", 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00147124 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363838+0000", 2024-09-12T17:07:12.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3130999999999999e-05 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363850+0000", 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1742999999999999e-05 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363938+0000", 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7649000000000001e-05 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.364120+0000", 2024-09-12T17:07:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018224699999999999 2024-09-12T17:07:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.364286+0000", 2024-09-12T17:07:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000166293 2024-09-12T17:07:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.369965+0000", 2024-09-12T17:07:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056791009999999998 2024-09-12T17:07:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379306+0000", 2024-09-12T17:07:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0093409119999999998 2024-09-12T17:07:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379401+0000", 2024-09-12T17:07:12.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4839000000000005e-05 2024-09-12T17:07:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379479+0000", 2024-09-12T17:07:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7799999999999994e-05 2024-09-12T17:07:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1178 3.15 e63/24 3:a8e620d9:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_16:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.403945+0000", 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4098408739999999, 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011402878999999999, 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.403945+0000", 2024-09-12T17:07:12.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.403945+0000", 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.403947+0000", 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7099999999999999e-06 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.409414+0000", 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054667869999999999 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.409444+0000", 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9654000000000001e-05 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.409456+0000", 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2686e-05 2024-09-12T17:07:12.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.409537+0000", 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0869000000000001e-05 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.409564+0000", 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6846999999999999e-05 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.415287+0000", 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057230179999999999 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.415348+0000", 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1308000000000003e-05 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1182 3.5 e63/24 3:a2f25cd1:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_20:head v 63'3, mlcod=63'1)", 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.437823+0000", 2024-09-12T17:07:12.841 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.3759629879999999, 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0094597410000000007, 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.437823+0000", 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.842 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.437823+0000", 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.437826+0000", 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.441673+0000", 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0038475219999999999 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.441700+0000", 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6227000000000001e-05 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.441712+0000", 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2612999999999999e-05 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.441787+0000", 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5078000000000002e-05 2024-09-12T17:07:12.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.441805+0000", 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7663999999999999e-05 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.447234+0000", 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054290989999999997 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.447283+0000", 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8928000000000003e-05 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1184 3.2 3:40bd418a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.3596520320000001, 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017076502, 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.846 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1184 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454137+0000", 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1820000000000002e-06 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455769+0000", 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001632 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.848 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455796+0000", 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6446000000000001e-05 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455808+0000", 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1652e-05 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455886+0000", 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8123999999999999e-05 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.456057+0000", 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170848 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.456221+0000", 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000164284 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.462621+0000", 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063999469999999996 2024-09-12T17:07:12.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471114+0000", 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084932219999999999 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471158+0000", 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3843e-05 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471211+0000", 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2954000000000002e-05 2024-09-12T17:07:12.851 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1201 3.8 3:114be366:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.000833804, 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021172410999999999, 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.852 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1201 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:12.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812956+0000", 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3050000000000001e-06 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816133+0000", 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031766699999999999 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816165+0000", 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2197999999999999e-05 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816177+0000", 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1973999999999999e-05 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816249+0000", 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1898999999999997e-05 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816385+0000", 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013646400000000001 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816513+0000", 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128097 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.821736+0000", 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052224869999999996 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834015+0000", 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012279784 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834087+0000", 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1935999999999997e-05 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834125+0000", 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7596999999999999e-05 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.857 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1202 3.2 3:421b0e45:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.99105001699999995, 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018086743999999998, 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.858 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1202 2024-09-12T17:07:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822739+0000", 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2589999999999999e-06 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824478+0000", 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001739256 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824502+0000", 2024-09-12T17:07:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3952999999999999e-05 2024-09-12T17:07:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824514+0000", 2024-09-12T17:07:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2031999999999999e-05 2024-09-12T17:07:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824577+0000", 2024-09-12T17:07:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2793999999999995e-05 2024-09-12T17:07:12.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824714+0000", 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013785199999999999 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824862+0000", 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147751 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.830267+0000", 2024-09-12T17:07:12.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054052670000000001 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840734+0000", 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010466938 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840780+0000", 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5831999999999998e-05 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840823+0000", 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2809999999999998e-05 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1210 3.29 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.87030575600000004, 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021481673, 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.864 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1210 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943483+0000", 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6520000000000002e-06 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945771+0000", 2024-09-12T17:07:12.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022874829999999999 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945806+0000", 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4836999999999999e-05 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945820+0000", 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939e-05 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.867 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945888+0000", 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7702999999999999e-05 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946027+0000", 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000139135 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946146+0000", 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118742 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.950285+0000", 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041384880000000001 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964885+0000", 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014600594 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964928+0000", 2024-09-12T17:07:12.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2536000000000001e-05 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964962+0000", 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4564000000000003e-05 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1211 3.7 3:e386213e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:12.870 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.85925273300000005, 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018028718999999999, 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1211 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:12.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954536+0000", 2024-09-12T17:07:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.791e-06 2024-09-12T17:07:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.955972+0000", 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001435363 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956007+0000", 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4777000000000003e-05 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956022+0000", 2024-09-12T17:07:12.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5480000000000001e-05 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956094+0000", 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1515999999999998e-05 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956229+0000", 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551599999999999 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:12.874 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956330+0000", 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010090900000000001 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.960617+0000", 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042865510000000004 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972437+0000", 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011820169 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972510+0000", 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3129999999999999e-05 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972562+0000", 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2516999999999999e-05 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1212 3.18 3:1a9dd96a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.965415+0000", 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.84837097800000005, 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012118515999999999, 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1212 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.877 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.965415+0000", 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.965415+0000", 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.965417+0000", 2024-09-12T17:07:12.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9460000000000001e-06 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.966781+0000", 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001364072 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.966824+0000", 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3071999999999997e-05 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.966840+0000", 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.562e-05 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.966927+0000", 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7038000000000003e-05 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.967075+0000", 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014776500000000001 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.880 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.967172+0000", 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7041999999999997e-05 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972210+0000", 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050379439999999999 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.977439+0000", 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052291569999999999 2024-09-12T17:07:12.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.977483+0000", 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3955000000000002e-05 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.977534+0000", 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0905000000000001e-05 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1213 3.2 3:40368246:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.975917+0000", 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.83786944699999999, 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015178712, 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1213 2024-09-12T17:07:12.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.975917+0000", 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.975917+0000", 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.975920+0000", 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0750000000000002e-06 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.977447+0000", 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015271869999999999 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.977464+0000", 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7280999999999999e-05 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.977473+0000", 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4800000000000001e-06 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.977544+0000", 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1107999999999997e-05 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.977721+0000", 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000176964 2024-09-12T17:07:12.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.977886+0000", 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016466000000000001 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.984205+0000", 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006319542 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.990965+0000", 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0067597300000000003 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.991041+0000", 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5748999999999996e-05 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.991096+0000", 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4935999999999997e-05 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.888 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1214 3.19 3:9b9036b0:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.986785+0000", 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.82700110900000001, 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015190164000000001, 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.889 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1214 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.986785+0000", 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.986785+0000", 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.986788+0000", 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7939999999999998e-06 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.988445+0000", 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016569200000000001 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.988479+0000", 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3803000000000001e-05 2024-09-12T17:07:12.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.988494+0000", 2024-09-12T17:07:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.505e-05 2024-09-12T17:07:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.988579+0000", 2024-09-12T17:07:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5179000000000006e-05 2024-09-12T17:07:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.988713+0000", 2024-09-12T17:07:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000134227 2024-09-12T17:07:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.988848+0000", 2024-09-12T17:07:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013520399999999999 2024-09-12T17:07:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.993266+0000", 2024-09-12T17:07:12.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0044171660000000001 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.001876+0000", 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0086100399999999994 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.001930+0000", 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4648000000000003e-05 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.001975+0000", 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5133000000000003e-05 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1216 3.33 3:cf30ff9d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.80582098099999999, 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023290796999999999, 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1216 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007968+0000", 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0580000000000002e-06 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009686+0000", 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017173920000000001 2024-09-12T17:07:12.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009718+0000", 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2632999999999997e-05 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009734+0000", 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6011999999999998e-05 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009834+0000", 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9947999999999999e-05 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010000+0000", 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016520599999999999 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010133+0000", 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133676 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.015744+0000", 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056104570000000001 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031150+0000", 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015405894999999999 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031209+0000", 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9247999999999999e-05 2024-09-12T17:07:12.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031256+0000", 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7271999999999997e-05 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1217 3.28 e63/24 3:164ed207:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_17:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.023458+0000", 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.79032845600000001, 2024-09-12T17:07:12.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011591550000000001, 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.023458+0000", 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.023458+0000", 2024-09-12T17:07:12.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.023460+0000", 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.874e-06 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.027302+0000", 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0038424639999999999 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.027328+0000", 2024-09-12T17:07:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5772e-05 2024-09-12T17:07:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.027340+0000", 2024-09-12T17:07:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2466999999999999e-05 2024-09-12T17:07:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.027437+0000", 2024-09-12T17:07:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6927000000000002e-05 2024-09-12T17:07:12.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.027472+0000", 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4798000000000001e-05 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.034979+0000", 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075069400000000001 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.035049+0000", 2024-09-12T17:07:12.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0308000000000005e-05 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1221 3.1e 3:79f1c04b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.068911+0000", 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.74487550000000002, 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015350558, 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1221 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.068911+0000", 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.068911+0000", 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.068914+0000", 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4539999999999999e-06 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070589+0000", 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016751260000000001 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070627+0000", 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7664999999999999e-05 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070644+0000", 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6506000000000001e-05 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070738+0000", 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3955000000000004e-05 2024-09-12T17:07:12.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070934+0000", 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019615999999999999 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.071101+0000", 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016696500000000001 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.076308+0000", 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052075710000000002 2024-09-12T17:07:12.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.084173+0000", 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0078652150000000001 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.084211+0000", 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7765000000000002e-05 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.084261+0000", 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0176000000000002e-05 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.911 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1223 3.24 3:24ad2b36:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.711866412, 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016675265000000002, 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.912 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1223 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101923+0000", 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6240000000000002e-06 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104205+0000", 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022823930000000002 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104235+0000", 2024-09-12T17:07:12.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9835000000000001e-05 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104250+0000", 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4944e-05 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104325+0000", 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5728000000000004e-05 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104486+0000", 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016037700000000001 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104593+0000", 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000107487 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.108869+0000", 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042754910000000002 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118512+0000", 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0096435110000000004 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118557+0000", 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4608999999999999e-05 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118595+0000", 2024-09-12T17:07:12.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8266000000000003e-05 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1230 3.24 3:257b3201:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.33055192999999999, 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018874753000000001, 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1230 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483238+0000", 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2880000000000001e-06 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485868+0000", 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026303490000000001 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485904+0000", 2024-09-12T17:07:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5513999999999999e-05 2024-09-12T17:07:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485920+0000", 2024-09-12T17:07:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6201999999999998e-05 2024-09-12T17:07:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486092+0000", 2024-09-12T17:07:12.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017220700000000001 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486500+0000", 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040771200000000002 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486750+0000", 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025026699999999998 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.500598+0000", 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013848226 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.501939+0000", 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013409839999999999 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502016+0000", 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6908000000000003e-05 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502109+0000", 2024-09-12T17:07:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3096000000000004e-05 2024-09-12T17:07:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1240 3.23 e63/24 3:c4fef345:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_12:head v 63'3, mlcod=62'1)", 2024-09-12T17:07:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.611845+0000", 2024-09-12T17:07:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.20194173400000001, 2024-09-12T17:07:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0094681820000000003, 2024-09-12T17:07:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.611845+0000", 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.611845+0000", 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.611847+0000", 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6649999999999999e-06 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.614052+0000", 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022048770000000001 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.614076+0000", 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3900000000000002e-05 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.614089+0000", 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2598e-05 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.614169+0000", 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0286999999999999e-05 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.614199+0000", 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.976e-05 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.621244+0000", 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070455229999999997 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.621313+0000", 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8571999999999993e-05 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.928 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1243 3.18 3:18d88b4f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.658618+0000", 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.15516832799999999, 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0099143410000000001, 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1243 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:12.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.658618+0000", 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.658618+0000", 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.658620+0000", 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.08e-06 2024-09-12T17:07:12.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.660216+0000", 2024-09-12T17:07:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001595958 2024-09-12T17:07:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.660246+0000", 2024-09-12T17:07:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0205e-05 2024-09-12T17:07:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.660266+0000", 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9653e-05 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.660335+0000", 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9189000000000005e-05 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.660450+0000", 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011516899999999999 2024-09-12T17:07:12.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.660575+0000", 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012468000000000001 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.665208+0000", 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046335279999999996 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:12.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.668422+0000", 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032135359999999999 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.668481+0000", 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9249999999999997e-05 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.668532+0000", 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1093e-05 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.934 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:12.935 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:12.935 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:12.936 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:12.818+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:12.937 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:07:12.937 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records in 2024-09-12T17:07:12.937 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records out 2024-09-12T17:07:12.937 INFO:tasks.workunit.client.0.smithi017.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0733493 s, 1.4 GB/s 2024-09-12T17:07:12.938 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:12.934+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:13.037 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:13.034+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:13.072 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:13.072 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:13.072 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:13.072 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:13.087 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:07:13.112 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T17:07:13.178 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:13.178+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:13.239 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:13.238+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:13.279 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:13.279 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:13.279 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:13.279 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:13.279 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:13.300 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:07:13.342 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:13.342+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:13.441 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:13.436+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:13.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:07:13.486 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:13.486 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:13.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:13.486 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:13.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.486 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1175 3.27 e63/24 3:e584c994:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_13:head v 63'3, mlcod=0'0)", 2024-09-12T17:07:13.486 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.365538+0000", 2024-09-12T17:07:13.486 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.1166020809999999, 2024-09-12T17:07:13.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01451322, 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.365538+0000", 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.365538+0000", 2024-09-12T17:07:13.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.365540+0000", 2024-09-12T17:07:13.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0040000000000002e-06 2024-09-12T17:07:13.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.369499+0000", 2024-09-12T17:07:13.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003958573 2024-09-12T17:07:13.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.369529+0000", 2024-09-12T17:07:13.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0136000000000001e-05 2024-09-12T17:07:13.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.369545+0000", 2024-09-12T17:07:13.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5985999999999999e-05 2024-09-12T17:07:13.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.369706+0000", 2024-09-12T17:07:13.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000161356 2024-09-12T17:07:13.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.369774+0000", 2024-09-12T17:07:13.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8392000000000005e-05 2024-09-12T17:07:13.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.379874+0000", 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010099449999999999 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.380051+0000", 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017732300000000001 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1179 3.13 e63/24 3:cbd4a155:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_17:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:13.491 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.411895+0000", 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.0702451900000001, 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016791774999999998, 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.411895+0000", 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.411895+0000", 2024-09-12T17:07:13.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.411897+0000", 2024-09-12T17:07:13.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5940000000000001e-06 2024-09-12T17:07:13.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.415978+0000", 2024-09-12T17:07:13.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040800660000000002 2024-09-12T17:07:13.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416016+0000", 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8065999999999998e-05 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416039+0000", 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3674999999999999e-05 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416194+0000", 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155014 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416240+0000", 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5624999999999998e-05 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.428596+0000", 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012356084 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.428687+0000", 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650999999999997e-05 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1181 3.a e63/24 3:52e4a2c7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_19:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.431597+0000", 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.050543443, 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016594662, 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.496 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.431597+0000", 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.431597+0000", 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.431599+0000", 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.945e-06 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.434168+0000", 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025690309999999998 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.434215+0000", 2024-09-12T17:07:13.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6949000000000001e-05 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.434237+0000", 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2371999999999999e-05 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.434431+0000", 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019459100000000001 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.434487+0000", 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5376e-05 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.448054+0000", 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013566854999999999 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.448191+0000", 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013754300000000001 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.500 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1188 3.31 3:8d857c15:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.98831851, 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019168672000000001, 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:13.501 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:13.502 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1188 2024-09-12T17:07:13.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.502 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:13.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:13.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493824+0000", 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.553e-06 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497820+0000", 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039958659999999998 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497855+0000", 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4956000000000002e-05 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497872+0000", 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6863000000000001e-05 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497996+0000", 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124306 2024-09-12T17:07:13.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498229+0000", 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023307699999999999 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498994+0000", 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076469699999999995 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.507996+0000", 2024-09-12T17:07:13.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090021540000000001 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512687+0000", 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046905360000000004 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512861+0000", 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017420399999999999 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512990+0000", 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012946 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1203 3.3 3:c32b8ddb:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.6354052530000001, 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018231720999999999, 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.507 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:13.508 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:13.508 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:13.508 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1203 2024-09-12T17:07:13.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.508 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:13.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846738+0000", 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1990000000000002e-06 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852055+0000", 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053168080000000001 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852093+0000", 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8682e-05 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852111+0000", 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7153e-05 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852292+0000", 2024-09-12T17:07:13.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018150999999999999 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852527+0000", 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023529000000000001 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852761+0000", 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023386500000000001 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:13.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864541+0000", 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011779367000000001 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864784+0000", 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000242861 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864885+0000", 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101124 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864967+0000", 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1861999999999997e-05 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1209 3.a e63/24 3:531ac038:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_9:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.942304+0000", 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.53983626, 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016937681999999999, 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.513 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942304+0000", 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942304+0000", 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942308+0000", 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1169999999999997e-06 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946066+0000", 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037579309999999999 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946104+0000", 2024-09-12T17:07:13.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8432000000000001e-05 2024-09-12T17:07:13.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946122+0000", 2024-09-12T17:07:13.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7612999999999999e-05 2024-09-12T17:07:13.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946292+0000", 2024-09-12T17:07:13.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000169872 2024-09-12T17:07:13.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946380+0000", 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8067999999999998e-05 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959145+0000", 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012765515 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959241+0000", 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6133999999999998e-05 2024-09-12T17:07:13.517 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1210 3.29 e63/24 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.534704852, 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018233155000000001, 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947437+0000", 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3039999999999999e-06 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953449+0000", 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0060117130000000001 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953487+0000", 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.748e-05 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953504+0000", 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7343e-05 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953639+0000", 2024-09-12T17:07:13.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013447700000000001 2024-09-12T17:07:13.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953683+0000", 2024-09-12T17:07:13.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4521999999999998e-05 2024-09-12T17:07:13.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.965566+0000", 2024-09-12T17:07:13.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011883138 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.965668+0000", 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102178 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1223 3.24 e63/24 3:24ad2b36:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_23:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.105878+0000", 2024-09-12T17:07:13.522 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.3762623220000001, 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013396339, 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.105878+0000", 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.105878+0000", 2024-09-12T17:07:13.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.105881+0000", 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8629999999999999e-06 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.109969+0000", 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040880600000000001 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.110007+0000", 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8543e-05 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.110031+0000", 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4096000000000001e-05 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.110162+0000", 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013086700000000001 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.110202+0000", 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9598999999999998e-05 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.119127+0000", 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0089250040000000003 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.119274+0000", 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147307 2024-09-12T17:07:13.526 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.527 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.527 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.527 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1226 3.9 3:93f5cdeb:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:13.527 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.131082+0000", 2024-09-12T17:07:13.527 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.351058152, 2024-09-12T17:07:13.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015703324000000001, 2024-09-12T17:07:13.527 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.527 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.527 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.527 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1226 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.131082+0000", 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.131082+0000", 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.131085+0000", 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.597e-06 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.135095+0000", 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040090589999999997 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.135129+0000", 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4192000000000001e-05 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.135147+0000", 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7779999999999999e-05 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.135295+0000", 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014838899999999999 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.135567+0000", 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027184099999999999 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.136375+0000", 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080785500000000001 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.146383+0000", 2024-09-12T17:07:13.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010008316999999999 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.146592+0000", 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000209421 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.146705+0000", 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000112561 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.146785+0000", 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0311999999999999e-05 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1232 3.14 3:2967aafe:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.96186560200000004, 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019509183999999999, 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.533 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1232 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520278+0000", 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9539999999999998e-06 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525478+0000", 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005199665 2024-09-12T17:07:13.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525520+0000", 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2391999999999997e-05 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525542+0000", 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1613000000000001e-05 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525676+0000", 2024-09-12T17:07:13.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013434300000000001 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525933+0000", 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025640400000000001 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.526162+0000", 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228722 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.534431+0000", 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082696019999999992 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539449+0000", 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050177099999999999 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539640+0000", 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190812 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539784+0000", 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143967 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1234 3.3 3:c0bf349d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.93669465699999999, 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019413466000000001, 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.539 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1234 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545450+0000", 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.313e-06 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549431+0000", 2024-09-12T17:07:13.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039813139999999997 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549472+0000", 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0828999999999998e-05 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549491+0000", 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9055999999999998e-05 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549627+0000", 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013646700000000001 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549859+0000", 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023186100000000001 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.550208+0000", 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000348372 2024-09-12T17:07:13.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.559516+0000", 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093083260000000004 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564688+0000", 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051717849999999999 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564783+0000", 2024-09-12T17:07:13.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4821000000000006e-05 2024-09-12T17:07:13.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564859+0000", 2024-09-12T17:07:13.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6322000000000006e-05 2024-09-12T17:07:13.545 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.545 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.545 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.545 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1235 3.1c e63/45 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.91962852100000003, 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023527869, 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562514+0000", 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570603+0000", 2024-09-12T17:07:13.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080886359999999997 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570630+0000", 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7276000000000001e-05 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570642+0000", 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2153e-05 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570805+0000", 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016319899999999999 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570900+0000", 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4988000000000006e-05 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.585884+0000", 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014984046000000001 2024-09-12T17:07:13.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.586039+0000", 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155184 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1236 3.1b e63/24 3:d9ff086a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_8:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.572563+0000", 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.90957697299999996, 2024-09-12T17:07:13.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017155578000000001, 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.572563+0000", 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.572563+0000", 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.572565+0000", 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0499999999999999e-06 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577606+0000", 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050408149999999997 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577631+0000", 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.546e-05 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577645+0000", 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3839000000000001e-05 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577817+0000", 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017171600000000001 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577856+0000", 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8692999999999997e-05 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.589631+0000", 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011775803 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.589719+0000", 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7201999999999996e-05 2024-09-12T17:07:13.554 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1238 3.3 3:c2fc49d9:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.89164708000000004, 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018644582999999999, 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:13.555 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1238 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590496+0000", 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4400000000000001e-06 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596047+0000", 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055506599999999998 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596086+0000", 2024-09-12T17:07:13.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9326000000000003e-05 2024-09-12T17:07:13.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596106+0000", 2024-09-12T17:07:13.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9119000000000001e-05 2024-09-12T17:07:13.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596263+0000", 2024-09-12T17:07:13.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015771700000000001 2024-09-12T17:07:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596516+0000", 2024-09-12T17:07:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025320799999999999 2024-09-12T17:07:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596769+0000", 2024-09-12T17:07:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025305400000000001 2024-09-12T17:07:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.605151+0000", 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.008381833 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.608970+0000", 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038186660000000001 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.609064+0000", 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4438000000000006e-05 2024-09-12T17:07:13.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.609138+0000", 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3121999999999995e-05 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1244 3.1a 3:594e2ce7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.81127294599999999, 2024-09-12T17:07:13.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018879997999999999, 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1244 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:13.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670871+0000", 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0459999999999999e-06 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675701+0000", 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048294169999999999 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675740+0000", 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9592999999999999e-05 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675758+0000", 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.77e-05 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675939+0000", 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018083199999999999 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.676345+0000", 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040617099999999998 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.676719+0000", 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037385800000000002 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.688469+0000", 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01174979 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689374+0000", 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00090544200000000001 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689551+0000", 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017685300000000001 2024-09-12T17:07:13.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689747+0000", 2024-09-12T17:07:13.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019629599999999999 2024-09-12T17:07:13.569 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.569 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.569 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.569 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1247 3.1a 3:58056b43:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:13.569 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:13.569 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.78110247899999996, 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021958978000000001, 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1247 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:13.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701041+0000", 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9399999999999998e-06 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705529+0000", 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044889789999999997 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705569+0000", 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9606e-05 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705588+0000", 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9375999999999999e-05 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705756+0000", 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016734200000000001 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706045+0000", 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028885400000000001 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706343+0000", 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029790300000000002 2024-09-12T17:07:13.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720973+0000", 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014630684 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722653+0000", 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016799790000000001 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722878+0000", 2024-09-12T17:07:13.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022488799999999999 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722997+0000", 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118427 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1248 3.f e63/24 3:f313a312:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_20:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.720460+0000", 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.76167970600000001, 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014019985, 2024-09-12T17:07:13.575 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720460+0000", 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720460+0000", 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720463+0000", 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.243e-06 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.725272+0000", 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048094710000000001 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.725317+0000", 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5419e-05 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.725343+0000", 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5636e-05 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.725511+0000", 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000167753 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.725564+0000", 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.3625000000000002e-05 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.733027+0000", 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074621239999999997 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.734480+0000", 2024-09-12T17:07:13.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001453714 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1249 3.a e63/24 3:5189db44:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_21:head v 63'3, mlcod=63'1)", 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.727790+0000", 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.75434984900000002, 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014370986000000001, 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.580 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.727790+0000", 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.727790+0000", 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.727793+0000", 2024-09-12T17:07:13.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.303e-06 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.731172+0000", 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0033782 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.731214+0000", 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2002000000000002e-05 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.731239+0000", 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4822999999999999e-05 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.731381+0000", 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014221700000000001 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.731428+0000", 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6995e-05 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.742046+0000", 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010618022 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.742161+0000", 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115424 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1251 3.1d e63/24 3:ba0891d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_23:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.749500+0000", 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.73264048900000001, 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013796966000000001, 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749500+0000", 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749500+0000", 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749503+0000", 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5489999999999998e-06 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.753574+0000", 2024-09-12T17:07:13.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040710049999999999 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.753613+0000", 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8779000000000003e-05 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.753631+0000", 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8193e-05 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.753791+0000", 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000160206 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.753835+0000", 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4106000000000001e-05 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763146+0000", 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093106379999999996 2024-09-12T17:07:13.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763297+0000", 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015049 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1270 3.1c e63/45 3:3a10adff:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_14:head v 63'3, mlcod=63'1)", 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.302579+0000", 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.179561367, 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013355496999999999, 2024-09-12T17:07:13.589 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.302579+0000", 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.302579+0000", 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:13.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.302580+0000", 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.824e-06 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.308047+0000", 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054669940000000002 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:13.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.308082+0000", 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4696000000000001e-05 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.308103+0000", 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0930000000000001e-05 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.308252+0000", 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014913599999999999 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.308302+0000", 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0092000000000001e-05 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.315882+0000", 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0075794130000000001 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.315934+0000", 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2411999999999999e-05 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.593 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.594 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.594 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:13.594 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:13.594 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:13.595 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_10: 100Mb.5 2024-09-12T17:07:13.595 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:13.595 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 6 2024-09-12T17:07:13.595 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records in 2024-09-12T17:07:13.595 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records out 2024-09-12T17:07:13.595 INFO:tasks.workunit.client.0.smithi017.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0722537 s, 1.5 GB/s 2024-09-12T17:07:13.596 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:07:13.597 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:13.594+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:13.633 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:13.634 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:13.659 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:13.659 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:13.685 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:13.686 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:13.696 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:13.692+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:13.704 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:13.704 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:13.723 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:13.724 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:13.742 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:13.742 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:13.761 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:13.762 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:13.773 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:13.773 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:13.783 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:13.783 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:13.789 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:07:13.797 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:13.792+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:13.898 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:13.898+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:13.925 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:13.925 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:13.942 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:07:14.026 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:14.026+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:14.100 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:14.098+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:14.114 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T17:07:14.117 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:14.117 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:14.138 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:14.201 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:14.196+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:14.291 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_10: 100Mb.6 2024-09-12T17:07:14.291 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:14.291 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 7 2024-09-12T17:07:14.302 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:14.296+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:14.315 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:14.315 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:14.330 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:14.371 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records in 2024-09-12T17:07:14.371 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records out 2024-09-12T17:07:14.371 INFO:tasks.workunit.client.0.smithi017.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0768417 s, 1.4 GB/s 2024-09-12T17:07:14.403 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:14.402+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:14.450 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:14.451 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:14.465 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:14.506 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:14.506+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:14.605 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:14.602+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:14.635 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:14.635 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:14.654 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:14.746 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:14.746+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:14.807 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:14.806+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:14.841 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:14.841 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:14.863 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:14.908 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:14.904+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:15.010 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:15.006+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:15.041 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:15.042 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:15.057 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:15.142 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:15.142+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:15.185 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_10: 100Mb.7 2024-09-12T17:07:15.185 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:15.185 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 8 2024-09-12T17:07:15.211 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:15.204+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:15.220 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:15.220 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:15.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:07:15.263 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records in 2024-09-12T17:07:15.263 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records out 2024-09-12T17:07:15.263 INFO:tasks.workunit.client.0.smithi017.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0753087 s, 1.4 GB/s 2024-09-12T17:07:15.312 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:15.308+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:15.374 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:15.374 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:15.389 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:07:15.432 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:15.428+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:15.513 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:15.508+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:15.592 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:15.592 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:15.614 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:15.610+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:15.616 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:07:15.714 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:15.708+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:15.804 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:07:15.805 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:15.805 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:15.815 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:15.814+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:15.825 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_10: 100Mb.8 2024-09-12T17:07:15.825 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:15.825 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 9 2024-09-12T17:07:15.826 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:07:15.899 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records in 2024-09-12T17:07:15.899 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records out 2024-09-12T17:07:15.899 INFO:tasks.workunit.client.0.smithi017.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0741994 s, 1.4 GB/s 2024-09-12T17:07:15.916 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:15.914+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:15.959 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:15.959 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:15.993 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:15.993 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:16.003 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:16.003 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:16.003 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:16.003 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:16.010 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:16.010 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:16.017 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:16.014+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:16.021 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:07:16.031 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:16.032 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:16.053 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:16.053 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:16.074 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:16.074 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:16.095 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:16.096 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:16.117 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:16.112+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:16.120 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:16.121 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:16.161 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:16.161 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:16.161 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:16.161 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:16.161 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:16.166 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T17:07:16.181 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:07:16.224 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:16.220+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:16.319 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:16.312+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:16.379 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:16.379 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:16.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:16.379 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:16.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.379 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:07:16.379 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 84.847811554000003, 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:07:16.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:07:16.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 80.690179357999995, 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:07:16.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:07:16.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.390 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:07:16.391 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:16.391 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.780085564999993, 2024-09-12T17:07:16.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:07:16.391 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.391 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.391 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.391 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.391 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:07:16.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.391 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:07:16.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:07:16.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:07:16.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.764194824, 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:07:16.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:07:16.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:07:16.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:07:16.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:07:16.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:07:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:07:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:07:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:07:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:07:16.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.738726154000005, 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.403 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:07:16.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:07:16.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:07:16.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:07:16.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:07:16.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:07:16.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.719765053000003, 2024-09-12T17:07:16.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:16.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.411 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:07:16.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.415 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.685209752999995, 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:07:16.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:07:16.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:07:16.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:16.421 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.371990339999996, 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:07:16.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.367098971999994, 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.428 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:07:16.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.433 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.328123512999994, 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.434 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:07:16.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:07:16.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:07:16.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:07:16.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:07:16.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:07:16.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:07:16.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:07:16.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:07:16.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:07:16.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:07:16.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.441 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.324225538999997, 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:07:16.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:07:16.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:07:16.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:07:16.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:07:16.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.255466307000006, 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:16.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:07:16.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:07:16.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:07:16.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:07:16.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:07:16.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:07:16.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:07:16.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:07:16.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:07:16.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:07:16.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:07:16.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.219622293, 2024-09-12T17:07:16.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:16.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:07:16.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:07:16.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:07:16.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:07:16.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:07:16.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:07:16.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.199434921999995, 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:07:16.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:07:16.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.466 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.194540559999993, 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.467 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:07:16.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:07:16.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:07:16.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.473 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.473 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.473 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.473 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:16.473 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.132572405000005, 2024-09-12T17:07:16.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:07:16.473 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.473 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.474 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.474 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:07:16.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.474 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:16.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:07:16.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 77.128165629999998, 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:07:16.479 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:07:16.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:07:16.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:07:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:07:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:16.485 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 76.960766288000002, 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:16.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:07:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:07:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:07:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:07:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:07:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:07:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:07:16.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.491 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 76.929991255000004, 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.492 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:07:16.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:07:16.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:07:16.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:07:16.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:07:16.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:07:16.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 76.925078999999997, 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:16.498 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:16.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:16.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:16.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:16.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:07:16.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:07:16.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:16.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:07:16.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:07:16.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:16.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:07:16.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:07:16.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:16.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:07:16.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:07:16.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:16.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:07:16.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:07:16.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:16.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:07:16.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:07:16.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:16.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:07:16.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:07:16.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:16.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:07:16.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:07:16.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:16.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:16.504 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:16.504 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:07:16.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:07:16.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.504 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:16.504 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:16.505 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:16.506 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:07:16.507 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_10: 100Mb.9 2024-09-12T17:07:16.507 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:16.507 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 10 2024-09-12T17:07:16.507 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:16.500+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:16.556 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records in 2024-09-12T17:07:16.556 INFO:tasks.workunit.client.0.smithi017.stderr:10+0 records out 2024-09-12T17:07:16.556 INFO:tasks.workunit.client.0.smithi017.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0687041 s, 1.5 GB/s 2024-09-12T17:07:16.607 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:16.600+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:16.663 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:16.663 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:16.663 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:16.663 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:16.677 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:07:16.724 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:16.720+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:16.809 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:16.804+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:16.850 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:16.852 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:16.852 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:16.867 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:07:16.952 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:16.948+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:17.012 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:17.010+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:17.050 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1170 3.21 3:87f83b83:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.7394314189999998, 2024-09-12T17:07:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019752527999999998, 2024-09-12T17:07:17.050 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1170 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307314+0000", 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.734e-06 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308952+0000", 2024-09-12T17:07:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016376190000000001 2024-09-12T17:07:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308985+0000", 2024-09-12T17:07:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3624000000000002e-05 2024-09-12T17:07:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308999+0000", 2024-09-12T17:07:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3127e-05 2024-09-12T17:07:17.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309087+0000", 2024-09-12T17:07:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8244000000000004e-05 2024-09-12T17:07:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309212+0000", 2024-09-12T17:07:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012551500000000001 2024-09-12T17:07:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309309+0000", 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7157000000000005e-05 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.314345+0000", 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050351900000000002 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.326922+0000", 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012577319 2024-09-12T17:07:17.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327013+0000", 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0801e-05 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327065+0000", 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2197999999999997e-05 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1173 3.1c 3:3ac09143:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.7070708029999997, 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023664096999999999, 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1173 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339676+0000", 2024-09-12T17:07:17.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341224+0000", 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015477679999999999 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341253+0000", 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9094999999999998e-05 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341267+0000", 2024-09-12T17:07:17.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3624e-05 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341349+0000", 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1766000000000003e-05 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341485+0000", 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013647099999999999 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341587+0000", 2024-09-12T17:07:17.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010150899999999999 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.345980+0000", 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043931990000000004 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363206+0000", 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017225963 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363278+0000", 2024-09-12T17:07:17.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2577999999999995e-05 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363337+0000", 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8839999999999999e-05 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1185 3.2d e63/24 3:b71e7b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_23:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:17.064 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.5761132980000001, 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011225964, 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:17.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470633+0000", 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8210000000000002e-06 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475312+0000", 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046786600000000003 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475342+0000", 2024-09-12T17:07:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0179999999999999e-05 2024-09-12T17:07:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475357+0000", 2024-09-12T17:07:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4290999999999999e-05 2024-09-12T17:07:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475443+0000", 2024-09-12T17:07:17.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6370000000000001e-05 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475470+0000", 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7478999999999999e-05 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.481792+0000", 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063212930000000004 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.481857+0000", 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4869999999999994e-05 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1218 3.21 3:84169186:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.0182501820000001, 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018163809, 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.069 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1218 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028495+0000", 2024-09-12T17:07:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7850000000000001e-06 2024-09-12T17:07:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030091+0000", 2024-09-12T17:07:17.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015958260000000001 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030124+0000", 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2990000000000001e-05 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030144+0000", 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9381e-05 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030232+0000", 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8494999999999999e-05 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030355+0000", 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012280700000000001 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030508+0000", 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015261300000000001 2024-09-12T17:07:17.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.035197+0000", 2024-09-12T17:07:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046889339999999996 2024-09-12T17:07:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046453+0000", 2024-09-12T17:07:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011256339000000001 2024-09-12T17:07:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046565+0000", 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112521 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046658+0000", 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2118000000000001e-05 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.075 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1235 3.1c 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4887644489999996, 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027479018000000001, 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1235 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557983+0000", 2024-09-12T17:07:17.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.941e-06 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560826+0000", 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028422479999999999 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560855+0000", 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8999000000000001e-05 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560870+0000", 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5231999999999999e-05 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560956+0000", 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6391999999999995e-05 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561123+0000", 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016676199999999999 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561284+0000", 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160672 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.567185+0000", 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059013720000000002 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585343+0000", 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018157514999999999 2024-09-12T17:07:17.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585409+0000", 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6210999999999993e-05 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585458+0000", 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9673999999999999e-05 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1244 3.1a e63/51 3:594e2ce7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_16:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.675971+0000", 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.3707723850000004, 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011889952000000001, 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.675971+0000", 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.675971+0000", 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.675975+0000", 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0570000000000001e-06 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681452+0000", 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054770540000000003 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681499+0000", 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7431e-05 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681515+0000", 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6248000000000001e-05 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681596+0000", 2024-09-12T17:07:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1157999999999998e-05 2024-09-12T17:07:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681625+0000", 2024-09-12T17:07:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8158999999999999e-05 2024-09-12T17:07:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.687775+0000", 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006150183 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.687861+0000", 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6662000000000005e-05 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1245 3.2d e63/24 3:b430eac2:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_17:head v 63'3, mlcod=63'1)", 2024-09-12T17:07:17.086 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.685297+0000", 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.3614472959999997, 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010837932, 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.685297+0000", 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.685297+0000", 2024-09-12T17:07:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.685299+0000", 2024-09-12T17:07:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9209999999999999e-06 2024-09-12T17:07:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.690974+0000", 2024-09-12T17:07:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056756139999999998 2024-09-12T17:07:17.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.691006+0000", 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1492000000000003e-05 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.691021+0000", 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5293000000000001e-05 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.691102+0000", 2024-09-12T17:07:17.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0798999999999997e-05 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.691122+0000", 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9958000000000001e-05 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.696068+0000", 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049460470000000003 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.696135+0000", 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6808000000000001e-05 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1247 3.1a e63/51 3:58056b43:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_19:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.705561+0000", 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.341182957, 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010664557999999999, 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.705561+0000", 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.705561+0000", 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.705568+0000", 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9999999999999999e-06 2024-09-12T17:07:17.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.709965+0000", 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00439683 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.709994+0000", 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9158000000000001e-05 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.710009+0000", 2024-09-12T17:07:17.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5262999999999999e-05 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.710103+0000", 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3752000000000006e-05 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.710133+0000", 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0479000000000001e-05 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.716171+0000", 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0060372209999999997 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.716225+0000", 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4855000000000002e-05 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.095 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1266 3.0 3:00469398:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.793970142, 2024-09-12T17:07:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017314286000000002, 2024-09-12T17:07:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1266 2024-09-12T17:07:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.096 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252779+0000", 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0749999999999997e-06 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.255994+0000", 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032153389999999998 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256031+0000", 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7017000000000002e-05 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256048+0000", 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6412000000000001e-05 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256133+0000", 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5282000000000001e-05 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256307+0000", 2024-09-12T17:07:17.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017426299999999999 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256441+0000", 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013364200000000001 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.263259+0000", 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068185850000000003 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.269955+0000", 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006695884 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.270031+0000", 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6227e-05 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.270088+0000", 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6560000000000001e-05 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.101 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1270 3.1c 3:3a10adff:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.7474489449999999, 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015927516999999999, 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.102 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1270 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299298+0000", 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4750000000000002e-06 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301014+0000", 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017152479999999999 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301037+0000", 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3227999999999999e-05 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301047+0000", 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0210999999999999e-05 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301122+0000", 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4762e-05 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301251+0000", 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129388 2024-09-12T17:07:17.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301358+0000", 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010699199999999999 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.306720+0000", 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053618620000000002 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315142+0000", 2024-09-12T17:07:17.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084221739999999993 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315186+0000", 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3257999999999998e-05 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315222+0000", 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6918999999999997e-05 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1277 3.4 3:23471f80:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.371714+0000", 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.6750301570000001, 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013608876000000001, 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1277 2024-09-12T17:07:17.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.109 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.371714+0000", 2024-09-12T17:07:17.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.371714+0000", 2024-09-12T17:07:17.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.371717+0000", 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3289999999999998e-06 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373422+0000", 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001704501 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373445+0000", 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3396000000000001e-05 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373458+0000", 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2728000000000001e-05 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373550+0000", 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2731000000000004e-05 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373721+0000", 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017056800000000001 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.111 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373882+0000", 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016094899999999999 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.379438+0000", 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055562179999999999 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.385201+0000", 2024-09-12T17:07:17.112 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057630659999999998 2024-09-12T17:07:17.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.385267+0000", 2024-09-12T17:07:17.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6149999999999995e-05 2024-09-12T17:07:17.113 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.113 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.113 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.113 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.385323+0000", 2024-09-12T17:07:17.113 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.524e-05 2024-09-12T17:07:17.113 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.113 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1280 3.2d e63/24 3:b42c98cf:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_24:head v 63'5, mlcod=63'3)", 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.449722+0000", 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.5970223150000002, 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010850079, 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.114 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.449722+0000", 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.449722+0000", 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.449724+0000", 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:17.115 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453659+0000", 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039347560000000002 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453693+0000", 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3866999999999999e-05 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.116 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453707+0000", 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4477e-05 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453792+0000", 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5101999999999999e-05 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453820+0000", 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7881e-05 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.117 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.460520+0000", 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066994699999999999 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.460572+0000", 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2138999999999997e-05 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.118 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1370 3.0 3:012d3768:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.89414870000000002, 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016632968000000001, 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1370 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.119 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152598+0000", 2024-09-12T17:07:17.120 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2969999999999999e-06 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154241+0000", 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016424709999999999 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154278+0000", 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7419000000000002e-05 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.121 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154295+0000", 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6841999999999999e-05 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154387+0000", 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2239999999999998e-05 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154532+0000", 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014412499999999999 2024-09-12T17:07:17.122 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154646+0000", 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114047 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.159659+0000", 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050133189999999996 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.123 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169086+0000", 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0094265870000000002 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169163+0000", 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7793000000000005e-05 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169228+0000", 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4827999999999997e-05 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.124 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1373 3.2d e64/24 3:b512a50c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_5:head v 64'8, mlcod=64'6)", 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.85417328699999995, 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018448697999999999, 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.125 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192572+0000", 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6789999999999999e-06 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.126 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198743+0000", 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061702900000000001 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198764+0000", 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1016999999999999e-05 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198774+0000", 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0387999999999999e-05 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.127 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198892+0000", 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117761 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198917+0000", 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5060999999999999e-05 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.210945+0000", 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012028492 2024-09-12T17:07:17.128 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.211019+0000", 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4010000000000005e-05 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1382 3.1a e64/51 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head v 64'4, mlcod=63'2)", 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.290880+0000", 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.75586369900000006, 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014067876, 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.129 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.290880+0000", 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.290880+0000", 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.130 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.290882+0000", 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1399999999999998e-06 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295534+0000", 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046512319999999999 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295572+0000", 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8247000000000002e-05 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.131 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295592+0000", 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0438e-05 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295699+0000", 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106328 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295733+0000", 2024-09-12T17:07:17.132 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4697999999999999e-05 2024-09-12T17:07:17.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304887+0000", 2024-09-12T17:07:17.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091535699999999998 2024-09-12T17:07:17.133 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.133 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.133 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.133 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304948+0000", 2024-09-12T17:07:17.133 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1223000000000007e-05 2024-09-12T17:07:17.133 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.133 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1383 3.9 e64/24 3:90e43e04:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_15:head v 64'3, mlcod=63'1)", 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.300673+0000", 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.74607081099999994, 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011288431999999999, 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.134 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.300673+0000", 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.300673+0000", 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.300676+0000", 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8449999999999999e-06 2024-09-12T17:07:17.135 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304598+0000", 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039216670000000002 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304626+0000", 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8790999999999999e-05 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.136 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304640+0000", 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3888e-05 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304744+0000", 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103766 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304782+0000", 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7673000000000003e-05 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.137 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.311893+0000", 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0071108050000000004 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.311962+0000", 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8997000000000004e-05 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.138 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1407 3.21 3:85243711:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.25490180000000001, 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020947763000000001, 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1407 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.139 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791845+0000", 2024-09-12T17:07:17.140 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.683e-06 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796758+0000", 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049128230000000002 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796800+0000", 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2613e-05 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.141 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796819+0000", 2024-09-12T17:07:17.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8632999999999999e-05 2024-09-12T17:07:17.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796934+0000", 2024-09-12T17:07:17.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011525499999999999 2024-09-12T17:07:17.142 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.142 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.142 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.142 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797083+0000", 2024-09-12T17:07:17.142 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149376 2024-09-12T17:07:17.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:17.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797216+0000", 2024-09-12T17:07:17.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132848 2024-09-12T17:07:17.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.143 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.143 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.804681+0000", 2024-09-12T17:07:17.143 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0074645960000000004 2024-09-12T17:07:17.143 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.143 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812614+0000", 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079326510000000006 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812720+0000", 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106909 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812790+0000", 2024-09-12T17:07:17.144 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9375999999999994e-05 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1412 3.1c 3:388fdd84:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.18827390699999999, 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016636860999999999, 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.145 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1412 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.146 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858473+0000", 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4079999999999998e-06 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860776+0000", 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023030809999999998 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.147 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860831+0000", 2024-09-12T17:07:17.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4166999999999998e-05 2024-09-12T17:07:17.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.148 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.148 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860860+0000", 2024-09-12T17:07:17.148 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8881999999999999e-05 2024-09-12T17:07:17.148 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.148 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860980+0000", 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120155 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.861095+0000", 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011500700000000001 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.861202+0000", 2024-09-12T17:07:17.149 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106909 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.866202+0000", 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050006260000000002 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875034+0000", 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0088313439999999997 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.150 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875075+0000", 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1423e-05 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875107+0000", 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1859000000000001e-05 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1416 3.0 3:03f8363f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:17.151 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.13628176, 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023938686000000001, 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1416 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.152 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:17.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:17.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.153 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.153 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.153 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.153 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910465+0000", 2024-09-12T17:07:17.153 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8569999999999999e-06 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912455+0000", 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019900009999999999 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912491+0000", 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5522000000000003e-05 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.154 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912506+0000", 2024-09-12T17:07:17.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5928000000000001e-05 2024-09-12T17:07:17.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912607+0000", 2024-09-12T17:07:17.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010094099999999999 2024-09-12T17:07:17.155 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.155 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.155 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.155 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912784+0000", 2024-09-12T17:07:17.155 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000176851 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912927+0000", 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142502 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.918121+0000", 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051943290000000001 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934276+0000", 2024-09-12T17:07:17.156 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016155426000000001 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934347+0000", 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0970000000000007e-05 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934401+0000", 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3359000000000002e-05 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.157 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.158 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.158 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.158 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1421 3.2e 3:76cf3736:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:17.158 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:17.158 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.086809255000000002, 2024-09-12T17:07:17.158 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018499980999999999, 2024-09-12T17:07:17.158 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.158 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.158 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.158 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.158 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.158 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1421 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.159 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959937+0000", 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962168+0000", 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002231004 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.160 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962202+0000", 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3704000000000001e-05 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962218+0000", 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5732000000000001e-05 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962302+0000", 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4165999999999993e-05 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.161 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962472+0000", 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000169863 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962643+0000", 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017084000000000001 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.967183+0000", 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045406090000000001 2024-09-12T17:07:17.162 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978294+0000", 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011110480000000001 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978376+0000", 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2522999999999996e-05 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978435+0000", 2024-09-12T17:07:17.163 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8425999999999999e-05 2024-09-12T17:07:17.164 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.164 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.164 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.164 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.164 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.164 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:17.165 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:07:17.166 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T17:07:17.167 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:17.162+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:17.266 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:17.266+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:17.336 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:17.336 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:17.336 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:17.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:07:17.367 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:17.366+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:17.469 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:17.466+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:17.476 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:17.476 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:17.476 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:17.476 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:17.476 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:17.489 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:07:17.569 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:17.564+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:17.614 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:17.615 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:17.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:17.615 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:17.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.615 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1174 3.27 3:e7a048aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.615 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:17.615 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.2590704800000001, 2024-09-12T17:07:17.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017154674000000002, 2024-09-12T17:07:17.615 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.615 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.616 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.616 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.616 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.616 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.616 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1174 2024-09-12T17:07:17.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.616 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:17.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350915+0000", 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9500000000000001e-06 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352415+0000", 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001500234 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352436+0000", 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0662999999999999e-05 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352446+0000", 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8630000000000003e-06 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352517+0000", 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1267999999999996e-05 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352657+0000", 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140252 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352747+0000", 2024-09-12T17:07:17.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9744e-05 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.357398+0000", 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004650469 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.367954+0000", 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010556592 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.368017+0000", 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3237000000000005e-05 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.368067+0000", 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9401999999999999e-05 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.621 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1175 3.27 3:e584c994:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.2476418149999997, 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017138075999999999, 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1175 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362344+0000", 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1209999999999998e-06 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363815+0000", 2024-09-12T17:07:17.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00147124 2024-09-12T17:07:17.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363838+0000", 2024-09-12T17:07:17.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3130999999999999e-05 2024-09-12T17:07:17.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363850+0000", 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1742999999999999e-05 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363938+0000", 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7649000000000001e-05 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.364120+0000", 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018224699999999999 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.625 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.364286+0000", 2024-09-12T17:07:17.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000166293 2024-09-12T17:07:17.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.369965+0000", 2024-09-12T17:07:17.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056791009999999998 2024-09-12T17:07:17.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379306+0000", 2024-09-12T17:07:17.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0093409119999999998 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379401+0000", 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4839000000000005e-05 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379479+0000", 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7799999999999994e-05 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1184 3.2 3:40bd418a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 6.1558483739999996, 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017076502, 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1184 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.628 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454137+0000", 2024-09-12T17:07:17.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1820000000000002e-06 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455769+0000", 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001632 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455796+0000", 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6446000000000001e-05 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455808+0000", 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1652e-05 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455886+0000", 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8123999999999999e-05 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.456057+0000", 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170848 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.456221+0000", 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000164284 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.462621+0000", 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063999469999999996 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471114+0000", 2024-09-12T17:07:17.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084932219999999999 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471158+0000", 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3843e-05 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471211+0000", 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2954000000000002e-05 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.633 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1201 3.8 3:114be366:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.797030146, 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021172410999999999, 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1201 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812956+0000", 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3050000000000001e-06 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816133+0000", 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031766699999999999 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816165+0000", 2024-09-12T17:07:17.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2197999999999999e-05 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816177+0000", 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1973999999999999e-05 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816249+0000", 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1898999999999997e-05 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816385+0000", 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013646400000000001 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816513+0000", 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128097 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.821736+0000", 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052224869999999996 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834015+0000", 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012279784 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834087+0000", 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1935999999999997e-05 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834125+0000", 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7596999999999999e-05 2024-09-12T17:07:17.639 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1202 3.2 3:421b0e45:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.7872463590000001, 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018086743999999998, 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.640 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1202 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822739+0000", 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2589999999999999e-06 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824478+0000", 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001739256 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824502+0000", 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3952999999999999e-05 2024-09-12T17:07:17.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824514+0000", 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2031999999999999e-05 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824577+0000", 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2793999999999995e-05 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824714+0000", 2024-09-12T17:07:17.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013785199999999999 2024-09-12T17:07:17.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:17.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824862+0000", 2024-09-12T17:07:17.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147751 2024-09-12T17:07:17.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.830267+0000", 2024-09-12T17:07:17.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054052670000000001 2024-09-12T17:07:17.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840734+0000", 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010466938 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840780+0000", 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5831999999999998e-05 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840823+0000", 2024-09-12T17:07:17.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2809999999999998e-05 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1210 3.29 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.6665020980000005, 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021481673, 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.646 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.647 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.647 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1210 2024-09-12T17:07:17.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.647 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:17.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:17.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943483+0000", 2024-09-12T17:07:17.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6520000000000002e-06 2024-09-12T17:07:17.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945771+0000", 2024-09-12T17:07:17.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022874829999999999 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945806+0000", 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4836999999999999e-05 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945820+0000", 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939e-05 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945888+0000", 2024-09-12T17:07:17.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7702999999999999e-05 2024-09-12T17:07:17.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946027+0000", 2024-09-12T17:07:17.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000139135 2024-09-12T17:07:17.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946146+0000", 2024-09-12T17:07:17.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118742 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.950285+0000", 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041384880000000001 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964885+0000", 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014600594 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964928+0000", 2024-09-12T17:07:17.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2536000000000001e-05 2024-09-12T17:07:17.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964962+0000", 2024-09-12T17:07:17.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4564000000000003e-05 2024-09-12T17:07:17.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.652 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.652 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1211 3.7 3:e386213e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.6554490749999999, 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018028718999999999, 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1211 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954536+0000", 2024-09-12T17:07:17.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.791e-06 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.955972+0000", 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001435363 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956007+0000", 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4777000000000003e-05 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956022+0000", 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5480000000000001e-05 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956094+0000", 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1515999999999998e-05 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956229+0000", 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551599999999999 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956330+0000", 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010090900000000001 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.960617+0000", 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042865510000000004 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972437+0000", 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011820169 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972510+0000", 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3129999999999999e-05 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972562+0000", 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2516999999999999e-05 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1216 3.33 3:cf30ff9d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.6020173230000001, 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023290796999999999, 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1216 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007968+0000", 2024-09-12T17:07:17.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0580000000000002e-06 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009686+0000", 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017173920000000001 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009718+0000", 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2632999999999997e-05 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009734+0000", 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6011999999999998e-05 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009834+0000", 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9947999999999999e-05 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010000+0000", 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016520599999999999 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010133+0000", 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133676 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.015744+0000", 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056104570000000001 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031150+0000", 2024-09-12T17:07:17.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015405894999999999 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031209+0000", 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9247999999999999e-05 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031256+0000", 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7271999999999997e-05 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.664 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1221 3.1e 3:79f1c04b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.068911+0000", 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.541071842, 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015350558, 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.665 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1221 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.068911+0000", 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.068911+0000", 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.068914+0000", 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4539999999999999e-06 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070589+0000", 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016751260000000001 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070627+0000", 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7664999999999999e-05 2024-09-12T17:07:17.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070644+0000", 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6506000000000001e-05 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070738+0000", 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3955000000000004e-05 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070934+0000", 2024-09-12T17:07:17.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019615999999999999 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.071101+0000", 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016696500000000001 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.076308+0000", 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052075710000000002 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.084173+0000", 2024-09-12T17:07:17.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0078652150000000001 2024-09-12T17:07:17.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.084211+0000", 2024-09-12T17:07:17.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7765000000000002e-05 2024-09-12T17:07:17.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.084261+0000", 2024-09-12T17:07:17.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0176000000000002e-05 2024-09-12T17:07:17.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.672 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.673 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.673 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1223 3.24 3:24ad2b36:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.673 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:17.673 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.508062754, 2024-09-12T17:07:17.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016675265000000002, 2024-09-12T17:07:17.673 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.673 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.674 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.674 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1223 2024-09-12T17:07:17.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.674 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:17.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101923+0000", 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6240000000000002e-06 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104205+0000", 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022823930000000002 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104235+0000", 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9835000000000001e-05 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104250+0000", 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4944e-05 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104325+0000", 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5728000000000004e-05 2024-09-12T17:07:17.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104486+0000", 2024-09-12T17:07:17.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016037700000000001 2024-09-12T17:07:17.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104593+0000", 2024-09-12T17:07:17.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000107487 2024-09-12T17:07:17.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.108869+0000", 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042754910000000002 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118512+0000", 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0096435110000000004 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118557+0000", 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4608999999999999e-05 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118595+0000", 2024-09-12T17:07:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8266000000000003e-05 2024-09-12T17:07:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1230 3.24 3:257b3201:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.1267482720000004, 2024-09-12T17:07:17.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018874753000000001, 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1230 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:17.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483238+0000", 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2880000000000001e-06 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485868+0000", 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026303490000000001 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485904+0000", 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5513999999999999e-05 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485920+0000", 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6201999999999998e-05 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486092+0000", 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017220700000000001 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486500+0000", 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040771200000000002 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486750+0000", 2024-09-12T17:07:17.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025026699999999998 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.500598+0000", 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013848226 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.501939+0000", 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013409839999999999 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502016+0000", 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6908000000000003e-05 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502109+0000", 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3096000000000004e-05 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1257 3.19 3:9b556f07:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.131835+0000", 2024-09-12T17:07:17.685 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4781478400000001, 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016443860000000001, 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1257 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.131835+0000", 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.131835+0000", 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.131838+0000", 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.517e-06 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133842+0000", 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020036479999999998 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133874+0000", 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1594000000000003e-05 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133885+0000", 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1691e-05 2024-09-12T17:07:17.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133964+0000", 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9155999999999999e-05 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.134163+0000", 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019894699999999999 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.134300+0000", 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137105 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.139969+0000", 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056682499999999997 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.148163+0000", 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0081945920000000005 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.148215+0000", 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.185e-05 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.148279+0000", 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3509999999999993e-05 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1261 3.33 3:cc53a442:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.691 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4206088550000002, 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017162891, 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1261 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189377+0000", 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.039e-06 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192004+0000", 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026268900000000002 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192041+0000", 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6838000000000002e-05 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192055+0000", 2024-09-12T17:07:17.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4446e-05 2024-09-12T17:07:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192223+0000", 2024-09-12T17:07:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016760200000000001 2024-09-12T17:07:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192514+0000", 2024-09-12T17:07:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00029128900000000002 2024-09-12T17:07:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192760+0000", 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024571700000000001 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.201494+0000", 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0087345800000000005 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206464+0000", 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00497007 2024-09-12T17:07:17.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206505+0000", 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0528999999999998e-05 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206537+0000", 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1890999999999997e-05 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1263 3.27 3:e7aec214:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.220304+0000", 2024-09-12T17:07:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.3896783880000001, 2024-09-12T17:07:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016093784999999999, 2024-09-12T17:07:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1263 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.220304+0000", 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.220304+0000", 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.220309+0000", 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1490000000000002e-06 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.223929+0000", 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036199650000000002 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.223972+0000", 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2824999999999997e-05 2024-09-12T17:07:17.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.223996+0000", 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4039000000000001e-05 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.224102+0000", 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105654 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.224301+0000", 2024-09-12T17:07:17.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019872800000000001 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.224487+0000", 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018613899999999999 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.230720+0000", 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062332689999999996 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.236271+0000", 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055509349999999999 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.236345+0000", 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4400999999999995e-05 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.236398+0000", 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680999999999999e-05 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.703 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1369 3.19 3:9a84d0e6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.141780+0000", 2024-09-12T17:07:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4682022960000001, 2024-09-12T17:07:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016456490000000001, 2024-09-12T17:07:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1369 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.141780+0000", 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.141780+0000", 2024-09-12T17:07:17.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.141785+0000", 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.335e-06 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143672+0000", 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018877659999999999 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143701+0000", 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8415000000000002e-05 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143715+0000", 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4430000000000001e-05 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143805+0000", 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9475000000000006e-05 2024-09-12T17:07:17.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.144006+0000", 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020146399999999999 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.144186+0000", 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180161 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.149534+0000", 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053479859999999999 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.158103+0000", 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085683849999999995 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.158178+0000", 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5605000000000005e-05 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.158237+0000", 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8468000000000003e-05 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1372 3.15 e64/24 3:a8d86e21:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_4:head v 64'3, mlcod=63'1)", 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.183175+0000", 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4268074340000001, 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016505895, 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.183175+0000", 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.183175+0000", 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.183178+0000", 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8559999999999998e-06 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192166+0000", 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089874199999999994 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192189+0000", 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3983000000000001e-05 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192199+0000", 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0000000000000001e-05 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192282+0000", 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2905999999999995e-05 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192310+0000", 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7571000000000001e-05 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.199614+0000", 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.007303543 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.199681+0000", 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7615999999999998e-05 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1375 3.29 3:95c1ad90:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.4044901890000001, 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016791820999999998, 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1375 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.715 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205496+0000", 2024-09-12T17:07:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7220000000000001e-06 2024-09-12T17:07:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208326+0000", 2024-09-12T17:07:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028297270000000002 2024-09-12T17:07:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208353+0000", 2024-09-12T17:07:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6675000000000001e-05 2024-09-12T17:07:17.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208365+0000", 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2006e-05 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208450+0000", 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4958999999999998e-05 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208666+0000", 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021668300000000001 2024-09-12T17:07:17.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208858+0000", 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000191707 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.215258+0000", 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0064000439999999997 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222154+0000", 2024-09-12T17:07:17.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068963949999999996 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222230+0000", 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5320000000000004e-05 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222284+0000", 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4583000000000002e-05 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1377 3.1e 3:7bce3e7d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.228040+0000", 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.381943022, 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016043414999999998, 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1377 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.721 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.228040+0000", 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.228040+0000", 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.228044+0000", 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8940000000000003e-06 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.229951+0000", 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019078389999999999 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230027+0000", 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5840000000000006e-05 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230045+0000", 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8088999999999999e-05 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230136+0000", 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1056000000000004e-05 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230305+0000", 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000168689 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230429+0000", 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012388000000000001 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.237640+0000", 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0072110849999999999 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.243914+0000", 2024-09-12T17:07:17.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062736170000000004 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.244004+0000", 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0251e-05 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.244083+0000", 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9175e-05 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1387 3.8 3:122cdcfa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 1.271693932, 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018409291000000001, 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1387 2024-09-12T17:07:17.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338292+0000", 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.631e-06 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340227+0000", 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001934217 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340262+0000", 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5893999999999999e-05 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340278+0000", 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5325e-05 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340387+0000", 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010876 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340570+0000", 2024-09-12T17:07:17.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018296299999999999 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340735+0000", 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568400000000001 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.345914+0000", 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051783319999999999 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356536+0000", 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010622529 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356632+0000", 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5927000000000005e-05 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356698+0000", 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6029000000000001e-05 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.732 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1427 3.7 3:e327d833:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.58634022900000005, 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017016304999999999, 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1427 2024-09-12T17:07:17.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:17.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023646+0000", 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2590000000000001e-06 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024847+0000", 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001201674 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024879+0000", 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1636e-05 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024894+0000", 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4613000000000001e-05 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024980+0000", 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-05 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.025132+0000", 2024-09-12T17:07:17.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152242 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.025252+0000", 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119731 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.029896+0000", 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046442810000000001 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:17.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040528+0000", 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010631508 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040600+0000", 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2125999999999994e-05 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040659+0000", 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9074999999999999e-05 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.738 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:17.739 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:17.739 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:17.740 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:07:17.741 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:17.736+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:17.842 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:17.836+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:17.874 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:17.874 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:17.875 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:17.875 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:17.889 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:07:17.942 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:17.942+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:18.020 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:18.020 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:18.020 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:18.021 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:18.021 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:18.039 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:07:18.082 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:18.082+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:18.143 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:07:18.144 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:18.142+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:18.215 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:18.215 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:18.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:18.215 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1179 3.13 e63/24 3:cbd4a155:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_17:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.411895+0000", 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.7997194409999997, 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016791774999999998, 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.411895+0000", 2024-09-12T17:07:18.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.411895+0000", 2024-09-12T17:07:18.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.411897+0000", 2024-09-12T17:07:18.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5940000000000001e-06 2024-09-12T17:07:18.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.415978+0000", 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040800660000000002 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416016+0000", 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8065999999999998e-05 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416039+0000", 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3674999999999999e-05 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416194+0000", 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155014 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416240+0000", 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5624999999999998e-05 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.428596+0000", 2024-09-12T17:07:18.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012356084 2024-09-12T17:07:18.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.428687+0000", 2024-09-12T17:07:18.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650999999999997e-05 2024-09-12T17:07:18.220 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.220 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.220 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.221 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1188 3.31 3:8d857c15:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:18.221 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:18.221 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.7177927610000001, 2024-09-12T17:07:18.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019168672000000001, 2024-09-12T17:07:18.221 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.221 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.221 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.221 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.221 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.221 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.221 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1188 2024-09-12T17:07:18.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493824+0000", 2024-09-12T17:07:18.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.553e-06 2024-09-12T17:07:18.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497820+0000", 2024-09-12T17:07:18.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039958659999999998 2024-09-12T17:07:18.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497855+0000", 2024-09-12T17:07:18.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4956000000000002e-05 2024-09-12T17:07:18.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497872+0000", 2024-09-12T17:07:18.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6863000000000001e-05 2024-09-12T17:07:18.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497996+0000", 2024-09-12T17:07:18.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124306 2024-09-12T17:07:18.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498229+0000", 2024-09-12T17:07:18.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023307699999999999 2024-09-12T17:07:18.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:18.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498994+0000", 2024-09-12T17:07:18.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076469699999999995 2024-09-12T17:07:18.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.507996+0000", 2024-09-12T17:07:18.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090021540000000001 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512687+0000", 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046905360000000004 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512861+0000", 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017420399999999999 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512990+0000", 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012946 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1203 3.3 3:c32b8ddb:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.3648795040000001, 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018231720999999999, 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.227 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1203 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846738+0000", 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1990000000000002e-06 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852055+0000", 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053168080000000001 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852093+0000", 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8682e-05 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852111+0000", 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7153e-05 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852292+0000", 2024-09-12T17:07:18.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018150999999999999 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852527+0000", 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023529000000000001 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852761+0000", 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023386500000000001 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864541+0000", 2024-09-12T17:07:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011779367000000001 2024-09-12T17:07:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864784+0000", 2024-09-12T17:07:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000242861 2024-09-12T17:07:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864885+0000", 2024-09-12T17:07:18.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101124 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864967+0000", 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1861999999999997e-05 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1209 3.a e63/24 3:531ac038:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_9:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.942304+0000", 2024-09-12T17:07:18.233 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.2693105109999996, 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016937681999999999, 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942304+0000", 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942304+0000", 2024-09-12T17:07:18.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942308+0000", 2024-09-12T17:07:18.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1169999999999997e-06 2024-09-12T17:07:18.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946066+0000", 2024-09-12T17:07:18.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037579309999999999 2024-09-12T17:07:18.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946104+0000", 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8432000000000001e-05 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946122+0000", 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7612999999999999e-05 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946292+0000", 2024-09-12T17:07:18.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000169872 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946380+0000", 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8067999999999998e-05 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959145+0000", 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012765515 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959241+0000", 2024-09-12T17:07:18.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6133999999999998e-05 2024-09-12T17:07:18.238 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.238 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.238 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.238 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1210 3.29 e63/24 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:18.238 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:18.238 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.264179103, 2024-09-12T17:07:18.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018233155000000001, 2024-09-12T17:07:18.238 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:18.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947437+0000", 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3039999999999999e-06 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953449+0000", 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0060117130000000001 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953487+0000", 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.748e-05 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953504+0000", 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7343e-05 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953639+0000", 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013447700000000001 2024-09-12T17:07:18.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953683+0000", 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4521999999999998e-05 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.965566+0000", 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011883138 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.965668+0000", 2024-09-12T17:07:18.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102178 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1232 3.14 3:2967aafe:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.6913398529999997, 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019509183999999999, 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.243 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.244 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.244 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1232 2024-09-12T17:07:18.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.244 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:18.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:18.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520278+0000", 2024-09-12T17:07:18.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9539999999999998e-06 2024-09-12T17:07:18.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525478+0000", 2024-09-12T17:07:18.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005199665 2024-09-12T17:07:18.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525520+0000", 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2391999999999997e-05 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525542+0000", 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1613000000000001e-05 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525676+0000", 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013434300000000001 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525933+0000", 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025640400000000001 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.526162+0000", 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228722 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.534431+0000", 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082696019999999992 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539449+0000", 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050177099999999999 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539640+0000", 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190812 2024-09-12T17:07:18.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539784+0000", 2024-09-12T17:07:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143967 2024-09-12T17:07:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1234 3.3 3:c0bf349d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:18.249 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.6661689079999995, 2024-09-12T17:07:18.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019413466000000001, 2024-09-12T17:07:18.250 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.250 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.250 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.250 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.250 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1234 2024-09-12T17:07:18.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.250 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545450+0000", 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.313e-06 2024-09-12T17:07:18.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549431+0000", 2024-09-12T17:07:18.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039813139999999997 2024-09-12T17:07:18.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549472+0000", 2024-09-12T17:07:18.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0828999999999998e-05 2024-09-12T17:07:18.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549491+0000", 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9055999999999998e-05 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549627+0000", 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013646700000000001 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549859+0000", 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023186100000000001 2024-09-12T17:07:18.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.550208+0000", 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000348372 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.559516+0000", 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093083260000000004 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564688+0000", 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051717849999999999 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564783+0000", 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4821000000000006e-05 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564859+0000", 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6322000000000006e-05 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.255 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.256 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.256 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1235 3.1c e63/45 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:18.256 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:18.256 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.649102772, 2024-09-12T17:07:18.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023527869, 2024-09-12T17:07:18.256 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.256 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.256 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.256 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562514+0000", 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:18.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570603+0000", 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080886359999999997 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570630+0000", 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7276000000000001e-05 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570642+0000", 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2153e-05 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570805+0000", 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016319899999999999 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570900+0000", 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4988000000000006e-05 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.585884+0000", 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014984046000000001 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.586039+0000", 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155184 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1236 3.1b e63/24 3:d9ff086a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_8:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.572563+0000", 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.6390512240000001, 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017155578000000001, 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.572563+0000", 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.572563+0000", 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.572565+0000", 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0499999999999999e-06 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577606+0000", 2024-09-12T17:07:18.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050408149999999997 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577631+0000", 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.546e-05 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577645+0000", 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3839000000000001e-05 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577817+0000", 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017171600000000001 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577856+0000", 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8692999999999997e-05 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.589631+0000", 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011775803 2024-09-12T17:07:18.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.589719+0000", 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7201999999999996e-05 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1238 3.3 3:c2fc49d9:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.6211213310000003, 2024-09-12T17:07:18.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018644582999999999, 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1238 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:18.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590496+0000", 2024-09-12T17:07:18.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4400000000000001e-06 2024-09-12T17:07:18.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596047+0000", 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055506599999999998 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596086+0000", 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9326000000000003e-05 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596106+0000", 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9119000000000001e-05 2024-09-12T17:07:18.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596263+0000", 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015771700000000001 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596516+0000", 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025320799999999999 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:18.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596769+0000", 2024-09-12T17:07:18.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025305400000000001 2024-09-12T17:07:18.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.605151+0000", 2024-09-12T17:07:18.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.008381833 2024-09-12T17:07:18.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.608970+0000", 2024-09-12T17:07:18.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038186660000000001 2024-09-12T17:07:18.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.609064+0000", 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4438000000000006e-05 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.609138+0000", 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3121999999999995e-05 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1244 3.1a 3:594e2ce7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.540747197, 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018879997999999999, 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1244 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.272 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670871+0000", 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0459999999999999e-06 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675701+0000", 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048294169999999999 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675740+0000", 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9592999999999999e-05 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675758+0000", 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.77e-05 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675939+0000", 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018083199999999999 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.676345+0000", 2024-09-12T17:07:18.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040617099999999998 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.676719+0000", 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037385800000000002 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.688469+0000", 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01174979 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689374+0000", 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00090544200000000001 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689551+0000", 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017685300000000001 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689747+0000", 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019629599999999999 2024-09-12T17:07:18.277 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1247 3.1a 3:58056b43:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.5105767300000004, 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021958978000000001, 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.278 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1247 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701041+0000", 2024-09-12T17:07:18.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9399999999999998e-06 2024-09-12T17:07:18.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705529+0000", 2024-09-12T17:07:18.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044889789999999997 2024-09-12T17:07:18.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705569+0000", 2024-09-12T17:07:18.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9606e-05 2024-09-12T17:07:18.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705588+0000", 2024-09-12T17:07:18.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9375999999999999e-05 2024-09-12T17:07:18.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705756+0000", 2024-09-12T17:07:18.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016734200000000001 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706045+0000", 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028885400000000001 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706343+0000", 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029790300000000002 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720973+0000", 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014630684 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722653+0000", 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016799790000000001 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722878+0000", 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022488799999999999 2024-09-12T17:07:18.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722997+0000", 2024-09-12T17:07:18.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118427 2024-09-12T17:07:18.284 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.284 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.284 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.284 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1376 3.3 3:c01937d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:18.284 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:18.284 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.9923878230000001, 2024-09-12T17:07:18.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020435229999999999, 2024-09-12T17:07:18.285 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.285 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.285 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.285 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.285 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.285 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.285 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1376 2024-09-12T17:07:18.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.285 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:18.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:18.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219230+0000", 2024-09-12T17:07:18.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.23e-06 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223391+0000", 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041610629999999996 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223425+0000", 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4167e-05 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223443+0000", 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8105999999999999e-05 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223562+0000", 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118861 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223840+0000", 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027762099999999998 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:18.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.224077+0000", 2024-09-12T17:07:18.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023720100000000001 2024-09-12T17:07:18.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.232976+0000", 2024-09-12T17:07:18.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0088992900000000007 2024-09-12T17:07:18.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239478+0000", 2024-09-12T17:07:18.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065023609999999999 2024-09-12T17:07:18.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239574+0000", 2024-09-12T17:07:18.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5527999999999997e-05 2024-09-12T17:07:18.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239662+0000", 2024-09-12T17:07:18.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7801999999999997e-05 2024-09-12T17:07:18.290 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1382 3.1a 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.925720871, 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020895593, 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.291 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.292 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.292 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1382 2024-09-12T17:07:18.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.292 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:18.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285897+0000", 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6669999999999998e-06 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290617+0000", 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047198689999999998 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290657+0000", 2024-09-12T17:07:18.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0201999999999999e-05 2024-09-12T17:07:18.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290676+0000", 2024-09-12T17:07:18.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9293e-05 2024-09-12T17:07:18.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290860+0000", 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000183353 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291264+0000", 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040463800000000002 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291676+0000", 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041151499999999999 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301391+0000", 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0097147350000000004 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306412+0000", 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050210790000000003 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306636+0000", 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000224589 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306789+0000", 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015265299999999999 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1383 3.9 3:90e43e04:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.296675+0000", 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.9149389779999999, 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017100829000000001, 2024-09-12T17:07:18.297 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1383 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.296675+0000", 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.296675+0000", 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.296679+0000", 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4769999999999999e-06 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.300641+0000", 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039620180000000003 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.300675+0000", 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4385999999999999e-05 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.300695+0000", 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9473000000000001e-05 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.300820+0000", 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012572399999999999 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301138+0000", 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031714599999999998 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301452+0000", 2024-09-12T17:07:18.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000314524 2024-09-12T17:07:18.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.310900+0000", 2024-09-12T17:07:18.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0094480109999999992 2024-09-12T17:07:18.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.313495+0000", 2024-09-12T17:07:18.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025945590000000002 2024-09-12T17:07:18.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.313654+0000", 2024-09-12T17:07:18.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000159304 2024-09-12T17:07:18.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.313776+0000", 2024-09-12T17:07:18.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012220699999999999 2024-09-12T17:07:18.303 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.303 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.303 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1385 3.34 3:2f3cb087:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.8936957649999999, 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024744103999999999, 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1385 2024-09-12T17:07:18.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317922+0000", 2024-09-12T17:07:18.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.157e-06 2024-09-12T17:07:18.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322800+0000", 2024-09-12T17:07:18.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048785879999999997 2024-09-12T17:07:18.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322846+0000", 2024-09-12T17:07:18.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5732999999999997e-05 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322866+0000", 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0415999999999999e-05 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323048+0000", 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018128 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323496+0000", 2024-09-12T17:07:18.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044786400000000002 2024-09-12T17:07:18.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:18.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323919+0000", 2024-09-12T17:07:18.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042374399999999999 2024-09-12T17:07:18.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.340076+0000", 2024-09-12T17:07:18.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016156925999999999 2024-09-12T17:07:18.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342379+0000", 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023025189999999998 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342546+0000", 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016719599999999999 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342663+0000", 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116681 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1409 3.a e64/24 3:53d4fdcd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_3:head v 64'6, mlcod=64'4)", 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.3902162229999999, 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021472076, 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.310 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821402+0000", 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4699999999999998e-06 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828337+0000", 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069354229999999996 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828387+0000", 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9908999999999999e-05 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828412+0000", 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5389999999999999e-05 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828587+0000", 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017425599999999999 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828654+0000", 2024-09-12T17:07:18.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7708999999999998e-05 2024-09-12T17:07:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842774+0000", 2024-09-12T17:07:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014119860999999999 2024-09-12T17:07:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842870+0000", 2024-09-12T17:07:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6057999999999994e-05 2024-09-12T17:07:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.314 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1417 3.14 3:29a29b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.2888878180000001, 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.034043223999999997, 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.315 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1417 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922731+0000", 2024-09-12T17:07:18.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1099999999999996e-06 2024-09-12T17:07:18.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930785+0000", 2024-09-12T17:07:18.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080541020000000005 2024-09-12T17:07:18.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930841+0000", 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6005999999999999e-05 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930869+0000", 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8602000000000002e-05 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931049+0000", 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017998299999999999 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931287+0000", 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000237712 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931510+0000", 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022283200000000001 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941891+0000", 2024-09-12T17:07:18.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010380785 2024-09-12T17:07:18.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.955891+0000", 2024-09-12T17:07:18.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014000207000000001 2024-09-12T17:07:18.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956636+0000", 2024-09-12T17:07:18.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00074503099999999995 2024-09-12T17:07:18.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956770+0000", 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013385400000000001 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1420 3.3 3:c118c659:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.259594002, 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022394282000000001, 2024-09-12T17:07:18.321 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.322 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.322 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.322 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.322 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.322 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.322 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1420 2024-09-12T17:07:18.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.322 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:18.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952024+0000", 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1760000000000003e-06 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958458+0000", 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064335770000000002 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958492+0000", 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4309e-05 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958508+0000", 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5699999999999999e-05 2024-09-12T17:07:18.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958717+0000", 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020871900000000001 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959163+0000", 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000446007 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959583+0000", 2024-09-12T17:07:18.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042026800000000001 2024-09-12T17:07:18.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.970389+0000", 2024-09-12T17:07:18.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010806375999999999 2024-09-12T17:07:18.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974044+0000", 2024-09-12T17:07:18.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003654352 2024-09-12T17:07:18.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974232+0000", 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018811899999999999 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974415+0000", 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018267899999999999 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.327 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1432 3.3 3:c31ee49b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.10:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:17.072308+0000", 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.1393058300000001, 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018638120000000001, 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1432 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:18.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.072308+0000", 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.072308+0000", 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.072311+0000", 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6390000000000001e-06 2024-09-12T17:07:18.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076248+0000", 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039373089999999999 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076285+0000", 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6470999999999997e-05 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076301+0000", 2024-09-12T17:07:18.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5693e-05 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076438+0000", 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013785100000000001 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076696+0000", 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025774499999999998 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.077565+0000", 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000869215 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.088840+0000", 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011274273 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.090743+0000", 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019029800000000001 2024-09-12T17:07:18.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.090866+0000", 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012304300000000001 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.090947+0000", 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0901000000000004e-05 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:18.333 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:18.334 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:18.334 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:18.335 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:18.336 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:18.336 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:18.336 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:07:18.337 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:18.334+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:18.337 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:18.337 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:18.349 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:18.349 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:18.386 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:18.386 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:18.423 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:18.423 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:18.436 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:18.432+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:18.459 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:18.459 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:18.495 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:18.496 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:18.513 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:18.513 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:18.527 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:07:18.574 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:18.574+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:18.638 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:18.638+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:18.655 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:18.655 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:18.671 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:07:18.762 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:18.762+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:18.839 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:18.832+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:18.843 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:18.843 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:18.857 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:18.940 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:18.936+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:19.033 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:19.034 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:19.041 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:19.037+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:19.049 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:19.142 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:19.141+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:19.168 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T17:07:19.233 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:19.233 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:19.243 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:19.236+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:19.249 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:19.344 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:19.340+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:19.414 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:19.415 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:19.429 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:19.478 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:19.477+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:19.546 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:19.540+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:19.566 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:19.566 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:19.583 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:19.647 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:19.640+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:19.748 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:19.744+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:19.758 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:19.758 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:19.775 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:19.849 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:19.845+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:19.904 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:19.921 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:07:19.963 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:19.961+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:20.044 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:20.045 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:20.051 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:20.044+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:20.058 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:07:20.138 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T17:07:20.152 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:20.149+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:20.238 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:20.238 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:20.253 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:20.249+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:20.258 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:07:20.354 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:20.348+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:20.383 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:20.383 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:20.397 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:07:20.484 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:20.480+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:20.519 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:07:20.554 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:20.555 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:20.556 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:20.553+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:20.568 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:07:20.656 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:20.656 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:20.656 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:20.653+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:20.672 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:20.673 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:20.693 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:20.694 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:20.729 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:20.736 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:20.736 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:20.736 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:20.736 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:20.736 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:20.750 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:07:20.758 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:20.753+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:20.765 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:20.765 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:20.785 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:20.785 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:20.821 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:20.821 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:20.858 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:20.859 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:20.859 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:20.857+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:20.894 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4367.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T17:07:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 89.364227139999997, 2024-09-12T17:07:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028722291, 2024-09-12T17:07:20.894 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "reached pg", 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4367", 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/33166702", 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526371+0000", 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526374+0000", 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9739999999999998e-06 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526388+0000", 2024-09-12T17:07:20.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3943e-05 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526415+0000", 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6406000000000001e-05 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526437+0000", 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2813e-05 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526587+0000", 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014930999999999999 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for peered", 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.526603+0000", 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5902000000000001e-05 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.554961+0000", 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.028358452999999999 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:51.555093+0000", 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013249 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 85.206594944000003, 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031366380000000002, 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.899 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 193 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684003+0000", 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684006+0000", 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4660000000000002e-06 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684017+0000", 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1477e-05 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684048+0000", 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0676000000000002e-05 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684063+0000", 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4786999999999999e-05 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684203+0000", 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140669 2024-09-12T17:07:20.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684408+0000", 2024-09-12T17:07:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020479800000000001 2024-09-12T17:07:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.684695+0000", 2024-09-12T17:07:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00028632100000000003 2024-09-12T17:07:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686493+0000", 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001798079 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.686969+0000", 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047675700000000002 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687070+0000", 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100759 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:55.687140+0000", 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9849000000000002e-05 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 82.296501151000001, 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003351274, 2024-09-12T17:07:20.905 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 208 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.906 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594097+0000", 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594100+0000", 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9869999999999999e-06 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594113+0000", 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.309e-05 2024-09-12T17:07:20.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594147+0000", 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3479999999999998e-05 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594163+0000", 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5863e-05 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594366+0000", 2024-09-12T17:07:20.908 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020340199999999999 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.594610+0000", 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024431399999999998 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.595026+0000", 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041540099999999998 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.909 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597255+0000", 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022293920000000002 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597292+0000", 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6619999999999998e-05 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597376+0000", 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4475999999999996e-05 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.597448+0000", 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2249000000000006e-05 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 82.280610409999994, 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003180389, 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.911 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 212 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609988+0000", 2024-09-12T17:07:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.609991+0000", 2024-09-12T17:07:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.757e-06 2024-09-12T17:07:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.913 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610003+0000", 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1953000000000001e-05 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610029+0000", 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6052999999999999e-05 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610043+0000", 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4076999999999999e-05 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610159+0000", 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116505 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610364+0000", 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020492500000000001 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.610752+0000", 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000387687 2024-09-12T17:07:20.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.612091+0000", 2024-09-12T17:07:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00133913 2024-09-12T17:07:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613017+0000", 2024-09-12T17:07:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00092613000000000005 2024-09-12T17:07:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.916 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613101+0000", 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4192999999999998e-05 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.613168+0000", 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6978999999999997e-05 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.917 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 82.255141739999999, 2024-09-12T17:07:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0034959570000000001, 2024-09-12T17:07:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 219 2024-09-12T17:07:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.918 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635457+0000", 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635459+0000", 2024-09-12T17:07:20.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.61e-06 2024-09-12T17:07:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635472+0000", 2024-09-12T17:07:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.288e-05 2024-09-12T17:07:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635504+0000", 2024-09-12T17:07:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2002999999999998e-05 2024-09-12T17:07:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635529+0000", 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4963000000000001e-05 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635663+0000", 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133533 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.635891+0000", 2024-09-12T17:07:20.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022862499999999999 2024-09-12T17:07:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.636356+0000", 2024-09-12T17:07:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046518900000000002 2024-09-12T17:07:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.637783+0000", 2024-09-12T17:07:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001426629 2024-09-12T17:07:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638652+0000", 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00086850000000000002 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638828+0000", 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017696199999999999 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.638953+0000", 2024-09-12T17:07:20.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012406299999999999 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 82.236180638999997, 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039400090000000004, 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.924 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 224 2024-09-12T17:07:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654418+0000", 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654421+0000", 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.96e-06 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654432+0000", 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1387e-05 2024-09-12T17:07:20.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654459+0000", 2024-09-12T17:07:20.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7313000000000001e-05 2024-09-12T17:07:20.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654474+0000", 2024-09-12T17:07:20.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4273e-05 2024-09-12T17:07:20.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.654623+0000", 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149689 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655014+0000", 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00039086999999999998 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.655788+0000", 2024-09-12T17:07:20.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077373399999999999 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.657394+0000", 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001605881 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658087+0000", 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00069306800000000003 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.929 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658252+0000", 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016480800000000001 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.658358+0000", 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106026 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.930 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 82.201625339000003, 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031075819999999998, 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 233 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688973+0000", 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688976+0000", 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.666e-06 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.688988+0000", 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2007e-05 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689018+0000", 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0426999999999999e-05 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689036+0000", 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7439e-05 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689149+0000", 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113163 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689384+0000", 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023498099999999999 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.689812+0000", 2024-09-12T17:07:20.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00042804699999999998 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691105+0000", 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00129345 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.691919+0000", 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00081363699999999998 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692013+0000", 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4425999999999993e-05 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:58.692081+0000", 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7339e-05 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:733 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:20.936 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.888405926000004, 2024-09-12T17:07:20.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036847070000000002, 2024-09-12T17:07:20.937 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.937 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.937 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.937 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.937 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 733 2024-09-12T17:07:20.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.937 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002192+0000", 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002195+0000", 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002205+0000", 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0539e-05 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002236+0000", 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.021e-05 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002250+0000", 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4749999999999999e-05 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002409+0000", 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015837199999999999 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.002770+0000", 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036157000000000002 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.003331+0000", 2024-09-12T17:07:20.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00056063 2024-09-12T17:07:20.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.004769+0000", 2024-09-12T17:07:20.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001437795 2024-09-12T17:07:20.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005602+0000", 2024-09-12T17:07:20.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083303000000000001 2024-09-12T17:07:20.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005761+0000", 2024-09-12T17:07:20.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159106 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.005877+0000", 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116325 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:735 6.4 6:26e74a3e:::obj_delete_at_hint.0000000052:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.883514558000002, 2024-09-12T17:07:20.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003121319, 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 735 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007084+0000", 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007086+0000", 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9199999999999998e-06 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007097+0000", 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1327e-05 2024-09-12T17:07:20.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007123+0000", 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6166e-05 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007136+0000", 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3297e-05 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007265+0000", 2024-09-12T17:07:20.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012853499999999999 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007506+0000", 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000241449 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.007990+0000", 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048329299999999998 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009188+0000", 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001198707 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.009924+0000", 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073526099999999997 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010080+0000", 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015620900000000001 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.010205+0000", 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000125155 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:751 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.844539099000002, 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030259039999999998, 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 751 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046059+0000", 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046062+0000", 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3800000000000001e-06 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046073+0000", 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0974e-05 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046104+0000", 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1210000000000001e-05 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046121+0000", 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7689999999999998e-05 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046239+0000", 2024-09-12T17:07:20.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117972 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046460+0000", 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000220535 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.046805+0000", 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034452700000000002 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048017+0000", 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012122039999999999 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048805+0000", 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078873400000000003 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.048964+0000", 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015848899999999999 2024-09-12T17:07:20.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049085+0000", 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012118899999999999 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:753 6.4 6:26903331:::obj_delete_at_hint.0000000058:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.840641125000005, 2024-09-12T17:07:20.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030652259999999999, 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 753 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049957+0000", 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049959+0000", 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0430000000000002e-06 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049970+0000", 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.083e-05 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.049997+0000", 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.652e-05 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050010+0000", 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3343000000000001e-05 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050141+0000", 2024-09-12T17:07:20.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013075200000000001 2024-09-12T17:07:20.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050393+0000", 2024-09-12T17:07:20.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025240100000000003 2024-09-12T17:07:20.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:20.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.050909+0000", 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00051639299999999997 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052113+0000", 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001204014 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052828+0000", 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00071426200000000001 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.052909+0000", 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1445000000000004e-05 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.053022+0000", 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113223 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.963 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:781 6.1 6:80542eaa:::obj_delete_at_hint.0000000068:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.771881893, 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0033807070000000002, 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 781 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118716+0000", 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118719+0000", 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3269999999999999e-06 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118730+0000", 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1005999999999999e-05 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118760+0000", 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0023999999999999e-05 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118779+0000", 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8776000000000001e-05 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.118936+0000", 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015714200000000001 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119306+0000", 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037036399999999998 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.119882+0000", 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057601199999999999 2024-09-12T17:07:20.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121333+0000", 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014513659999999999 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121821+0000", 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00048790900000000002 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.121982+0000", 2024-09-12T17:07:20.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160626 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.122097+0000", 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000115155 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:796 6.1 6:8411e274:::obj_delete_at_hint.0000000073:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.736037878999994, 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031904479999999998, 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 796 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154560+0000", 2024-09-12T17:07:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154563+0000", 2024-09-12T17:07:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5129999999999999e-06 2024-09-12T17:07:20.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154575+0000", 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1874e-05 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154602+0000", 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7348999999999999e-05 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154617+0000", 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4797000000000001e-05 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154734+0000", 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011724500000000001 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.154969+0000", 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023504600000000001 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.155286+0000", 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00031692999999999999 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.156506+0000", 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001219311 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157461+0000", 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000955695 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157627+0000", 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016544899999999999 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.157751+0000", 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000124239 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.975 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:805 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.715850508000003, 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036766720000000002, 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 805 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174748+0000", 2024-09-12T17:07:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174750+0000", 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.34e-06 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174761+0000", 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0926e-05 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174789+0000", 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8133e-05 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174807+0000", 2024-09-12T17:07:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7312999999999998e-05 2024-09-12T17:07:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.174985+0000", 2024-09-12T17:07:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000178202 2024-09-12T17:07:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175345+0000", 2024-09-12T17:07:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00036061099999999999 2024-09-12T17:07:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.175925+0000", 2024-09-12T17:07:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00058002900000000003 2024-09-12T17:07:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.177181+0000", 2024-09-12T17:07:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0012552030000000001 2024-09-12T17:07:20.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178137+0000", 2024-09-12T17:07:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00095595299999999995 2024-09-12T17:07:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178297+0000", 2024-09-12T17:07:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016000300000000001 2024-09-12T17:07:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.178424+0000", 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000127959 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:807 6.4 6:2533b45a:::obj_delete_at_hint.0000000076:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.710956146000001, 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031635719999999999, 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.982 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 807 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179642+0000", 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179644+0000", 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.26e-06 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179654+0000", 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6460000000000005e-06 2024-09-12T17:07:20.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179681+0000", 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.675e-05 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179694+0000", 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3664e-05 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.179830+0000", 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013566500000000001 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180067+0000", 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023733200000000001 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.180544+0000", 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047612899999999999 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.181709+0000", 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001165368 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182540+0000", 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00083053000000000001 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182688+0000", 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014804600000000001 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.182806+0000", 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118182 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.648987990999998, 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.003105362, 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.988 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 832 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241610+0000", 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241613+0000", 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241625+0000", 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1883e-05 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241655+0000", 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.065e-05 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241671+0000", 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5140000000000001e-05 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.241814+0000", 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014356199999999999 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242038+0000", 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000224138 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.242347+0000", 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00030881499999999999 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.243658+0000", 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013113599999999999 2024-09-12T17:07:20.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244423+0000", 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00076420000000000004 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244593+0000", 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017002599999999999 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:20.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.244716+0000", 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012297499999999999 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:834 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.644581216000006, 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030901769999999999, 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:20.994 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 834 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:20.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246017+0000", 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246019+0000", 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3070000000000001e-06 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246030+0000", 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0502999999999999e-05 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246062+0000", 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2036999999999998e-05 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246081+0000", 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8963000000000001e-05 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246211+0000", 2024-09-12T17:07:20.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012997900000000001 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246454+0000", 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000243005 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.246949+0000", 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00049503899999999996 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248119+0000", 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001170485 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248829+0000", 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00070963799999999996 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.248990+0000", 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016115199999999999 2024-09-12T17:07:20.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.249107+0000", 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117069 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:903 6.1d 6:bf899a2e:::obj_delete_at_hint.0000000108:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.477181873999996, 2024-09-12T17:07:21.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0030940059999999998, 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 903 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413416+0000", 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413419+0000", 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.514e-06 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413430+0000", 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.116e-05 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413461+0000", 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0725999999999997e-05 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413480+0000", 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8796000000000001e-05 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413612+0000", 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013220899999999999 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.413843+0000", 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000230666 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.414312+0000", 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00046954899999999999 2024-09-12T17:07:21.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.415491+0000", 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011791939999999999 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416238+0000", 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00074629799999999995 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416392+0000", 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015478200000000001 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.416510+0000", 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118112 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:21.006 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.446406840999998, 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036840810000000001, 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 916 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444191+0000", 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444194+0000", 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.43e-06 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444205+0000", 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1525999999999999e-05 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444236+0000", 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0397000000000001e-05 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444251+0000", 2024-09-12T17:07:21.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5415999999999999e-05 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444409+0000", 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000158049 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.444788+0000", 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00037823099999999998 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:21.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.445366+0000", 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00057815199999999996 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.446826+0000", 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014599680000000001 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447602+0000", 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00077601099999999995 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447762+0000", 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000159992 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.447876+0000", 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000113909 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.012 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 81.441494586000005, 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031653860000000001, 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 918 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449104+0000", 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449106+0000", 2024-09-12T17:07:21.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.503e-06 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449117+0000", 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1236999999999999e-05 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449150+0000", 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2295999999999997e-05 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449165+0000", 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5444e-05 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449304+0000", 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000138839 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.449535+0000", 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023137099999999999 2024-09-12T17:07:21.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.450010+0000", 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00047463600000000001 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.451219+0000", 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001208661 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452005+0000", 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00078664399999999997 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452161+0000", 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015518899999999999 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:05:59.452269+0000", 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000108566 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.018 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.019 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.019 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:21.020 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:07:21.021 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:21.017+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:21.121 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:21.117+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:21.180 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:21.180 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:21.180 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:21.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:07:21.222 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:21.221+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:21.315 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:21.315 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:21.316 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:21.323 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:21.321+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:21.336 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:07:21.424 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:21.421+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:21.469 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:21.469 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:21.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1170 3.21 3:87f83b83:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.157584631000001, 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019752527999999998, 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.470 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1170 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307314+0000", 2024-09-12T17:07:21.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.734e-06 2024-09-12T17:07:21.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308952+0000", 2024-09-12T17:07:21.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016376190000000001 2024-09-12T17:07:21.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308985+0000", 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3624000000000002e-05 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308999+0000", 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3127e-05 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309087+0000", 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8244000000000004e-05 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309212+0000", 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012551500000000001 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309309+0000", 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7157000000000005e-05 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.314345+0000", 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050351900000000002 2024-09-12T17:07:21.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.326922+0000", 2024-09-12T17:07:21.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012577319 2024-09-12T17:07:21.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327013+0000", 2024-09-12T17:07:21.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0801e-05 2024-09-12T17:07:21.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327065+0000", 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2197999999999997e-05 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1173 3.1c 3:3ac09143:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.125224015000001, 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023664096999999999, 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.476 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.477 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.477 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.477 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.477 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1173 2024-09-12T17:07:21.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.477 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.477 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.477 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:21.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339676+0000", 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341224+0000", 2024-09-12T17:07:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015477679999999999 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341253+0000", 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9094999999999998e-05 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341267+0000", 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3624e-05 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341349+0000", 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1766000000000003e-05 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341485+0000", 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013647099999999999 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341587+0000", 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010150899999999999 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.345980+0000", 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043931990000000004 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363206+0000", 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017225963 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363278+0000", 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2577999999999995e-05 2024-09-12T17:07:21.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363337+0000", 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8839999999999999e-05 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1185 3.2d e63/24 3:b71e7b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_23:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.9942665099999992, 2024-09-12T17:07:21.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011225964, 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470633+0000", 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8210000000000002e-06 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475312+0000", 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046786600000000003 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475342+0000", 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0179999999999999e-05 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475357+0000", 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4290999999999999e-05 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475443+0000", 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6370000000000001e-05 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475470+0000", 2024-09-12T17:07:21.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7478999999999999e-05 2024-09-12T17:07:21.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.481792+0000", 2024-09-12T17:07:21.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063212930000000004 2024-09-12T17:07:21.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.481857+0000", 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4869999999999994e-05 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1218 3.21 3:84169186:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4364033939999992, 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018163809, 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.487 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1218 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028495+0000", 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7850000000000001e-06 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030091+0000", 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015958260000000001 2024-09-12T17:07:21.489 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030124+0000", 2024-09-12T17:07:21.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2990000000000001e-05 2024-09-12T17:07:21.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.490 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030144+0000", 2024-09-12T17:07:21.490 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9381e-05 2024-09-12T17:07:21.490 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.490 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.490 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030232+0000", 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8494999999999999e-05 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030355+0000", 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012280700000000001 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030508+0000", 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015261300000000001 2024-09-12T17:07:21.491 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.035197+0000", 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046889339999999996 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046453+0000", 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011256339000000001 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.492 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046565+0000", 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112521 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046658+0000", 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2118000000000001e-05 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1235 3.1c 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:21.493 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.9069176609999996, 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027479018000000001, 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1235 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.494 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557983+0000", 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.941e-06 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.495 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560826+0000", 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028422479999999999 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560855+0000", 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8999000000000001e-05 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560870+0000", 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5231999999999999e-05 2024-09-12T17:07:21.496 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560956+0000", 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6391999999999995e-05 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561123+0000", 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016676199999999999 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561284+0000", 2024-09-12T17:07:21.497 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160672 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.567185+0000", 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059013720000000002 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585343+0000", 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018157514999999999 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.498 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585409+0000", 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6210999999999993e-05 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585458+0000", 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9673999999999999e-05 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1244 3.1a e63/51 3:594e2ce7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_16:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:21.499 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.675971+0000", 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.7889255970000004, 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011889952000000001, 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.675971+0000", 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.500 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.675971+0000", 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.675975+0000", 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0570000000000001e-06 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681452+0000", 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054770540000000003 2024-09-12T17:07:21.501 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681499+0000", 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7431e-05 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681515+0000", 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6248000000000001e-05 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681596+0000", 2024-09-12T17:07:21.502 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1157999999999998e-05 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681625+0000", 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8158999999999999e-05 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.687775+0000", 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006150183 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.503 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.687861+0000", 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6662000000000005e-05 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1245 3.2d e63/24 3:b430eac2:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_17:head v 63'3, mlcod=63'1)", 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.685297+0000", 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.7796005079999997, 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010837932, 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.504 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.685297+0000", 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.685297+0000", 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.505 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.685299+0000", 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9209999999999999e-06 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.690974+0000", 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056756139999999998 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.691006+0000", 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1492000000000003e-05 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.506 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.691021+0000", 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5293000000000001e-05 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.691102+0000", 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0798999999999997e-05 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.691122+0000", 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9958000000000001e-05 2024-09-12T17:07:21.507 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.696068+0000", 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049460470000000003 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.696135+0000", 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6808000000000001e-05 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.508 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1266 3.0 3:00469398:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.2121233539999992, 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017314286000000002, 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1266 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.509 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252779+0000", 2024-09-12T17:07:21.510 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0749999999999997e-06 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.255994+0000", 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032153389999999998 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256031+0000", 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7017000000000002e-05 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.511 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256048+0000", 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6412000000000001e-05 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256133+0000", 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5282000000000001e-05 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256307+0000", 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017426299999999999 2024-09-12T17:07:21.512 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256441+0000", 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013364200000000001 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.263259+0000", 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068185850000000003 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.513 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.269955+0000", 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006695884 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.270031+0000", 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6227e-05 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.270088+0000", 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6560000000000001e-05 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.514 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1270 3.1c 3:3a10adff:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.1656021570000004, 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015927516999999999, 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.515 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1270 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.516 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299298+0000", 2024-09-12T17:07:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4750000000000002e-06 2024-09-12T17:07:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301014+0000", 2024-09-12T17:07:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017152479999999999 2024-09-12T17:07:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.517 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301037+0000", 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3227999999999999e-05 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301047+0000", 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0210999999999999e-05 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301122+0000", 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4762e-05 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.518 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301251+0000", 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129388 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301358+0000", 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010699199999999999 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.306720+0000", 2024-09-12T17:07:21.519 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053618620000000002 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315142+0000", 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084221739999999993 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315186+0000", 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3257999999999998e-05 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.520 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315222+0000", 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6918999999999997e-05 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1277 3.4 3:23471f80:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.371714+0000", 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.0931833690000001, 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013608876000000001, 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.521 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1277 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.371714+0000", 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.522 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.371714+0000", 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.371717+0000", 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3289999999999998e-06 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373422+0000", 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001704501 2024-09-12T17:07:21.523 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373445+0000", 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3396000000000001e-05 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373458+0000", 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2728000000000001e-05 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.524 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373550+0000", 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2731000000000004e-05 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373721+0000", 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017056800000000001 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373882+0000", 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016094899999999999 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.525 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.379438+0000", 2024-09-12T17:07:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055562179999999999 2024-09-12T17:07:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.385201+0000", 2024-09-12T17:07:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057630659999999998 2024-09-12T17:07:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.526 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.385267+0000", 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6149999999999995e-05 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.385323+0000", 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.524e-05 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1280 3.2d e63/24 3:b42c98cf:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_24:head v 63'5, mlcod=63'3)", 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.449722+0000", 2024-09-12T17:07:21.527 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.0151755270000002, 2024-09-12T17:07:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010850079, 2024-09-12T17:07:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.449722+0000", 2024-09-12T17:07:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.528 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.449722+0000", 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.449724+0000", 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453659+0000", 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039347560000000002 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.529 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453693+0000", 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3866999999999999e-05 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453707+0000", 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4477e-05 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453792+0000", 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5101999999999999e-05 2024-09-12T17:07:21.530 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453820+0000", 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7881e-05 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.460520+0000", 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066994699999999999 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.531 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.460572+0000", 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2138999999999997e-05 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1370 3.0 3:012d3768:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3123019119999997, 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016632968000000001, 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.532 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1370 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.533 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152598+0000", 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2969999999999999e-06 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154241+0000", 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016424709999999999 2024-09-12T17:07:21.534 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154278+0000", 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7419000000000002e-05 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154295+0000", 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6841999999999999e-05 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.535 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154387+0000", 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2239999999999998e-05 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154532+0000", 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014412499999999999 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154646+0000", 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114047 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.536 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.159659+0000", 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050133189999999996 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169086+0000", 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0094265870000000002 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169163+0000", 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7793000000000005e-05 2024-09-12T17:07:21.537 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169228+0000", 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4827999999999997e-05 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1373 3.2d e64/24 3:b512a50c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_5:head v 64'8, mlcod=64'6)", 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.2723264990000001, 2024-09-12T17:07:21.538 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018448697999999999, 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:21.539 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192572+0000", 2024-09-12T17:07:21.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6789999999999999e-06 2024-09-12T17:07:21.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.540 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.540 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198743+0000", 2024-09-12T17:07:21.540 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061702900000000001 2024-09-12T17:07:21.540 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.540 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198764+0000", 2024-09-12T17:07:21.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1016999999999999e-05 2024-09-12T17:07:21.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198774+0000", 2024-09-12T17:07:21.541 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0387999999999999e-05 2024-09-12T17:07:21.541 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.541 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.541 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.541 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198892+0000", 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117761 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198917+0000", 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5060999999999999e-05 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.210945+0000", 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012028492 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.542 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.211019+0000", 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4010000000000005e-05 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1382 3.1a e64/51 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head v 64'4, mlcod=63'2)", 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.290880+0000", 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.1740169109999998, 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014067876, 2024-09-12T17:07:21.543 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.290880+0000", 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.290880+0000", 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.544 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.290882+0000", 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1399999999999998e-06 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295534+0000", 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046512319999999999 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.545 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295572+0000", 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8247000000000002e-05 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295592+0000", 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0438e-05 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295699+0000", 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106328 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.546 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295733+0000", 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4697999999999999e-05 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304887+0000", 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091535699999999998 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304948+0000", 2024-09-12T17:07:21.547 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1223000000000007e-05 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1383 3.9 e64/24 3:90e43e04:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_15:head v 64'3, mlcod=63'1)", 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.300673+0000", 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.1642240230000001, 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011288431999999999, 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.548 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.300673+0000", 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.300673+0000", 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.300676+0000", 2024-09-12T17:07:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8449999999999999e-06 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304598+0000", 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039216670000000002 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304626+0000", 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8790999999999999e-05 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.550 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304640+0000", 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3888e-05 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304744+0000", 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103766 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304782+0000", 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7673000000000003e-05 2024-09-12T17:07:21.551 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.311893+0000", 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0071108050000000004 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.311962+0000", 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8997000000000004e-05 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.552 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1407 3.21 3:85243711:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.6730550119999998, 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020947763000000001, 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1407 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.553 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791845+0000", 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.683e-06 2024-09-12T17:07:21.554 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796758+0000", 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049128230000000002 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796800+0000", 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2613e-05 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796819+0000", 2024-09-12T17:07:21.555 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8632999999999999e-05 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796934+0000", 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011525499999999999 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797083+0000", 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149376 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.556 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797216+0000", 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132848 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.804681+0000", 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0074645960000000004 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812614+0000", 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079326510000000006 2024-09-12T17:07:21.557 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812720+0000", 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106909 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812790+0000", 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9375999999999994e-05 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.558 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1412 3.1c 3:388fdd84:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.6064271190000001, 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016636860999999999, 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1412 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.559 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.560 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858473+0000", 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4079999999999998e-06 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860776+0000", 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023030809999999998 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860831+0000", 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4166999999999998e-05 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.561 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860860+0000", 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8881999999999999e-05 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860980+0000", 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120155 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.861095+0000", 2024-09-12T17:07:21.562 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011500700000000001 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.861202+0000", 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106909 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.866202+0000", 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050006260000000002 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.563 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875034+0000", 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0088313439999999997 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875075+0000", 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1423e-05 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875107+0000", 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1859000000000001e-05 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.564 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1416 3.0 3:03f8363f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.5544349720000001, 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023938686000000001, 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.565 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1416 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.566 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910465+0000", 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8569999999999999e-06 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912455+0000", 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019900009999999999 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912491+0000", 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5522000000000003e-05 2024-09-12T17:07:21.567 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912506+0000", 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5928000000000001e-05 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912607+0000", 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010094099999999999 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.568 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912784+0000", 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000176851 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912927+0000", 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142502 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.918121+0000", 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051943290000000001 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.569 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934276+0000", 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016155426000000001 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934347+0000", 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0970000000000007e-05 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934401+0000", 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3359000000000002e-05 2024-09-12T17:07:21.570 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1421 3.2e 3:76cf3736:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.5049624670000004, 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018499980999999999, 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.571 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1421 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.572 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959937+0000", 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962168+0000", 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002231004 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.573 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962202+0000", 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3704000000000001e-05 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962218+0000", 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5732000000000001e-05 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962302+0000", 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4165999999999993e-05 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.574 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962472+0000", 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000169863 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962643+0000", 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017084000000000001 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.967183+0000", 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045406090000000001 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.575 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978294+0000", 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011110480000000001 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978376+0000", 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2522999999999996e-05 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978435+0000", 2024-09-12T17:07:21.576 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8425999999999999e-05 2024-09-12T17:07:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1430 3.3d e64/24 3:bdbc1043:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_24:head v 64'3, mlcod=64'1)", 2024-09-12T17:07:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:17.056023+0000", 2024-09-12T17:07:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4088740269999995, 2024-09-12T17:07:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010994927, 2024-09-12T17:07:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.577 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.056023+0000", 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.056023+0000", 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.578 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.056026+0000", 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058105+0000", 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020795039999999998 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058141+0000", 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5429999999999998e-05 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.579 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058157+0000", 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6008999999999999e-05 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058252+0000", 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5069999999999996e-05 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058281+0000", 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9198000000000001e-05 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.580 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.066971+0000", 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0086899420000000008 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.067018+0000", 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7160999999999998e-05 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.581 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:21.583 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:07:21.583 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:21.581+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:21.684 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:21.681+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:21.704 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:21.704 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:21.704 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:21.704 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:21.717 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:07:21.785 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:21.781+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:21.834 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:21.834 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:21.834 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:21.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:07:21.892 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:21.888+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:21.986 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:21.980+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:21.989 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:21.989 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1174 3.27 3:e7a048aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.633717112999999, 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017154674000000002, 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.990 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1174 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350915+0000", 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9500000000000001e-06 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352415+0000", 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001500234 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352436+0000", 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0662999999999999e-05 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352446+0000", 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8630000000000003e-06 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352517+0000", 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1267999999999996e-05 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352657+0000", 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140252 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352747+0000", 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9744e-05 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.357398+0000", 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004650469 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.367954+0000", 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010556592 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.368017+0000", 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3237000000000005e-05 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.368067+0000", 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9401999999999999e-05 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.995 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1175 3.27 3:e584c994:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.622288448000001, 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017138075999999999, 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:21.996 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1175 2024-09-12T17:07:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:21.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362344+0000", 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1209999999999998e-06 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363815+0000", 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00147124 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:21.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363838+0000", 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3130999999999999e-05 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363850+0000", 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1742999999999999e-05 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363938+0000", 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7649000000000001e-05 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:21.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.364120+0000", 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018224699999999999 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.364286+0000", 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000166293 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.369965+0000", 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056791009999999998 2024-09-12T17:07:22.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379306+0000", 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0093409119999999998 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379401+0000", 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4839000000000005e-05 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379479+0000", 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7799999999999994e-05 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1184 3.2 3:40bd418a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.530495007000001, 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017076502, 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.002 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1184 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:22.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454137+0000", 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1820000000000002e-06 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455769+0000", 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001632 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455796+0000", 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6446000000000001e-05 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455808+0000", 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1652e-05 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455886+0000", 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8123999999999999e-05 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.456057+0000", 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170848 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.456221+0000", 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000164284 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.462621+0000", 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063999469999999996 2024-09-12T17:07:22.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471114+0000", 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084932219999999999 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471158+0000", 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3843e-05 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471211+0000", 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2954000000000002e-05 2024-09-12T17:07:22.007 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1201 3.8 3:114be366:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.171676779, 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021172410999999999, 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.008 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1201 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812956+0000", 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3050000000000001e-06 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816133+0000", 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031766699999999999 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816165+0000", 2024-09-12T17:07:22.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2197999999999999e-05 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816177+0000", 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1973999999999999e-05 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816249+0000", 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1898999999999997e-05 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816385+0000", 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013646400000000001 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816513+0000", 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128097 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.821736+0000", 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052224869999999996 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834015+0000", 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012279784 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834087+0000", 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1935999999999997e-05 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834125+0000", 2024-09-12T17:07:22.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7596999999999999e-05 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1202 3.2 3:421b0e45:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.161892992, 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018086743999999998, 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.014 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1202 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822739+0000", 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2589999999999999e-06 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824478+0000", 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001739256 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824502+0000", 2024-09-12T17:07:22.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3952999999999999e-05 2024-09-12T17:07:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824514+0000", 2024-09-12T17:07:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2031999999999999e-05 2024-09-12T17:07:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824577+0000", 2024-09-12T17:07:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2793999999999995e-05 2024-09-12T17:07:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824714+0000", 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013785199999999999 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824862+0000", 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147751 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.830267+0000", 2024-09-12T17:07:22.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054052670000000001 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840734+0000", 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010466938 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840780+0000", 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5831999999999998e-05 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840823+0000", 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2809999999999998e-05 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1210 3.29 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.041148731, 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021481673, 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.020 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1210 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:22.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943483+0000", 2024-09-12T17:07:22.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6520000000000002e-06 2024-09-12T17:07:22.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945771+0000", 2024-09-12T17:07:22.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022874829999999999 2024-09-12T17:07:22.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945806+0000", 2024-09-12T17:07:22.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4836999999999999e-05 2024-09-12T17:07:22.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945820+0000", 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939e-05 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945888+0000", 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7702999999999999e-05 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946027+0000", 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000139135 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946146+0000", 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118742 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.950285+0000", 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041384880000000001 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964885+0000", 2024-09-12T17:07:22.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014600594 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964928+0000", 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2536000000000001e-05 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964962+0000", 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4564000000000003e-05 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1211 3.7 3:e386213e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.030095707999999, 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018028718999999999, 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1211 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954536+0000", 2024-09-12T17:07:22.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.791e-06 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.955972+0000", 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001435363 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956007+0000", 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4777000000000003e-05 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956022+0000", 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5480000000000001e-05 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956094+0000", 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1515999999999998e-05 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956229+0000", 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551599999999999 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:22.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956330+0000", 2024-09-12T17:07:22.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010090900000000001 2024-09-12T17:07:22.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.960617+0000", 2024-09-12T17:07:22.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042865510000000004 2024-09-12T17:07:22.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972437+0000", 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011820169 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972510+0000", 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3129999999999999e-05 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972562+0000", 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2516999999999999e-05 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.032 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1216 3.33 3:cf30ff9d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.9766639559999994, 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023290796999999999, 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.033 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1216 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007968+0000", 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0580000000000002e-06 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009686+0000", 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017173920000000001 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009718+0000", 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2632999999999997e-05 2024-09-12T17:07:22.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009734+0000", 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6011999999999998e-05 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009834+0000", 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9947999999999999e-05 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010000+0000", 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016520599999999999 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010133+0000", 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133676 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.015744+0000", 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056104570000000001 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031150+0000", 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015405894999999999 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031209+0000", 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9247999999999999e-05 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031256+0000", 2024-09-12T17:07:22.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7271999999999997e-05 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1221 3.1e 3:79f1c04b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.068911+0000", 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.9157184750000003, 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015350558, 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.039 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1221 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.068911+0000", 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.068911+0000", 2024-09-12T17:07:22.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.068914+0000", 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4539999999999999e-06 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070589+0000", 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016751260000000001 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070627+0000", 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7664999999999999e-05 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070644+0000", 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6506000000000001e-05 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070738+0000", 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3955000000000004e-05 2024-09-12T17:07:22.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070934+0000", 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019615999999999999 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.071101+0000", 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016696500000000001 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.076308+0000", 2024-09-12T17:07:22.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052075710000000002 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.084173+0000", 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0078652150000000001 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.084211+0000", 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7765000000000002e-05 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.084261+0000", 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0176000000000002e-05 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1223 3.24 3:24ad2b36:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.8827093870000002, 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016675265000000002, 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.045 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1223 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101923+0000", 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6240000000000002e-06 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104205+0000", 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022823930000000002 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104235+0000", 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9835000000000001e-05 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104250+0000", 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4944e-05 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104325+0000", 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5728000000000004e-05 2024-09-12T17:07:22.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104486+0000", 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016037700000000001 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104593+0000", 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000107487 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.108869+0000", 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042754910000000002 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118512+0000", 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0096435110000000004 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118557+0000", 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4608999999999999e-05 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118595+0000", 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8266000000000003e-05 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1230 3.24 3:257b3201:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.5013949049999997, 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018874753000000001, 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.051 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1230 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483238+0000", 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2880000000000001e-06 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485868+0000", 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026303490000000001 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485904+0000", 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5513999999999999e-05 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485920+0000", 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6201999999999998e-05 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486092+0000", 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017220700000000001 2024-09-12T17:07:22.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486500+0000", 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040771200000000002 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486750+0000", 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025026699999999998 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.500598+0000", 2024-09-12T17:07:22.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013848226 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.501939+0000", 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013409839999999999 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502016+0000", 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6908000000000003e-05 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502109+0000", 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3096000000000004e-05 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1257 3.19 3:9b556f07:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.131835+0000", 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.8527944729999994, 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016443860000000001, 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1257 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.131835+0000", 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.131835+0000", 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.131838+0000", 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.517e-06 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133842+0000", 2024-09-12T17:07:22.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020036479999999998 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133874+0000", 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1594000000000003e-05 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133885+0000", 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1691e-05 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133964+0000", 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9155999999999999e-05 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.134163+0000", 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019894699999999999 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.134300+0000", 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137105 2024-09-12T17:07:22.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.139969+0000", 2024-09-12T17:07:22.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056682499999999997 2024-09-12T17:07:22.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.148163+0000", 2024-09-12T17:07:22.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0081945920000000005 2024-09-12T17:07:22.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.148215+0000", 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.185e-05 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.148279+0000", 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3509999999999993e-05 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.063 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1261 3.33 3:cc53a442:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.7952554880000005, 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017162891, 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1261 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:22.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:22.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189377+0000", 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.039e-06 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192004+0000", 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026268900000000002 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192041+0000", 2024-09-12T17:07:22.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6838000000000002e-05 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192055+0000", 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4446e-05 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192223+0000", 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016760200000000001 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192514+0000", 2024-09-12T17:07:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00029128900000000002 2024-09-12T17:07:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192760+0000", 2024-09-12T17:07:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024571700000000001 2024-09-12T17:07:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.201494+0000", 2024-09-12T17:07:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0087345800000000005 2024-09-12T17:07:22.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206464+0000", 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00497007 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206505+0000", 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0528999999999998e-05 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206537+0000", 2024-09-12T17:07:22.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1890999999999997e-05 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1263 3.27 3:e7aec214:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.220304+0000", 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.7643250209999994, 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016093784999999999, 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.070 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1263 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.220304+0000", 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.220304+0000", 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.071 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.220309+0000", 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1490000000000002e-06 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.223929+0000", 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036199650000000002 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.223972+0000", 2024-09-12T17:07:22.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2824999999999997e-05 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.223996+0000", 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4039000000000001e-05 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.224102+0000", 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105654 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.224301+0000", 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019872800000000001 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.224487+0000", 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018613899999999999 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.230720+0000", 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062332689999999996 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.074 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.236271+0000", 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055509349999999999 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.236345+0000", 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4400999999999995e-05 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.236398+0000", 2024-09-12T17:07:22.075 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680999999999999e-05 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1369 3.19 3:9a84d0e6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.141780+0000", 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.8428489289999996, 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016456490000000001, 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.076 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1369 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.141780+0000", 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.141780+0000", 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.141785+0000", 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.335e-06 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143672+0000", 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018877659999999999 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143701+0000", 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8415000000000002e-05 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143715+0000", 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4430000000000001e-05 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143805+0000", 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9475000000000006e-05 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.144006+0000", 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020146399999999999 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.144186+0000", 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180161 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.149534+0000", 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053479859999999999 2024-09-12T17:07:22.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.158103+0000", 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085683849999999995 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.158178+0000", 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5605000000000005e-05 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.158237+0000", 2024-09-12T17:07:22.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8468000000000003e-05 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1372 3.15 e64/24 3:a8d86e21:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_4:head v 64'3, mlcod=63'1)", 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.183175+0000", 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.8014540669999999, 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016505895, 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.082 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.183175+0000", 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.183175+0000", 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.183178+0000", 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8559999999999998e-06 2024-09-12T17:07:22.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192166+0000", 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089874199999999994 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192189+0000", 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3983000000000001e-05 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192199+0000", 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0000000000000001e-05 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192282+0000", 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2905999999999995e-05 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192310+0000", 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7571000000000001e-05 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.199614+0000", 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.007303543 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.199681+0000", 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7615999999999998e-05 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1375 3.29 3:95c1ad90:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:22.086 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.7791368219999999, 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016791820999999998, 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1375 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:22.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205496+0000", 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7220000000000001e-06 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208326+0000", 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028297270000000002 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208353+0000", 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6675000000000001e-05 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208365+0000", 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2006e-05 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208450+0000", 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4958999999999998e-05 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208666+0000", 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021668300000000001 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208858+0000", 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000191707 2024-09-12T17:07:22.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.215258+0000", 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0064000439999999997 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222154+0000", 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068963949999999996 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222230+0000", 2024-09-12T17:07:22.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5320000000000004e-05 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222284+0000", 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4583000000000002e-05 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1377 3.1e 3:7bce3e7d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.228040+0000", 2024-09-12T17:07:22.092 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.756589655, 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016043414999999998, 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1377 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.228040+0000", 2024-09-12T17:07:22.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.228040+0000", 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.228044+0000", 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8940000000000003e-06 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.094 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.229951+0000", 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019078389999999999 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230027+0000", 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5840000000000006e-05 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230045+0000", 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8088999999999999e-05 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230136+0000", 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1056000000000004e-05 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230305+0000", 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000168689 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230429+0000", 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012388000000000001 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.237640+0000", 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0072110849999999999 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.243914+0000", 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062736170000000004 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.244004+0000", 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0251e-05 2024-09-12T17:07:22.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.244083+0000", 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9175e-05 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1387 3.8 3:122cdcfa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.646340565, 2024-09-12T17:07:22.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018409291000000001, 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1387 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:22.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338292+0000", 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.631e-06 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.100 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340227+0000", 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001934217 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340262+0000", 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5893999999999999e-05 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340278+0000", 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5325e-05 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340387+0000", 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010876 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340570+0000", 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018296299999999999 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340735+0000", 2024-09-12T17:07:22.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568400000000001 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.345914+0000", 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051783319999999999 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356536+0000", 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010622529 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356632+0000", 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5927000000000005e-05 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356698+0000", 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6029000000000001e-05 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.104 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1427 3.7 3:e327d833:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.9609868620000004, 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017016304999999999, 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1427 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023646+0000", 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2590000000000001e-06 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.106 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024847+0000", 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001201674 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024879+0000", 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1636e-05 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024894+0000", 2024-09-12T17:07:22.107 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4613000000000001e-05 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024980+0000", 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-05 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.025132+0000", 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152242 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:22.108 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.025252+0000", 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119731 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.029896+0000", 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046442810000000001 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040528+0000", 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010631508 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.109 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040600+0000", 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2125999999999994e-05 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040659+0000", 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9074999999999999e-05 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:22.110 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:22.112 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:07:22.112 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:22.109+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:22.160 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T17:07:22.213 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:22.208+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:22.251 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:22.251 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:22.251 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:22.251 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:22.265 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:07:22.313 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:22.309+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:22.385 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:22.386 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:22.386 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:22.386 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:22.386 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:22.400 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:07:22.443 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:22.441+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:22.515 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:22.513+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:22.578 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:22.579 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:22.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:22.579 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:22.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.579 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1179 3.13 e63/24 3:cbd4a155:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_17:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:22.579 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.411895+0000", 2024-09-12T17:07:22.579 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.162626510000001, 2024-09-12T17:07:22.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016791774999999998, 2024-09-12T17:07:22.579 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.579 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.579 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.579 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.411895+0000", 2024-09-12T17:07:22.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.411895+0000", 2024-09-12T17:07:22.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.411897+0000", 2024-09-12T17:07:22.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5940000000000001e-06 2024-09-12T17:07:22.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.415978+0000", 2024-09-12T17:07:22.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040800660000000002 2024-09-12T17:07:22.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416016+0000", 2024-09-12T17:07:22.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8065999999999998e-05 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416039+0000", 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3674999999999999e-05 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416194+0000", 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155014 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416240+0000", 2024-09-12T17:07:22.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5624999999999998e-05 2024-09-12T17:07:22.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.428596+0000", 2024-09-12T17:07:22.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012356084 2024-09-12T17:07:22.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.428687+0000", 2024-09-12T17:07:22.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650999999999997e-05 2024-09-12T17:07:22.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.584 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.584 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1188 3.31 3:8d857c15:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.584 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:22.584 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.08069983, 2024-09-12T17:07:22.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019168672000000001, 2024-09-12T17:07:22.585 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1188 2024-09-12T17:07:22.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.585 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:22.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:22.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493824+0000", 2024-09-12T17:07:22.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.553e-06 2024-09-12T17:07:22.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497820+0000", 2024-09-12T17:07:22.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039958659999999998 2024-09-12T17:07:22.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497855+0000", 2024-09-12T17:07:22.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4956000000000002e-05 2024-09-12T17:07:22.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497872+0000", 2024-09-12T17:07:22.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6863000000000001e-05 2024-09-12T17:07:22.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497996+0000", 2024-09-12T17:07:22.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124306 2024-09-12T17:07:22.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498229+0000", 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023307699999999999 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498994+0000", 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076469699999999995 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.507996+0000", 2024-09-12T17:07:22.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090021540000000001 2024-09-12T17:07:22.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512687+0000", 2024-09-12T17:07:22.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046905360000000004 2024-09-12T17:07:22.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512861+0000", 2024-09-12T17:07:22.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017420399999999999 2024-09-12T17:07:22.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512990+0000", 2024-09-12T17:07:22.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012946 2024-09-12T17:07:22.591 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.591 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.591 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.591 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1203 3.3 3:c32b8ddb:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.591 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:22.591 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.727786572999999, 2024-09-12T17:07:22.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018231720999999999, 2024-09-12T17:07:22.592 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.592 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.592 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.592 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.592 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.592 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.592 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1203 2024-09-12T17:07:22.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.592 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846738+0000", 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1990000000000002e-06 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852055+0000", 2024-09-12T17:07:22.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053168080000000001 2024-09-12T17:07:22.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852093+0000", 2024-09-12T17:07:22.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8682e-05 2024-09-12T17:07:22.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852111+0000", 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7153e-05 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852292+0000", 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018150999999999999 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852527+0000", 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023529000000000001 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852761+0000", 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023386500000000001 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864541+0000", 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011779367000000001 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864784+0000", 2024-09-12T17:07:22.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000242861 2024-09-12T17:07:22.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864885+0000", 2024-09-12T17:07:22.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101124 2024-09-12T17:07:22.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864967+0000", 2024-09-12T17:07:22.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1861999999999997e-05 2024-09-12T17:07:22.597 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.597 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.598 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.598 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1209 3.a e63/24 3:531ac038:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_9:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:22.598 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.942304+0000", 2024-09-12T17:07:22.598 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.632217580000001, 2024-09-12T17:07:22.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016937681999999999, 2024-09-12T17:07:22.598 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.598 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.598 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942304+0000", 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942304+0000", 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942308+0000", 2024-09-12T17:07:22.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1169999999999997e-06 2024-09-12T17:07:22.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946066+0000", 2024-09-12T17:07:22.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037579309999999999 2024-09-12T17:07:22.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946104+0000", 2024-09-12T17:07:22.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8432000000000001e-05 2024-09-12T17:07:22.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946122+0000", 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7612999999999999e-05 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946292+0000", 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000169872 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946380+0000", 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8067999999999998e-05 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959145+0000", 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012765515 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959241+0000", 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6133999999999998e-05 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.602 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1210 3.29 e63/24 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.627086172, 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018233155000000001, 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:22.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:22.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947437+0000", 2024-09-12T17:07:22.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3039999999999999e-06 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953449+0000", 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0060117130000000001 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953487+0000", 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.748e-05 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953504+0000", 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7343e-05 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953639+0000", 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013447700000000001 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953683+0000", 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4521999999999998e-05 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.965566+0000", 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011883138 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.965668+0000", 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102178 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1232 3.14 3:2967aafe:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.607 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.054246922000001, 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019509183999999999, 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1232 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520278+0000", 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9539999999999998e-06 2024-09-12T17:07:22.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525478+0000", 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005199665 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525520+0000", 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2391999999999997e-05 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525542+0000", 2024-09-12T17:07:22.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1613000000000001e-05 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525676+0000", 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013434300000000001 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525933+0000", 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025640400000000001 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.526162+0000", 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228722 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.534431+0000", 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082696019999999992 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539449+0000", 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050177099999999999 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539640+0000", 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190812 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539784+0000", 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143967 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.614 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1234 3.3 3:c0bf349d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.614 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:22.614 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.029075977, 2024-09-12T17:07:22.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019413466000000001, 2024-09-12T17:07:22.614 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.614 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.614 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.614 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.614 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.614 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.614 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1234 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545450+0000", 2024-09-12T17:07:22.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.313e-06 2024-09-12T17:07:22.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549431+0000", 2024-09-12T17:07:22.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039813139999999997 2024-09-12T17:07:22.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549472+0000", 2024-09-12T17:07:22.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0828999999999998e-05 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549491+0000", 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9055999999999998e-05 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549627+0000", 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013646700000000001 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549859+0000", 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023186100000000001 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.550208+0000", 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000348372 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.559516+0000", 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093083260000000004 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564688+0000", 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051717849999999999 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564783+0000", 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4821000000000006e-05 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564859+0000", 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6322000000000006e-05 2024-09-12T17:07:22.619 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1235 3.1c e63/45 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.012009840999999, 2024-09-12T17:07:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023527869, 2024-09-12T17:07:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.620 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562514+0000", 2024-09-12T17:07:22.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:22.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570603+0000", 2024-09-12T17:07:22.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080886359999999997 2024-09-12T17:07:22.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570630+0000", 2024-09-12T17:07:22.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7276000000000001e-05 2024-09-12T17:07:22.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570642+0000", 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2153e-05 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570805+0000", 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016319899999999999 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570900+0000", 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4988000000000006e-05 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.585884+0000", 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014984046000000001 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.586039+0000", 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155184 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.624 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1236 3.1b e63/24 3:d9ff086a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_8:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.572563+0000", 2024-09-12T17:07:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.001958293, 2024-09-12T17:07:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017155578000000001, 2024-09-12T17:07:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.572563+0000", 2024-09-12T17:07:22.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.572563+0000", 2024-09-12T17:07:22.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.572565+0000", 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0499999999999999e-06 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577606+0000", 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050408149999999997 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577631+0000", 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.546e-05 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577645+0000", 2024-09-12T17:07:22.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3839000000000001e-05 2024-09-12T17:07:22.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577817+0000", 2024-09-12T17:07:22.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017171600000000001 2024-09-12T17:07:22.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577856+0000", 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8692999999999997e-05 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.589631+0000", 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011775803 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.589719+0000", 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7201999999999996e-05 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.629 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1238 3.3 3:c2fc49d9:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.9840283999999997, 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018644582999999999, 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.630 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1238 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590496+0000", 2024-09-12T17:07:22.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4400000000000001e-06 2024-09-12T17:07:22.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596047+0000", 2024-09-12T17:07:22.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055506599999999998 2024-09-12T17:07:22.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596086+0000", 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9326000000000003e-05 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596106+0000", 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9119000000000001e-05 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596263+0000", 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015771700000000001 2024-09-12T17:07:22.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596516+0000", 2024-09-12T17:07:22.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025320799999999999 2024-09-12T17:07:22.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:22.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596769+0000", 2024-09-12T17:07:22.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025305400000000001 2024-09-12T17:07:22.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.605151+0000", 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.008381833 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.608970+0000", 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038186660000000001 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.609064+0000", 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4438000000000006e-05 2024-09-12T17:07:22.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.609138+0000", 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3121999999999995e-05 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1244 3.1a 3:594e2ce7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.9036542660000002, 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018879997999999999, 2024-09-12T17:07:22.636 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.637 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.637 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1244 2024-09-12T17:07:22.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.637 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:22.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670871+0000", 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0459999999999999e-06 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675701+0000", 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048294169999999999 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675740+0000", 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9592999999999999e-05 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675758+0000", 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.77e-05 2024-09-12T17:07:22.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675939+0000", 2024-09-12T17:07:22.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018083199999999999 2024-09-12T17:07:22.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.676345+0000", 2024-09-12T17:07:22.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040617099999999998 2024-09-12T17:07:22.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.676719+0000", 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037385800000000002 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.688469+0000", 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01174979 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689374+0000", 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00090544200000000001 2024-09-12T17:07:22.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689551+0000", 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017685300000000001 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689747+0000", 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019629599999999999 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.643 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1247 3.1a 3:58056b43:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:22.643 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:22.643 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8734837990000006, 2024-09-12T17:07:22.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021958978000000001, 2024-09-12T17:07:22.643 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.643 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.643 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.643 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.643 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.643 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.643 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1247 2024-09-12T17:07:22.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701041+0000", 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9399999999999998e-06 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705529+0000", 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044889789999999997 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705569+0000", 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9606e-05 2024-09-12T17:07:22.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705588+0000", 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9375999999999999e-05 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705756+0000", 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016734200000000001 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706045+0000", 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028885400000000001 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706343+0000", 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029790300000000002 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720973+0000", 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014630684 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722653+0000", 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016799790000000001 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722878+0000", 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022488799999999999 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722997+0000", 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118427 2024-09-12T17:07:22.648 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1376 3.3 3:c01937d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.3552948919999999, 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020435229999999999, 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.649 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1376 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219230+0000", 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.23e-06 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223391+0000", 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041610629999999996 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223425+0000", 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4167e-05 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223443+0000", 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8105999999999999e-05 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223562+0000", 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118861 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223840+0000", 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027762099999999998 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.224077+0000", 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023720100000000001 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.232976+0000", 2024-09-12T17:07:22.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0088992900000000007 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239478+0000", 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065023609999999999 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239574+0000", 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5527999999999997e-05 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239662+0000", 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7801999999999997e-05 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1382 3.1a 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.2886279399999996, 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020895593, 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.655 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1382 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:22.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285897+0000", 2024-09-12T17:07:22.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6669999999999998e-06 2024-09-12T17:07:22.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290617+0000", 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047198689999999998 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290657+0000", 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0201999999999999e-05 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290676+0000", 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9293e-05 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290860+0000", 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000183353 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291264+0000", 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040463800000000002 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291676+0000", 2024-09-12T17:07:22.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041151499999999999 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301391+0000", 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0097147350000000004 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306412+0000", 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050210790000000003 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306636+0000", 2024-09-12T17:07:22.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000224589 2024-09-12T17:07:22.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306789+0000", 2024-09-12T17:07:22.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015265299999999999 2024-09-12T17:07:22.661 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.661 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.661 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1383 3.9 3:90e43e04:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.296675+0000", 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.2778460469999997, 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017100829000000001, 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1383 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.296675+0000", 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.296675+0000", 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.296679+0000", 2024-09-12T17:07:22.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4769999999999999e-06 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.300641+0000", 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039620180000000003 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.300675+0000", 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4385999999999999e-05 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.300695+0000", 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9473000000000001e-05 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.300820+0000", 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012572399999999999 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301138+0000", 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031714599999999998 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301452+0000", 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000314524 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.310900+0000", 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0094480109999999992 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.313495+0000", 2024-09-12T17:07:22.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025945590000000002 2024-09-12T17:07:22.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.313654+0000", 2024-09-12T17:07:22.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000159304 2024-09-12T17:07:22.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.313776+0000", 2024-09-12T17:07:22.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012220699999999999 2024-09-12T17:07:22.667 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.668 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.668 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.668 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1385 3.34 3:2f3cb087:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:22.668 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:22.668 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.2566028339999997, 2024-09-12T17:07:22.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024744103999999999, 2024-09-12T17:07:22.668 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.668 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.668 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1385 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317922+0000", 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.157e-06 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322800+0000", 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048785879999999997 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322846+0000", 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5732999999999997e-05 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322866+0000", 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0415999999999999e-05 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323048+0000", 2024-09-12T17:07:22.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018128 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323496+0000", 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044786400000000002 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323919+0000", 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042374399999999999 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.340076+0000", 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016156925999999999 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342379+0000", 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023025189999999998 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342546+0000", 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016719599999999999 2024-09-12T17:07:22.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342663+0000", 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116681 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1409 3.a e64/24 3:53d4fdcd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_3:head v 64'6, mlcod=64'4)", 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7531232919999997, 2024-09-12T17:07:22.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021472076, 2024-09-12T17:07:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821402+0000", 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4699999999999998e-06 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828337+0000", 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069354229999999996 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828387+0000", 2024-09-12T17:07:22.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9908999999999999e-05 2024-09-12T17:07:22.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828412+0000", 2024-09-12T17:07:22.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5389999999999999e-05 2024-09-12T17:07:22.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828587+0000", 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017425599999999999 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828654+0000", 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7708999999999998e-05 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842774+0000", 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014119860999999999 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842870+0000", 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6057999999999994e-05 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1417 3.14 3:29a29b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.6517948870000003, 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.034043223999999997, 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.679 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1417 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922731+0000", 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1099999999999996e-06 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930785+0000", 2024-09-12T17:07:22.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080541020000000005 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930841+0000", 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6005999999999999e-05 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930869+0000", 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8602000000000002e-05 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931049+0000", 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017998299999999999 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931287+0000", 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000237712 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931510+0000", 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022283200000000001 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941891+0000", 2024-09-12T17:07:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010380785 2024-09-12T17:07:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.955891+0000", 2024-09-12T17:07:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014000207000000001 2024-09-12T17:07:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956636+0000", 2024-09-12T17:07:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00074503099999999995 2024-09-12T17:07:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956770+0000", 2024-09-12T17:07:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013385400000000001 2024-09-12T17:07:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.685 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1420 3.3 3:c118c659:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.6225010710000003, 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022394282000000001, 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1420 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952024+0000", 2024-09-12T17:07:22.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1760000000000003e-06 2024-09-12T17:07:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958458+0000", 2024-09-12T17:07:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064335770000000002 2024-09-12T17:07:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958492+0000", 2024-09-12T17:07:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4309e-05 2024-09-12T17:07:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958508+0000", 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5699999999999999e-05 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958717+0000", 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020871900000000001 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959163+0000", 2024-09-12T17:07:22.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000446007 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959583+0000", 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042026800000000001 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.970389+0000", 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010806375999999999 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974044+0000", 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003654352 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974232+0000", 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018811899999999999 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974415+0000", 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018267899999999999 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.691 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1432 3.3 3:c31ee49b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.10:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:17.072308+0000", 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.5022128989999999, 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018638120000000001, 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:22.692 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1432 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.072308+0000", 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.072308+0000", 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.072311+0000", 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6390000000000001e-06 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076248+0000", 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039373089999999999 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076285+0000", 2024-09-12T17:07:22.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6470999999999997e-05 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076301+0000", 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5693e-05 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076438+0000", 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013785100000000001 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076696+0000", 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025774499999999998 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.077565+0000", 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000869215 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.088840+0000", 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011274273 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.090743+0000", 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019029800000000001 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.090866+0000", 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012304300000000001 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.090947+0000", 2024-09-12T17:07:22.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0901000000000004e-05 2024-09-12T17:07:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:22.698 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:22.698 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:22.699 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:07:22.700 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:22.697+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:22.800 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:22.796+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:22.878 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:07:22.880 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:22.880 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:22.880 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:22.894 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:07:22.942 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:22.941+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:23.002 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:22.997+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:23.017 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:23.017 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:23.017 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:23.025 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:23.025 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:23.031 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:07:23.041 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:23.041 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:23.058 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:23.058 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:23.075 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:23.075 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:23.093 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:23.094 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:23.103 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:23.096+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:23.113 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:23.113 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:23.132 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:23.133 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:23.139 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T17:07:23.155 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:23.156 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:23.204 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:23.201+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:23.206 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:23.206 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:23.221 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:23.305 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:23.300+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:23.391 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:23.391 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:23.405 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:23.406 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:23.400+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:23.506 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:23.505+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:23.526 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:23.527 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:23.542 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:23.607 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:23.600+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:23.708 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:23.705+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:23.711 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:23.711 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:23.725 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:23.809 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:23.804+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:23.888 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:23.888 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:23.904 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:23.950 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:23.949+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:24.011 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:24.004+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:24.030 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:24.030 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:24.044 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:24.112 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:24.108+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:24.213 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:24.208+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:24.214 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:24.214 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:24.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:07:24.315 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:24.308+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:24.345 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:24.345 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:24.359 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:07:24.444 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:24.440+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:24.516 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:24.512+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:24.527 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:24.527 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:24.540 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:07:24.617 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:24.613+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:24.699 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:24.700 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:24.713 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:07:24.760 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:24.756+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:24.818 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:24.817+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:24.826 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:24.826 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:24.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:07:24.928 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:24.924+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:24.997 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:24.997 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:25.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:07:25.020 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:25.017+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:25.121 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:25.116+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:25.163 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T17:07:25.171 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:25.171 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:25.174 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:07:25.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:07:25.228 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:25.224+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:25.308 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:25.308 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:25.323 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:25.321+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:25.325 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:25.325 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:25.342 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:25.342 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:25.360 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:25.360 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:25.372 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:25.372 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:25.372 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:25.372 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:25.381 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:25.381 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:25.392 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:07:25.401 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:25.402 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:25.422 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:25.423 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:25.423 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:25.416+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:25.443 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:25.443 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:25.504 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:25.505 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:25.505 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:25.505 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:25.505 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:25.517 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:07:25.524 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:25.521+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:25.625 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:25.620+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:25.633 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:25.633 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:25.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:25.633 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1170 3.21 3:87f83b83:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.322479228000001, 2024-09-12T17:07:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019752527999999998, 2024-09-12T17:07:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:25.634 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1170 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307314+0000", 2024-09-12T17:07:25.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.734e-06 2024-09-12T17:07:25.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308952+0000", 2024-09-12T17:07:25.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016376190000000001 2024-09-12T17:07:25.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308985+0000", 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3624000000000002e-05 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308999+0000", 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3127e-05 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309087+0000", 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8244000000000004e-05 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309212+0000", 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012551500000000001 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309309+0000", 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7157000000000005e-05 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.314345+0000", 2024-09-12T17:07:25.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050351900000000002 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.326922+0000", 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012577319 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327013+0000", 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0801e-05 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327065+0000", 2024-09-12T17:07:25.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2197999999999997e-05 2024-09-12T17:07:25.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.640 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.640 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.640 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1173 3.1c 3:3ac09143:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:25.640 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:25.640 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.290118612000001, 2024-09-12T17:07:25.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023664096999999999, 2024-09-12T17:07:25.640 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1173 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339676+0000", 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341224+0000", 2024-09-12T17:07:25.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015477679999999999 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341253+0000", 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9094999999999998e-05 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341267+0000", 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3624e-05 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341349+0000", 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1766000000000003e-05 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341485+0000", 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013647099999999999 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341587+0000", 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010150899999999999 2024-09-12T17:07:25.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.345980+0000", 2024-09-12T17:07:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043931990000000004 2024-09-12T17:07:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363206+0000", 2024-09-12T17:07:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017225963 2024-09-12T17:07:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363278+0000", 2024-09-12T17:07:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2577999999999995e-05 2024-09-12T17:07:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363337+0000", 2024-09-12T17:07:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8839999999999999e-05 2024-09-12T17:07:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.646 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1185 3.2d e63/24 3:b71e7b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_23:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.159161106999999, 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011225964, 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470633+0000", 2024-09-12T17:07:25.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8210000000000002e-06 2024-09-12T17:07:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475312+0000", 2024-09-12T17:07:25.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046786600000000003 2024-09-12T17:07:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475342+0000", 2024-09-12T17:07:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0179999999999999e-05 2024-09-12T17:07:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475357+0000", 2024-09-12T17:07:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4290999999999999e-05 2024-09-12T17:07:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475443+0000", 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6370000000000001e-05 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475470+0000", 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7478999999999999e-05 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.481792+0000", 2024-09-12T17:07:25.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063212930000000004 2024-09-12T17:07:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.481857+0000", 2024-09-12T17:07:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4869999999999994e-05 2024-09-12T17:07:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1218 3.21 3:84169186:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:25.652 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.601297990999999, 2024-09-12T17:07:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018163809, 2024-09-12T17:07:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1218 2024-09-12T17:07:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.653 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028495+0000", 2024-09-12T17:07:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7850000000000001e-06 2024-09-12T17:07:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030091+0000", 2024-09-12T17:07:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015958260000000001 2024-09-12T17:07:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.657 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030124+0000", 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2990000000000001e-05 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030144+0000", 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9381e-05 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030232+0000", 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8494999999999999e-05 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030355+0000", 2024-09-12T17:07:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012280700000000001 2024-09-12T17:07:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030508+0000", 2024-09-12T17:07:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015261300000000001 2024-09-12T17:07:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.035197+0000", 2024-09-12T17:07:25.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046889339999999996 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046453+0000", 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011256339000000001 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046565+0000", 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112521 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046658+0000", 2024-09-12T17:07:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2118000000000001e-05 2024-09-12T17:07:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1235 3.1c 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.071812258, 2024-09-12T17:07:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027479018000000001, 2024-09-12T17:07:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.661 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1235 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557983+0000", 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.941e-06 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560826+0000", 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028422479999999999 2024-09-12T17:07:25.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560855+0000", 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8999000000000001e-05 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560870+0000", 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5231999999999999e-05 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560956+0000", 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6391999999999995e-05 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561123+0000", 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016676199999999999 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561284+0000", 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160672 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.567185+0000", 2024-09-12T17:07:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059013720000000002 2024-09-12T17:07:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585343+0000", 2024-09-12T17:07:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018157514999999999 2024-09-12T17:07:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585409+0000", 2024-09-12T17:07:25.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6210999999999993e-05 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585458+0000", 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9673999999999999e-05 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1244 3.1a e63/51 3:594e2ce7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_16:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.675971+0000", 2024-09-12T17:07:25.667 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.953820194, 2024-09-12T17:07:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011889952000000001, 2024-09-12T17:07:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.675971+0000", 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.675971+0000", 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.675975+0000", 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0570000000000001e-06 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681452+0000", 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054770540000000003 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681499+0000", 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7431e-05 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681515+0000", 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6248000000000001e-05 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681596+0000", 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1157999999999998e-05 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681625+0000", 2024-09-12T17:07:25.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8158999999999999e-05 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.687775+0000", 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006150183 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.687861+0000", 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6662000000000005e-05 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.672 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1245 3.2d e63/24 3:b430eac2:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_17:head v 63'3, mlcod=63'1)", 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.685297+0000", 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.944495105, 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010837932, 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.685297+0000", 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.685297+0000", 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.685299+0000", 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9209999999999999e-06 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.690974+0000", 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056756139999999998 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.691006+0000", 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1492000000000003e-05 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.691021+0000", 2024-09-12T17:07:25.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5293000000000001e-05 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.691102+0000", 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0798999999999997e-05 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.691122+0000", 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9958000000000001e-05 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.696068+0000", 2024-09-12T17:07:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049460470000000003 2024-09-12T17:07:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.696135+0000", 2024-09-12T17:07:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6808000000000001e-05 2024-09-12T17:07:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.677 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1266 3.0 3:00469398:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.377017950999999, 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017314286000000002, 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1266 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252779+0000", 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0749999999999997e-06 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.255994+0000", 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032153389999999998 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256031+0000", 2024-09-12T17:07:25.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7017000000000002e-05 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256048+0000", 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6412000000000001e-05 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256133+0000", 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5282000000000001e-05 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256307+0000", 2024-09-12T17:07:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017426299999999999 2024-09-12T17:07:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256441+0000", 2024-09-12T17:07:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013364200000000001 2024-09-12T17:07:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.263259+0000", 2024-09-12T17:07:25.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068185850000000003 2024-09-12T17:07:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.269955+0000", 2024-09-12T17:07:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006695884 2024-09-12T17:07:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.270031+0000", 2024-09-12T17:07:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6227e-05 2024-09-12T17:07:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.270088+0000", 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6560000000000001e-05 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1270 3.1c 3:3a10adff:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.330496754, 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015927516999999999, 2024-09-12T17:07:25.684 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1270 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299298+0000", 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4750000000000002e-06 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301014+0000", 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017152479999999999 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301037+0000", 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3227999999999999e-05 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301047+0000", 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0210999999999999e-05 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301122+0000", 2024-09-12T17:07:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4762e-05 2024-09-12T17:07:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301251+0000", 2024-09-12T17:07:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129388 2024-09-12T17:07:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301358+0000", 2024-09-12T17:07:25.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010699199999999999 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.306720+0000", 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053618620000000002 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315142+0000", 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084221739999999993 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315186+0000", 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3257999999999998e-05 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315222+0000", 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6918999999999997e-05 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.690 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1277 3.4 3:23471f80:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.371714+0000", 2024-09-12T17:07:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.258077966, 2024-09-12T17:07:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013608876000000001, 2024-09-12T17:07:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1277 2024-09-12T17:07:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.691 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.371714+0000", 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.371714+0000", 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.371717+0000", 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3289999999999998e-06 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373422+0000", 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001704501 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373445+0000", 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3396000000000001e-05 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373458+0000", 2024-09-12T17:07:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2728000000000001e-05 2024-09-12T17:07:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373550+0000", 2024-09-12T17:07:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2731000000000004e-05 2024-09-12T17:07:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373721+0000", 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017056800000000001 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373882+0000", 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016094899999999999 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.379438+0000", 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055562179999999999 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.385201+0000", 2024-09-12T17:07:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057630659999999998 2024-09-12T17:07:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.385267+0000", 2024-09-12T17:07:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6149999999999995e-05 2024-09-12T17:07:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.385323+0000", 2024-09-12T17:07:25.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.524e-05 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1280 3.2d e63/24 3:b42c98cf:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_24:head v 63'5, mlcod=63'3)", 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.449722+0000", 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.180070124, 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010850079, 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.697 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.449722+0000", 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.449722+0000", 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.449724+0000", 2024-09-12T17:07:25.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453659+0000", 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039347560000000002 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453693+0000", 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3866999999999999e-05 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453707+0000", 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4477e-05 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453792+0000", 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5101999999999999e-05 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453820+0000", 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7881e-05 2024-09-12T17:07:25.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.460520+0000", 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066994699999999999 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.460572+0000", 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2138999999999997e-05 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1370 3.0 3:012d3768:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4771965090000005, 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016632968000000001, 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1370 2024-09-12T17:07:25.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152598+0000", 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2969999999999999e-06 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154241+0000", 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016424709999999999 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154278+0000", 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7419000000000002e-05 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154295+0000", 2024-09-12T17:07:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6841999999999999e-05 2024-09-12T17:07:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154387+0000", 2024-09-12T17:07:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2239999999999998e-05 2024-09-12T17:07:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154532+0000", 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014412499999999999 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154646+0000", 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114047 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.159659+0000", 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050133189999999996 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169086+0000", 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0094265870000000002 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169163+0000", 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7793000000000005e-05 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169228+0000", 2024-09-12T17:07:25.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4827999999999997e-05 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1373 3.2d e64/24 3:b512a50c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_5:head v 64'8, mlcod=64'6)", 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.437221096, 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018448697999999999, 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.708 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192572+0000", 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6789999999999999e-06 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198743+0000", 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061702900000000001 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198764+0000", 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1016999999999999e-05 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198774+0000", 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0387999999999999e-05 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198892+0000", 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117761 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198917+0000", 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5060999999999999e-05 2024-09-12T17:07:25.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.210945+0000", 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012028492 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.211019+0000", 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4010000000000005e-05 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1382 3.1a e64/51 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head v 64'4, mlcod=63'2)", 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.290880+0000", 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3389115080000007, 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014067876, 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.290880+0000", 2024-09-12T17:07:25.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.290880+0000", 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.290882+0000", 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1399999999999998e-06 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295534+0000", 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046512319999999999 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295572+0000", 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8247000000000002e-05 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295592+0000", 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0438e-05 2024-09-12T17:07:25.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295699+0000", 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106328 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295733+0000", 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4697999999999999e-05 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304887+0000", 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091535699999999998 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304948+0000", 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1223000000000007e-05 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1383 3.9 e64/24 3:90e43e04:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_15:head v 64'3, mlcod=63'1)", 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.300673+0000", 2024-09-12T17:07:25.717 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.3291186199999991, 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011288431999999999, 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.300673+0000", 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.300673+0000", 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.300676+0000", 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8449999999999999e-06 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304598+0000", 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039216670000000002 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304626+0000", 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8790999999999999e-05 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304640+0000", 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3888e-05 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304744+0000", 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103766 2024-09-12T17:07:25.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304782+0000", 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7673000000000003e-05 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.311893+0000", 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0071108050000000004 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.311962+0000", 2024-09-12T17:07:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8997000000000004e-05 2024-09-12T17:07:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1407 3.21 3:85243711:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.8379496090000007, 2024-09-12T17:07:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020947763000000001, 2024-09-12T17:07:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1407 2024-09-12T17:07:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791845+0000", 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.683e-06 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796758+0000", 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049128230000000002 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796800+0000", 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2613e-05 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796819+0000", 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8632999999999999e-05 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796934+0000", 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011525499999999999 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797083+0000", 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149376 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797216+0000", 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132848 2024-09-12T17:07:25.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.804681+0000", 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0074645960000000004 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812614+0000", 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079326510000000006 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812720+0000", 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106909 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812790+0000", 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9375999999999994e-05 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1412 3.1c 3:388fdd84:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.7713217159999992, 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016636860999999999, 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1412 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858473+0000", 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4079999999999998e-06 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860776+0000", 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023030809999999998 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860831+0000", 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4166999999999998e-05 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860860+0000", 2024-09-12T17:07:25.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8881999999999999e-05 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860980+0000", 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120155 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.861095+0000", 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011500700000000001 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.861202+0000", 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106909 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.866202+0000", 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050006260000000002 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875034+0000", 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0088313439999999997 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875075+0000", 2024-09-12T17:07:25.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1423e-05 2024-09-12T17:07:25.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875107+0000", 2024-09-12T17:07:25.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1859000000000001e-05 2024-09-12T17:07:25.734 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.734 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.734 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1416 3.0 3:03f8363f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.7193295689999992, 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023938686000000001, 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1416 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.735 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910465+0000", 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8569999999999999e-06 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912455+0000", 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019900009999999999 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912491+0000", 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5522000000000003e-05 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912506+0000", 2024-09-12T17:07:25.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5928000000000001e-05 2024-09-12T17:07:25.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912607+0000", 2024-09-12T17:07:25.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010094099999999999 2024-09-12T17:07:25.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912784+0000", 2024-09-12T17:07:25.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000176851 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912927+0000", 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142502 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.918121+0000", 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051943290000000001 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:25.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934276+0000", 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016155426000000001 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934347+0000", 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0970000000000007e-05 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934401+0000", 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3359000000000002e-05 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.740 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1421 3.2e 3:76cf3736:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.6698570640000003, 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018499980999999999, 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:25.741 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1421 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.742 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959937+0000", 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962168+0000", 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002231004 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962202+0000", 2024-09-12T17:07:25.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3704000000000001e-05 2024-09-12T17:07:25.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962218+0000", 2024-09-12T17:07:25.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5732000000000001e-05 2024-09-12T17:07:25.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962302+0000", 2024-09-12T17:07:25.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4165999999999993e-05 2024-09-12T17:07:25.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962472+0000", 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000169863 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962643+0000", 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017084000000000001 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.967183+0000", 2024-09-12T17:07:25.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045406090000000001 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978294+0000", 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011110480000000001 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978376+0000", 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2522999999999996e-05 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978435+0000", 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8425999999999999e-05 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1430 3.3d e64/24 3:bdbc1043:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_24:head v 64'3, mlcod=64'1)", 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:17.056023+0000", 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.5737686239999995, 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010994927, 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:25.747 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.056023+0000", 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.056023+0000", 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.056026+0000", 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058105+0000", 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020795039999999998 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058141+0000", 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5429999999999998e-05 2024-09-12T17:07:25.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058157+0000", 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6008999999999999e-05 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058252+0000", 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5069999999999996e-05 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:25.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058281+0000", 2024-09-12T17:07:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9198000000000001e-05 2024-09-12T17:07:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.066971+0000", 2024-09-12T17:07:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0086899420000000008 2024-09-12T17:07:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.067018+0000", 2024-09-12T17:07:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7160999999999998e-05 2024-09-12T17:07:25.751 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.752 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.752 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.752 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:25.752 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:25.752 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:25.753 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:07:25.754 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:25.749+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:25.854 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:25.848+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:25.919 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:25.920 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:25.920 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:25.920 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:25.934 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:07:25.955 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:25.953+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:26.056 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:26.053+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:26.106 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:26.106 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:26.106 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:26.106 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:26.106 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:26.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:07:26.156 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T17:07:26.157 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:26.153+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:26.241 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1174 3.27 3:e7a048aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.887509499, 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017154674000000002, 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.242 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1174 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:26.243 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350915+0000", 2024-09-12T17:07:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9500000000000001e-06 2024-09-12T17:07:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352415+0000", 2024-09-12T17:07:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001500234 2024-09-12T17:07:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.244 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352436+0000", 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0662999999999999e-05 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352446+0000", 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8630000000000003e-06 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352517+0000", 2024-09-12T17:07:26.245 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1267999999999996e-05 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352657+0000", 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140252 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352747+0000", 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9744e-05 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.246 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.357398+0000", 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004650469 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.367954+0000", 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010556592 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.368017+0000", 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3237000000000005e-05 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.247 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.368067+0000", 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9401999999999999e-05 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1175 3.27 3:e584c994:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.876080834, 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017138075999999999, 2024-09-12T17:07:26.248 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1175 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.249 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362344+0000", 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1209999999999998e-06 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363815+0000", 2024-09-12T17:07:26.250 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00147124 2024-09-12T17:07:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363838+0000", 2024-09-12T17:07:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3130999999999999e-05 2024-09-12T17:07:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363850+0000", 2024-09-12T17:07:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1742999999999999e-05 2024-09-12T17:07:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.251 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363938+0000", 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7649000000000001e-05 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.364120+0000", 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018224699999999999 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.364286+0000", 2024-09-12T17:07:26.252 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000166293 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.369965+0000", 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056791009999999998 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379306+0000", 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0093409119999999998 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.253 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379401+0000", 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4839000000000005e-05 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379479+0000", 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7799999999999994e-05 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.254 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1184 3.2 3:40bd418a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.784287393, 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017076502, 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1184 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.255 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.256 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454137+0000", 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1820000000000002e-06 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455769+0000", 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001632 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455796+0000", 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6446000000000001e-05 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.257 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455808+0000", 2024-09-12T17:07:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1652e-05 2024-09-12T17:07:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455886+0000", 2024-09-12T17:07:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8123999999999999e-05 2024-09-12T17:07:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.456057+0000", 2024-09-12T17:07:26.258 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170848 2024-09-12T17:07:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.456221+0000", 2024-09-12T17:07:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000164284 2024-09-12T17:07:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.259 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.462621+0000", 2024-09-12T17:07:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063999469999999996 2024-09-12T17:07:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471114+0000", 2024-09-12T17:07:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084932219999999999 2024-09-12T17:07:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471158+0000", 2024-09-12T17:07:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3843e-05 2024-09-12T17:07:26.260 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471211+0000", 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2954000000000002e-05 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1201 3.8 3:114be366:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.425469164999999, 2024-09-12T17:07:26.261 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021172410999999999, 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1201 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:26.262 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812956+0000", 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3050000000000001e-06 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.263 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816133+0000", 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031766699999999999 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816165+0000", 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2197999999999999e-05 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816177+0000", 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1973999999999999e-05 2024-09-12T17:07:26.264 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816249+0000", 2024-09-12T17:07:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1898999999999997e-05 2024-09-12T17:07:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816385+0000", 2024-09-12T17:07:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013646400000000001 2024-09-12T17:07:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816513+0000", 2024-09-12T17:07:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128097 2024-09-12T17:07:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.821736+0000", 2024-09-12T17:07:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052224869999999996 2024-09-12T17:07:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834015+0000", 2024-09-12T17:07:26.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012279784 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834087+0000", 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1935999999999997e-05 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834125+0000", 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7596999999999999e-05 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1202 3.2 3:421b0e45:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.415685377999999, 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018086743999999998, 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1202 2024-09-12T17:07:26.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822739+0000", 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2589999999999999e-06 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824478+0000", 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001739256 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824502+0000", 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3952999999999999e-05 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824514+0000", 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2031999999999999e-05 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824577+0000", 2024-09-12T17:07:26.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2793999999999995e-05 2024-09-12T17:07:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824714+0000", 2024-09-12T17:07:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013785199999999999 2024-09-12T17:07:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824862+0000", 2024-09-12T17:07:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147751 2024-09-12T17:07:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.830267+0000", 2024-09-12T17:07:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054052670000000001 2024-09-12T17:07:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840734+0000", 2024-09-12T17:07:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010466938 2024-09-12T17:07:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840780+0000", 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5831999999999998e-05 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840823+0000", 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2809999999999998e-05 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1210 3.29 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.274 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.294941117, 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021481673, 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1210 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943483+0000", 2024-09-12T17:07:26.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6520000000000002e-06 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945771+0000", 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022874829999999999 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945806+0000", 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4836999999999999e-05 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945820+0000", 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939e-05 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945888+0000", 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7702999999999999e-05 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946027+0000", 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000139135 2024-09-12T17:07:26.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946146+0000", 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118742 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.950285+0000", 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041384880000000001 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964885+0000", 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014600594 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964928+0000", 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2536000000000001e-05 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964962+0000", 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4564000000000003e-05 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.280 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1211 3.7 3:e386213e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.283888094, 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018028718999999999, 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1211 2024-09-12T17:07:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:26.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954536+0000", 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.791e-06 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.955972+0000", 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001435363 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956007+0000", 2024-09-12T17:07:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4777000000000003e-05 2024-09-12T17:07:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956022+0000", 2024-09-12T17:07:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5480000000000001e-05 2024-09-12T17:07:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956094+0000", 2024-09-12T17:07:26.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1515999999999998e-05 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956229+0000", 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551599999999999 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956330+0000", 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010090900000000001 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.960617+0000", 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042865510000000004 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972437+0000", 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011820169 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972510+0000", 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3129999999999999e-05 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972562+0000", 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2516999999999999e-05 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1216 3.33 3:cf30ff9d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.230456342, 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023290796999999999, 2024-09-12T17:07:26.287 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1216 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007968+0000", 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0580000000000002e-06 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009686+0000", 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017173920000000001 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009718+0000", 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2632999999999997e-05 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009734+0000", 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6011999999999998e-05 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009834+0000", 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9947999999999999e-05 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010000+0000", 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016520599999999999 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010133+0000", 2024-09-12T17:07:26.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133676 2024-09-12T17:07:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.015744+0000", 2024-09-12T17:07:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056104570000000001 2024-09-12T17:07:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031150+0000", 2024-09-12T17:07:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015405894999999999 2024-09-12T17:07:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031209+0000", 2024-09-12T17:07:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9247999999999999e-05 2024-09-12T17:07:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031256+0000", 2024-09-12T17:07:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7271999999999997e-05 2024-09-12T17:07:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1221 3.1e 3:79f1c04b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.068911+0000", 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.169510860999999, 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015350558, 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1221 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.294 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.068911+0000", 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.068911+0000", 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.068914+0000", 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4539999999999999e-06 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070589+0000", 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016751260000000001 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070627+0000", 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7664999999999999e-05 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070644+0000", 2024-09-12T17:07:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6506000000000001e-05 2024-09-12T17:07:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070738+0000", 2024-09-12T17:07:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3955000000000004e-05 2024-09-12T17:07:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.070934+0000", 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019615999999999999 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.071101+0000", 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016696500000000001 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.076308+0000", 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052075710000000002 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.084173+0000", 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0078652150000000001 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.084211+0000", 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7765000000000002e-05 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.084261+0000", 2024-09-12T17:07:26.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0176000000000002e-05 2024-09-12T17:07:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1223 3.24 3:24ad2b36:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.136501772999999, 2024-09-12T17:07:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016675265000000002, 2024-09-12T17:07:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.300 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1223 2024-09-12T17:07:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101923+0000", 2024-09-12T17:07:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6240000000000002e-06 2024-09-12T17:07:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104205+0000", 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022823930000000002 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104235+0000", 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9835000000000001e-05 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104250+0000", 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4944e-05 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104325+0000", 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5728000000000004e-05 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104486+0000", 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016037700000000001 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104593+0000", 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000107487 2024-09-12T17:07:26.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.108869+0000", 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042754910000000002 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118512+0000", 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0096435110000000004 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118557+0000", 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4608999999999999e-05 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118595+0000", 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8266000000000003e-05 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1230 3.24 3:257b3201:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.306 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.755187291, 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018874753000000001, 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1230 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483238+0000", 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2880000000000001e-06 2024-09-12T17:07:26.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485868+0000", 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026303490000000001 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485904+0000", 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5513999999999999e-05 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485920+0000", 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6201999999999998e-05 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486092+0000", 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017220700000000001 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486500+0000", 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040771200000000002 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486750+0000", 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025026699999999998 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.500598+0000", 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013848226 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.501939+0000", 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013409839999999999 2024-09-12T17:07:26.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502016+0000", 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6908000000000003e-05 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502109+0000", 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3096000000000004e-05 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1257 3.19 3:9b556f07:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.131835+0000", 2024-09-12T17:07:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.106586859, 2024-09-12T17:07:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016443860000000001, 2024-09-12T17:07:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.313 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1257 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.131835+0000", 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.131835+0000", 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.131838+0000", 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.517e-06 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133842+0000", 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020036479999999998 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133874+0000", 2024-09-12T17:07:26.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1594000000000003e-05 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133885+0000", 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1691e-05 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133964+0000", 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9155999999999999e-05 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.134163+0000", 2024-09-12T17:07:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019894699999999999 2024-09-12T17:07:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.134300+0000", 2024-09-12T17:07:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137105 2024-09-12T17:07:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.139969+0000", 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056682499999999997 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.148163+0000", 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0081945920000000005 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.148215+0000", 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.185e-05 2024-09-12T17:07:26.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.148279+0000", 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3509999999999993e-05 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1261 3.33 3:cc53a442:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.049047873999999, 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017162891, 2024-09-12T17:07:26.319 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1261 2024-09-12T17:07:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189377+0000", 2024-09-12T17:07:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.039e-06 2024-09-12T17:07:26.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192004+0000", 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026268900000000002 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192041+0000", 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6838000000000002e-05 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192055+0000", 2024-09-12T17:07:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4446e-05 2024-09-12T17:07:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192223+0000", 2024-09-12T17:07:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016760200000000001 2024-09-12T17:07:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192514+0000", 2024-09-12T17:07:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00029128900000000002 2024-09-12T17:07:26.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192760+0000", 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024571700000000001 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.201494+0000", 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0087345800000000005 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206464+0000", 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00497007 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206505+0000", 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0528999999999998e-05 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206537+0000", 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1890999999999997e-05 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.325 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1263 3.27 3:e7aec214:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.220304+0000", 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.018117407, 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016093784999999999, 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1263 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.220304+0000", 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.220304+0000", 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.220309+0000", 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1490000000000002e-06 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.223929+0000", 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036199650000000002 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.223972+0000", 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2824999999999997e-05 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.223996+0000", 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4039000000000001e-05 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.224102+0000", 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105654 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.224301+0000", 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019872800000000001 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.224487+0000", 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018613899999999999 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.230720+0000", 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062332689999999996 2024-09-12T17:07:26.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.236271+0000", 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055509349999999999 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.236345+0000", 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4400999999999995e-05 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.236398+0000", 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680999999999999e-05 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1369 3.19 3:9a84d0e6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.141780+0000", 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.096641314999999, 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016456490000000001, 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.332 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1369 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.141780+0000", 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.141780+0000", 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.141785+0000", 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.335e-06 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143672+0000", 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018877659999999999 2024-09-12T17:07:26.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143701+0000", 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8415000000000002e-05 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143715+0000", 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4430000000000001e-05 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143805+0000", 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9475000000000006e-05 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.144006+0000", 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020146399999999999 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.144186+0000", 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180161 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.149534+0000", 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053479859999999999 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.158103+0000", 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085683849999999995 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.158178+0000", 2024-09-12T17:07:26.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5605000000000005e-05 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.158237+0000", 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8468000000000003e-05 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1372 3.15 e64/24 3:a8d86e21:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_4:head v 64'3, mlcod=63'1)", 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.183175+0000", 2024-09-12T17:07:26.338 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.055246453000001, 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016505895, 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.183175+0000", 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.183175+0000", 2024-09-12T17:07:26.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.183178+0000", 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8559999999999998e-06 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192166+0000", 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089874199999999994 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192189+0000", 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3983000000000001e-05 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192199+0000", 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0000000000000001e-05 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192282+0000", 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2905999999999995e-05 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192310+0000", 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7571000000000001e-05 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.199614+0000", 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.007303543 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.199681+0000", 2024-09-12T17:07:26.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7615999999999998e-05 2024-09-12T17:07:26.343 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.343 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.343 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.343 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1375 3.29 3:95c1ad90:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:26.343 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:26.343 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.032929208000001, 2024-09-12T17:07:26.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016791820999999998, 2024-09-12T17:07:26.343 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.343 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.343 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.344 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.344 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.344 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.344 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1375 2024-09-12T17:07:26.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.344 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:26.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205496+0000", 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7220000000000001e-06 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208326+0000", 2024-09-12T17:07:26.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028297270000000002 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208353+0000", 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6675000000000001e-05 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208365+0000", 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2006e-05 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208450+0000", 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4958999999999998e-05 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208666+0000", 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021668300000000001 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208858+0000", 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000191707 2024-09-12T17:07:26.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.215258+0000", 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0064000439999999997 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222154+0000", 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068963949999999996 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222230+0000", 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5320000000000004e-05 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222284+0000", 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4583000000000002e-05 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1377 3.1e 3:7bce3e7d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:26.349 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.228040+0000", 2024-09-12T17:07:26.350 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.010382041, 2024-09-12T17:07:26.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016043414999999998, 2024-09-12T17:07:26.350 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.350 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.350 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.350 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.350 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1377 2024-09-12T17:07:26.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.350 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.228040+0000", 2024-09-12T17:07:26.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.228040+0000", 2024-09-12T17:07:26.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.228044+0000", 2024-09-12T17:07:26.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8940000000000003e-06 2024-09-12T17:07:26.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.229951+0000", 2024-09-12T17:07:26.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019078389999999999 2024-09-12T17:07:26.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230027+0000", 2024-09-12T17:07:26.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5840000000000006e-05 2024-09-12T17:07:26.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230045+0000", 2024-09-12T17:07:26.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8088999999999999e-05 2024-09-12T17:07:26.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230136+0000", 2024-09-12T17:07:26.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1056000000000004e-05 2024-09-12T17:07:26.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230305+0000", 2024-09-12T17:07:26.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000168689 2024-09-12T17:07:26.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:26.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.230429+0000", 2024-09-12T17:07:26.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012388000000000001 2024-09-12T17:07:26.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.237640+0000", 2024-09-12T17:07:26.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0072110849999999999 2024-09-12T17:07:26.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.243914+0000", 2024-09-12T17:07:26.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062736170000000004 2024-09-12T17:07:26.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.244004+0000", 2024-09-12T17:07:26.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0251e-05 2024-09-12T17:07:26.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.244083+0000", 2024-09-12T17:07:26.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9175e-05 2024-09-12T17:07:26.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.356 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.356 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.356 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1387 3.8 3:122cdcfa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:26.356 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:26.357 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.9001329509999998, 2024-09-12T17:07:26.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018409291000000001, 2024-09-12T17:07:26.357 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.357 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.357 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1387 2024-09-12T17:07:26.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.357 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:26.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:26.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338292+0000", 2024-09-12T17:07:26.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.631e-06 2024-09-12T17:07:26.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340227+0000", 2024-09-12T17:07:26.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001934217 2024-09-12T17:07:26.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340262+0000", 2024-09-12T17:07:26.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5893999999999999e-05 2024-09-12T17:07:26.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340278+0000", 2024-09-12T17:07:26.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5325e-05 2024-09-12T17:07:26.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340387+0000", 2024-09-12T17:07:26.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010876 2024-09-12T17:07:26.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340570+0000", 2024-09-12T17:07:26.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018296299999999999 2024-09-12T17:07:26.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340735+0000", 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568400000000001 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.345914+0000", 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051783319999999999 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356536+0000", 2024-09-12T17:07:26.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010622529 2024-09-12T17:07:26.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356632+0000", 2024-09-12T17:07:26.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5927000000000005e-05 2024-09-12T17:07:26.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356698+0000", 2024-09-12T17:07:26.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6029000000000001e-05 2024-09-12T17:07:26.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.363 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1427 3.7 3:e327d833:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2147792479999993, 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017016304999999999, 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:26.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1427 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:26.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023646+0000", 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2590000000000001e-06 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024847+0000", 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001201674 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024879+0000", 2024-09-12T17:07:26.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1636e-05 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024894+0000", 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4613000000000001e-05 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024980+0000", 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-05 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:26.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.025132+0000", 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152242 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.025252+0000", 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119731 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.029896+0000", 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046442810000000001 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040528+0000", 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010631508 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040600+0000", 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2125999999999994e-05 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040659+0000", 2024-09-12T17:07:26.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9074999999999999e-05 2024-09-12T17:07:26.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.370 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:26.370 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:26.370 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:26.372 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:07:26.372 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:26.368+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:26.473 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:26.468+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:26.485 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_10: 100Mb.10 2024-09-12T17:07:26.485 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:26.485 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 100Mb.1 from bucket to /tmp/downloadfile.1 2024-09-12T17:07:26.486 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 100Mb.2 from bucket to /tmp/downloadfile.2 2024-09-12T17:07:26.486 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 100Mb.3 from bucket to /tmp/downloadfile.3 2024-09-12T17:07:26.486 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 100Mb.4 from bucket to /tmp/downloadfile.4 2024-09-12T17:07:26.486 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 100Mb.5 from bucket to /tmp/downloadfile.5 2024-09-12T17:07:26.486 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 100Mb.6 from bucket to /tmp/downloadfile.6 2024-09-12T17:07:26.486 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 100Mb.7 from bucket to /tmp/downloadfile.7 2024-09-12T17:07:26.486 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 100Mb.8 from bucket to /tmp/downloadfile.8 2024-09-12T17:07:26.486 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 100Mb.9 from bucket to /tmp/downloadfile.9 2024-09-12T17:07:26.486 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 100Mb.10 from bucket to /tmp/downloadfile.10 2024-09-12T17:07:26.486 INFO:tasks.workunit.client.0.smithi017.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T17:07:26.486 INFO:tasks.workunit.client.0.smithi017.stdout:Test case: PASSED - checksum verification for multipart upload passed 2024-09-12T17:07:26.486 INFO:tasks.workunit.client.0.smithi017.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T17:07:26.507 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:26.507 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:26.507 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:26.507 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:26.522 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:07:26.573 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:26.568+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:26.653 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:26.653 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:26.653 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:26.653 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:26.669 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:07:26.714 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:26.713+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:26.775 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:26.773+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:26.810 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1179 3.13 e63/24 3:cbd4a155:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_17:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.411895+0000", 2024-09-12T17:07:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.394859597, 2024-09-12T17:07:26.810 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016791774999999998, 2024-09-12T17:07:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.411895+0000", 2024-09-12T17:07:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.811 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.411895+0000", 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.411897+0000", 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5940000000000001e-06 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.415978+0000", 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040800660000000002 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416016+0000", 2024-09-12T17:07:26.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8065999999999998e-05 2024-09-12T17:07:26.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416039+0000", 2024-09-12T17:07:26.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3674999999999999e-05 2024-09-12T17:07:26.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416194+0000", 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155014 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.416240+0000", 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5624999999999998e-05 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.428596+0000", 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012356084 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.428687+0000", 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0650999999999997e-05 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1188 3.31 3:8d857c15:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.312932916999999, 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019168672000000001, 2024-09-12T17:07:26.815 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1188 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:26.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493824+0000", 2024-09-12T17:07:26.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.553e-06 2024-09-12T17:07:26.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497820+0000", 2024-09-12T17:07:26.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039958659999999998 2024-09-12T17:07:26.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497855+0000", 2024-09-12T17:07:26.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4956000000000002e-05 2024-09-12T17:07:26.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497872+0000", 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6863000000000001e-05 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497996+0000", 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124306 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498229+0000", 2024-09-12T17:07:26.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023307699999999999 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498994+0000", 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076469699999999995 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.507996+0000", 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090021540000000001 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512687+0000", 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046905360000000004 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512861+0000", 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017420399999999999 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512990+0000", 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012946 2024-09-12T17:07:26.821 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1203 3.3 3:c32b8ddb:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.96001966, 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018231720999999999, 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.822 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.823 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.823 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1203 2024-09-12T17:07:26.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.823 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:26.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:26.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846738+0000", 2024-09-12T17:07:26.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1990000000000002e-06 2024-09-12T17:07:26.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852055+0000", 2024-09-12T17:07:26.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053168080000000001 2024-09-12T17:07:26.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852093+0000", 2024-09-12T17:07:26.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8682e-05 2024-09-12T17:07:26.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.825 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.825 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852111+0000", 2024-09-12T17:07:26.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7153e-05 2024-09-12T17:07:26.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852292+0000", 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018150999999999999 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852527+0000", 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023529000000000001 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852761+0000", 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023386500000000001 2024-09-12T17:07:26.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864541+0000", 2024-09-12T17:07:26.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011779367000000001 2024-09-12T17:07:26.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864784+0000", 2024-09-12T17:07:26.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000242861 2024-09-12T17:07:26.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864885+0000", 2024-09-12T17:07:26.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101124 2024-09-12T17:07:26.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864967+0000", 2024-09-12T17:07:26.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1861999999999997e-05 2024-09-12T17:07:26.828 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.828 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.828 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1209 3.a e63/24 3:531ac038:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_9:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.942304+0000", 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.864450667, 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016937681999999999, 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942304+0000", 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942304+0000", 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942308+0000", 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1169999999999997e-06 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946066+0000", 2024-09-12T17:07:26.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037579309999999999 2024-09-12T17:07:26.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946104+0000", 2024-09-12T17:07:26.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8432000000000001e-05 2024-09-12T17:07:26.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946122+0000", 2024-09-12T17:07:26.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7612999999999999e-05 2024-09-12T17:07:26.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946292+0000", 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000169872 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.946380+0000", 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8067999999999998e-05 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.832 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959145+0000", 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012765515 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959241+0000", 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6133999999999998e-05 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1210 3.29 e63/24 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:26.833 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.859319258999999, 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018233155000000001, 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947437+0000", 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3039999999999999e-06 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953449+0000", 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0060117130000000001 2024-09-12T17:07:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953487+0000", 2024-09-12T17:07:26.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.748e-05 2024-09-12T17:07:26.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953504+0000", 2024-09-12T17:07:26.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7343e-05 2024-09-12T17:07:26.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953639+0000", 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013447700000000001 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953683+0000", 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4521999999999998e-05 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.965566+0000", 2024-09-12T17:07:26.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011883138 2024-09-12T17:07:26.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.838 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.838 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.965668+0000", 2024-09-12T17:07:26.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102178 2024-09-12T17:07:26.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.838 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.838 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.838 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1232 3.14 3:2967aafe:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.838 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.286480009, 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019509183999999999, 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1232 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:26.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:26.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520278+0000", 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9539999999999998e-06 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525478+0000", 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005199665 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525520+0000", 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2391999999999997e-05 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525542+0000", 2024-09-12T17:07:26.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1613000000000001e-05 2024-09-12T17:07:26.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525676+0000", 2024-09-12T17:07:26.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013434300000000001 2024-09-12T17:07:26.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525933+0000", 2024-09-12T17:07:26.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025640400000000001 2024-09-12T17:07:26.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:26.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.526162+0000", 2024-09-12T17:07:26.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228722 2024-09-12T17:07:26.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.534431+0000", 2024-09-12T17:07:26.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082696019999999992 2024-09-12T17:07:26.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539449+0000", 2024-09-12T17:07:26.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050177099999999999 2024-09-12T17:07:26.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.844 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539640+0000", 2024-09-12T17:07:26.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190812 2024-09-12T17:07:26.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.844 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539784+0000", 2024-09-12T17:07:26.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143967 2024-09-12T17:07:26.845 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.845 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.845 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.845 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1234 3.3 3:c0bf349d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.845 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:26.845 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.261309064000001, 2024-09-12T17:07:26.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019413466000000001, 2024-09-12T17:07:26.845 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.846 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.846 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.846 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.846 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.846 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.846 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1234 2024-09-12T17:07:26.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.846 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:26.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545450+0000", 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.313e-06 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549431+0000", 2024-09-12T17:07:26.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039813139999999997 2024-09-12T17:07:26.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549472+0000", 2024-09-12T17:07:26.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0828999999999998e-05 2024-09-12T17:07:26.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549491+0000", 2024-09-12T17:07:26.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9055999999999998e-05 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549627+0000", 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013646700000000001 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549859+0000", 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023186100000000001 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.550208+0000", 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000348372 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.559516+0000", 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093083260000000004 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564688+0000", 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051717849999999999 2024-09-12T17:07:26.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564783+0000", 2024-09-12T17:07:26.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4821000000000006e-05 2024-09-12T17:07:26.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564859+0000", 2024-09-12T17:07:26.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6322000000000006e-05 2024-09-12T17:07:26.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.851 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.851 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1235 3.1c e63/45 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.244242928, 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023527869, 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562514+0000", 2024-09-12T17:07:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:26.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570603+0000", 2024-09-12T17:07:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080886359999999997 2024-09-12T17:07:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570630+0000", 2024-09-12T17:07:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7276000000000001e-05 2024-09-12T17:07:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570642+0000", 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2153e-05 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570805+0000", 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016319899999999999 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570900+0000", 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4988000000000006e-05 2024-09-12T17:07:26.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.585884+0000", 2024-09-12T17:07:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014984046000000001 2024-09-12T17:07:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.586039+0000", 2024-09-12T17:07:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155184 2024-09-12T17:07:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1236 3.1b e63/24 3:d9ff086a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_8:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.572563+0000", 2024-09-12T17:07:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.23419138, 2024-09-12T17:07:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017155578000000001, 2024-09-12T17:07:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.572563+0000", 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.572563+0000", 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.572565+0000", 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0499999999999999e-06 2024-09-12T17:07:26.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577606+0000", 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050408149999999997 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577631+0000", 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.546e-05 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577645+0000", 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3839000000000001e-05 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577817+0000", 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017171600000000001 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.577856+0000", 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8692999999999997e-05 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.589631+0000", 2024-09-12T17:07:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011775803 2024-09-12T17:07:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.589719+0000", 2024-09-12T17:07:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7201999999999996e-05 2024-09-12T17:07:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1238 3.3 3:c2fc49d9:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.216261487000001, 2024-09-12T17:07:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018644582999999999, 2024-09-12T17:07:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.862 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1238 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:26.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590496+0000", 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4400000000000001e-06 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596047+0000", 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055506599999999998 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596086+0000", 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9326000000000003e-05 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596106+0000", 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9119000000000001e-05 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596263+0000", 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015771700000000001 2024-09-12T17:07:26.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596516+0000", 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025320799999999999 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596769+0000", 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025305400000000001 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.605151+0000", 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.008381833 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.608970+0000", 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038186660000000001 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.609064+0000", 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4438000000000006e-05 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.609138+0000", 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3121999999999995e-05 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1244 3.1a 3:594e2ce7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.135887352999999, 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018879997999999999, 2024-09-12T17:07:26.868 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.869 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.869 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.869 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.869 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.869 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.869 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1244 2024-09-12T17:07:26.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.869 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.869 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.869 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:26.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:26.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670871+0000", 2024-09-12T17:07:26.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0459999999999999e-06 2024-09-12T17:07:26.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675701+0000", 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048294169999999999 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675740+0000", 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9592999999999999e-05 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675758+0000", 2024-09-12T17:07:26.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.77e-05 2024-09-12T17:07:26.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675939+0000", 2024-09-12T17:07:26.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018083199999999999 2024-09-12T17:07:26.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.676345+0000", 2024-09-12T17:07:26.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040617099999999998 2024-09-12T17:07:26.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.676719+0000", 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037385800000000002 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.688469+0000", 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01174979 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689374+0000", 2024-09-12T17:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00090544200000000001 2024-09-12T17:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689551+0000", 2024-09-12T17:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017685300000000001 2024-09-12T17:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689747+0000", 2024-09-12T17:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019629599999999999 2024-09-12T17:07:26.874 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1247 3.1a 3:58056b43:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.105716886, 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021958978000000001, 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.875 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.876 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.876 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1247 2024-09-12T17:07:26.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.876 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:26.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701041+0000", 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9399999999999998e-06 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705529+0000", 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044889789999999997 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705569+0000", 2024-09-12T17:07:26.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9606e-05 2024-09-12T17:07:26.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705588+0000", 2024-09-12T17:07:26.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9375999999999999e-05 2024-09-12T17:07:26.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705756+0000", 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016734200000000001 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706045+0000", 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028885400000000001 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:26.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706343+0000", 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029790300000000002 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720973+0000", 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014630684 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722653+0000", 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016799790000000001 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722878+0000", 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022488799999999999 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722997+0000", 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118427 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.882 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1376 3.3 3:c01937d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:26.882 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:26.885 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.587527979000001, 2024-09-12T17:07:26.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020435229999999999, 2024-09-12T17:07:26.885 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.885 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.885 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.885 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.885 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1376 2024-09-12T17:07:26.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.885 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:26.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:26.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219230+0000", 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.23e-06 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223391+0000", 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041610629999999996 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223425+0000", 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4167e-05 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223443+0000", 2024-09-12T17:07:26.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8105999999999999e-05 2024-09-12T17:07:26.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223562+0000", 2024-09-12T17:07:26.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118861 2024-09-12T17:07:26.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.888 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.888 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223840+0000", 2024-09-12T17:07:26.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027762099999999998 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.224077+0000", 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023720100000000001 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.232976+0000", 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0088992900000000007 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239478+0000", 2024-09-12T17:07:26.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065023609999999999 2024-09-12T17:07:26.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239574+0000", 2024-09-12T17:07:26.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5527999999999997e-05 2024-09-12T17:07:26.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239662+0000", 2024-09-12T17:07:26.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7801999999999997e-05 2024-09-12T17:07:26.891 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.891 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.891 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.891 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1382 3.1a 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:26.891 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:26.891 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.520861027, 2024-09-12T17:07:26.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020895593, 2024-09-12T17:07:26.891 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.891 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.891 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.892 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.892 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.892 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.892 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1382 2024-09-12T17:07:26.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.892 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:26.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285897+0000", 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6669999999999998e-06 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290617+0000", 2024-09-12T17:07:26.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047198689999999998 2024-09-12T17:07:26.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290657+0000", 2024-09-12T17:07:26.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0201999999999999e-05 2024-09-12T17:07:26.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290676+0000", 2024-09-12T17:07:26.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9293e-05 2024-09-12T17:07:26.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290860+0000", 2024-09-12T17:07:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000183353 2024-09-12T17:07:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291264+0000", 2024-09-12T17:07:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040463800000000002 2024-09-12T17:07:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291676+0000", 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041151499999999999 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301391+0000", 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0097147350000000004 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306412+0000", 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050210790000000003 2024-09-12T17:07:26.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306636+0000", 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000224589 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306789+0000", 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015265299999999999 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1383 3.9 3:90e43e04:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.296675+0000", 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.510079134, 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017100829000000001, 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1383 2024-09-12T17:07:26.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.296675+0000", 2024-09-12T17:07:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.296675+0000", 2024-09-12T17:07:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.296679+0000", 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4769999999999999e-06 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.300641+0000", 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039620180000000003 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.300675+0000", 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4385999999999999e-05 2024-09-12T17:07:26.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.300695+0000", 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9473000000000001e-05 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.300820+0000", 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012572399999999999 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301138+0000", 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00031714599999999998 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301452+0000", 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000314524 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.310900+0000", 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0094480109999999992 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.313495+0000", 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0025945590000000002 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.313654+0000", 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000159304 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.313776+0000", 2024-09-12T17:07:26.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012220699999999999 2024-09-12T17:07:26.906 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.906 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.906 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.906 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1385 3.34 3:2f3cb087:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:26.906 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:26.906 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.488835921, 2024-09-12T17:07:26.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024744103999999999, 2024-09-12T17:07:26.906 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.906 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.906 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1385 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317922+0000", 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.157e-06 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322800+0000", 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048785879999999997 2024-09-12T17:07:26.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322846+0000", 2024-09-12T17:07:26.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5732999999999997e-05 2024-09-12T17:07:26.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322866+0000", 2024-09-12T17:07:26.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0415999999999999e-05 2024-09-12T17:07:26.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323048+0000", 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018128 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323496+0000", 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044786400000000002 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323919+0000", 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042374399999999999 2024-09-12T17:07:26.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.340076+0000", 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016156925999999999 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342379+0000", 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023025189999999998 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342546+0000", 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016719599999999999 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342663+0000", 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116681 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1409 3.a e64/24 3:53d4fdcd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_3:head v 64'6, mlcod=64'4)", 2024-09-12T17:07:26.912 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.9853563790000006, 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021472076, 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821402+0000", 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4699999999999998e-06 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828337+0000", 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069354229999999996 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828387+0000", 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9908999999999999e-05 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828412+0000", 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5389999999999999e-05 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828587+0000", 2024-09-12T17:07:26.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017425599999999999 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828654+0000", 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7708999999999998e-05 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842774+0000", 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014119860999999999 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842870+0000", 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6057999999999994e-05 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1417 3.14 3:29a29b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8840279740000003, 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.034043223999999997, 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.917 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1417 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922731+0000", 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1099999999999996e-06 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930785+0000", 2024-09-12T17:07:26.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080541020000000005 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930841+0000", 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6005999999999999e-05 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930869+0000", 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8602000000000002e-05 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931049+0000", 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017998299999999999 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931287+0000", 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000237712 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931510+0000", 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022283200000000001 2024-09-12T17:07:26.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941891+0000", 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010380785 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.955891+0000", 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014000207000000001 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956636+0000", 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00074503099999999995 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956770+0000", 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013385400000000001 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1420 3.3 3:c118c659:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:26.923 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8547341579999994, 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022394282000000001, 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1420 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:26.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:26.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952024+0000", 2024-09-12T17:07:26.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1760000000000003e-06 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958458+0000", 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064335770000000002 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958492+0000", 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4309e-05 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958508+0000", 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5699999999999999e-05 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958717+0000", 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020871900000000001 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959163+0000", 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000446007 2024-09-12T17:07:26.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959583+0000", 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042026800000000001 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.970389+0000", 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010806375999999999 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974044+0000", 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003654352 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974232+0000", 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018811899999999999 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974415+0000", 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018267899999999999 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.929 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1432 3.3 3:c31ee49b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.10:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:17.072308+0000", 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.7344459860000008, 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018638120000000001, 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:26.930 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1432 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.072308+0000", 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.072308+0000", 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:26.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.072311+0000", 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6390000000000001e-06 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076248+0000", 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039373089999999999 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:26.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076285+0000", 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6470999999999997e-05 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076301+0000", 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5693e-05 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076438+0000", 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013785100000000001 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076696+0000", 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025774499999999998 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.077565+0000", 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000869215 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.088840+0000", 2024-09-12T17:07:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011274273 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.090743+0000", 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019029800000000001 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.090866+0000", 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012304300000000001 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:26.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:26.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.090947+0000", 2024-09-12T17:07:26.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0901000000000004e-05 2024-09-12T17:07:26.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.936 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.936 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:26.936 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:26.936 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:26.937 INFO:tasks.workunit.client.0.smithi017.stdout:user 0.029932081074552 deleted 2024-09-12T17:07:26.938 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:07:26.938 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:26.933+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:26.993 INFO:tasks.workunit.client.0.smithi017.stdout:Bucket Created: buck_2024_08_12_17_07_26 2024-09-12T17:07:26.993 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 1 2024-09-12T17:07:27.004 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:27.004 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:27.004 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00920153 s, 1.1 GB/s 2024-09-12T17:07:27.039 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:27.032+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:27.120 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.1 2024-09-12T17:07:27.120 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:27.120 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 2 2024-09-12T17:07:27.127 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:27.127 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:27.128 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:27.128 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:27.134 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:27.134 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:27.134 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114048 s, 919 MB/s 2024-09-12T17:07:27.140 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:27.136+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:27.143 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:07:27.241 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:27.237+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:27.280 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.2 2024-09-12T17:07:27.280 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:27.280 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 3 2024-09-12T17:07:27.284 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:27.284 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:27.284 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:27.284 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:27.284 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:27.296 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:27.296 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:27.296 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127314 s, 824 MB/s 2024-09-12T17:07:27.302 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:07:27.343 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:27.341+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:27.428 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.3 2024-09-12T17:07:27.428 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:27.428 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 4 2024-09-12T17:07:27.441 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:27.437+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:27.444 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:27.444 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:27.444 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0133202 s, 787 MB/s 2024-09-12T17:07:27.461 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:07:27.480 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1208 3.1f e63/24 3:fa8ff2df:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_8:head v 63'3, mlcod=63'1)", 2024-09-12T17:07:27.481 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.925779+0000", 2024-09-12T17:07:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.55178926, 2024-09-12T17:07:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018615184999999999, 2024-09-12T17:07:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.925779+0000", 2024-09-12T17:07:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.925779+0000", 2024-09-12T17:07:27.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.925782+0000", 2024-09-12T17:07:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.627e-06 2024-09-12T17:07:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.931139+0000", 2024-09-12T17:07:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053568829999999998 2024-09-12T17:07:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.931177+0000", 2024-09-12T17:07:27.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7734999999999997e-05 2024-09-12T17:07:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.931194+0000", 2024-09-12T17:07:27.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6952999999999998e-05 2024-09-12T17:07:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.931338+0000", 2024-09-12T17:07:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014459 2024-09-12T17:07:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.931379+0000", 2024-09-12T17:07:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0961999999999998e-05 2024-09-12T17:07:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.944263+0000", 2024-09-12T17:07:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012883314999999999 2024-09-12T17:07:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.944395+0000", 2024-09-12T17:07:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013212 2024-09-12T17:07:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.489 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.490 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1215 3.2a 3:54858903:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.490 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.999868+0000", 2024-09-12T17:07:27.490 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.477700754000001, 2024-09-12T17:07:27.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017784926999999999, 2024-09-12T17:07:27.490 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.490 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.490 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.490 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.490 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.490 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1215 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.999868+0000", 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.999868+0000", 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.999872+0000", 2024-09-12T17:07:27.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4859999999999999e-06 2024-09-12T17:07:27.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.003960+0000", 2024-09-12T17:07:27.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040871350000000004 2024-09-12T17:07:27.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.003997+0000", 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7799000000000002e-05 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.004016+0000", 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8326999999999999e-05 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.004156+0000", 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000140123 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.004410+0000", 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000254348 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.004643+0000", 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023330700000000001 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.014798+0000", 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010154863 2024-09-12T17:07:27.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.017481+0000", 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0026826689999999999 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.017580+0000", 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8927999999999999e-05 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.017653+0000", 2024-09-12T17:07:27.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2941999999999994e-05 2024-09-12T17:07:27.496 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.496 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.496 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.496 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1217 3.28 3:164ed207:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.496 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.019582+0000", 2024-09-12T17:07:27.496 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.457986408, 2024-09-12T17:07:27.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017378035999999999, 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1217 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.019582+0000", 2024-09-12T17:07:27.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.019582+0000", 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.019585+0000", 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1700000000000001e-06 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.498 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.023555+0000", 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039696200000000001 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.023595+0000", 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9805999999999998e-05 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.023621+0000", 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5715999999999999e-05 2024-09-12T17:07:27.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.023782+0000", 2024-09-12T17:07:27.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016111000000000001 2024-09-12T17:07:27.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.024030+0000", 2024-09-12T17:07:27.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024798399999999998 2024-09-12T17:07:27.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.024265+0000", 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000235298 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.032279+0000", 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080137149999999994 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.036791+0000", 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045117969999999997 2024-09-12T17:07:27.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.036881+0000", 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0557999999999996e-05 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.036960+0000", 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9262000000000001e-05 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1239 3.16 3:6b2cb9ce:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.876581510999999, 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021398218, 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1239 2024-09-12T17:07:27.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600991+0000", 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9559999999999999e-06 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606170+0000", 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051789460000000002 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606222+0000", 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1422000000000003e-05 2024-09-12T17:07:27.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606249+0000", 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7163000000000001e-05 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606450+0000", 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000201325 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606877+0000", 2024-09-12T17:07:27.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042682799999999997 2024-09-12T17:07:27.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:27.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.607298+0000", 2024-09-12T17:07:27.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042127700000000001 2024-09-12T17:07:27.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.615845+0000", 2024-09-12T17:07:27.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0085471260000000004 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622186+0000", 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063410690000000004 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622292+0000", 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105305 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.509 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622385+0000", 2024-09-12T17:07:27.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3801000000000005e-05 2024-09-12T17:07:27.509 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.509 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.509 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.509 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.509 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1251 3.1d 3:ba0891d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.509 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:27.509 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.734241995, 2024-09-12T17:07:27.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020778814999999999, 2024-09-12T17:07:27.509 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1251 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743330+0000", 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7000000000000002e-06 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748572+0000", 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052414710000000002 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748616+0000", 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4369000000000002e-05 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748636+0000", 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9582999999999999e-05 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748778+0000", 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141867 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749017+0000", 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000239218 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749233+0000", 2024-09-12T17:07:27.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021619799999999999 2024-09-12T17:07:27.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.756641+0000", 2024-09-12T17:07:27.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074078089999999996 2024-09-12T17:07:27.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763784+0000", 2024-09-12T17:07:27.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0071433809999999999 2024-09-12T17:07:27.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763958+0000", 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000173862 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.764106+0000", 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014735700000000001 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.516 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1259 3.5 3:a1f83edd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.516 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:27.516 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.321354127999999, 2024-09-12T17:07:27.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024500529, 2024-09-12T17:07:27.516 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.516 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.516 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.516 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.516 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.516 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.516 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1259 2024-09-12T17:07:27.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.517 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:27.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:27.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156217+0000", 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8940000000000002e-06 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160482+0000", 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042645269999999997 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160513+0000", 2024-09-12T17:07:27.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1228e-05 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160526+0000", 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2976000000000001e-05 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160624+0000", 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8048999999999996e-05 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160825+0000", 2024-09-12T17:07:27.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020054799999999999 2024-09-12T17:07:27.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:27.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160997+0000", 2024-09-12T17:07:27.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017260499999999999 2024-09-12T17:07:27.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.169300+0000", 2024-09-12T17:07:27.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083027050000000005 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180595+0000", 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011294465 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180660+0000", 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5616000000000003e-05 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180715+0000", 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4916000000000001e-05 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1260 3.5 3:a2328a91:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.166866+0000", 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.310702223, 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018585485999999998, 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.522 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.523 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.523 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.523 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.523 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.523 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1260 2024-09-12T17:07:27.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.523 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.166866+0000", 2024-09-12T17:07:27.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.166866+0000", 2024-09-12T17:07:27.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.166869+0000", 2024-09-12T17:07:27.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2050000000000001e-06 2024-09-12T17:07:27.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.170733+0000", 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038638969999999998 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.170754+0000", 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1537999999999999e-05 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.170767+0000", 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2797e-05 2024-09-12T17:07:27.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.170859+0000", 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2514000000000002e-05 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.171060+0000", 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020073399999999999 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.171243+0000", 2024-09-12T17:07:27.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018331099999999999 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.176876+0000", 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056325689999999996 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.185350+0000", 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0084741599999999997 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.185409+0000", 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8628999999999997e-05 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.185452+0000", 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3132e-05 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.528 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1262 3.5 3:a3a998f2:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.266721415999999, 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020328525, 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1262 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:27.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:27.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210850+0000", 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.005e-06 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214862+0000", 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040120640000000001 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214903+0000", 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0831999999999998e-05 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214940+0000", 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7036000000000003e-05 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215059+0000", 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118631 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215237+0000", 2024-09-12T17:07:27.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017834900000000001 2024-09-12T17:07:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215406+0000", 2024-09-12T17:07:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016896200000000001 2024-09-12T17:07:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.221184+0000", 2024-09-12T17:07:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057780130000000002 2024-09-12T17:07:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231002+0000", 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0098174969999999997 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231096+0000", 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4204999999999997e-05 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231176+0000", 2024-09-12T17:07:27.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9931000000000004e-05 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1264 3.c 3:30907361:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.245798431000001, 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021106314000000001, 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.535 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1264 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231772+0000", 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1560000000000002e-06 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235787+0000", 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040149790000000001 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235824+0000", 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6956000000000003e-05 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235843+0000", 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8315999999999999e-05 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235954+0000", 2024-09-12T17:07:27.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111601 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236135+0000", 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000180941 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236302+0000", 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016626600000000001 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242422+0000", 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061200730000000002 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252655+0000", 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010232978 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252749+0000", 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4481000000000006e-05 2024-09-12T17:07:27.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252877+0000", 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012756700000000001 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1265 3.22 3:44204d7e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.235310245999999, 2024-09-12T17:07:27.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021506441000000001, 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1265 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:27.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242262+0000", 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7299999999999999e-06 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246237+0000", 2024-09-12T17:07:27.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039746989999999999 2024-09-12T17:07:27.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246272+0000", 2024-09-12T17:07:27.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5589000000000001e-05 2024-09-12T17:07:27.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246290+0000", 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7107000000000001e-05 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246410+0000", 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119984 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246589+0000", 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000179853 2024-09-12T17:07:27.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246748+0000", 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158536 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252569+0000", 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058212810000000002 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263464+0000", 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010894406000000001 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263627+0000", 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000163833 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263765+0000", 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013742299999999999 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.547 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1267 3.22 3:45aa8e5c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.269003+0000", 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.20856597, 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017359309, 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.548 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1267 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.269003+0000", 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.269003+0000", 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.269009+0000", 2024-09-12T17:07:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2929999999999997e-06 2024-09-12T17:07:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.272862+0000", 2024-09-12T17:07:27.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038530589999999998 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.272903+0000", 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1125999999999999e-05 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.272921+0000", 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7872000000000001e-05 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.273027+0000", 2024-09-12T17:07:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105635 2024-09-12T17:07:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.273197+0000", 2024-09-12T17:07:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017066600000000001 2024-09-12T17:07:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.273356+0000", 2024-09-12T17:07:27.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015825799999999999 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.279638+0000", 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0062824919999999998 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.286233+0000", 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.006594445 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.286296+0000", 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.3058999999999994e-05 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.286362+0000", 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.6403999999999996e-05 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1269 3.c 3:3287b6aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.186683073999999, 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019007443999999998, 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1269 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290890+0000", 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2529999999999998e-06 2024-09-12T17:07:27.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294907+0000", 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004017189 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294952+0000", 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5252e-05 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294971+0000", 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8606000000000001e-05 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295107+0000", 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000135654 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295466+0000", 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000359448 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295948+0000", 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000482079 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.308012+0000", 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012064210000000001 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309570+0000", 2024-09-12T17:07:27.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015580839999999999 2024-09-12T17:07:27.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309758+0000", 2024-09-12T17:07:27.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000187522 2024-09-12T17:07:27.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309893+0000", 2024-09-12T17:07:27.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013514700000000001 2024-09-12T17:07:27.560 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.560 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1275 3.16 3:68cda83e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.123985932, 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019055547999999999, 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.561 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1275 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353586+0000", 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0769999999999999e-06 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359376+0000", 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057904100000000002 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359400+0000", 2024-09-12T17:07:27.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3805999999999999e-05 2024-09-12T17:07:27.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359412+0000", 2024-09-12T17:07:27.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2404e-05 2024-09-12T17:07:27.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359522+0000", 2024-09-12T17:07:27.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109685 2024-09-12T17:07:27.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359767+0000", 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024471399999999999 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.360035+0000", 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026762699999999999 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372243+0000", 2024-09-12T17:07:27.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012208169 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372526+0000", 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028289599999999998 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372581+0000", 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5747e-05 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372638+0000", 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7012999999999998e-05 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1282 3.c 3:302741ef:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.5:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.466278+0000", 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.011291057999999, 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018897081999999999, 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1282 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.466278+0000", 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.466278+0000", 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.466280+0000", 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1959999999999998e-06 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471118+0000", 2024-09-12T17:07:27.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048379460000000001 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471160+0000", 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2499000000000001e-05 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471178+0000", 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.766e-05 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471346+0000", 2024-09-12T17:07:27.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016801300000000001 2024-09-12T17:07:27.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471770+0000", 2024-09-12T17:07:27.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042415399999999999 2024-09-12T17:07:27.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:27.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.472909+0000", 2024-09-12T17:07:27.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011385 2024-09-12T17:07:27.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.483340+0000", 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010431184 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.485061+0000", 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017208830000000001 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.485116+0000", 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4889000000000003e-05 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.485175+0000", 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9157999999999998e-05 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1371 3.35 e64/24 3:ad03dbae:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_3:head v 64'4, mlcod=64'2)", 2024-09-12T17:07:27.573 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.170534+0000", 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.307034863, 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018740685999999999, 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.170534+0000", 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.170534+0000", 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.170538+0000", 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8569999999999997e-06 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176170+0000", 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056319960000000002 2024-09-12T17:07:27.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176214+0000", 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4515999999999999e-05 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176236+0000", 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1886999999999999e-05 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176393+0000", 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015728699999999999 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176433+0000", 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0045e-05 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.189172+0000", 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012738642999999999 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.189275+0000", 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010245499999999999 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1389 3.28 3:156adf53:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.363735+0000", 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.113834079, 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018182126999999999, 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.578 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1389 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.363735+0000", 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.363735+0000", 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.363739+0000", 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3839999999999999e-06 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.370384+0000", 2024-09-12T17:07:27.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066451590000000003 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.370428+0000", 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4242000000000001e-05 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.370449+0000", 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0293e-05 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.370608+0000", 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000159073 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.370932+0000", 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032428699999999998 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.371236+0000", 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030435999999999999 2024-09-12T17:07:27.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.380161+0000", 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0089244589999999992 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381629+0000", 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014678759999999999 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381797+0000", 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016834 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381917+0000", 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119654 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1390 3.2f 3:f51d0419:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:27.584 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:27.585 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.100793206000001, 2024-09-12T17:07:27.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019302698, 2024-09-12T17:07:27.585 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.585 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.585 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.585 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.585 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1390 2024-09-12T17:07:27.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.585 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376779+0000", 2024-09-12T17:07:27.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8700000000000002e-06 2024-09-12T17:07:27.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381020+0000", 2024-09-12T17:07:27.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042401660000000001 2024-09-12T17:07:27.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381069+0000", 2024-09-12T17:07:27.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9279e-05 2024-09-12T17:07:27.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381098+0000", 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9110000000000001e-05 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381276+0000", 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017790199999999999 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381577+0000", 2024-09-12T17:07:27.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030131400000000001 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381798+0000", 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022053200000000001 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.391131+0000", 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093337400000000001 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395755+0000", 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004624034 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395932+0000", 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000176317 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.396078+0000", 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000146434 2024-09-12T17:07:27.590 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1408 3.2a 3:56341a86:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.673704081, 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.030673474999999999, 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.591 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1408 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:27.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803868+0000", 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1130000000000001e-06 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808291+0000", 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044233120000000004 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808331+0000", 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9869000000000001e-05 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808351+0000", 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9673e-05 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808511+0000", 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015999699999999999 2024-09-12T17:07:27.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808843+0000", 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033221900000000003 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.809106+0000", 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026355900000000002 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.827691+0000", 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018584471000000002 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834339+0000", 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066477790000000004 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834448+0000", 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109578 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834538+0000", 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9905000000000001e-05 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1414 3.3a 3:5f72b292:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.890509+0000", 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.587060075, 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018777497000000001, 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.597 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1414 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.890509+0000", 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.890509+0000", 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.890513+0000", 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.07e-06 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.894491+0000", 2024-09-12T17:07:27.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039787069999999997 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.894533+0000", 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1638999999999999e-05 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.894567+0000", 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3689999999999998e-05 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.894754+0000", 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000187006 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.895081+0000", 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032771900000000002 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.895342+0000", 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026024499999999999 2024-09-12T17:07:27.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.903175+0000", 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0078331809999999998 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.909015+0000", 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005839622 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.909134+0000", 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119905 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.909286+0000", 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015171299999999999 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1423 3.28 3:17c0aad8:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:27.603 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.981662+0000", 2024-09-12T17:07:27.604 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.495906438, 2024-09-12T17:07:27.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018096924, 2024-09-12T17:07:27.604 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:27.604 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:27.604 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:27.604 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:27.604 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:27.604 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:27.604 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1423 2024-09-12T17:07:27.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.604 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:27.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.981662+0000", 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.981662+0000", 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.981666+0000", 2024-09-12T17:07:27.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0600000000000001e-06 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.987043+0000", 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053768189999999997 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.987084+0000", 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0812000000000002e-05 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.987103+0000", 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9380000000000001e-05 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.987312+0000", 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000208252 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.987562+0000", 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025063800000000002 2024-09-12T17:07:27.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:27.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.987802+0000", 2024-09-12T17:07:27.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023980599999999999 2024-09-12T17:07:27.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:27.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.998293+0000", 2024-09-12T17:07:27.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010491240000000001 2024-09-12T17:07:27.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:27.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.999558+0000", 2024-09-12T17:07:27.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001264938 2024-09-12T17:07:27.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:27.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.999670+0000", 2024-09-12T17:07:27.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111963 2024-09-12T17:07:27.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:27.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:27.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:27.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.999759+0000", 2024-09-12T17:07:27.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9016000000000003e-05 2024-09-12T17:07:27.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.610 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:27.610 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:27.610 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:27.611 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.4 2024-09-12T17:07:27.611 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:27.611 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 5 2024-09-12T17:07:27.612 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:27.612 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:27.612 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106889 s, 981 MB/s 2024-09-12T17:07:27.612 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:27.604+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:27.613 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:27.623 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:27.623 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:27.643 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:27.644 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:27.665 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:27.665 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:27.675 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.5 2024-09-12T17:07:27.675 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:27.675 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 6 2024-09-12T17:07:27.682 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:27.683 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:27.685 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:27.685 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:27.685 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00881393 s, 1.2 GB/s 2024-09-12T17:07:27.704 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:27.705 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:27.712 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:27.708+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:27.721 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:27.721 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:27.747 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:27.747 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:27.769 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:27.770 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:27.779 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.6 2024-09-12T17:07:27.779 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:27.779 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 7 2024-09-12T17:07:27.790 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:27.790 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:27.790 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00899563 s, 1.2 GB/s 2024-09-12T17:07:27.805 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:27.805 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:27.819 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:27.836 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:27.832+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:27.883 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.7 2024-09-12T17:07:27.883 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:27.883 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 8 2024-09-12T17:07:27.896 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:27.896 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:27.896 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113829 s, 921 MB/s 2024-09-12T17:07:27.914 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:27.908+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:27.944 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:27.944 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:27.959 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:28.006 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.8 2024-09-12T17:07:28.007 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:28.007 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 9 2024-09-12T17:07:28.014 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:28.009+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:28.021 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:28.021 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:28.021 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123182 s, 851 MB/s 2024-09-12T17:07:28.090 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:28.090 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:28.105 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:28.142 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.9 2024-09-12T17:07:28.142 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:28.142 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 10 2024-09-12T17:07:28.146 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:28.145+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:28.157 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:28.157 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:28.157 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.011861 s, 884 MB/s 2024-09-12T17:07:28.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T17:07:28.216 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:28.213+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:28.279 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.10 2024-09-12T17:07:28.280 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:28.280 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 11 2024-09-12T17:07:28.291 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:28.291 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:28.292 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101731 s, 1.0 GB/s 2024-09-12T17:07:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:28.293 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:28.310 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:28.319 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:28.312+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:28.393 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.11 2024-09-12T17:07:28.393 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:28.393 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 12 2024-09-12T17:07:28.406 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:28.406 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:28.406 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105975 s, 989 MB/s 2024-09-12T17:07:28.419 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:28.417+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:28.481 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:28.482 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:28.496 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:28.521 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:28.516+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:28.534 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.12 2024-09-12T17:07:28.534 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:28.535 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 13 2024-09-12T17:07:28.547 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:28.547 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:28.547 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010503 s, 998 MB/s 2024-09-12T17:07:28.622 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:28.617+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:28.671 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.13 2024-09-12T17:07:28.671 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:28.671 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 14 2024-09-12T17:07:28.676 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:28.676 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:28.687 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:28.687 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:28.687 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0134532 s, 779 MB/s 2024-09-12T17:07:28.691 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:07:28.736 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:28.732+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:28.804 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.14 2024-09-12T17:07:28.804 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:28.805 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 15 2024-09-12T17:07:28.818 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:28.818 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:28.818 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108008 s, 971 MB/s 2024-09-12T17:07:28.823 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:28.816+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:28.829 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:28.830 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:28.844 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:07:28.932 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:28.928+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:28.939 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.15 2024-09-12T17:07:28.939 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:28.939 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 16 2024-09-12T17:07:28.951 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:28.951 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:28.951 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101277 s, 1.0 GB/s 2024-09-12T17:07:29.025 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:29.020+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:29.043 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:29.043 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:29.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:07:29.070 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.16 2024-09-12T17:07:29.070 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:29.070 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 17 2024-09-12T17:07:29.083 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:29.083 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:29.083 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115111 s, 911 MB/s 2024-09-12T17:07:29.126 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:29.125+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:29.183 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T17:07:29.185 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.17 2024-09-12T17:07:29.185 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:29.185 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 18 2024-09-12T17:07:29.201 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:29.201 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:29.201 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.013317 s, 787 MB/s 2024-09-12T17:07:29.207 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:29.207 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:29.222 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:07:29.227 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:29.225+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:29.311 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.18 2024-09-12T17:07:29.311 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:29.311 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 19 2024-09-12T17:07:29.323 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:29.323 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:29.323 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105692 s, 992 MB/s 2024-09-12T17:07:29.327 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:29.324+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:29.392 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:29.393 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:29.407 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:07:29.428 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.19 2024-09-12T17:07:29.428 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:29.428 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 20 2024-09-12T17:07:29.429 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:29.424+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:29.440 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:29.440 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:29.440 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00938083 s, 1.1 GB/s 2024-09-12T17:07:29.529 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:29.524+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:29.553 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.20 2024-09-12T17:07:29.554 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:29.554 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 21 2024-09-12T17:07:29.561 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:29.561 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:29.567 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:29.567 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:29.567 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111903 s, 937 MB/s 2024-09-12T17:07:29.577 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:07:29.668 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:29.664+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:29.689 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.21 2024-09-12T17:07:29.689 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:29.689 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 22 2024-09-12T17:07:29.702 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:29.702 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:29.702 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104887 s, 1000 MB/s 2024-09-12T17:07:29.731 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:29.729+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:29.749 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:29.750 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:29.766 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:07:29.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:07:29.828 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.22 2024-09-12T17:07:29.828 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:29.828 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 23 2024-09-12T17:07:29.839 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:29.839 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:29.839 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00958336 s, 1.1 GB/s 2024-09-12T17:07:29.839 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:29.836+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:29.932 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:29.929+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:29.942 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:29.943 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.23 2024-09-12T17:07:29.943 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:29.943 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 24 2024-09-12T17:07:29.954 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:29.954 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:29.954 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00946532 s, 1.1 GB/s 2024-09-12T17:07:29.961 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:07:29.976 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:29.977 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:29.996 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:29.997 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:30.022 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:30.023 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:30.033 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:30.029+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:30.041 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:30.042 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:30.064 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:30.064 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:30.064 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.24 2024-09-12T17:07:30.065 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:30.065 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 25 2024-09-12T17:07:30.079 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:30.079 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:30.079 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0132875 s, 789 MB/s 2024-09-12T17:07:30.092 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:30.092 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:30.099 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:30.100 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:30.100 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:30.100 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:30.100 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:30.115 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:30.115 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:30.118 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:07:30.137 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:30.138 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:30.138 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:30.132+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:30.185 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.25 2024-09-12T17:07:30.185 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:30.185 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 26 2024-09-12T17:07:30.196 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:30.196 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:30.197 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00896664 s, 1.2 GB/s 2024-09-12T17:07:30.235 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:30.228+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:30.263 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:30.263 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1170 3.21 3:87f83b83:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.953250741000002, 2024-09-12T17:07:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019752527999999998, 2024-09-12T17:07:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.264 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1170 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.265 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307314+0000", 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.734e-06 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308952+0000", 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016376190000000001 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308985+0000", 2024-09-12T17:07:30.266 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3624000000000002e-05 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308999+0000", 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3127e-05 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309087+0000", 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8244000000000004e-05 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.267 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309212+0000", 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012551500000000001 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309309+0000", 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7157000000000005e-05 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.314345+0000", 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050351900000000002 2024-09-12T17:07:30.268 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.326922+0000", 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012577319 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327013+0000", 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0801e-05 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.269 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327065+0000", 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2197999999999997e-05 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1173 3.1c 3:3ac09143:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.920890125, 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023664096999999999, 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.270 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1173 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.271 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339676+0000", 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341224+0000", 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015477679999999999 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341253+0000", 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9094999999999998e-05 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341267+0000", 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3624e-05 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341349+0000", 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1766000000000003e-05 2024-09-12T17:07:30.273 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341485+0000", 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013647099999999999 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341587+0000", 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010150899999999999 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.274 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.345980+0000", 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043931990000000004 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363206+0000", 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017225963 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363278+0000", 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2577999999999995e-05 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.275 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363337+0000", 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8839999999999999e-05 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1185 3.2d e63/24 3:b71e7b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_23:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.789932619999998, 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011225964, 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.276 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470631+0000", 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.277 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.470633+0000", 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8210000000000002e-06 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475312+0000", 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046786600000000003 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475342+0000", 2024-09-12T17:07:30.278 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0179999999999999e-05 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475357+0000", 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4290999999999999e-05 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475443+0000", 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6370000000000001e-05 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.279 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.475470+0000", 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7478999999999999e-05 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.481792+0000", 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063212930000000004 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.481857+0000", 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4869999999999994e-05 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.280 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1218 3.21 3:84169186:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.232069503999998, 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018163809, 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.281 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1218 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.282 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028495+0000", 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7850000000000001e-06 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030091+0000", 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015958260000000001 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030124+0000", 2024-09-12T17:07:30.283 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2990000000000001e-05 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030144+0000", 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9381e-05 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030232+0000", 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8494999999999999e-05 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.284 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030355+0000", 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012280700000000001 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030508+0000", 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015261300000000001 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.035197+0000", 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046889339999999996 2024-09-12T17:07:30.285 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046453+0000", 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011256339000000001 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046565+0000", 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112521 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046658+0000", 2024-09-12T17:07:30.286 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2118000000000001e-05 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1235 3.1c 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.702583771, 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027479018000000001, 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.287 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1235 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:30.288 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557983+0000", 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.941e-06 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560826+0000", 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028422479999999999 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.289 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560855+0000", 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8999000000000001e-05 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560870+0000", 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5231999999999999e-05 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560956+0000", 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6391999999999995e-05 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.290 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561123+0000", 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016676199999999999 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561284+0000", 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160672 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.567185+0000", 2024-09-12T17:07:30.291 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059013720000000002 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585343+0000", 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018157514999999999 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585409+0000", 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6210999999999993e-05 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.292 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.293 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585458+0000", 2024-09-12T17:07:30.293 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9673999999999999e-05 2024-09-12T17:07:30.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.293 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.293 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.293 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.293 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.293 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1244 3.1a e63/51 3:594e2ce7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_16:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:30.293 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.675971+0000", 2024-09-12T17:07:30.293 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.584591707000001, 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011889952000000001, 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.675971+0000", 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.294 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.675971+0000", 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.675975+0000", 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0570000000000001e-06 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681452+0000", 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054770540000000003 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.295 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681499+0000", 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7431e-05 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681515+0000", 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6248000000000001e-05 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681596+0000", 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1157999999999998e-05 2024-09-12T17:07:30.296 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.681625+0000", 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8158999999999999e-05 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.687775+0000", 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006150183 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.297 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.687861+0000", 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6662000000000005e-05 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1266 3.0 3:00469398:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.007789463999998, 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017314286000000002, 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1266 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.299 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252779+0000", 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0749999999999997e-06 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.255994+0000", 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032153389999999998 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.300 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256031+0000", 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7017000000000002e-05 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256048+0000", 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6412000000000001e-05 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256133+0000", 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5282000000000001e-05 2024-09-12T17:07:30.301 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256307+0000", 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017426299999999999 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256441+0000", 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013364200000000001 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.302 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.263259+0000", 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068185850000000003 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.269955+0000", 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006695884 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.270031+0000", 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6227e-05 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.303 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.304 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.304 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.270088+0000", 2024-09-12T17:07:30.304 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6560000000000001e-05 2024-09-12T17:07:30.304 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.304 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.304 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.304 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.304 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.304 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1270 3.1c 3:3a10adff:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.304 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.961268267000001, 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015927516999999999, 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1270 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.305 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:30.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:30.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.306 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.306 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.306 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299298+0000", 2024-09-12T17:07:30.306 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4750000000000002e-06 2024-09-12T17:07:30.306 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301014+0000", 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017152479999999999 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301037+0000", 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3227999999999999e-05 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301047+0000", 2024-09-12T17:07:30.307 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0210999999999999e-05 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301122+0000", 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4762e-05 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301251+0000", 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129388 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.308 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301358+0000", 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010699199999999999 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.306720+0000", 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053618620000000002 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315142+0000", 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084221739999999993 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.309 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315186+0000", 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3257999999999998e-05 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315222+0000", 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6918999999999997e-05 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.310 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1277 3.4 3:23471f80:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.371714+0000", 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.888849479000001, 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013608876000000001, 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1277 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.311 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.371714+0000", 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.371714+0000", 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.371717+0000", 2024-09-12T17:07:30.312 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3289999999999998e-06 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373422+0000", 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001704501 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373445+0000", 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3396000000000001e-05 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.313 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373458+0000", 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2728000000000001e-05 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373550+0000", 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2731000000000004e-05 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373721+0000", 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017056800000000001 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.314 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.373882+0000", 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016094899999999999 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.379438+0000", 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055562179999999999 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.385201+0000", 2024-09-12T17:07:30.315 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0057630659999999998 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.385267+0000", 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6149999999999995e-05 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.385323+0000", 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.524e-05 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.316 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1280 3.2d e63/24 3:b42c98cf:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_24:head v 63'5, mlcod=63'3)", 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.449722+0000", 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 16.810841636999999, 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010850079, 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.449722+0000", 2024-09-12T17:07:30.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.449722+0000", 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.449724+0000", 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.318 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453659+0000", 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039347560000000002 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453693+0000", 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3866999999999999e-05 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453707+0000", 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4477e-05 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453792+0000", 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5101999999999999e-05 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.453820+0000", 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7881e-05 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.460520+0000", 2024-09-12T17:07:30.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066994699999999999 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.460572+0000", 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2138999999999997e-05 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1370 3.0 3:012d3768:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:30.321 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.107968022, 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016632968000000001, 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1370 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:30.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152598+0000", 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2969999999999999e-06 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154241+0000", 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016424709999999999 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154278+0000", 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7419000000000002e-05 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154295+0000", 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6841999999999999e-05 2024-09-12T17:07:30.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154387+0000", 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2239999999999998e-05 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154532+0000", 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014412499999999999 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154646+0000", 2024-09-12T17:07:30.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114047 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.159659+0000", 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050133189999999996 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169086+0000", 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0094265870000000002 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.326 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169163+0000", 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7793000000000005e-05 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169228+0000", 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4827999999999997e-05 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.327 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1373 3.2d e64/24 3:b512a50c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_5:head v 64'8, mlcod=64'6)", 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.067992608999999, 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018448697999999999, 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192572+0000", 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6789999999999999e-06 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198743+0000", 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061702900000000001 2024-09-12T17:07:30.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198764+0000", 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1016999999999999e-05 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198774+0000", 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0387999999999999e-05 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198892+0000", 2024-09-12T17:07:30.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117761 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198917+0000", 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5060999999999999e-05 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.210945+0000", 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012028492 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.211019+0000", 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4010000000000005e-05 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1382 3.1a e64/51 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head v 64'4, mlcod=63'2)", 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.290880+0000", 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.969683021, 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014067876, 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.332 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.290880+0000", 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.290880+0000", 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.290882+0000", 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1399999999999998e-06 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295534+0000", 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046512319999999999 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295572+0000", 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8247000000000002e-05 2024-09-12T17:07:30.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295592+0000", 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0438e-05 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295699+0000", 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106328 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.295733+0000", 2024-09-12T17:07:30.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4697999999999999e-05 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304887+0000", 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0091535699999999998 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304948+0000", 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1223000000000007e-05 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.336 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1383 3.9 e64/24 3:90e43e04:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_15:head v 64'3, mlcod=63'1)", 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.300673+0000", 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.959890133, 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011288431999999999, 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.300673+0000", 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.300673+0000", 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.300676+0000", 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8449999999999999e-06 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304598+0000", 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039216670000000002 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304626+0000", 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8790999999999999e-05 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304640+0000", 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3888e-05 2024-09-12T17:07:30.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304744+0000", 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000103766 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.304782+0000", 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7673000000000003e-05 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.311893+0000", 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0071108050000000004 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.311962+0000", 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.8997000000000004e-05 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1407 3.21 3:85243711:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:30.341 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.468721122, 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020947763000000001, 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1407 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791845+0000", 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.683e-06 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796758+0000", 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049128230000000002 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796800+0000", 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2613e-05 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796819+0000", 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8632999999999999e-05 2024-09-12T17:07:30.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796934+0000", 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011525499999999999 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797083+0000", 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149376 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:30.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797216+0000", 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132848 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.804681+0000", 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0074645960000000004 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812614+0000", 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079326510000000006 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812720+0000", 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106909 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812790+0000", 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9375999999999994e-05 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.347 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1412 3.1c 3:388fdd84:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.402093229, 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016636860999999999, 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1412 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858473+0000", 2024-09-12T17:07:30.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4079999999999998e-06 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860776+0000", 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023030809999999998 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860831+0000", 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4166999999999998e-05 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860860+0000", 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8881999999999999e-05 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860980+0000", 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120155 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.861095+0000", 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011500700000000001 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.861202+0000", 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106909 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.866202+0000", 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050006260000000002 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875034+0000", 2024-09-12T17:07:30.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0088313439999999997 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875075+0000", 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1423e-05 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875107+0000", 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1859000000000001e-05 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.353 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1416 3.0 3:03f8363f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.350101082, 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023938686000000001, 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.354 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1416 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910465+0000", 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8569999999999999e-06 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912455+0000", 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019900009999999999 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912491+0000", 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5522000000000003e-05 2024-09-12T17:07:30.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912506+0000", 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5928000000000001e-05 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912607+0000", 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010094099999999999 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912784+0000", 2024-09-12T17:07:30.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000176851 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912927+0000", 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142502 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.918121+0000", 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051943290000000001 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934276+0000", 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016155426000000001 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934347+0000", 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0970000000000007e-05 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934401+0000", 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3359000000000002e-05 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.359 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1421 3.2e 3:76cf3736:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.300628576999999, 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018499980999999999, 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.360 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1421 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959937+0000", 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962168+0000", 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002231004 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962202+0000", 2024-09-12T17:07:30.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3704000000000001e-05 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962218+0000", 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5732000000000001e-05 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962302+0000", 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4165999999999993e-05 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962472+0000", 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000169863 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962643+0000", 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017084000000000001 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.967183+0000", 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045406090000000001 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978294+0000", 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011110480000000001 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978376+0000", 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2522999999999996e-05 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978435+0000", 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8425999999999999e-05 2024-09-12T17:07:30.365 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1430 3.3d e64/24 3:bdbc1043:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_24:head v 64'3, mlcod=64'1)", 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:17.056023+0000", 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.204540137, 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010994927, 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.056023+0000", 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.056023+0000", 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.056026+0000", 2024-09-12T17:07:30.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6129999999999998e-06 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058105+0000", 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020795039999999998 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058141+0000", 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5429999999999998e-05 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058157+0000", 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6008999999999999e-05 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058252+0000", 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5069999999999996e-05 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.058281+0000", 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9198000000000001e-05 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.066971+0000", 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0086899420000000008 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.067018+0000", 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7160999999999998e-05 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.370 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1747 3.2d e69/24 3:b65ccb38:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.1WIPq_cHo5kI8P6J6YoSpzHQu4w7UKi_1:head v 69'10, mlcod=64'8)", 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:27.383827+0000", 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.8767358989999998, 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017674796999999999, 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.383827+0000", 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.383827+0000", 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.383828+0000", 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4699999999999998e-07 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.391101+0000", 2024-09-12T17:07:30.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0072731100000000002 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.391128+0000", 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7373999999999999e-05 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.391143+0000", 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4960000000000001e-05 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.391254+0000", 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011067500000000001 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.391292+0000", 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7987000000000001e-05 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.401379+0000", 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010086918 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.401502+0000", 2024-09-12T17:07:30.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123526 2024-09-12T17:07:30.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.375 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.375 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.375 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:30.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:07:30.377 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.26 2024-09-12T17:07:30.377 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:30.377 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 27 2024-09-12T17:07:30.377 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:30.378 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:30.378 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113567 s, 923 MB/s 2024-09-12T17:07:30.378 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:30.373+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:30.428 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.27 2024-09-12T17:07:30.428 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:30.428 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 28 2024-09-12T17:07:30.443 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:30.443 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:30.443 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120044 s, 873 MB/s 2024-09-12T17:07:30.478 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:30.477+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:30.545 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.28 2024-09-12T17:07:30.545 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:30.545 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 29 2024-09-12T17:07:30.556 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:30.556 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:30.556 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00968662 s, 1.1 GB/s 2024-09-12T17:07:30.560 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:30.560 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:30.561 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:30.561 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:30.572 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:07:30.579 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:30.577+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:30.666 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.29 2024-09-12T17:07:30.667 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:30.667 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 30 2024-09-12T17:07:30.678 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:30.678 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:30.678 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00950158 s, 1.1 GB/s 2024-09-12T17:07:30.679 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:30.677+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:30.757 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:30.757 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:30.757 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:30.758 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:30.758 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:30.776 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:07:30.780 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:30.777+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:30.801 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.30 2024-09-12T17:07:30.802 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:30.802 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 31 2024-09-12T17:07:30.812 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:30.812 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:30.812 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00898566 s, 1.2 GB/s 2024-09-12T17:07:30.881 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:30.877+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:30.915 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:30.916 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:30.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:30.916 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:30.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.916 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1174 3.27 3:e7a048aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.916 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:30.916 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.561008331, 2024-09-12T17:07:30.916 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017154674000000002, 2024-09-12T17:07:30.916 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.916 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1174 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:30.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350915+0000", 2024-09-12T17:07:30.918 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9500000000000001e-06 2024-09-12T17:07:30.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.918 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.918 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352415+0000", 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001500234 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352436+0000", 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0662999999999999e-05 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352446+0000", 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8630000000000003e-06 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.919 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352517+0000", 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1267999999999996e-05 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352657+0000", 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140252 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352747+0000", 2024-09-12T17:07:30.920 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9744e-05 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.357398+0000", 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004650469 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.367954+0000", 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010556592 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.921 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.368017+0000", 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3237000000000005e-05 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.368067+0000", 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9401999999999999e-05 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.922 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1175 3.27 3:e584c994:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.549579666, 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017138075999999999, 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1175 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.923 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362344+0000", 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1209999999999998e-06 2024-09-12T17:07:30.924 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363815+0000", 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00147124 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363838+0000", 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3130999999999999e-05 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.925 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363850+0000", 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1742999999999999e-05 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363938+0000", 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7649000000000001e-05 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.364120+0000", 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018224699999999999 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.926 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:30.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.364286+0000", 2024-09-12T17:07:30.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000166293 2024-09-12T17:07:30.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.369965+0000", 2024-09-12T17:07:30.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056791009999999998 2024-09-12T17:07:30.927 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.927 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.927 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.927 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379306+0000", 2024-09-12T17:07:30.927 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0093409119999999998 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379401+0000", 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4839000000000005e-05 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379479+0000", 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7799999999999994e-05 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.928 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.929 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.929 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1184 3.2 3:40bd418a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.929 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:30.929 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.457786225, 2024-09-12T17:07:30.929 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017076502, 2024-09-12T17:07:30.929 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.929 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.929 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.929 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.929 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1184 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.930 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454137+0000", 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1820000000000002e-06 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455769+0000", 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001632 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455796+0000", 2024-09-12T17:07:30.931 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6446000000000001e-05 2024-09-12T17:07:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455808+0000", 2024-09-12T17:07:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1652e-05 2024-09-12T17:07:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455886+0000", 2024-09-12T17:07:30.932 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8123999999999999e-05 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.456057+0000", 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170848 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.456221+0000", 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000164284 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.933 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.462621+0000", 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063999469999999996 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471114+0000", 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084932219999999999 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471158+0000", 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3843e-05 2024-09-12T17:07:30.934 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471211+0000", 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2954000000000002e-05 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1201 3.8 3:114be366:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.098967996999999, 2024-09-12T17:07:30.935 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021172410999999999, 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1201 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:30.936 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812956+0000", 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3050000000000001e-06 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.937 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816133+0000", 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031766699999999999 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816165+0000", 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2197999999999999e-05 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816177+0000", 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1973999999999999e-05 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.938 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816249+0000", 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1898999999999997e-05 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816385+0000", 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013646400000000001 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816513+0000", 2024-09-12T17:07:30.939 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128097 2024-09-12T17:07:30.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.940 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.821736+0000", 2024-09-12T17:07:30.940 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052224869999999996 2024-09-12T17:07:30.940 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.940 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.940 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834015+0000", 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012279784 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834087+0000", 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1935999999999997e-05 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834125+0000", 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7596999999999999e-05 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.941 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1202 3.2 3:421b0e45:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.089184209999999, 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018086743999999998, 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.942 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1202 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.943 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822739+0000", 2024-09-12T17:07:30.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2589999999999999e-06 2024-09-12T17:07:30.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.944 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824478+0000", 2024-09-12T17:07:30.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001739256 2024-09-12T17:07:30.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.944 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824502+0000", 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3952999999999999e-05 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824514+0000", 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2031999999999999e-05 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824577+0000", 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2793999999999995e-05 2024-09-12T17:07:30.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824714+0000", 2024-09-12T17:07:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013785199999999999 2024-09-12T17:07:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824862+0000", 2024-09-12T17:07:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147751 2024-09-12T17:07:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.830267+0000", 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054052670000000001 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840734+0000", 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010466938 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840780+0000", 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5831999999999998e-05 2024-09-12T17:07:30.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840823+0000", 2024-09-12T17:07:30.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2809999999999998e-05 2024-09-12T17:07:30.948 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.948 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.948 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.948 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1210 3.29 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.968439949, 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021481673, 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1210 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:30.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:30.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943483+0000", 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6520000000000002e-06 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945771+0000", 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022874829999999999 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945806+0000", 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4836999999999999e-05 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945820+0000", 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939e-05 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945888+0000", 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7702999999999999e-05 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946027+0000", 2024-09-12T17:07:30.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000139135 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946146+0000", 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118742 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.950285+0000", 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041384880000000001 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964885+0000", 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014600594 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964928+0000", 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2536000000000001e-05 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964962+0000", 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4564000000000003e-05 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.954 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.955 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.955 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1211 3.7 3:e386213e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.955 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:30.955 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.957386926000002, 2024-09-12T17:07:30.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018028718999999999, 2024-09-12T17:07:30.955 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.955 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.955 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.955 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1211 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:30.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954536+0000", 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.791e-06 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.955972+0000", 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001435363 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956007+0000", 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4777000000000003e-05 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956022+0000", 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5480000000000001e-05 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956094+0000", 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1515999999999998e-05 2024-09-12T17:07:30.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956229+0000", 2024-09-12T17:07:30.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551599999999999 2024-09-12T17:07:30.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:30.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956330+0000", 2024-09-12T17:07:30.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010090900000000001 2024-09-12T17:07:30.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.960617+0000", 2024-09-12T17:07:30.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042865510000000004 2024-09-12T17:07:30.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972437+0000", 2024-09-12T17:07:30.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011820169 2024-09-12T17:07:30.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972510+0000", 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3129999999999999e-05 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972562+0000", 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2516999999999999e-05 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1216 3.33 3:cf30ff9d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.961 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.903955174, 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023290796999999999, 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1216 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007968+0000", 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0580000000000002e-06 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009686+0000", 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017173920000000001 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009718+0000", 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2632999999999997e-05 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009734+0000", 2024-09-12T17:07:30.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6011999999999998e-05 2024-09-12T17:07:30.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009834+0000", 2024-09-12T17:07:30.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9947999999999999e-05 2024-09-12T17:07:30.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010000+0000", 2024-09-12T17:07:30.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016520599999999999 2024-09-12T17:07:30.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:30.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010133+0000", 2024-09-12T17:07:30.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133676 2024-09-12T17:07:30.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.015744+0000", 2024-09-12T17:07:30.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056104570000000001 2024-09-12T17:07:30.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031150+0000", 2024-09-12T17:07:30.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015405894999999999 2024-09-12T17:07:30.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.970 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031209+0000", 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9247999999999999e-05 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031256+0000", 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7271999999999997e-05 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1223 3.24 3:24ad2b36:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.971 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.810000604999999, 2024-09-12T17:07:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016675265000000002, 2024-09-12T17:07:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1223 2024-09-12T17:07:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101920+0000", 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.101923+0000", 2024-09-12T17:07:30.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6240000000000002e-06 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104205+0000", 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022823930000000002 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104235+0000", 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9835000000000001e-05 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104250+0000", 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4944e-05 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104325+0000", 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5728000000000004e-05 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104486+0000", 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016037700000000001 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.104593+0000", 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000107487 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.108869+0000", 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042754910000000002 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118512+0000", 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0096435110000000004 2024-09-12T17:07:30.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118557+0000", 2024-09-12T17:07:30.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4608999999999999e-05 2024-09-12T17:07:30.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.977 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.118595+0000", 2024-09-12T17:07:30.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8266000000000003e-05 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1230 3.24 3:257b3201:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.428686122999999, 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018874753000000001, 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.978 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1230 2024-09-12T17:07:30.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.979 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:30.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483238+0000", 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2880000000000001e-06 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485868+0000", 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026303490000000001 2024-09-12T17:07:30.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485904+0000", 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5513999999999999e-05 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485920+0000", 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6201999999999998e-05 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486092+0000", 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017220700000000001 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486500+0000", 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040771200000000002 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486750+0000", 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025026699999999998 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.500598+0000", 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013848226 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.501939+0000", 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013409839999999999 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502016+0000", 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6908000000000003e-05 2024-09-12T17:07:30.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502109+0000", 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3096000000000004e-05 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1257 3.19 3:9b556f07:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.131835+0000", 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.780085691, 2024-09-12T17:07:30.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016443860000000001, 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1257 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.131835+0000", 2024-09-12T17:07:30.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.131835+0000", 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.131838+0000", 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.517e-06 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133842+0000", 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020036479999999998 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133874+0000", 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1594000000000003e-05 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133885+0000", 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1691e-05 2024-09-12T17:07:30.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.133964+0000", 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9155999999999999e-05 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.134163+0000", 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019894699999999999 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:30.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.134300+0000", 2024-09-12T17:07:30.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000137105 2024-09-12T17:07:30.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.139969+0000", 2024-09-12T17:07:30.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056682499999999997 2024-09-12T17:07:30.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.148163+0000", 2024-09-12T17:07:30.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0081945920000000005 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.148215+0000", 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.185e-05 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.148279+0000", 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3509999999999993e-05 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1261 3.33 3:cc53a442:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.722546705999999, 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017162891, 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1261 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:30.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189377+0000", 2024-09-12T17:07:30.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.039e-06 2024-09-12T17:07:30.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:30.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192004+0000", 2024-09-12T17:07:30.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026268900000000002 2024-09-12T17:07:30.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:30.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192041+0000", 2024-09-12T17:07:30.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6838000000000002e-05 2024-09-12T17:07:30.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:30.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192055+0000", 2024-09-12T17:07:30.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4446e-05 2024-09-12T17:07:30.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192223+0000", 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016760200000000001 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192514+0000", 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00029128900000000002 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192760+0000", 2024-09-12T17:07:30.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024571700000000001 2024-09-12T17:07:30.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:30.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.201494+0000", 2024-09-12T17:07:30.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0087345800000000005 2024-09-12T17:07:30.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:30.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206464+0000", 2024-09-12T17:07:30.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00497007 2024-09-12T17:07:30.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206505+0000", 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0528999999999998e-05 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206537+0000", 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1890999999999997e-05 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1263 3.27 3:e7aec214:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.220304+0000", 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.691616238999998, 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016093784999999999, 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1263 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.998 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:30.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:30.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.220304+0000", 2024-09-12T17:07:30.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:30.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.220304+0000", 2024-09-12T17:07:30.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:30.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:30.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:30.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.220309+0000", 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.1490000000000002e-06 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.223929+0000", 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036199650000000002 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.223972+0000", 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2824999999999997e-05 2024-09-12T17:07:31.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.223996+0000", 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4039000000000001e-05 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.224102+0000", 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105654 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:31.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.224301+0000", 2024-09-12T17:07:31.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019872800000000001 2024-09-12T17:07:31.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:31.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.224487+0000", 2024-09-12T17:07:31.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018613899999999999 2024-09-12T17:07:31.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:31.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.230720+0000", 2024-09-12T17:07:31.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0062332689999999996 2024-09-12T17:07:31.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.236271+0000", 2024-09-12T17:07:31.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055509349999999999 2024-09-12T17:07:31.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:31.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.236345+0000", 2024-09-12T17:07:31.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4400999999999995e-05 2024-09-12T17:07:31.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:31.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.236398+0000", 2024-09-12T17:07:31.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2680999999999999e-05 2024-09-12T17:07:31.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.004 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:31.004 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1369 3.19 3:9a84d0e6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.141780+0000", 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.770140146999999, 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016456490000000001, 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1369 2024-09-12T17:07:31.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.006 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:31.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:31.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.141780+0000", 2024-09-12T17:07:31.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:31.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.141780+0000", 2024-09-12T17:07:31.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.141785+0000", 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.335e-06 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143672+0000", 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018877659999999999 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143701+0000", 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8415000000000002e-05 2024-09-12T17:07:31.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143715+0000", 2024-09-12T17:07:31.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4430000000000001e-05 2024-09-12T17:07:31.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:31.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.143805+0000", 2024-09-12T17:07:31.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9475000000000006e-05 2024-09-12T17:07:31.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.144006+0000", 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020146399999999999 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.144186+0000", 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000180161 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.149534+0000", 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053479859999999999 2024-09-12T17:07:31.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.158103+0000", 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0085683849999999995 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.158178+0000", 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5605000000000005e-05 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:31.010 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.158237+0000", 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8468000000000003e-05 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1372 3.15 e64/24 3:a8d86e21:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_4:head v 64'3, mlcod=63'1)", 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.183175+0000", 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.728745285, 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016505895, 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:31.011 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.183175+0000", 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.183175+0000", 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.183178+0000", 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8559999999999998e-06 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192166+0000", 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089874199999999994 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192189+0000", 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3983000000000001e-05 2024-09-12T17:07:31.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192199+0000", 2024-09-12T17:07:31.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0000000000000001e-05 2024-09-12T17:07:31.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:31.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192282+0000", 2024-09-12T17:07:31.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2905999999999995e-05 2024-09-12T17:07:31.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192310+0000", 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7571000000000001e-05 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.199614+0000", 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.007303543 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.199681+0000", 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7615999999999998e-05 2024-09-12T17:07:31.015 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1375 3.29 3:95c1ad90:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.70642804, 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016791820999999998, 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:31.016 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1375 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:31.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205496+0000", 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7220000000000001e-06 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208326+0000", 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028297270000000002 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208353+0000", 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6675000000000001e-05 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208365+0000", 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2006e-05 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208450+0000", 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4958999999999998e-05 2024-09-12T17:07:31.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208666+0000", 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021668300000000001 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208858+0000", 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000191707 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:31.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.215258+0000", 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0064000439999999997 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222154+0000", 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068963949999999996 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222230+0000", 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5320000000000004e-05 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222284+0000", 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4583000000000002e-05 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1387 3.8 3:122cdcfa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.573631783, 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018409291000000001, 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:31.022 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1387 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:31.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:31.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:31.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338292+0000", 2024-09-12T17:07:31.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.631e-06 2024-09-12T17:07:31.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:31.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340227+0000", 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001934217 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340262+0000", 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5893999999999999e-05 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340278+0000", 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5325e-05 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340387+0000", 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010876 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340570+0000", 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018296299999999999 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340735+0000", 2024-09-12T17:07:31.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568400000000001 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.345914+0000", 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051783319999999999 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356536+0000", 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010622529 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356632+0000", 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5927000000000005e-05 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356698+0000", 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6029000000000001e-05 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.028 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1427 3.7 3:e327d833:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:31.029 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:31.029 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.888278079999999, 2024-09-12T17:07:31.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017016304999999999, 2024-09-12T17:07:31.029 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:31.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:31.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:31.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:31.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1427 2024-09-12T17:07:31.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.029 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023646+0000", 2024-09-12T17:07:31.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2590000000000001e-06 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024847+0000", 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001201674 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024879+0000", 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1636e-05 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024894+0000", 2024-09-12T17:07:31.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4613000000000001e-05 2024-09-12T17:07:31.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:31.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024980+0000", 2024-09-12T17:07:31.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-05 2024-09-12T17:07:31.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:31.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.025132+0000", 2024-09-12T17:07:31.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152242 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.025252+0000", 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119731 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.029896+0000", 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046442810000000001 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040528+0000", 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010631508 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040600+0000", 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2125999999999994e-05 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040659+0000", 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9074999999999999e-05 2024-09-12T17:07:31.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1733 3.33 3:cd3b7926:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.M8SFsRZfEjvXnxNc1Ny07cg_vtwVJ9y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.8443221909999998, 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024112788, 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:31.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1733 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:31.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067603+0000", 2024-09-12T17:07:31.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.707e-06 2024-09-12T17:07:31.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:31.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072541+0000", 2024-09-12T17:07:31.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049382710000000002 2024-09-12T17:07:31.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072582+0000", 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0392999999999998e-05 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072606+0000", 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4303000000000001e-05 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072745+0000", 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013889300000000001 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072967+0000", 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022192800000000001 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.073233+0000", 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026631499999999999 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.086312+0000", 2024-09-12T17:07:31.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013078579 2024-09-12T17:07:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091563+0000", 2024-09-12T17:07:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052509369999999998 2024-09-12T17:07:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091648+0000", 2024-09-12T17:07:31.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5051999999999998e-05 2024-09-12T17:07:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091711+0000", 2024-09-12T17:07:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3410000000000004e-05 2024-09-12T17:07:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.041 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1887 3.33 3:cf01266b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.yI34Oa84OEb7C49UYPF9HCMJS_d1s3T_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.64883483399999997, 2024-09-12T17:07:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018315027000000001, 2024-09-12T17:07:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1887 2024-09-12T17:07:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.042 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263090+0000", 2024-09-12T17:07:31.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0239999999999999e-06 2024-09-12T17:07:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265411+0000", 2024-09-12T17:07:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00232132 2024-09-12T17:07:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265443+0000", 2024-09-12T17:07:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1718999999999999e-05 2024-09-12T17:07:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265455+0000", 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2143999999999999e-05 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265535+0000", 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9659000000000004e-05 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265655+0000", 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120902 2024-09-12T17:07:31.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265755+0000", 2024-09-12T17:07:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9761999999999998e-05 2024-09-12T17:07:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.272399+0000", 2024-09-12T17:07:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066442510000000003 2024-09-12T17:07:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281321+0000", 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089219669999999994 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281358+0000", 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6355e-05 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281401+0000", 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2923999999999998e-05 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.047 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:31.048 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:31.048 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:31.049 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:07:31.050 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.31 2024-09-12T17:07:31.050 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:31.050 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 32 2024-09-12T17:07:31.050 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:31.051 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:31.051 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00880774 s, 1.2 GB/s 2024-09-12T17:07:31.051 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:31.044+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:31.081 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.32 2024-09-12T17:07:31.081 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:31.081 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 33 2024-09-12T17:07:31.097 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:31.097 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:31.097 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0129364 s, 811 MB/s 2024-09-12T17:07:31.150 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:31.144+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:31.184 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:31.184 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:31.184 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:31.200 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:07:31.211 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T17:07:31.235 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.33 2024-09-12T17:07:31.235 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:31.235 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 34 2024-09-12T17:07:31.250 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:31.250 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:31.250 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124843 s, 840 MB/s 2024-09-12T17:07:31.251 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:31.249+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:31.330 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:31.330 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:31.330 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:31.347 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:07:31.355 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.34 2024-09-12T17:07:31.355 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:31.355 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 35 2024-09-12T17:07:31.371 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:31.371 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:31.371 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0126852 s, 827 MB/s 2024-09-12T17:07:31.391 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:31.389+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:31.451 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:31.449+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:31.464 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.35 2024-09-12T17:07:31.464 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:31.464 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 36 2024-09-12T17:07:31.478 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:31.478 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:31.478 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112161 s, 935 MB/s 2024-09-12T17:07:31.521 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:31.521 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1188 3.31 3:8d857c15:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.02293551, 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019168672000000001, 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1188 2024-09-12T17:07:31.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493824+0000", 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.553e-06 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497820+0000", 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039958659999999998 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497855+0000", 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4956000000000002e-05 2024-09-12T17:07:31.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497872+0000", 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6863000000000001e-05 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497996+0000", 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124306 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498229+0000", 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023307699999999999 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498994+0000", 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076469699999999995 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.507996+0000", 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090021540000000001 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512687+0000", 2024-09-12T17:07:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046905360000000004 2024-09-12T17:07:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512861+0000", 2024-09-12T17:07:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017420399999999999 2024-09-12T17:07:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.527 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512990+0000", 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012946 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1203 3.3 3:c32b8ddb:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.670022252999999, 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018231720999999999, 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.528 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1203 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846735+0000", 2024-09-12T17:07:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.846738+0000", 2024-09-12T17:07:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1990000000000002e-06 2024-09-12T17:07:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852055+0000", 2024-09-12T17:07:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053168080000000001 2024-09-12T17:07:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852093+0000", 2024-09-12T17:07:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8682e-05 2024-09-12T17:07:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852111+0000", 2024-09-12T17:07:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7153e-05 2024-09-12T17:07:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852292+0000", 2024-09-12T17:07:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018150999999999999 2024-09-12T17:07:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852527+0000", 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023529000000000001 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.852761+0000", 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023386500000000001 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864541+0000", 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011779367000000001 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864784+0000", 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000242861 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864885+0000", 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000101124 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.864967+0000", 2024-09-12T17:07:31.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.1861999999999997e-05 2024-09-12T17:07:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1210 3.29 e63/24 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.569321852000002, 2024-09-12T17:07:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018233155000000001, 2024-09-12T17:07:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.535 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947435+0000", 2024-09-12T17:07:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.947437+0000", 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3039999999999999e-06 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953449+0000", 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0060117130000000001 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953487+0000", 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.748e-05 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953504+0000", 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7343e-05 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953639+0000", 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013447700000000001 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.953683+0000", 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4521999999999998e-05 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.965566+0000", 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011883138 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.965668+0000", 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000102178 2024-09-12T17:07:31.539 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1232 3.14 3:2967aafe:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.996482602, 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019509183999999999, 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.540 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1232 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:31.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520278+0000", 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9539999999999998e-06 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525478+0000", 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005199665 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525520+0000", 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2391999999999997e-05 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525542+0000", 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1613000000000001e-05 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525676+0000", 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013434300000000001 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525933+0000", 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025640400000000001 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.526162+0000", 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228722 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.534431+0000", 2024-09-12T17:07:31.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082696019999999992 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539449+0000", 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050177099999999999 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539640+0000", 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190812 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539784+0000", 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143967 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1234 3.3 3:c0bf349d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.971311657000001, 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019413466000000001, 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.546 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1234 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545450+0000", 2024-09-12T17:07:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.313e-06 2024-09-12T17:07:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549431+0000", 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039813139999999997 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549472+0000", 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0828999999999998e-05 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549491+0000", 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9055999999999998e-05 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549627+0000", 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013646700000000001 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549859+0000", 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023186100000000001 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.550208+0000", 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000348372 2024-09-12T17:07:31.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.559516+0000", 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093083260000000004 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564688+0000", 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051717849999999999 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564783+0000", 2024-09-12T17:07:31.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4821000000000006e-05 2024-09-12T17:07:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564859+0000", 2024-09-12T17:07:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6322000000000006e-05 2024-09-12T17:07:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1235 3.1c e63/45 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.954245521000001, 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023527869, 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:31.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562514+0000", 2024-09-12T17:07:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:31.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570603+0000", 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080886359999999997 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570630+0000", 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7276000000000001e-05 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570642+0000", 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2153e-05 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570805+0000", 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016319899999999999 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570900+0000", 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4988000000000006e-05 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.585884+0000", 2024-09-12T17:07:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014984046000000001 2024-09-12T17:07:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.586039+0000", 2024-09-12T17:07:31.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155184 2024-09-12T17:07:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1238 3.3 3:c2fc49d9:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.926264079999999, 2024-09-12T17:07:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018644582999999999, 2024-09-12T17:07:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.558 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1238 2024-09-12T17:07:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590496+0000", 2024-09-12T17:07:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4400000000000001e-06 2024-09-12T17:07:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596047+0000", 2024-09-12T17:07:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055506599999999998 2024-09-12T17:07:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596086+0000", 2024-09-12T17:07:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9326000000000003e-05 2024-09-12T17:07:31.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596106+0000", 2024-09-12T17:07:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9119000000000001e-05 2024-09-12T17:07:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596263+0000", 2024-09-12T17:07:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015771700000000001 2024-09-12T17:07:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596516+0000", 2024-09-12T17:07:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025320799999999999 2024-09-12T17:07:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596769+0000", 2024-09-12T17:07:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025305400000000001 2024-09-12T17:07:31.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.605151+0000", 2024-09-12T17:07:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.008381833 2024-09-12T17:07:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.608970+0000", 2024-09-12T17:07:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038186660000000001 2024-09-12T17:07:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.609064+0000", 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4438000000000006e-05 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.609138+0000", 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3121999999999995e-05 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.566 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1244 3.1a 3:594e2ce7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.845889946, 2024-09-12T17:07:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018879997999999999, 2024-09-12T17:07:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.567 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1244 2024-09-12T17:07:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670871+0000", 2024-09-12T17:07:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0459999999999999e-06 2024-09-12T17:07:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675701+0000", 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048294169999999999 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675740+0000", 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9592999999999999e-05 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675758+0000", 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.77e-05 2024-09-12T17:07:31.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675939+0000", 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018083199999999999 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.676345+0000", 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040617099999999998 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.676719+0000", 2024-09-12T17:07:31.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037385800000000002 2024-09-12T17:07:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.688469+0000", 2024-09-12T17:07:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01174979 2024-09-12T17:07:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689374+0000", 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00090544200000000001 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689551+0000", 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017685300000000001 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689747+0000", 2024-09-12T17:07:31.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019629599999999999 2024-09-12T17:07:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1247 3.1a 3:58056b43:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.815719478999998, 2024-09-12T17:07:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021958978000000001, 2024-09-12T17:07:31.574 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.575 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1247 2024-09-12T17:07:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:31.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701041+0000", 2024-09-12T17:07:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9399999999999998e-06 2024-09-12T17:07:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705529+0000", 2024-09-12T17:07:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044889789999999997 2024-09-12T17:07:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705569+0000", 2024-09-12T17:07:31.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9606e-05 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705588+0000", 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9375999999999999e-05 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705756+0000", 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016734200000000001 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706045+0000", 2024-09-12T17:07:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028885400000000001 2024-09-12T17:07:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706343+0000", 2024-09-12T17:07:31.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029790300000000002 2024-09-12T17:07:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720973+0000", 2024-09-12T17:07:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014630684 2024-09-12T17:07:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722653+0000", 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016799790000000001 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722878+0000", 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022488799999999999 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722997+0000", 2024-09-12T17:07:31.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118427 2024-09-12T17:07:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1376 3.3 3:c01937d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.297530571999999, 2024-09-12T17:07:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020435229999999999, 2024-09-12T17:07:31.586 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1376 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219230+0000", 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.23e-06 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223391+0000", 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041610629999999996 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223425+0000", 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4167e-05 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223443+0000", 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8105999999999999e-05 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223562+0000", 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118861 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223840+0000", 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027762099999999998 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.224077+0000", 2024-09-12T17:07:31.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023720100000000001 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.232976+0000", 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0088992900000000007 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239478+0000", 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065023609999999999 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239574+0000", 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5527999999999997e-05 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239662+0000", 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7801999999999997e-05 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1382 3.1a 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:31.592 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.230863619999999, 2024-09-12T17:07:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020895593, 2024-09-12T17:07:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1382 2024-09-12T17:07:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285897+0000", 2024-09-12T17:07:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6669999999999998e-06 2024-09-12T17:07:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290617+0000", 2024-09-12T17:07:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047198689999999998 2024-09-12T17:07:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290657+0000", 2024-09-12T17:07:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0201999999999999e-05 2024-09-12T17:07:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290676+0000", 2024-09-12T17:07:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9293e-05 2024-09-12T17:07:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290860+0000", 2024-09-12T17:07:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000183353 2024-09-12T17:07:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291264+0000", 2024-09-12T17:07:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040463800000000002 2024-09-12T17:07:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:31.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291676+0000", 2024-09-12T17:07:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041151499999999999 2024-09-12T17:07:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301391+0000", 2024-09-12T17:07:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0097147350000000004 2024-09-12T17:07:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306412+0000", 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050210790000000003 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306636+0000", 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000224589 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306789+0000", 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015265299999999999 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.599 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1385 3.34 3:2f3cb087:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.198838514, 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024744103999999999, 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.600 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1385 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317922+0000", 2024-09-12T17:07:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.157e-06 2024-09-12T17:07:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322800+0000", 2024-09-12T17:07:31.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048785879999999997 2024-09-12T17:07:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322846+0000", 2024-09-12T17:07:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5732999999999997e-05 2024-09-12T17:07:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322866+0000", 2024-09-12T17:07:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0415999999999999e-05 2024-09-12T17:07:31.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323048+0000", 2024-09-12T17:07:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018128 2024-09-12T17:07:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323496+0000", 2024-09-12T17:07:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044786400000000002 2024-09-12T17:07:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323919+0000", 2024-09-12T17:07:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042374399999999999 2024-09-12T17:07:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.340076+0000", 2024-09-12T17:07:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016156925999999999 2024-09-12T17:07:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342379+0000", 2024-09-12T17:07:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023025189999999998 2024-09-12T17:07:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342546+0000", 2024-09-12T17:07:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016719599999999999 2024-09-12T17:07:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342663+0000", 2024-09-12T17:07:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116681 2024-09-12T17:07:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1409 3.a e64/24 3:53d4fdcd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_3:head v 64'6, mlcod=64'4)", 2024-09-12T17:07:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.695358971999999, 2024-09-12T17:07:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021472076, 2024-09-12T17:07:31.607 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821402+0000", 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4699999999999998e-06 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828337+0000", 2024-09-12T17:07:31.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069354229999999996 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828387+0000", 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9908999999999999e-05 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828412+0000", 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5389999999999999e-05 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828587+0000", 2024-09-12T17:07:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017425599999999999 2024-09-12T17:07:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828654+0000", 2024-09-12T17:07:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7708999999999998e-05 2024-09-12T17:07:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842774+0000", 2024-09-12T17:07:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014119860999999999 2024-09-12T17:07:31.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842870+0000", 2024-09-12T17:07:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6057999999999994e-05 2024-09-12T17:07:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1417 3.14 3:29a29b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.594030567000001, 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.034043223999999997, 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1417 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.613 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922731+0000", 2024-09-12T17:07:31.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1099999999999996e-06 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930785+0000", 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080541020000000005 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930841+0000", 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6005999999999999e-05 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930869+0000", 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8602000000000002e-05 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931049+0000", 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017998299999999999 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931287+0000", 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000237712 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931510+0000", 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022283200000000001 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941891+0000", 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010380785 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.955891+0000", 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014000207000000001 2024-09-12T17:07:31.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956636+0000", 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00074503099999999995 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956770+0000", 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013385400000000001 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1420 3.3 3:c118c659:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.564736751, 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022394282000000001, 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1420 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952024+0000", 2024-09-12T17:07:31.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1760000000000003e-06 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958458+0000", 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064335770000000002 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958492+0000", 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4309e-05 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958508+0000", 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5699999999999999e-05 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958717+0000", 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020871900000000001 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959163+0000", 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000446007 2024-09-12T17:07:31.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959583+0000", 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042026800000000001 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.970389+0000", 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010806375999999999 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974044+0000", 2024-09-12T17:07:31.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003654352 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974232+0000", 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018811899999999999 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974415+0000", 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018267899999999999 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.624 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1432 3.3 3:c31ee49b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.10:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:17.072308+0000", 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.444448578999999, 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018638120000000001, 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.625 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1432 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.072308+0000", 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.072308+0000", 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.072311+0000", 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6390000000000001e-06 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076248+0000", 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039373089999999999 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076285+0000", 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6470999999999997e-05 2024-09-12T17:07:31.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076301+0000", 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5693e-05 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076438+0000", 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013785100000000001 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.076696+0000", 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025774499999999998 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.077565+0000", 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000869215 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.088840+0000", 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011274273 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.090743+0000", 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0019029800000000001 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.090866+0000", 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012304300000000001 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.090947+0000", 2024-09-12T17:07:31.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.0901000000000004e-05 2024-09-12T17:07:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1896 3.2c e71/24 3:3773d78b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.27:head v 71'8, mlcod=71'6)", 2024-09-12T17:07:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.112700544, 2024-09-12T17:07:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021824796, 2024-09-12T17:07:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.631 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404059+0000", 2024-09-12T17:07:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.537e-06 2024-09-12T17:07:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408616+0000", 2024-09-12T17:07:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045564799999999999 2024-09-12T17:07:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408657+0000", 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1968000000000002e-05 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408676+0000", 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8445999999999999e-05 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408880+0000", 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020370100000000001 2024-09-12T17:07:31.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408952+0000", 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2226999999999998e-05 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.425787+0000", 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016835383999999998 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.425881+0000", 2024-09-12T17:07:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4053000000000002e-05 2024-09-12T17:07:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1917 3.1a 3:5b4c0dd7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.P_wej9y73GH8iAzyXzEiqKNwtELtJTp_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.63278815200000005, 2024-09-12T17:07:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026569157999999999, 2024-09-12T17:07:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.636 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1917 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883971+0000", 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4030000000000001e-06 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890727+0000", 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067561080000000003 2024-09-12T17:07:31.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890770+0000", 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2614999999999998e-05 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890794+0000", 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3808999999999999e-05 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890964+0000", 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000169956 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.891223+0000", 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025883600000000003 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.891466+0000", 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000242883 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.909542+0000", 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018076262999999999 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910349+0000", 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080699299999999999 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910447+0000", 2024-09-12T17:07:31.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8301999999999995e-05 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910538+0000", 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0989999999999994e-05 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1923 3.1d e71/24 3:bbfa0a4b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.RvdbUUXkO22SF-kwzRd4VKnEQTGoFzf_1:head v 71'2, mlcod=0'0)", 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:31.642 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.48244520000000002, 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020143629, 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:31.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034315+0000", 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.123e-06 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038477+0000", 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041615999999999997 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038520+0000", 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3705000000000003e-05 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038539+0000", 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8825999999999999e-05 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038679+0000", 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000140051 2024-09-12T17:07:31.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038729+0000", 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9455e-05 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054300+0000", 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015571000999999999 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054455+0000", 2024-09-12T17:07:31.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015586800000000001 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1926 3.9 3:92ed9a0c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.32:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.45721176499999999, 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019336487999999999, 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:31.647 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1926 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:31.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059548+0000", 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063544+0000", 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039964340000000001 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:31.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063587+0000", 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2701000000000003e-05 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063605+0000", 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8065999999999999e-05 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063745+0000", 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014033000000000001 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.064004+0000", 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025869899999999998 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.064666+0000", 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00066141599999999996 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.074813+0000", 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010147168 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078769+0000", 2024-09-12T17:07:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039561680000000004 2024-09-12T17:07:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078837+0000", 2024-09-12T17:07:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8089000000000005e-05 2024-09-12T17:07:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:31.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078882+0000", 2024-09-12T17:07:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4827000000000003e-05 2024-09-12T17:07:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:31.653 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:31.653 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:31.654 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.36 2024-09-12T17:07:31.654 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:31.654 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 37 2024-09-12T17:07:31.655 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:31.655 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:31.655 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107724 s, 973 MB/s 2024-09-12T17:07:31.655 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:31.648+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:31.656 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:07:31.738 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.37 2024-09-12T17:07:31.738 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:31.738 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 38 2024-09-12T17:07:31.752 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:31.753 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:31.753 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120136 s, 873 MB/s 2024-09-12T17:07:31.755 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:31.753+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:31.837 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:31.838 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:31.838 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:31.853 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:07:31.855 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:31.852+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:31.908 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.38 2024-09-12T17:07:31.908 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:31.908 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 39 2024-09-12T17:07:31.924 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:31.924 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:31.924 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128733 s, 815 MB/s 2024-09-12T17:07:31.956 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:31.953+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:32.018 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:32.018 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:32.019 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:32.035 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:07:32.067 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.39 2024-09-12T17:07:32.067 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:32.067 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 40 2024-09-12T17:07:32.083 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:32.081+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:32.083 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:32.083 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:32.083 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131497 s, 797 MB/s 2024-09-12T17:07:32.158 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:32.157+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:32.159 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:07:32.197 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T17:07:32.214 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.40 2024-09-12T17:07:32.215 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:32.215 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 41 2024-09-12T17:07:32.221 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:32.221 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:32.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:32.221 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:32.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.221 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1208 3.1f e63/24 3:fa8ff2df:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_8:head v 63'3, mlcod=63'1)", 2024-09-12T17:07:32.221 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.925779+0000", 2024-09-12T17:07:32.221 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.289912272999999, 2024-09-12T17:07:32.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018615184999999999, 2024-09-12T17:07:32.222 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.222 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.222 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.222 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.925779+0000", 2024-09-12T17:07:32.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.925779+0000", 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.925782+0000", 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.627e-06 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.931139+0000", 2024-09-12T17:07:32.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053568829999999998 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.931177+0000", 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7734999999999997e-05 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.931194+0000", 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6952999999999998e-05 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.931338+0000", 2024-09-12T17:07:32.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014459 2024-09-12T17:07:32.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.931379+0000", 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0961999999999998e-05 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.944263+0000", 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012883314999999999 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.944395+0000", 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013212 2024-09-12T17:07:32.226 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.227 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.227 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1239 3.16 3:6b2cb9ce:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:32.227 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:32.227 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.614704524, 2024-09-12T17:07:32.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021398218, 2024-09-12T17:07:32.227 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1239 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:32.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600991+0000", 2024-09-12T17:07:32.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9559999999999999e-06 2024-09-12T17:07:32.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606170+0000", 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051789460000000002 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606222+0000", 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1422000000000003e-05 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606249+0000", 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7163000000000001e-05 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606450+0000", 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000201325 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606877+0000", 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042682799999999997 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.607298+0000", 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042127700000000001 2024-09-12T17:07:32.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.615845+0000", 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0085471260000000004 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622186+0000", 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063410690000000004 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622292+0000", 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105305 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622385+0000", 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3801000000000005e-05 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1251 3.1d 3:ba0891d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:32.233 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.472365008000001, 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020778814999999999, 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1251 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743330+0000", 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7000000000000002e-06 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748572+0000", 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052414710000000002 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748616+0000", 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4369000000000002e-05 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748636+0000", 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9582999999999999e-05 2024-09-12T17:07:32.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748778+0000", 2024-09-12T17:07:32.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141867 2024-09-12T17:07:32.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749017+0000", 2024-09-12T17:07:32.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000239218 2024-09-12T17:07:32.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:32.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749233+0000", 2024-09-12T17:07:32.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021619799999999999 2024-09-12T17:07:32.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.756641+0000", 2024-09-12T17:07:32.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074078089999999996 2024-09-12T17:07:32.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763784+0000", 2024-09-12T17:07:32.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0071433809999999999 2024-09-12T17:07:32.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763958+0000", 2024-09-12T17:07:32.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000173862 2024-09-12T17:07:32.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.764106+0000", 2024-09-12T17:07:32.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014735700000000001 2024-09-12T17:07:32.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.240 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.240 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.240 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1259 3.5 3:a1f83edd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:32.240 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:32.241 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.059477140999999, 2024-09-12T17:07:32.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024500529, 2024-09-12T17:07:32.241 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.241 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.241 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.241 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.242 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1259 2024-09-12T17:07:32.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.242 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:32.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:32.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156217+0000", 2024-09-12T17:07:32.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8940000000000002e-06 2024-09-12T17:07:32.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160482+0000", 2024-09-12T17:07:32.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042645269999999997 2024-09-12T17:07:32.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160513+0000", 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1228e-05 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160526+0000", 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2976000000000001e-05 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160624+0000", 2024-09-12T17:07:32.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8048999999999996e-05 2024-09-12T17:07:32.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160825+0000", 2024-09-12T17:07:32.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020054799999999999 2024-09-12T17:07:32.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:32.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160997+0000", 2024-09-12T17:07:32.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017260499999999999 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.169300+0000", 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083027050000000005 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180595+0000", 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011294465 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180660+0000", 2024-09-12T17:07:32.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5616000000000003e-05 2024-09-12T17:07:32.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180715+0000", 2024-09-12T17:07:32.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4916000000000001e-05 2024-09-12T17:07:32.248 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.248 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.248 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.248 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1260 3.5 3:a2328a91:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:32.249 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.166866+0000", 2024-09-12T17:07:32.249 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.048825235999999, 2024-09-12T17:07:32.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018585485999999998, 2024-09-12T17:07:32.249 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.249 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.249 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.249 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.249 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.249 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.249 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1260 2024-09-12T17:07:32.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.166866+0000", 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.166866+0000", 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.166869+0000", 2024-09-12T17:07:32.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2050000000000001e-06 2024-09-12T17:07:32.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.170733+0000", 2024-09-12T17:07:32.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038638969999999998 2024-09-12T17:07:32.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.170754+0000", 2024-09-12T17:07:32.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1537999999999999e-05 2024-09-12T17:07:32.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.170767+0000", 2024-09-12T17:07:32.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2797e-05 2024-09-12T17:07:32.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.170859+0000", 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2514000000000002e-05 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.171060+0000", 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020073399999999999 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.171243+0000", 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018331099999999999 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.176876+0000", 2024-09-12T17:07:32.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056325689999999996 2024-09-12T17:07:32.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.185350+0000", 2024-09-12T17:07:32.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0084741599999999997 2024-09-12T17:07:32.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.185409+0000", 2024-09-12T17:07:32.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8628999999999997e-05 2024-09-12T17:07:32.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.185452+0000", 2024-09-12T17:07:32.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3132e-05 2024-09-12T17:07:32.255 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.255 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.255 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1262 3.5 3:a3a998f2:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.004844428999998, 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020328525, 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1262 2024-09-12T17:07:32.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.257 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:32.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:32.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210850+0000", 2024-09-12T17:07:32.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.005e-06 2024-09-12T17:07:32.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214862+0000", 2024-09-12T17:07:32.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040120640000000001 2024-09-12T17:07:32.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214903+0000", 2024-09-12T17:07:32.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0831999999999998e-05 2024-09-12T17:07:32.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214940+0000", 2024-09-12T17:07:32.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7036000000000003e-05 2024-09-12T17:07:32.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215059+0000", 2024-09-12T17:07:32.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118631 2024-09-12T17:07:32.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215237+0000", 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017834900000000001 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215406+0000", 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016896200000000001 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.221184+0000", 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057780130000000002 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231002+0000", 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0098174969999999997 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231096+0000", 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4204999999999997e-05 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231176+0000", 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9931000000000004e-05 2024-09-12T17:07:32.262 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.263 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.263 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1264 3.c 3:30907361:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:32.263 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:32.263 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.983921444, 2024-09-12T17:07:32.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021106314000000001, 2024-09-12T17:07:32.263 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.263 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.263 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.263 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1264 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:32.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231772+0000", 2024-09-12T17:07:32.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1560000000000002e-06 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235787+0000", 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040149790000000001 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235824+0000", 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6956000000000003e-05 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235843+0000", 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8315999999999999e-05 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235954+0000", 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111601 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236135+0000", 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000180941 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:32.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236302+0000", 2024-09-12T17:07:32.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016626600000000001 2024-09-12T17:07:32.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242422+0000", 2024-09-12T17:07:32.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061200730000000002 2024-09-12T17:07:32.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252655+0000", 2024-09-12T17:07:32.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010232978 2024-09-12T17:07:32.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252749+0000", 2024-09-12T17:07:32.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4481000000000006e-05 2024-09-12T17:07:32.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252877+0000", 2024-09-12T17:07:32.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012756700000000001 2024-09-12T17:07:32.270 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.270 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.270 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.270 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1265 3.22 3:44204d7e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:32.270 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:32.271 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.973433259, 2024-09-12T17:07:32.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021506441000000001, 2024-09-12T17:07:32.271 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.271 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.271 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.271 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.272 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1265 2024-09-12T17:07:32.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.272 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:32.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:32.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242262+0000", 2024-09-12T17:07:32.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7299999999999999e-06 2024-09-12T17:07:32.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246237+0000", 2024-09-12T17:07:32.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039746989999999999 2024-09-12T17:07:32.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246272+0000", 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5589000000000001e-05 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246290+0000", 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7107000000000001e-05 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246410+0000", 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119984 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246589+0000", 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000179853 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246748+0000", 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158536 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252569+0000", 2024-09-12T17:07:32.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058212810000000002 2024-09-12T17:07:32.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263464+0000", 2024-09-12T17:07:32.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010894406000000001 2024-09-12T17:07:32.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263627+0000", 2024-09-12T17:07:32.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000163833 2024-09-12T17:07:32.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263765+0000", 2024-09-12T17:07:32.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013742299999999999 2024-09-12T17:07:32.278 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.278 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.279 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.279 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1269 3.c 3:3287b6aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:32.279 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:32.279 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.924806087, 2024-09-12T17:07:32.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019007443999999998, 2024-09-12T17:07:32.279 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.279 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.279 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.280 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1269 2024-09-12T17:07:32.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.280 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:32.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290890+0000", 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2529999999999998e-06 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294907+0000", 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004017189 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294952+0000", 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5252e-05 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294971+0000", 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8606000000000001e-05 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295107+0000", 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000135654 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295466+0000", 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000359448 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295948+0000", 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000482079 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.308012+0000", 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012064210000000001 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309570+0000", 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015580839999999999 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309758+0000", 2024-09-12T17:07:32.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000187522 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309893+0000", 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013514700000000001 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1275 3.16 3:68cda83e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:32.285 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.862108944999999, 2024-09-12T17:07:32.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019055547999999999, 2024-09-12T17:07:32.286 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.286 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.286 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.286 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1275 2024-09-12T17:07:32.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.286 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353586+0000", 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0769999999999999e-06 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359376+0000", 2024-09-12T17:07:32.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057904100000000002 2024-09-12T17:07:32.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359400+0000", 2024-09-12T17:07:32.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3805999999999999e-05 2024-09-12T17:07:32.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359412+0000", 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2404e-05 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359522+0000", 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109685 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359767+0000", 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024471399999999999 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:32.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.360035+0000", 2024-09-12T17:07:32.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026762699999999999 2024-09-12T17:07:32.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372243+0000", 2024-09-12T17:07:32.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012208169 2024-09-12T17:07:32.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372526+0000", 2024-09-12T17:07:32.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028289599999999998 2024-09-12T17:07:32.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372581+0000", 2024-09-12T17:07:32.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5747e-05 2024-09-12T17:07:32.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372638+0000", 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7012999999999998e-05 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1282 3.c 3:302741ef:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.5:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.466278+0000", 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.749414071, 2024-09-12T17:07:32.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018897081999999999, 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1282 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.466278+0000", 2024-09-12T17:07:32.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.466278+0000", 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.466280+0000", 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1959999999999998e-06 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471118+0000", 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048379460000000001 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471160+0000", 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2499000000000001e-05 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471178+0000", 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.766e-05 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471346+0000", 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016801300000000001 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471770+0000", 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042415399999999999 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.472909+0000", 2024-09-12T17:07:32.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011385 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.483340+0000", 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010431184 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.485061+0000", 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017208830000000001 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.485116+0000", 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4889000000000003e-05 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.485175+0000", 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9157999999999998e-05 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1371 3.35 e64/24 3:ad03dbae:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_3:head v 64'4, mlcod=64'2)", 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.170534+0000", 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.045157876000001, 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018740685999999999, 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.170534+0000", 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.170534+0000", 2024-09-12T17:07:32.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.170538+0000", 2024-09-12T17:07:32.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8569999999999997e-06 2024-09-12T17:07:32.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176170+0000", 2024-09-12T17:07:32.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056319960000000002 2024-09-12T17:07:32.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176214+0000", 2024-09-12T17:07:32.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4515999999999999e-05 2024-09-12T17:07:32.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176236+0000", 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1886999999999999e-05 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176393+0000", 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015728699999999999 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176433+0000", 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0045e-05 2024-09-12T17:07:32.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.189172+0000", 2024-09-12T17:07:32.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012738642999999999 2024-09-12T17:07:32.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.189275+0000", 2024-09-12T17:07:32.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010245499999999999 2024-09-12T17:07:32.303 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.303 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.303 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.304 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1389 3.28 3:156adf53:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:32.304 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.363735+0000", 2024-09-12T17:07:32.304 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.851957091999999, 2024-09-12T17:07:32.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018182126999999999, 2024-09-12T17:07:32.304 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.304 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.304 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.304 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.304 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.304 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.305 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1389 2024-09-12T17:07:32.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.305 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.363735+0000", 2024-09-12T17:07:32.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.363735+0000", 2024-09-12T17:07:32.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.363739+0000", 2024-09-12T17:07:32.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3839999999999999e-06 2024-09-12T17:07:32.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.370384+0000", 2024-09-12T17:07:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066451590000000003 2024-09-12T17:07:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.370428+0000", 2024-09-12T17:07:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4242000000000001e-05 2024-09-12T17:07:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.370449+0000", 2024-09-12T17:07:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0293e-05 2024-09-12T17:07:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.370608+0000", 2024-09-12T17:07:32.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000159073 2024-09-12T17:07:32.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.370932+0000", 2024-09-12T17:07:32.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032428699999999998 2024-09-12T17:07:32.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:32.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.371236+0000", 2024-09-12T17:07:32.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030435999999999999 2024-09-12T17:07:32.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.380161+0000", 2024-09-12T17:07:32.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0089244589999999992 2024-09-12T17:07:32.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381629+0000", 2024-09-12T17:07:32.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0014678759999999999 2024-09-12T17:07:32.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381797+0000", 2024-09-12T17:07:32.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016834 2024-09-12T17:07:32.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381917+0000", 2024-09-12T17:07:32.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119654 2024-09-12T17:07:32.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.311 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.311 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.311 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1390 3.2f 3:f51d0419:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:32.311 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:32.311 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.838916219, 2024-09-12T17:07:32.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019302698, 2024-09-12T17:07:32.311 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.311 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.311 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.312 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.312 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.312 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.312 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1390 2024-09-12T17:07:32.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.312 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:32.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:32.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376779+0000", 2024-09-12T17:07:32.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8700000000000002e-06 2024-09-12T17:07:32.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381020+0000", 2024-09-12T17:07:32.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042401660000000001 2024-09-12T17:07:32.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381069+0000", 2024-09-12T17:07:32.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9279e-05 2024-09-12T17:07:32.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381098+0000", 2024-09-12T17:07:32.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9110000000000001e-05 2024-09-12T17:07:32.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381276+0000", 2024-09-12T17:07:32.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017790199999999999 2024-09-12T17:07:32.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381577+0000", 2024-09-12T17:07:32.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030131400000000001 2024-09-12T17:07:32.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:32.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381798+0000", 2024-09-12T17:07:32.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022053200000000001 2024-09-12T17:07:32.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.391131+0000", 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093337400000000001 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395755+0000", 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004624034 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395932+0000", 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000176317 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.396078+0000", 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000146434 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1408 3.2a 3:56341a86:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:32.319 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.411827094, 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.030673474999999999, 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1408 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:32.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:32.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803868+0000", 2024-09-12T17:07:32.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1130000000000001e-06 2024-09-12T17:07:32.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808291+0000", 2024-09-12T17:07:32.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044233120000000004 2024-09-12T17:07:32.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808331+0000", 2024-09-12T17:07:32.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9869000000000001e-05 2024-09-12T17:07:32.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808351+0000", 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9673e-05 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808511+0000", 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015999699999999999 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808843+0000", 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033221900000000003 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.809106+0000", 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026355900000000002 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.827691+0000", 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018584471000000002 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834339+0000", 2024-09-12T17:07:32.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066477790000000004 2024-09-12T17:07:32.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834448+0000", 2024-09-12T17:07:32.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109578 2024-09-12T17:07:32.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834538+0000", 2024-09-12T17:07:32.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9905000000000001e-05 2024-09-12T17:07:32.326 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.326 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.326 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.326 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1414 3.3a 3:5f72b292:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:32.326 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.890509+0000", 2024-09-12T17:07:32.326 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.325183087999999, 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018777497000000001, 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1414 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.890509+0000", 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.890509+0000", 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.890513+0000", 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.07e-06 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.894491+0000", 2024-09-12T17:07:32.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039787069999999997 2024-09-12T17:07:32.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.894533+0000", 2024-09-12T17:07:32.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1638999999999999e-05 2024-09-12T17:07:32.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.894567+0000", 2024-09-12T17:07:32.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3689999999999998e-05 2024-09-12T17:07:32.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.894754+0000", 2024-09-12T17:07:32.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000187006 2024-09-12T17:07:32.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.895081+0000", 2024-09-12T17:07:32.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032771900000000002 2024-09-12T17:07:32.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:32.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.895342+0000", 2024-09-12T17:07:32.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026024499999999999 2024-09-12T17:07:32.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.903175+0000", 2024-09-12T17:07:32.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0078331809999999998 2024-09-12T17:07:32.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.909015+0000", 2024-09-12T17:07:32.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005839622 2024-09-12T17:07:32.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.909134+0000", 2024-09-12T17:07:32.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119905 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.909286+0000", 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015171299999999999 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1423 3.28 3:17c0aad8:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.981662+0000", 2024-09-12T17:07:32.333 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.234029451, 2024-09-12T17:07:32.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018096924, 2024-09-12T17:07:32.334 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.334 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.334 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.334 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.334 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.334 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.334 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1423 2024-09-12T17:07:32.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.334 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.981662+0000", 2024-09-12T17:07:32.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.335 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.981662+0000", 2024-09-12T17:07:32.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.335 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.981666+0000", 2024-09-12T17:07:32.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0600000000000001e-06 2024-09-12T17:07:32.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.987043+0000", 2024-09-12T17:07:32.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0053768189999999997 2024-09-12T17:07:32.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.987084+0000", 2024-09-12T17:07:32.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0812000000000002e-05 2024-09-12T17:07:32.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.987103+0000", 2024-09-12T17:07:32.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9380000000000001e-05 2024-09-12T17:07:32.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.987312+0000", 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000208252 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.987562+0000", 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025063800000000002 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.987802+0000", 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023980599999999999 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.998293+0000", 2024-09-12T17:07:32.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010491240000000001 2024-09-12T17:07:32.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.999558+0000", 2024-09-12T17:07:32.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001264938 2024-09-12T17:07:32.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.999670+0000", 2024-09-12T17:07:32.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111963 2024-09-12T17:07:32.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.999759+0000", 2024-09-12T17:07:32.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9016000000000003e-05 2024-09-12T17:07:32.341 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.341 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.341 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.342 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1884 3.16 3:6a49863c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.25:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:32.342 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:32.342 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 2.057569269, 2024-09-12T17:07:32.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02557398, 2024-09-12T17:07:32.342 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.342 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.342 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.343 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.343 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1884 2024-09-12T17:07:32.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.343 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158125+0000", 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1399999999999998e-06 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163204+0000", 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050792720000000001 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163244+0000", 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0522000000000003e-05 2024-09-12T17:07:32.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163262+0000", 2024-09-12T17:07:32.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7872000000000001e-05 2024-09-12T17:07:32.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163395+0000", 2024-09-12T17:07:32.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013291799999999999 2024-09-12T17:07:32.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163698+0000", 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030317700000000001 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.164523+0000", 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082438900000000002 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.181881+0000", 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017357991999999999 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183465+0000", 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015843509999999999 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183583+0000", 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118025 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183696+0000", 2024-09-12T17:07:32.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113322 2024-09-12T17:07:32.349 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.349 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.349 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.349 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1923 3.1d 3:bbfa0a4b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.RvdbUUXkO22SF-kwzRd4VKnEQTGoFzf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:32.349 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:32.349 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.190597414, 2024-09-12T17:07:32.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.029952679999999999, 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1923 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025097+0000", 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6599999999999999e-06 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033262+0000", 2024-09-12T17:07:32.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0081647409999999997 2024-09-12T17:07:32.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033304+0000", 2024-09-12T17:07:32.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2138000000000002e-05 2024-09-12T17:07:32.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033322+0000", 2024-09-12T17:07:32.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8059000000000001e-05 2024-09-12T17:07:32.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033512+0000", 2024-09-12T17:07:32.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019057199999999999 2024-09-12T17:07:32.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033775+0000", 2024-09-12T17:07:32.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026250299999999998 2024-09-12T17:07:32.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034023+0000", 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024751999999999999 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.047403+0000", 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013380845000000001 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054890+0000", 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074861529999999997 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054976+0000", 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6644999999999995e-05 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.055047+0000", 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0844000000000001e-05 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1972 3.c 3:33b65f1e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.38:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.887772+0000", 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.327920188, 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018237594999999999, 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1972 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.356 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.887772+0000", 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.887772+0000", 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:32.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.887773+0000", 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3349999999999999e-06 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.891537+0000", 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037638839999999999 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.891552+0000", 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5356e-05 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:32.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.891563+0000", 2024-09-12T17:07:32.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.0596e-05 2024-09-12T17:07:32.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:32.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.891689+0000", 2024-09-12T17:07:32.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000125931 2024-09-12T17:07:32.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:32.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.891966+0000", 2024-09-12T17:07:32.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027752899999999999 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.892835+0000", 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00086911099999999999 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.902201+0000", 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093661319999999992 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.905898+0000", 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0036965740000000002 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.905966+0000", 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7546999999999996e-05 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.906009+0000", 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3600000000000003e-05 2024-09-12T17:07:32.361 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.362 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.362 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.362 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:32.362 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:32.362 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:32.364 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:32.364 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:32.364 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00929966 s, 1.1 GB/s 2024-09-12T17:07:32.365 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:32.365 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:32.365 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:32.365 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.41 2024-09-12T17:07:32.366 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:32.366 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 42 2024-09-12T17:07:32.366 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:32.366 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:32.366 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:32.367 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:32.367 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00884694 s, 1.2 GB/s 2024-09-12T17:07:32.367 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:32.356+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:32.376 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:32.376 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:32.401 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:32.402 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:32.424 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:32.424 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:32.448 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:32.449 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:32.464 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:32.460+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:32.464 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.42 2024-09-12T17:07:32.464 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:32.464 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 43 2024-09-12T17:07:32.467 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:32.468 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:32.475 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:32.475 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:32.475 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00902495 s, 1.2 GB/s 2024-09-12T17:07:32.497 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:32.497 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:32.555 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:32.556 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:32.568 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:32.564+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:32.572 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:32.579 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.43 2024-09-12T17:07:32.579 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:32.579 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 44 2024-09-12T17:07:32.594 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:32.594 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:32.594 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119519 s, 877 MB/s 2024-09-12T17:07:32.666 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:32.661+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:32.705 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:32.705 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:32.722 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:32.724 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.44 2024-09-12T17:07:32.724 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:32.724 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 45 2024-09-12T17:07:32.740 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:32.740 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:32.740 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012584 s, 833 MB/s 2024-09-12T17:07:32.767 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:32.765+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:32.864 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.45 2024-09-12T17:07:32.864 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:32.865 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 46 2024-09-12T17:07:32.867 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:32.865+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:32.880 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:32.880 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:32.880 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0129596 s, 809 MB/s 2024-09-12T17:07:32.900 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:32.901 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:32.915 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:32.968 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:32.964+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:32.999 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.46 2024-09-12T17:07:32.999 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:32.999 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 47 2024-09-12T17:07:33.015 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:33.015 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:33.015 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0133375 s, 786 MB/s 2024-09-12T17:07:33.069 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:33.064+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:33.099 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:33.099 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:33.114 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:33.155 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.47 2024-09-12T17:07:33.155 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:33.155 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 48 2024-09-12T17:07:33.170 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:33.169+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:33.171 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:33.171 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:33.171 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0135462 s, 774 MB/s 2024-09-12T17:07:33.236 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:33.236 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:33.251 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:33.295 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:33.293+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:33.328 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.48 2024-09-12T17:07:33.328 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:33.328 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 49 2024-09-12T17:07:33.344 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:33.344 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:33.344 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0130291 s, 805 MB/s 2024-09-12T17:07:33.372 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:33.369+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:33.418 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:33.418 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:33.433 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:07:33.477 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.49 2024-09-12T17:07:33.477 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:33.477 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 50 2024-09-12T17:07:33.477 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:33.472+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:33.491 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:33.491 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:33.491 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116118 s, 903 MB/s 2024-09-12T17:07:33.573 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:33.568+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:33.574 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:33.574 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:33.590 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:07:33.605 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.50 2024-09-12T17:07:33.606 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:33.606 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 51 2024-09-12T17:07:33.618 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:33.619 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:33.619 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112242 s, 934 MB/s 2024-09-12T17:07:33.675 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:33.668+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:33.744 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.51 2024-09-12T17:07:33.744 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:33.744 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 52 2024-09-12T17:07:33.757 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:33.757 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:33.757 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104712 s, 1.0 GB/s 2024-09-12T17:07:33.775 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:33.772+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:33.777 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:33.777 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:33.799 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:07:33.865 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.52 2024-09-12T17:07:33.865 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:33.865 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 53 2024-09-12T17:07:33.876 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:33.873+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:33.878 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:33.878 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:33.878 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107934 s, 971 MB/s 2024-09-12T17:07:33.977 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:33.977 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:33.977 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:33.973+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:33.996 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:07:33.998 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.53 2024-09-12T17:07:33.998 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:33.998 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 54 2024-09-12T17:07:34.011 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:34.011 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:34.012 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114243 s, 918 MB/s 2024-09-12T17:07:34.078 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:34.072+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:34.125 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:34.125 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:34.133 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.54 2024-09-12T17:07:34.133 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:34.133 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 55 2024-09-12T17:07:34.140 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:07:34.147 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:34.147 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:34.147 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106397 s, 986 MB/s 2024-09-12T17:07:34.192 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:34.188+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:34.262 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.55 2024-09-12T17:07:34.262 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:34.262 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 56 2024-09-12T17:07:34.273 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:34.274 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:34.274 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00991263 s, 1.1 GB/s 2024-09-12T17:07:34.274 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:34.274 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:34.280 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:34.276+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:34.289 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:07:34.365 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T17:07:34.381 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:34.377+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:34.400 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.56 2024-09-12T17:07:34.400 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:34.400 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 57 2024-09-12T17:07:34.415 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:34.415 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:34.415 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124863 s, 840 MB/s 2024-09-12T17:07:34.466 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:34.466 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:34.482 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:34.477+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:34.485 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:07:34.519 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.57 2024-09-12T17:07:34.519 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:34.519 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 58 2024-09-12T17:07:34.525 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:07:34.532 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:34.532 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:34.532 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115118 s, 911 MB/s 2024-09-12T17:07:34.583 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:34.576+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:34.634 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.58 2024-09-12T17:07:34.634 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:34.634 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 59 2024-09-12T17:07:34.644 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:34.644 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:34.644 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00888034 s, 1.2 GB/s 2024-09-12T17:07:34.649 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:34.649 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:34.667 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:07:34.690 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:34.691 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:34.691 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:34.684+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:34.712 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:34.712 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:34.732 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:34.733 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:34.744 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.59 2024-09-12T17:07:34.745 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:34.745 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 60 2024-09-12T17:07:34.751 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:34.752 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:34.756 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:34.756 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:34.756 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00969377 s, 1.1 GB/s 2024-09-12T17:07:34.774 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:34.774 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:34.784 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:34.780+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:34.798 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:34.798 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:34.821 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:34.821 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:34.823 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:34.823 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:34.823 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:34.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:07:34.845 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:34.846 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:34.846 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.60 2024-09-12T17:07:34.846 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:34.846 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 61 2024-09-12T17:07:34.857 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:34.857 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:34.857 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00934093 s, 1.1 GB/s 2024-09-12T17:07:34.886 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:34.881+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:34.947 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.61 2024-09-12T17:07:34.947 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:34.947 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 62 2024-09-12T17:07:34.958 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:34.958 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:34.958 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00937278 s, 1.1 GB/s 2024-09-12T17:07:34.978 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1170 3.21 3:87f83b83:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.665715892000001, 2024-09-12T17:07:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019752527999999998, 2024-09-12T17:07:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:34.978 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1170 2024-09-12T17:07:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:34.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307314+0000", 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.734e-06 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:34.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308952+0000", 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016376190000000001 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308985+0000", 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3624000000000002e-05 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308999+0000", 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3127e-05 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309087+0000", 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8244000000000004e-05 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309212+0000", 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012551500000000001 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309309+0000", 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7157000000000005e-05 2024-09-12T17:07:34.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.314345+0000", 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050351900000000002 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.326922+0000", 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012577319 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:34.983 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327013+0000", 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0801e-05 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327065+0000", 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2197999999999997e-05 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1173 3.1c 3:3ac09143:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:34.984 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.633355276, 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023664096999999999, 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1173 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:34.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339676+0000", 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:34.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341224+0000", 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015477679999999999 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341253+0000", 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9094999999999998e-05 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341267+0000", 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3624e-05 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341349+0000", 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1766000000000003e-05 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341485+0000", 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013647099999999999 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341587+0000", 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010150899999999999 2024-09-12T17:07:34.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.345980+0000", 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043931990000000004 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363206+0000", 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017225963 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:34.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363278+0000", 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2577999999999995e-05 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363337+0000", 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8839999999999999e-05 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1218 3.21 3:84169186:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:34.990 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.944534654999998, 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018163809, 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1218 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:34.991 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:34.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:34.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:34.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:34.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:34.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:34.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028495+0000", 2024-09-12T17:07:34.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7850000000000001e-06 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030091+0000", 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015958260000000001 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030124+0000", 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2990000000000001e-05 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:34.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030144+0000", 2024-09-12T17:07:34.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9381e-05 2024-09-12T17:07:34.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:34.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030232+0000", 2024-09-12T17:07:34.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8494999999999999e-05 2024-09-12T17:07:34.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:34.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030355+0000", 2024-09-12T17:07:34.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012280700000000001 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030508+0000", 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015261300000000001 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.035197+0000", 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046889339999999996 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046453+0000", 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011256339000000001 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046565+0000", 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112521 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046658+0000", 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2118000000000001e-05 2024-09-12T17:07:34.996 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1235 3.1c 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.415048922, 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027479018000000001, 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:34.997 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1235 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:34.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557983+0000", 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.941e-06 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560826+0000", 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028422479999999999 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560855+0000", 2024-09-12T17:07:34.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8999000000000001e-05 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560870+0000", 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5231999999999999e-05 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560956+0000", 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6391999999999995e-05 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561123+0000", 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016676199999999999 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561284+0000", 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160672 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.567185+0000", 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059013720000000002 2024-09-12T17:07:35.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585343+0000", 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018157514999999999 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585409+0000", 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6210999999999993e-05 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585458+0000", 2024-09-12T17:07:35.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9673999999999999e-05 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1266 3.0 3:00469398:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.720254615000002, 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017314286000000002, 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.003 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1266 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.004 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252774+0000", 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.252779+0000", 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.0749999999999997e-06 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.255994+0000", 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0032153389999999998 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256031+0000", 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7017000000000002e-05 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256048+0000", 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6412000000000001e-05 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256133+0000", 2024-09-12T17:07:35.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5282000000000001e-05 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256307+0000", 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017426299999999999 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.256441+0000", 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013364200000000001 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.263259+0000", 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068185850000000003 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.269955+0000", 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.006695884 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.270031+0000", 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6227e-05 2024-09-12T17:07:35.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.270088+0000", 2024-09-12T17:07:35.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6560000000000001e-05 2024-09-12T17:07:35.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.009 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.009 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.009 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1270 3.1c 3:3a10adff:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:35.010 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:35.010 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 21.673733418000001, 2024-09-12T17:07:35.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015927516999999999, 2024-09-12T17:07:35.010 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.010 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1270 2024-09-12T17:07:35.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.010 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299295+0000", 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.299298+0000", 2024-09-12T17:07:35.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4750000000000002e-06 2024-09-12T17:07:35.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301014+0000", 2024-09-12T17:07:35.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017152479999999999 2024-09-12T17:07:35.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301037+0000", 2024-09-12T17:07:35.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3227999999999999e-05 2024-09-12T17:07:35.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301047+0000", 2024-09-12T17:07:35.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0210999999999999e-05 2024-09-12T17:07:35.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301122+0000", 2024-09-12T17:07:35.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4762e-05 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301251+0000", 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000129388 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.301358+0000", 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010699199999999999 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.306720+0000", 2024-09-12T17:07:35.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0053618620000000002 2024-09-12T17:07:35.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315142+0000", 2024-09-12T17:07:35.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084221739999999993 2024-09-12T17:07:35.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315186+0000", 2024-09-12T17:07:35.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3257999999999998e-05 2024-09-12T17:07:35.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.016 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.315222+0000", 2024-09-12T17:07:35.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6918999999999997e-05 2024-09-12T17:07:35.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.016 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.017 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1370 3.0 3:012d3768:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:35.017 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:35.017 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.820433173000001, 2024-09-12T17:07:35.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016632968000000001, 2024-09-12T17:07:35.017 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.017 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1370 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152595+0000", 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.152598+0000", 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2969999999999999e-06 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154241+0000", 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016424709999999999 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154278+0000", 2024-09-12T17:07:35.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7419000000000002e-05 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154295+0000", 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6841999999999999e-05 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154387+0000", 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2239999999999998e-05 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154532+0000", 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014412499999999999 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.154646+0000", 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000114047 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.159659+0000", 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050133189999999996 2024-09-12T17:07:35.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169086+0000", 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0094265870000000002 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169163+0000", 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7793000000000005e-05 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.169228+0000", 2024-09-12T17:07:35.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.4827999999999997e-05 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1373 3.2d e64/24 3:b512a50c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_5:head v 64'8, mlcod=64'6)", 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.780457760000001, 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018448697999999999, 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.023 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:35.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:35.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192572+0000", 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6789999999999999e-06 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198743+0000", 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061702900000000001 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198764+0000", 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1016999999999999e-05 2024-09-12T17:07:35.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198774+0000", 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0387999999999999e-05 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198892+0000", 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117761 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198917+0000", 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5060999999999999e-05 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.210945+0000", 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012028492 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.211019+0000", 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4010000000000005e-05 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.027 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1407 3.21 3:85243711:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.181186273000002, 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020947763000000001, 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.028 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1407 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791845+0000", 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.683e-06 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796758+0000", 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049128230000000002 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796800+0000", 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2613e-05 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796819+0000", 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8632999999999999e-05 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796934+0000", 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011525499999999999 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797083+0000", 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149376 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797216+0000", 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132848 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.804681+0000", 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0074645960000000004 2024-09-12T17:07:35.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812614+0000", 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079326510000000006 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812720+0000", 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106909 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812790+0000", 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9375999999999994e-05 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1412 3.1c 3:388fdd84:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.114558379999998, 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016636860999999999, 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.034 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1412 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858470+0000", 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.858473+0000", 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4079999999999998e-06 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860776+0000", 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023030809999999998 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860831+0000", 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4166999999999998e-05 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860860+0000", 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8881999999999999e-05 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.860980+0000", 2024-09-12T17:07:35.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120155 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.861095+0000", 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011500700000000001 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.861202+0000", 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106909 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.866202+0000", 2024-09-12T17:07:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050006260000000002 2024-09-12T17:07:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875034+0000", 2024-09-12T17:07:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0088313439999999997 2024-09-12T17:07:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875075+0000", 2024-09-12T17:07:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1423e-05 2024-09-12T17:07:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.875107+0000", 2024-09-12T17:07:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1859000000000001e-05 2024-09-12T17:07:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1416 3.0 3:03f8363f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.062566232999998, 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023938686000000001, 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1416 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.041 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910465+0000", 2024-09-12T17:07:35.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8569999999999999e-06 2024-09-12T17:07:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912455+0000", 2024-09-12T17:07:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019900009999999999 2024-09-12T17:07:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912491+0000", 2024-09-12T17:07:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5522000000000003e-05 2024-09-12T17:07:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912506+0000", 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5928000000000001e-05 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912607+0000", 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010094099999999999 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912784+0000", 2024-09-12T17:07:35.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000176851 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912927+0000", 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142502 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.918121+0000", 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051943290000000001 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934276+0000", 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016155426000000001 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934347+0000", 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0970000000000007e-05 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934401+0000", 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3359000000000002e-05 2024-09-12T17:07:35.046 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1421 3.2e 3:76cf3736:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.013093728000001, 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018499980999999999, 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.047 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1421 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:35.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959937+0000", 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962168+0000", 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002231004 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962202+0000", 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3704000000000001e-05 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962218+0000", 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5732000000000001e-05 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962302+0000", 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4165999999999993e-05 2024-09-12T17:07:35.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962472+0000", 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000169863 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962643+0000", 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017084000000000001 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.967183+0000", 2024-09-12T17:07:35.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045406090000000001 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978294+0000", 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011110480000000001 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978376+0000", 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2522999999999996e-05 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.052 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978435+0000", 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8425999999999999e-05 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1747 3.2d e69/24 3:b65ccb38:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.1WIPq_cHo5kI8P6J6YoSpzHQu4w7UKi_1:head v 69'10, mlcod=64'8)", 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:27.383827+0000", 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.5892010499999998, 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017674796999999999, 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.053 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.383827+0000", 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.383827+0000", 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.383828+0000", 2024-09-12T17:07:35.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4699999999999998e-07 2024-09-12T17:07:35.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.391101+0000", 2024-09-12T17:07:35.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0072731100000000002 2024-09-12T17:07:35.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.391128+0000", 2024-09-12T17:07:35.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7373999999999999e-05 2024-09-12T17:07:35.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.391143+0000", 2024-09-12T17:07:35.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4960000000000001e-05 2024-09-12T17:07:35.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.391254+0000", 2024-09-12T17:07:35.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011067500000000001 2024-09-12T17:07:35.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.391292+0000", 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7987000000000001e-05 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.401379+0000", 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010086918 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.401502+0000", 2024-09-12T17:07:35.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000123526 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1899 3.21 3:87e83b37:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.TqvupIMz_YBVo8UQwbzZKEaVUuoNehW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.499595+0000", 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4734336250000002, 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021513126, 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.058 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1899 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.499595+0000", 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.499595+0000", 2024-09-12T17:07:35.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.499598+0000", 2024-09-12T17:07:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7330000000000001e-06 2024-09-12T17:07:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502077+0000", 2024-09-12T17:07:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024790229999999999 2024-09-12T17:07:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502119+0000", 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2008999999999997e-05 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502135+0000", 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5619000000000001e-05 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502246+0000", 2024-09-12T17:07:35.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011110799999999999 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502494+0000", 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024810700000000002 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502713+0000", 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021841800000000001 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.511955+0000", 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0092418729999999994 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.520919+0000", 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089645000000000002 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.521032+0000", 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112383 2024-09-12T17:07:35.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.521108+0000", 2024-09-12T17:07:35.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6353000000000006e-05 2024-09-12T17:07:35.064 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.064 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.064 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.064 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1932 3.38 3:1c6d2b57:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.33:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:35.064 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:31.216436+0000", 2024-09-12T17:07:35.064 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.7565918709999999, 2024-09-12T17:07:35.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016077692000000001, 2024-09-12T17:07:35.065 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.065 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.065 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.065 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.065 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.065 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.065 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1932 2024-09-12T17:07:35.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.065 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.216436+0000", 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.216436+0000", 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.216439+0000", 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7269999999999999e-06 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.218998+0000", 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025591120000000001 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.219031+0000", 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2289000000000002e-05 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.219045+0000", 2024-09-12T17:07:35.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4449e-05 2024-09-12T17:07:35.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.219170+0000", 2024-09-12T17:07:35.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012444299999999999 2024-09-12T17:07:35.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.068 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.068 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.219441+0000", 2024-09-12T17:07:35.068 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00027106999999999999 2024-09-12T17:07:35.068 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.068 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.220270+0000", 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00082989700000000001 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.230143+0000", 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0098722930000000007 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.232327+0000", 2024-09-12T17:07:35.069 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021840010000000001 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.232432+0000", 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000105232 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.232514+0000", 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2179e-05 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.070 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.071 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.071 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1941 3.0 3:027dd256:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.vaucv35rBclacx5OUimU27x8JBlyouo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:35.071 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:31.426933+0000", 2024-09-12T17:07:35.071 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.546095395, 2024-09-12T17:07:35.071 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017902310000000001, 2024-09-12T17:07:35.071 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.071 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.071 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.071 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.071 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1941 2024-09-12T17:07:35.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.072 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.072 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.426933+0000", 2024-09-12T17:07:35.072 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.072 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.072 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.072 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.073 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.426933+0000", 2024-09-12T17:07:35.073 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.073 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.073 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.073 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.426936+0000", 2024-09-12T17:07:35.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4640000000000002e-06 2024-09-12T17:07:35.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.428466+0000", 2024-09-12T17:07:35.077 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001529667 2024-09-12T17:07:35.077 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.077 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.077 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.077 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.428496+0000", 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0173999999999999e-05 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.428508+0000", 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1666e-05 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.428588+0000", 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9604999999999994e-05 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.078 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.428722+0000", 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000134105 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.428839+0000", 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117365 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.433882+0000", 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050430500000000003 2024-09-12T17:07:35.079 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.444704+0000", 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010821949000000001 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.444774+0000", 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0198999999999997e-05 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.080 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.444835+0000", 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1066000000000001e-05 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1975 3.1c 3:3805ec2a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.jnyWlqSvXNPIAN3dK-0eL-Xl-MeMoAE_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:32.015571+0000", 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.9574571359999999, 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024966074000000001, 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.081 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1975 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.015571+0000", 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.082 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.015571+0000", 2024-09-12T17:07:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.015576+0000", 2024-09-12T17:07:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9729999999999997e-06 2024-09-12T17:07:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.019608+0000", 2024-09-12T17:07:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040314599999999997 2024-09-12T17:07:35.083 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.019653+0000", 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4990000000000001e-05 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.019673+0000", 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9927000000000001e-05 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.084 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.019839+0000", 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016682900000000001 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.020109+0000", 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026921399999999999 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.020341+0000", 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023246900000000001 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.085 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.034871+0000", 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014529495999999999 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.040325+0000", 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054543109999999999 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.040416+0000", 2024-09-12T17:07:35.086 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1506000000000001e-05 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.040537+0000", 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120899 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1981 3.2e 3:75b4d622:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.DHv_qNfW1ugGvVwwMJm3RIrQK33ulM0_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:32.169675+0000", 2024-09-12T17:07:35.087 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.8033538259999999, 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019548751999999999, 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1981 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.088 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.169675+0000", 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.169675+0000", 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.169679+0000", 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1799999999999998e-06 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.089 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172140+0000", 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024608870000000001 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172175+0000", 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5775999999999998e-05 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172191+0000", 2024-09-12T17:07:35.090 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5235999999999999e-05 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172355+0000", 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000164883 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172758+0000", 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040222800000000003 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:35.091 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.173172+0000", 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041465000000000002 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.183831+0000", 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010658495 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.188992+0000", 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051616229999999997 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.092 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.189081+0000", 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8790999999999997e-05 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.189223+0000", 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142003 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.093 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1984 3.38 3:1dd59a50:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.40:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:32.193565+0000", 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.7794632940000001, 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019128305000000002, 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1984 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.094 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.193565+0000", 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.193565+0000", 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.193568+0000", 2024-09-12T17:07:35.095 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.897e-06 2024-09-12T17:07:35.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.195649+0000", 2024-09-12T17:07:35.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020805620000000002 2024-09-12T17:07:35.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.096 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.096 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.195684+0000", 2024-09-12T17:07:35.096 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5944e-05 2024-09-12T17:07:35.096 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.096 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.195702+0000", 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7374e-05 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.195806+0000", 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104104 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.196006+0000", 2024-09-12T17:07:35.097 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020045600000000001 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.196745+0000", 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073819200000000004 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.205729+0000", 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089840010000000001 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.098 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.212556+0000", 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068270429999999997 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.212636+0000", 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0408000000000007e-05 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.212693+0000", 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7324000000000002e-05 2024-09-12T17:07:35.099 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.100 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.100 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.100 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.100 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.100 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1987 3.21 3:87fea81b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.WuniG_VTTofaI6Y_i6SAkiz4T-cD3pD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:35.100 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:32.295771+0000", 2024-09-12T17:07:35.100 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 2.6772569420000001, 2024-09-12T17:07:35.100 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017969545999999999, 2024-09-12T17:07:35.100 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.100 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.100 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.100 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1987 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.295771+0000", 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.101 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.295771+0000", 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.295774+0000", 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0819999999999999e-06 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297227+0000", 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014524410000000001 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.102 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297254+0000", 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7538e-05 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297268+0000", 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3084e-05 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297344+0000", 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6428999999999996e-05 2024-09-12T17:07:35.103 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297491+0000", 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014728500000000001 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297596+0000", 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104641 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.104 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.302509+0000", 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049128119999999999 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.313653+0000", 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011144708 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.313693+0000", 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9499000000000002e-05 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.105 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.106 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.313741+0000", 2024-09-12T17:07:35.106 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8026999999999999e-05 2024-09-12T17:07:35.106 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.106 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.106 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.106 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.106 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.106 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:35.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:07:35.108 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.62 2024-09-12T17:07:35.108 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:35.108 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 63 2024-09-12T17:07:35.109 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:35.109 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:35.109 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116745 s, 898 MB/s 2024-09-12T17:07:35.109 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:35.105+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:35.187 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.63 2024-09-12T17:07:35.187 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:35.187 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 64 2024-09-12T17:07:35.199 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:35.199 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:35.199 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101565 s, 1.0 GB/s 2024-09-12T17:07:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T17:07:35.209 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:35.205+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:35.254 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:35.254 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:35.254 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:35.272 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:07:35.316 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:35.312+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:35.317 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.64 2024-09-12T17:07:35.317 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:35.317 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 65 2024-09-12T17:07:35.330 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:35.330 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:35.330 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114862 s, 913 MB/s 2024-09-12T17:07:35.411 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:35.409+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:35.445 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:35.446 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:35.446 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:35.446 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:35.446 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:35.453 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.65 2024-09-12T17:07:35.453 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:35.453 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 66 2024-09-12T17:07:35.462 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:07:35.466 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:35.466 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:35.466 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110675 s, 947 MB/s 2024-09-12T17:07:35.512 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:35.508+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:35.579 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.66 2024-09-12T17:07:35.579 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:35.580 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 67 2024-09-12T17:07:35.589 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:35.590 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:35.590 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00879964 s, 1.2 GB/s 2024-09-12T17:07:35.598 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:35.598 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:35.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:35.598 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:35.598 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.598 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1174 3.27 3:e7a048aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:35.598 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:35.598 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.242412165000001, 2024-09-12T17:07:35.598 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017154674000000002, 2024-09-12T17:07:35.598 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1174 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.599 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350912+0000", 2024-09-12T17:07:35.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.600 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.350915+0000", 2024-09-12T17:07:35.600 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9500000000000001e-06 2024-09-12T17:07:35.600 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.600 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.600 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352415+0000", 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001500234 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352436+0000", 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0662999999999999e-05 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352446+0000", 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.8630000000000003e-06 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.601 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352517+0000", 2024-09-12T17:07:35.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1267999999999996e-05 2024-09-12T17:07:35.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352657+0000", 2024-09-12T17:07:35.602 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140252 2024-09-12T17:07:35.602 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.602 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.602 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.602 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.352747+0000", 2024-09-12T17:07:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.9744e-05 2024-09-12T17:07:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.357398+0000", 2024-09-12T17:07:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004650469 2024-09-12T17:07:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.603 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.367954+0000", 2024-09-12T17:07:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010556592 2024-09-12T17:07:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.368017+0000", 2024-09-12T17:07:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3237000000000005e-05 2024-09-12T17:07:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.368067+0000", 2024-09-12T17:07:35.604 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9401999999999999e-05 2024-09-12T17:07:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1175 3.27 3:e584c994:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.230983500000001, 2024-09-12T17:07:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017138075999999999, 2024-09-12T17:07:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.605 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1175 2024-09-12T17:07:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.606 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362341+0000", 2024-09-12T17:07:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.362344+0000", 2024-09-12T17:07:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1209999999999998e-06 2024-09-12T17:07:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.607 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363815+0000", 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00147124 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363838+0000", 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3130999999999999e-05 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363850+0000", 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1742999999999999e-05 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.608 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363938+0000", 2024-09-12T17:07:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.7649000000000001e-05 2024-09-12T17:07:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.364120+0000", 2024-09-12T17:07:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018224699999999999 2024-09-12T17:07:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.364286+0000", 2024-09-12T17:07:35.609 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000166293 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.369965+0000", 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056791009999999998 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379306+0000", 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0093409119999999998 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.610 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379401+0000", 2024-09-12T17:07:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4839000000000005e-05 2024-09-12T17:07:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.379479+0000", 2024-09-12T17:07:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7799999999999994e-05 2024-09-12T17:07:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.611 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1184 3.2 3:40bd418a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.139190059000001, 2024-09-12T17:07:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017076502, 2024-09-12T17:07:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1184 2024-09-12T17:07:35.612 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454134+0000", 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.613 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.454137+0000", 2024-09-12T17:07:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1820000000000002e-06 2024-09-12T17:07:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455769+0000", 2024-09-12T17:07:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001632 2024-09-12T17:07:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455796+0000", 2024-09-12T17:07:35.614 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6446000000000001e-05 2024-09-12T17:07:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455808+0000", 2024-09-12T17:07:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1652e-05 2024-09-12T17:07:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.455886+0000", 2024-09-12T17:07:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.8123999999999999e-05 2024-09-12T17:07:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.615 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.456057+0000", 2024-09-12T17:07:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000170848 2024-09-12T17:07:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.456221+0000", 2024-09-12T17:07:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000164284 2024-09-12T17:07:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.616 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.462621+0000", 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0063999469999999996 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471114+0000", 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0084932219999999999 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471158+0000", 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3843e-05 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.617 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.471211+0000", 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2954000000000002e-05 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1201 3.8 3:114be366:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.780371831, 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021172410999999999, 2024-09-12T17:07:35.618 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1201 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.619 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812956+0000", 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3050000000000001e-06 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.620 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816133+0000", 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031766699999999999 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816165+0000", 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2197999999999999e-05 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816177+0000", 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1973999999999999e-05 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.621 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816249+0000", 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1898999999999997e-05 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816385+0000", 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013646400000000001 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816513+0000", 2024-09-12T17:07:35.622 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128097 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.821736+0000", 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052224869999999996 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834015+0000", 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012279784 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.623 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834087+0000", 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1935999999999997e-05 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834125+0000", 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7596999999999999e-05 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.624 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1202 3.2 3:421b0e45:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.770588044, 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018086743999999998, 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1202 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.625 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822739+0000", 2024-09-12T17:07:35.626 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2589999999999999e-06 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824478+0000", 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001739256 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824502+0000", 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3952999999999999e-05 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.627 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824514+0000", 2024-09-12T17:07:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2031999999999999e-05 2024-09-12T17:07:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824577+0000", 2024-09-12T17:07:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2793999999999995e-05 2024-09-12T17:07:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824714+0000", 2024-09-12T17:07:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013785199999999999 2024-09-12T17:07:35.628 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824862+0000", 2024-09-12T17:07:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147751 2024-09-12T17:07:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.830267+0000", 2024-09-12T17:07:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054052670000000001 2024-09-12T17:07:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.629 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840734+0000", 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010466938 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840780+0000", 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5831999999999998e-05 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840823+0000", 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2809999999999998e-05 2024-09-12T17:07:35.630 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1210 3.29 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.649843783000001, 2024-09-12T17:07:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021481673, 2024-09-12T17:07:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.631 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1210 2024-09-12T17:07:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.632 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943483+0000", 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6520000000000002e-06 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945771+0000", 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022874829999999999 2024-09-12T17:07:35.633 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945806+0000", 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4836999999999999e-05 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945820+0000", 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939e-05 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.634 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945888+0000", 2024-09-12T17:07:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7702999999999999e-05 2024-09-12T17:07:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946027+0000", 2024-09-12T17:07:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000139135 2024-09-12T17:07:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946146+0000", 2024-09-12T17:07:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118742 2024-09-12T17:07:35.635 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.950285+0000", 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041384880000000001 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964885+0000", 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014600594 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964928+0000", 2024-09-12T17:07:35.636 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2536000000000001e-05 2024-09-12T17:07:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964962+0000", 2024-09-12T17:07:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4564000000000003e-05 2024-09-12T17:07:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1211 3.7 3:e386213e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:35.637 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.638790759999999, 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018028718999999999, 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1211 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.638 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954534+0000", 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.954536+0000", 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.791e-06 2024-09-12T17:07:35.639 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.955972+0000", 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001435363 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956007+0000", 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4777000000000003e-05 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.640 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956022+0000", 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5480000000000001e-05 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956094+0000", 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1515999999999998e-05 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956229+0000", 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013551599999999999 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.641 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.956330+0000", 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010090900000000001 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.960617+0000", 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0042865510000000004 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972437+0000", 2024-09-12T17:07:35.642 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011820169 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972510+0000", 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3129999999999999e-05 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.972562+0000", 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2516999999999999e-05 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.643 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1216 3.33 3:cf30ff9d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.585359008000001, 2024-09-12T17:07:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023290796999999999, 2024-09-12T17:07:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.644 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1216 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.645 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007968+0000", 2024-09-12T17:07:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0580000000000002e-06 2024-09-12T17:07:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009686+0000", 2024-09-12T17:07:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017173920000000001 2024-09-12T17:07:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.646 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009718+0000", 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2632999999999997e-05 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009734+0000", 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6011999999999998e-05 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009834+0000", 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9947999999999999e-05 2024-09-12T17:07:35.647 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010000+0000", 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016520599999999999 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010133+0000", 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133676 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.648 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.015744+0000", 2024-09-12T17:07:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056104570000000001 2024-09-12T17:07:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031150+0000", 2024-09-12T17:07:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015405894999999999 2024-09-12T17:07:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031209+0000", 2024-09-12T17:07:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9247999999999999e-05 2024-09-12T17:07:35.649 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031256+0000", 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7271999999999997e-05 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1230 3.24 3:257b3201:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.110089957, 2024-09-12T17:07:35.650 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018874753000000001, 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1230 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:35.651 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483238+0000", 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2880000000000001e-06 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.652 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485868+0000", 2024-09-12T17:07:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026303490000000001 2024-09-12T17:07:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485904+0000", 2024-09-12T17:07:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5513999999999999e-05 2024-09-12T17:07:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485920+0000", 2024-09-12T17:07:35.653 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6201999999999998e-05 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486092+0000", 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017220700000000001 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486500+0000", 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040771200000000002 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.654 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486750+0000", 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025026699999999998 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.500598+0000", 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013848226 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.501939+0000", 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013409839999999999 2024-09-12T17:07:35.655 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502016+0000", 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6908000000000003e-05 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502109+0000", 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3096000000000004e-05 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.656 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1261 3.33 3:cc53a442:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.40395054, 2024-09-12T17:07:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017162891, 2024-09-12T17:07:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.657 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1261 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189374+0000", 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.658 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.189377+0000", 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.039e-06 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192004+0000", 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026268900000000002 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192041+0000", 2024-09-12T17:07:35.659 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6838000000000002e-05 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192055+0000", 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4446e-05 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192223+0000", 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016760200000000001 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.660 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192514+0000", 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00029128900000000002 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.192760+0000", 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024571700000000001 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.201494+0000", 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0087345800000000005 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.661 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206464+0000", 2024-09-12T17:07:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00497007 2024-09-12T17:07:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206505+0000", 2024-09-12T17:07:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0528999999999998e-05 2024-09-12T17:07:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.662 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:13.206537+0000", 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1890999999999997e-05 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1375 3.29 3:95c1ad90:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.387831874, 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016791820999999998, 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.663 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1375 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.664 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205492+0000", 2024-09-12T17:07:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.205496+0000", 2024-09-12T17:07:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7220000000000001e-06 2024-09-12T17:07:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208326+0000", 2024-09-12T17:07:35.665 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028297270000000002 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208353+0000", 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6675000000000001e-05 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208365+0000", 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2006e-05 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.666 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208450+0000", 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4958999999999998e-05 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208666+0000", 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021668300000000001 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.208858+0000", 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000191707 2024-09-12T17:07:35.667 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.215258+0000", 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0064000439999999997 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222154+0000", 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068963949999999996 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.668 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222230+0000", 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.5320000000000004e-05 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.222284+0000", 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.4583000000000002e-05 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1387 3.8 3:122cdcfa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:35.669 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.255035617000001, 2024-09-12T17:07:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018409291000000001, 2024-09-12T17:07:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.670 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1387 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338292+0000", 2024-09-12T17:07:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.631e-06 2024-09-12T17:07:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340227+0000", 2024-09-12T17:07:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001934217 2024-09-12T17:07:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340262+0000", 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5893999999999999e-05 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340278+0000", 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5325e-05 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340387+0000", 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010876 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340570+0000", 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018296299999999999 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340735+0000", 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568400000000001 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.345914+0000", 2024-09-12T17:07:35.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051783319999999999 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356536+0000", 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010622529 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356632+0000", 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5927000000000005e-05 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.675 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356698+0000", 2024-09-12T17:07:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6029000000000001e-05 2024-09-12T17:07:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1427 3.7 3:e327d833:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.569681914, 2024-09-12T17:07:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017016304999999999, 2024-09-12T17:07:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.676 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1427 2024-09-12T17:07:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023642+0000", 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.023646+0000", 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2590000000000001e-06 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024847+0000", 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001201674 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024879+0000", 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1636e-05 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024894+0000", 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4613000000000001e-05 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.024980+0000", 2024-09-12T17:07:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6160000000000002e-05 2024-09-12T17:07:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.025132+0000", 2024-09-12T17:07:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000152242 2024-09-12T17:07:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.025252+0000", 2024-09-12T17:07:35.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000119731 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.029896+0000", 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046442810000000001 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040528+0000", 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010631508 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.681 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040600+0000", 2024-09-12T17:07:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2125999999999994e-05 2024-09-12T17:07:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:17.040659+0000", 2024-09-12T17:07:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9074999999999999e-05 2024-09-12T17:07:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1733 3.33 3:cd3b7926:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.M8SFsRZfEjvXnxNc1Ny07cg_vtwVJ9y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T17:07:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.5257260250000009, 2024-09-12T17:07:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024112788, 2024-09-12T17:07:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1733 2024-09-12T17:07:35.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067603+0000", 2024-09-12T17:07:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.707e-06 2024-09-12T17:07:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072541+0000", 2024-09-12T17:07:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049382710000000002 2024-09-12T17:07:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072582+0000", 2024-09-12T17:07:35.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0392999999999998e-05 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072606+0000", 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4303000000000001e-05 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072745+0000", 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013889300000000001 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072967+0000", 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022192800000000001 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.073233+0000", 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026631499999999999 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.086312+0000", 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013078579 2024-09-12T17:07:35.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091563+0000", 2024-09-12T17:07:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052509369999999998 2024-09-12T17:07:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091648+0000", 2024-09-12T17:07:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5051999999999998e-05 2024-09-12T17:07:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091711+0000", 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3410000000000004e-05 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1887 3.33 3:cf01266b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.yI34Oa84OEb7C49UYPF9HCMJS_d1s3T_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.3302386679999998, 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018315027000000001, 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.689 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1887 2024-09-12T17:07:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:35.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263090+0000", 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0239999999999999e-06 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265411+0000", 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00232132 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265443+0000", 2024-09-12T17:07:35.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1718999999999999e-05 2024-09-12T17:07:35.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265455+0000", 2024-09-12T17:07:35.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2143999999999999e-05 2024-09-12T17:07:35.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265535+0000", 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9659000000000004e-05 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265655+0000", 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120902 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265755+0000", 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9761999999999998e-05 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.272399+0000", 2024-09-12T17:07:35.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066442510000000003 2024-09-12T17:07:35.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281321+0000", 2024-09-12T17:07:35.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089219669999999994 2024-09-12T17:07:35.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281358+0000", 2024-09-12T17:07:35.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6355e-05 2024-09-12T17:07:35.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281401+0000", 2024-09-12T17:07:35.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2923999999999998e-05 2024-09-12T17:07:35.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.697 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.697 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.697 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1920 3.8 3:11cda29a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.31:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:35.697 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.6794700689999997, 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022252124000000002, 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1920 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913858+0000", 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0770000000000001e-06 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917854+0000", 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039960600000000001 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917898+0000", 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3689999999999997e-05 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917917+0000", 2024-09-12T17:07:35.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9233e-05 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.918051+0000", 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133969 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.918315+0000", 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000263355 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:35.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.919198+0000", 2024-09-12T17:07:35.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00088375200000000002 2024-09-12T17:07:35.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.928506+0000", 2024-09-12T17:07:35.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0093070960000000008 2024-09-12T17:07:35.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936025+0000", 2024-09-12T17:07:35.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075193400000000002 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936073+0000", 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8012e-05 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936106+0000", 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3540000000000001e-05 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.704 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1938 3.19 3:9addcbec:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.34:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:35.704 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:35.704 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.260329574, 2024-09-12T17:07:35.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020463775, 2024-09-12T17:07:35.704 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.704 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1938 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332997+0000", 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5100000000000001e-06 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337007+0000", 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040099979999999999 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337054+0000", 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6826000000000002e-05 2024-09-12T17:07:35.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337073+0000", 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8743e-05 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337189+0000", 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116507 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337415+0000", 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022530099999999999 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.338022+0000", 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00060701600000000004 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.347566+0000", 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0095447150000000005 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353379+0000", 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058124170000000003 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353425+0000", 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5824e-05 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353459+0000", 2024-09-12T17:07:35.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3918000000000003e-05 2024-09-12T17:07:35.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.710 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.710 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2101 3.24 3:25ca6521:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.4pZZCgy-wBJXiNQ0J0vFl8TPz4X_i3J_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:35.710 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:35.710 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.78253991499999997, 2024-09-12T17:07:35.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018837217999999999, 2024-09-12T17:07:35.710 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2101 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810788+0000", 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0069999999999999e-06 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812434+0000", 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016459020000000001 2024-09-12T17:07:35.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812468+0000", 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3173999999999998e-05 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812482+0000", 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3985000000000001e-05 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812582+0000", 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100801 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812780+0000", 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000197219 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812965+0000", 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018523500000000001 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.818504+0000", 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055390429999999996 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829488+0000", 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010984551 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829565+0000", 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7106000000000003e-05 2024-09-12T17:07:35.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.716 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.716 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829622+0000", 2024-09-12T17:07:35.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6195e-05 2024-09-12T17:07:35.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.716 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.716 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2107 3.27 3:e6a067b7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.Yyze1zZ5yDQsQYVWfVwDqF36m9lCinJ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:35.716 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:35.716 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.68157163099999996, 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020701105000000001, 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2107 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911756+0000", 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.557e-06 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913489+0000", 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001732623 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913518+0000", 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8949e-05 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913530+0000", 2024-09-12T17:07:35.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1691999999999999e-05 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913612+0000", 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2706000000000004e-05 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913803+0000", 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000190695 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913972+0000", 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000169536 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.919843+0000", 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058703280000000002 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932289+0000", 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0124463 2024-09-12T17:07:35.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932386+0000", 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7108999999999995e-05 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932454+0000", 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7609999999999998e-05 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2134 3.19 3:9a3dd654:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.65:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.16368380299999999, 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021094020000000002, 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2134 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.723 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:35.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429643+0000", 2024-09-12T17:07:35.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.588e-06 2024-09-12T17:07:35.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:35.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431844+0000", 2024-09-12T17:07:35.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022009040000000001 2024-09-12T17:07:35.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:35.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431875+0000", 2024-09-12T17:07:35.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1217999999999998e-05 2024-09-12T17:07:35.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431889+0000", 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.432039+0000", 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015003799999999999 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:35.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.432481+0000", 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00044164399999999999 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.433634+0000", 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011532059999999999 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.449117+0000", 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015483241999999999 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:35.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450419+0000", 2024-09-12T17:07:35.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001301466 2024-09-12T17:07:35.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:35.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450606+0000", 2024-09-12T17:07:35.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000187009 2024-09-12T17:07:35.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:35.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:35.728 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:35.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450735+0000", 2024-09-12T17:07:35.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012906199999999999 2024-09-12T17:07:35.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.729 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.729 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:35.729 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:35.729 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:35.731 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:07:35.731 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.67 2024-09-12T17:07:35.731 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:35.731 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 68 2024-09-12T17:07:35.731 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:35.731 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:35.732 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123532 s, 849 MB/s 2024-09-12T17:07:35.732 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:35.729+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:35.832 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:35.828+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:35.863 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.68 2024-09-12T17:07:35.864 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:35.864 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 69 2024-09-12T17:07:35.874 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:35.874 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:35.874 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:35.874 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:35.879 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:35.879 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:35.879 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127122 s, 825 MB/s 2024-09-12T17:07:35.890 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:07:35.933 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:35.928+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:36.015 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.69 2024-09-12T17:07:36.016 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:36.016 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 70 2024-09-12T17:07:36.018 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:36.018 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:36.018 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:36.018 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:36.018 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:36.031 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:36.031 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:36.031 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127923 s, 820 MB/s 2024-09-12T17:07:36.033 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:07:36.034 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:36.029+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:36.134 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:36.128+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:36.176 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.70 2024-09-12T17:07:36.176 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:36.176 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 71 2024-09-12T17:07:36.191 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:36.191 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:36.192 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128391 s, 817 MB/s 2024-09-12T17:07:36.214 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:36.215 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:36.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:36.215 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:36.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.215 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1188 3.31 3:8d857c15:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.215 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:36.215 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.716725176000001, 2024-09-12T17:07:36.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019168672000000001, 2024-09-12T17:07:36.215 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.215 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.215 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1188 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493824+0000", 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.553e-06 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497820+0000", 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039958659999999998 2024-09-12T17:07:36.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497855+0000", 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4956000000000002e-05 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497872+0000", 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6863000000000001e-05 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497996+0000", 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124306 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498229+0000", 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023307699999999999 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498994+0000", 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076469699999999995 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.507996+0000", 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090021540000000001 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512687+0000", 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046905360000000004 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512861+0000", 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017420399999999999 2024-09-12T17:07:36.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512990+0000", 2024-09-12T17:07:36.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012946 2024-09-12T17:07:36.221 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.221 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.221 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.221 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1232 3.14 3:2967aafe:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.221 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.690272268000001, 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019509183999999999, 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1232 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520278+0000", 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9539999999999998e-06 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525478+0000", 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005199665 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525520+0000", 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2391999999999997e-05 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525542+0000", 2024-09-12T17:07:36.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1613000000000001e-05 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525676+0000", 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013434300000000001 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525933+0000", 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025640400000000001 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:36.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.526162+0000", 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228722 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.534431+0000", 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082696019999999992 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539449+0000", 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050177099999999999 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539640+0000", 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190812 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539784+0000", 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143967 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.228 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1234 3.3 3:c0bf349d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.228 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:36.228 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.665101323000002, 2024-09-12T17:07:36.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019413466000000001, 2024-09-12T17:07:36.228 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.228 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.228 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.228 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1234 2024-09-12T17:07:36.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545450+0000", 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.313e-06 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549431+0000", 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039813139999999997 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549472+0000", 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0828999999999998e-05 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549491+0000", 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9055999999999998e-05 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549627+0000", 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013646700000000001 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549859+0000", 2024-09-12T17:07:36.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023186100000000001 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.550208+0000", 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000348372 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.559516+0000", 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093083260000000004 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564688+0000", 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051717849999999999 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564783+0000", 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4821000000000006e-05 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564859+0000", 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6322000000000006e-05 2024-09-12T17:07:36.233 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1235 3.1c e63/45 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.648035187000001, 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023527869, 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562514+0000", 2024-09-12T17:07:36.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570603+0000", 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080886359999999997 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570630+0000", 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7276000000000001e-05 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570642+0000", 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2153e-05 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570805+0000", 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016319899999999999 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570900+0000", 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4988000000000006e-05 2024-09-12T17:07:36.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.585884+0000", 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014984046000000001 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.586039+0000", 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155184 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1238 3.3 3:c2fc49d9:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.620053746, 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018644582999999999, 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1238 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.239 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590493+0000", 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.590496+0000", 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4400000000000001e-06 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596047+0000", 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0055506599999999998 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596086+0000", 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9326000000000003e-05 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596106+0000", 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9119000000000001e-05 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596263+0000", 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015771700000000001 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596516+0000", 2024-09-12T17:07:36.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025320799999999999 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.596769+0000", 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025305400000000001 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.605151+0000", 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.008381833 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.608970+0000", 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0038186660000000001 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.609064+0000", 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4438000000000006e-05 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.609138+0000", 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3121999999999995e-05 2024-09-12T17:07:36.244 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1244 3.1a 3:594e2ce7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.539679612, 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018879997999999999, 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.245 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1244 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670867+0000", 2024-09-12T17:07:36.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.670871+0000", 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0459999999999999e-06 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675701+0000", 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048294169999999999 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675740+0000", 2024-09-12T17:07:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9592999999999999e-05 2024-09-12T17:07:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675758+0000", 2024-09-12T17:07:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.77e-05 2024-09-12T17:07:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.675939+0000", 2024-09-12T17:07:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018083199999999999 2024-09-12T17:07:36.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.676345+0000", 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040617099999999998 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.676719+0000", 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00037385800000000002 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.688469+0000", 2024-09-12T17:07:36.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01174979 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689374+0000", 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00090544200000000001 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689551+0000", 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017685300000000001 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.689747+0000", 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019629599999999999 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1247 3.1a 3:58056b43:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.509509144999999, 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021958978000000001, 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.251 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1247 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701041+0000", 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9399999999999998e-06 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705529+0000", 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044889789999999997 2024-09-12T17:07:36.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705569+0000", 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9606e-05 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705588+0000", 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9375999999999999e-05 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705756+0000", 2024-09-12T17:07:36.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016734200000000001 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706045+0000", 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028885400000000001 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706343+0000", 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029790300000000002 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720973+0000", 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014630684 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722653+0000", 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016799790000000001 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722878+0000", 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022488799999999999 2024-09-12T17:07:36.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722997+0000", 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118427 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1376 3.3 3:c01937d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.991320238, 2024-09-12T17:07:36.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020435229999999999, 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1376 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219230+0000", 2024-09-12T17:07:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.23e-06 2024-09-12T17:07:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223391+0000", 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041610629999999996 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223425+0000", 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4167e-05 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223443+0000", 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8105999999999999e-05 2024-09-12T17:07:36.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223562+0000", 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118861 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223840+0000", 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027762099999999998 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:36.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.224077+0000", 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023720100000000001 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.232976+0000", 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0088992900000000007 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239478+0000", 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065023609999999999 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239574+0000", 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5527999999999997e-05 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239662+0000", 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7801999999999997e-05 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.263 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1382 3.1a 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.924653286000002, 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020895593, 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1382 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285897+0000", 2024-09-12T17:07:36.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6669999999999998e-06 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290617+0000", 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047198689999999998 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290657+0000", 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0201999999999999e-05 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290676+0000", 2024-09-12T17:07:36.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9293e-05 2024-09-12T17:07:36.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290860+0000", 2024-09-12T17:07:36.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000183353 2024-09-12T17:07:36.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291264+0000", 2024-09-12T17:07:36.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040463800000000002 2024-09-12T17:07:36.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291676+0000", 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041151499999999999 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301391+0000", 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0097147350000000004 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306412+0000", 2024-09-12T17:07:36.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050210790000000003 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306636+0000", 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000224589 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306789+0000", 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015265299999999999 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.269 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1385 3.34 3:2f3cb087:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.892628179999999, 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024744103999999999, 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.270 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1385 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317922+0000", 2024-09-12T17:07:36.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.157e-06 2024-09-12T17:07:36.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322800+0000", 2024-09-12T17:07:36.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048785879999999997 2024-09-12T17:07:36.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322846+0000", 2024-09-12T17:07:36.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5732999999999997e-05 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322866+0000", 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0415999999999999e-05 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323048+0000", 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018128 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323496+0000", 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044786400000000002 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323919+0000", 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042374399999999999 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.340076+0000", 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016156925999999999 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342379+0000", 2024-09-12T17:07:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023025189999999998 2024-09-12T17:07:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342546+0000", 2024-09-12T17:07:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016719599999999999 2024-09-12T17:07:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342663+0000", 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116681 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1409 3.a e64/24 3:53d4fdcd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_3:head v 64'6, mlcod=64'4)", 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.389148638000002, 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021472076, 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821402+0000", 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4699999999999998e-06 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828337+0000", 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069354229999999996 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828387+0000", 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9908999999999999e-05 2024-09-12T17:07:36.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828412+0000", 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5389999999999999e-05 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828587+0000", 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017425599999999999 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828654+0000", 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7708999999999998e-05 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842774+0000", 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014119860999999999 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842870+0000", 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6057999999999994e-05 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.280 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1417 3.14 3:29a29b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.287820233000001, 2024-09-12T17:07:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.034043223999999997, 2024-09-12T17:07:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.281 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1417 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922731+0000", 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1099999999999996e-06 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930785+0000", 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080541020000000005 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930841+0000", 2024-09-12T17:07:36.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6005999999999999e-05 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930869+0000", 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8602000000000002e-05 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931049+0000", 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017998299999999999 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931287+0000", 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000237712 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931510+0000", 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022283200000000001 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941891+0000", 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010380785 2024-09-12T17:07:36.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.955891+0000", 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014000207000000001 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956636+0000", 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00074503099999999995 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956770+0000", 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013385400000000001 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1420 3.3 3:c118c659:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.258526416999999, 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022394282000000001, 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.287 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1420 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952024+0000", 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1760000000000003e-06 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958458+0000", 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064335770000000002 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958492+0000", 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4309e-05 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958508+0000", 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5699999999999999e-05 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958717+0000", 2024-09-12T17:07:36.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020871900000000001 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959163+0000", 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000446007 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959583+0000", 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042026800000000001 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.970389+0000", 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010806375999999999 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974044+0000", 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003654352 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974232+0000", 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018811899999999999 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974415+0000", 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018267899999999999 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1896 3.2c e71/24 3:3773d78b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.27:head v 71'8, mlcod=71'6)", 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.8064902099999998, 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021824796, 2024-09-12T17:07:36.293 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404059+0000", 2024-09-12T17:07:36.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.537e-06 2024-09-12T17:07:36.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408616+0000", 2024-09-12T17:07:36.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045564799999999999 2024-09-12T17:07:36.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408657+0000", 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1968000000000002e-05 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408676+0000", 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8445999999999999e-05 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408880+0000", 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020370100000000001 2024-09-12T17:07:36.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408952+0000", 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2226999999999998e-05 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.425787+0000", 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016835383999999998 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.425881+0000", 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4053000000000002e-05 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1917 3.1a 3:5b4c0dd7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.P_wej9y73GH8iAzyXzEiqKNwtELtJTp_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.3265778179999996, 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026569157999999999, 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.298 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1917 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:36.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883971+0000", 2024-09-12T17:07:36.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4030000000000001e-06 2024-09-12T17:07:36.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890727+0000", 2024-09-12T17:07:36.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067561080000000003 2024-09-12T17:07:36.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890770+0000", 2024-09-12T17:07:36.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2614999999999998e-05 2024-09-12T17:07:36.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890794+0000", 2024-09-12T17:07:36.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3808999999999999e-05 2024-09-12T17:07:36.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890964+0000", 2024-09-12T17:07:36.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000169956 2024-09-12T17:07:36.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.891223+0000", 2024-09-12T17:07:36.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025883600000000003 2024-09-12T17:07:36.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.891466+0000", 2024-09-12T17:07:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000242883 2024-09-12T17:07:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.909542+0000", 2024-09-12T17:07:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018076262999999999 2024-09-12T17:07:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910349+0000", 2024-09-12T17:07:36.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080699299999999999 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910447+0000", 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8301999999999995e-05 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910538+0000", 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0989999999999994e-05 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.304 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1923 3.1d e71/24 3:bbfa0a4b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.RvdbUUXkO22SF-kwzRd4VKnEQTGoFzf_1:head v 71'2, mlcod=0'0)", 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.1762348659999997, 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020143629, 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:36.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:36.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034315+0000", 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.123e-06 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038477+0000", 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041615999999999997 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038520+0000", 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3705000000000003e-05 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038539+0000", 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8825999999999999e-05 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038679+0000", 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000140051 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038729+0000", 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9455e-05 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054300+0000", 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015571000999999999 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054455+0000", 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015586800000000001 2024-09-12T17:07:36.311 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.312 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.312 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.312 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1926 3.9 3:92ed9a0c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.32:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:36.312 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:36.312 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.1510014310000001, 2024-09-12T17:07:36.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019336487999999999, 2024-09-12T17:07:36.312 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.312 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.312 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.312 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1926 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:36.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059548+0000", 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063544+0000", 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039964340000000001 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.314 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063587+0000", 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2701000000000003e-05 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063605+0000", 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8065999999999999e-05 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063745+0000", 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014033000000000001 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.064004+0000", 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025869899999999998 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.064666+0000", 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00066141599999999996 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.074813+0000", 2024-09-12T17:07:36.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010147168 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078769+0000", 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039561680000000004 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078837+0000", 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8089000000000005e-05 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078882+0000", 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4827000000000003e-05 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1975 3.1c e71/45 3:3805ec2a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.jnyWlqSvXNPIAN3dK-0eL-Xl-MeMoAE_1:head v 71'6, mlcod=64'4)", 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.1893084800000002, 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019266097999999999, 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.318 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021241+0000", 2024-09-12T17:07:36.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0369999999999999e-06 2024-09-12T17:07:36.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027374+0000", 2024-09-12T17:07:36.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061327090000000001 2024-09-12T17:07:36.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027417+0000", 2024-09-12T17:07:36.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2966000000000002e-05 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027435+0000", 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7796e-05 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027586+0000", 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015143000000000001 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.321 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027623+0000", 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6535000000000002e-05 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.040387+0000", 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012764463 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.040504+0000", 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117162 2024-09-12T17:07:36.322 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2131 3.34 3:2ed641cc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.zMHhD2lKVde2GeFxbpVTls1jtnLcDP5_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.81560159300000001, 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025713333000000001, 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.323 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2131 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394949+0000", 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6799999999999999e-06 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399541+0000", 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004591955 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399595+0000", 2024-09-12T17:07:36.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4694000000000002e-05 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399622+0000", 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6466e-05 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399826+0000", 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020443600000000001 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.400245+0000", 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041897400000000002 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.400666+0000", 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042066199999999998 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420138+0000", 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019472382 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420297+0000", 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158214 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420498+0000", 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020172899999999999 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420658+0000", 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016014100000000001 2024-09-12T17:07:36.328 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2146 3.2c e73/24 3:35eb2578:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.67:head v 73'11, mlcod=71'9)", 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.52367290300000002, 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018962961, 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686876+0000", 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6740000000000001e-06 2024-09-12T17:07:36.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691317+0000", 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044404900000000001 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691352+0000", 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5355999999999998e-05 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691370+0000", 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7584999999999999e-05 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691503+0000", 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013263199999999999 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691545+0000", 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2886000000000002e-05 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.705738+0000", 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014192885000000001 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.705837+0000", 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8453000000000001e-05 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.333 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:36.334 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.71 2024-09-12T17:07:36.334 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:36.334 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 72 2024-09-12T17:07:36.335 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:07:36.336 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:36.333+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:36.338 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:36.338 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:36.338 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120042 s, 874 MB/s 2024-09-12T17:07:36.436 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:36.432+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:36.475 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.72 2024-09-12T17:07:36.475 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:36.475 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 73 2024-09-12T17:07:36.491 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:36.491 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:36.491 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131677 s, 796 MB/s 2024-09-12T17:07:36.521 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:36.521 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:36.521 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:36.521 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:36.536 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:07:36.537 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:36.532+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:36.638 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:36.632+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:36.665 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:36.665 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:36.665 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:36.665 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:36.665 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:36.665 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.73 2024-09-12T17:07:36.666 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:36.666 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 74 2024-09-12T17:07:36.680 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:07:36.680 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:36.680 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:36.680 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0127407 s, 823 MB/s 2024-09-12T17:07:36.739 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:36.732+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:36.812 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:36.812 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:36.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:36.812 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:36.812 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.812 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1239 3.16 3:6b2cb9ce:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.812 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:36.812 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.206251657999999, 2024-09-12T17:07:36.812 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021398218, 2024-09-12T17:07:36.812 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1239 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.813 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600991+0000", 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9559999999999999e-06 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.814 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606170+0000", 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051789460000000002 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606222+0000", 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1422000000000003e-05 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606249+0000", 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7163000000000001e-05 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.815 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606450+0000", 2024-09-12T17:07:36.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000201325 2024-09-12T17:07:36.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606877+0000", 2024-09-12T17:07:36.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042682799999999997 2024-09-12T17:07:36.816 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.816 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.816 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:36.816 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.607298+0000", 2024-09-12T17:07:36.816 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042127700000000001 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.615845+0000", 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0085471260000000004 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622186+0000", 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063410690000000004 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.817 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622292+0000", 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105305 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622385+0000", 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3801000000000005e-05 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1251 3.1d 3:ba0891d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.818 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.063912142, 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020778814999999999, 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1251 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.819 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:36.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:36.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.820 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.820 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.820 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.820 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743330+0000", 2024-09-12T17:07:36.820 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7000000000000002e-06 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748572+0000", 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052414710000000002 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748616+0000", 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4369000000000002e-05 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.821 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748636+0000", 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9582999999999999e-05 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748778+0000", 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141867 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749017+0000", 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000239218 2024-09-12T17:07:36.822 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749233+0000", 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021619799999999999 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.756641+0000", 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074078089999999996 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763784+0000", 2024-09-12T17:07:36.823 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0071433809999999999 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763958+0000", 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000173862 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.764106+0000", 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014735700000000001 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.824 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1259 3.5 3:a1f83edd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.651024275000001, 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024500529, 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.825 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1259 2024-09-12T17:07:36.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.826 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:36.826 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.826 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.826 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.826 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.826 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:36.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156217+0000", 2024-09-12T17:07:36.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8940000000000002e-06 2024-09-12T17:07:36.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.827 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.827 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.827 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160482+0000", 2024-09-12T17:07:36.827 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042645269999999997 2024-09-12T17:07:36.827 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160513+0000", 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1228e-05 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160526+0000", 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2976000000000001e-05 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.828 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160624+0000", 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8048999999999996e-05 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160825+0000", 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020054799999999999 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160997+0000", 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017260499999999999 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.829 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.169300+0000", 2024-09-12T17:07:36.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083027050000000005 2024-09-12T17:07:36.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180595+0000", 2024-09-12T17:07:36.830 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011294465 2024-09-12T17:07:36.830 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.830 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.830 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.830 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180660+0000", 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5616000000000003e-05 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180715+0000", 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4916000000000001e-05 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1262 3.5 3:a3a998f2:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.831 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.596391563000001, 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020328525, 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1262 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.832 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210850+0000", 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.005e-06 2024-09-12T17:07:36.833 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214862+0000", 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040120640000000001 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214903+0000", 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0831999999999998e-05 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214940+0000", 2024-09-12T17:07:36.834 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7036000000000003e-05 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215059+0000", 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118631 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215237+0000", 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017834900000000001 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.835 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215406+0000", 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016896200000000001 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.221184+0000", 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057780130000000002 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231002+0000", 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0098174969999999997 2024-09-12T17:07:36.836 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231096+0000", 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4204999999999997e-05 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231176+0000", 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9931000000000004e-05 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.837 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1264 3.c 3:30907361:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.575468577999999, 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021106314000000001, 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1264 2024-09-12T17:07:36.838 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.839 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231772+0000", 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1560000000000002e-06 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235787+0000", 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040149790000000001 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235824+0000", 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6956000000000003e-05 2024-09-12T17:07:36.840 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235843+0000", 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8315999999999999e-05 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235954+0000", 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111601 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.841 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236135+0000", 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000180941 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236302+0000", 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016626600000000001 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242422+0000", 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061200730000000002 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.842 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252655+0000", 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010232978 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252749+0000", 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4481000000000006e-05 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252877+0000", 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012756700000000001 2024-09-12T17:07:36.843 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1265 3.22 3:44204d7e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.564980392999999, 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021506441000000001, 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.844 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1265 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:36.845 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242262+0000", 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7299999999999999e-06 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246237+0000", 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039746989999999999 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.846 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246272+0000", 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5589000000000001e-05 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246290+0000", 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7107000000000001e-05 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246410+0000", 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119984 2024-09-12T17:07:36.847 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246589+0000", 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000179853 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246748+0000", 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158536 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.848 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252569+0000", 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058212810000000002 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263464+0000", 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010894406000000001 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263627+0000", 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000163833 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.849 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263765+0000", 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013742299999999999 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1269 3.c 3:3287b6aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.516353220999999, 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019007443999999998, 2024-09-12T17:07:36.850 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1269 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.851 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290890+0000", 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2529999999999998e-06 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.852 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294907+0000", 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004017189 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294952+0000", 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5252e-05 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294971+0000", 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8606000000000001e-05 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.853 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295107+0000", 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000135654 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295466+0000", 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000359448 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295948+0000", 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000482079 2024-09-12T17:07:36.854 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.308012+0000", 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012064210000000001 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309570+0000", 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015580839999999999 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.855 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309758+0000", 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000187522 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309893+0000", 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013514700000000001 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1275 3.16 3:68cda83e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.856 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.453656079000002, 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019055547999999999, 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1275 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.857 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353586+0000", 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0769999999999999e-06 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.858 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359376+0000", 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057904100000000002 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359400+0000", 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3805999999999999e-05 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359412+0000", 2024-09-12T17:07:36.859 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2404e-05 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359522+0000", 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109685 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359767+0000", 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024471399999999999 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.860 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.360035+0000", 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026762699999999999 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372243+0000", 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012208169 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372526+0000", 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028289599999999998 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.861 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372581+0000", 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5747e-05 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372638+0000", 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7012999999999998e-05 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.862 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1282 3.c 3:302741ef:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.5:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.466278+0000", 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.340961204999999, 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018897081999999999, 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1282 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.863 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.466278+0000", 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.466278+0000", 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.864 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.466280+0000", 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1959999999999998e-06 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471118+0000", 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048379460000000001 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471160+0000", 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2499000000000001e-05 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.865 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471178+0000", 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.766e-05 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471346+0000", 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016801300000000001 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.471770+0000", 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042415399999999999 2024-09-12T17:07:36.866 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.472909+0000", 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0011385 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.483340+0000", 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010431184 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.867 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.485061+0000", 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0017208830000000001 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.485116+0000", 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4889000000000003e-05 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.485175+0000", 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9157999999999998e-05 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.868 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1390 3.2f 3:f51d0419:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.430463353, 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019302698, 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.869 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1390 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.870 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376779+0000", 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8700000000000002e-06 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381020+0000", 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042401660000000001 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381069+0000", 2024-09-12T17:07:36.871 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9279e-05 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381098+0000", 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9110000000000001e-05 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381276+0000", 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017790199999999999 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.872 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381577+0000", 2024-09-12T17:07:36.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030131400000000001 2024-09-12T17:07:36.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:36.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381798+0000", 2024-09-12T17:07:36.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022053200000000001 2024-09-12T17:07:36.873 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.873 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.873 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.873 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.391131+0000", 2024-09-12T17:07:36.873 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093337400000000001 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395755+0000", 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004624034 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395932+0000", 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000176317 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.874 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.396078+0000", 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000146434 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1408 3.2a 3:56341a86:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.003374227999998, 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.030673474999999999, 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.875 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1408 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.876 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803868+0000", 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1130000000000001e-06 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808291+0000", 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044233120000000004 2024-09-12T17:07:36.877 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808331+0000", 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9869000000000001e-05 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808351+0000", 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9673e-05 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808511+0000", 2024-09-12T17:07:36.878 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015999699999999999 2024-09-12T17:07:36.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808843+0000", 2024-09-12T17:07:36.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033221900000000003 2024-09-12T17:07:36.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.879 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:36.879 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.809106+0000", 2024-09-12T17:07:36.879 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026355900000000002 2024-09-12T17:07:36.879 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.879 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.827691+0000", 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018584471000000002 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834339+0000", 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066477790000000004 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834448+0000", 2024-09-12T17:07:36.880 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109578 2024-09-12T17:07:36.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.881 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.881 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834538+0000", 2024-09-12T17:07:36.881 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9905000000000001e-05 2024-09-12T17:07:36.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.881 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.881 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.881 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.881 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.881 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1414 3.3a 3:5f72b292:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:36.881 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.890509+0000", 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.916730221999998, 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018777497000000001, 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1414 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.882 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.890509+0000", 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.890509+0000", 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.890513+0000", 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.07e-06 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.883 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.894491+0000", 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039787069999999997 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.894533+0000", 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1638999999999999e-05 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.894567+0000", 2024-09-12T17:07:36.884 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3689999999999998e-05 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.894754+0000", 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000187006 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.895081+0000", 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00032771900000000002 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:36.885 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.895342+0000", 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026024499999999999 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.903175+0000", 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0078331809999999998 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.909015+0000", 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005839622 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.886 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.909134+0000", 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119905 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.909286+0000", 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015171299999999999 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.887 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1884 3.16 3:6a49863c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.25:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.6491164029999998, 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02557398, 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1884 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.888 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:36.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:36.889 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.889 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.889 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.889 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.889 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158125+0000", 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1399999999999998e-06 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163204+0000", 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050792720000000001 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163244+0000", 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0522000000000003e-05 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.890 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163262+0000", 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7872000000000001e-05 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163395+0000", 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013291799999999999 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163698+0000", 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030317700000000001 2024-09-12T17:07:36.891 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.164523+0000", 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082438900000000002 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.181881+0000", 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017357991999999999 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.892 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183465+0000", 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015843509999999999 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183583+0000", 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118025 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183696+0000", 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113322 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.893 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1923 3.1d 3:bbfa0a4b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.RvdbUUXkO22SF-kwzRd4VKnEQTGoFzf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.7821445479999998, 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.029952679999999999, 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1923 2024-09-12T17:07:36.894 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.895 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025097+0000", 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6599999999999999e-06 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033262+0000", 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0081647409999999997 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033304+0000", 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2138000000000002e-05 2024-09-12T17:07:36.896 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033322+0000", 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8059000000000001e-05 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033512+0000", 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019057199999999999 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033775+0000", 2024-09-12T17:07:36.897 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026250299999999998 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034023+0000", 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024751999999999999 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.047403+0000", 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013380845000000001 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.898 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054890+0000", 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074861529999999997 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054976+0000", 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6644999999999995e-05 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.055047+0000", 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0844000000000001e-05 2024-09-12T17:07:36.899 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.900 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.900 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.900 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.900 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.900 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1990 3.28 3:17f1f290:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.41:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:36.900 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:36.900 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.4894475289999995, 2024-09-12T17:07:36.900 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019908233000000001, 2024-09-12T17:07:36.900 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.900 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.900 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.900 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1990 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.901 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317794+0000", 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.993e-06 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323013+0000", 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052182490000000003 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.902 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323051+0000", 2024-09-12T17:07:36.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8343000000000002e-05 2024-09-12T17:07:36.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323069+0000", 2024-09-12T17:07:36.903 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8082000000000001e-05 2024-09-12T17:07:36.903 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.903 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.903 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.903 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323264+0000", 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019453499999999999 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323530+0000", 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026603999999999999 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.324371+0000", 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00084152599999999999 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.904 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.336666+0000", 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012295276000000001 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337488+0000", 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082180399999999998 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337622+0000", 2024-09-12T17:07:36.905 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000133864 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337700+0000", 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7521000000000005e-05 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2125 3.4 e73/51 3:235ee04f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.q5_4TTRRhSFZvQfgJaK5ATByAODjVXJ_1:head v 73'6, mlcod=71'4)", 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:36.906 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.540041945, 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024265888999999999, 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.907 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0299999999999999e-07 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274450+0000", 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0072528879999999999 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.908 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274475+0000", 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5185e-05 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274491+0000", 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5305999999999999e-05 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274624+0000", 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000132915 2024-09-12T17:07:36.909 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274681+0000", 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7340999999999999e-05 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.291377+0000", 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016695451 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.910 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.291463+0000", 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6299999999999997e-05 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2128 3.5 3:a25f4989:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.64:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.5118153649999999, 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019706656999999999, 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.911 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2128 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295427+0000", 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4060000000000001e-06 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299816+0000", 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043890029999999998 2024-09-12T17:07:36.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299855+0000", 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8955000000000002e-05 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299873+0000", 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8359000000000002e-05 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.300038+0000", 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016448100000000001 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.300335+0000", 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029776899999999997 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.301250+0000", 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00091437699999999996 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.313996+0000", 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012745975 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.314902+0000", 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00090575699999999998 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.315023+0000", 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012113899999999999 2024-09-12T17:07:36.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.315130+0000", 2024-09-12T17:07:36.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010743600000000001 2024-09-12T17:07:36.917 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.917 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.917 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.917 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2137 3.4 e73/51 3:2101eb5b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.-SdXmNUYFTeVbonk8GPVYzJxRUjygU-_1:head v 73'7, mlcod=72'5)", 2024-09-12T17:07:36.917 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.534671+0000", 2024-09-12T17:07:36.917 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.2725677799999999, 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018971099000000002, 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.534671+0000", 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.534671+0000", 2024-09-12T17:07:36.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.534674+0000", 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5359999999999999e-06 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.540329+0000", 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056556660000000002 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.540365+0000", 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5382000000000001e-05 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.540381+0000", 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5971999999999999e-05 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.540536+0000", 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015578799999999999 2024-09-12T17:07:36.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.540602+0000", 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5578000000000001e-05 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.553538+0000", 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012935761 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.553642+0000", 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000104416 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2158 3.3a 3:5f23622e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.69:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.81905184499999995, 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025287745, 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.922 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2158 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988190+0000", 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.897e-06 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992248+0000", 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040576420000000002 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992288+0000", 2024-09-12T17:07:36.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9959000000000001e-05 2024-09-12T17:07:36.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992305+0000", 2024-09-12T17:07:36.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7813999999999999e-05 2024-09-12T17:07:36.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992495+0000", 2024-09-12T17:07:36.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018977800000000001 2024-09-12T17:07:36.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992759+0000", 2024-09-12T17:07:36.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026367399999999998 2024-09-12T17:07:36.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:36.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.993586+0000", 2024-09-12T17:07:36.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082746299999999996 2024-09-12T17:07:36.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.002363+0000", 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087768069999999993 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013296+0000", 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010932871 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013408+0000", 2024-09-12T17:07:36.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111709 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013475+0000", 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7131000000000005e-05 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2161 3.5 3:a0815047:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.1213Daer3gr3KDhM5kgqYBB_xC83lvZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:36.928 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 0.68065614100000005, 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020142651000000001, 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2161 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:36.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126586+0000", 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9830000000000001e-06 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130385+0000", 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037997009999999999 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130415+0000", 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9529000000000001e-05 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130427+0000", 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2351000000000001e-05 2024-09-12T17:07:36.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130516+0000", 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8214999999999995e-05 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130663+0000", 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147145 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:36.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130793+0000", 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012986700000000001 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.138966+0000", 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0081739810000000003 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146483+0000", 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.007516928 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146599+0000", 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115932 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146725+0000", 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000126019 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:36.934 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:36.935 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:07:36.936 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.74 2024-09-12T17:07:36.936 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:36.936 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 75 2024-09-12T17:07:36.936 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:36.937 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:36.937 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0129545 s, 809 MB/s 2024-09-12T17:07:36.937 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:36.938 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:36.933+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:36.977 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.75 2024-09-12T17:07:36.978 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:36.978 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 76 2024-09-12T17:07:36.989 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:36.989 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:36.989 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00941625 s, 1.1 GB/s 2024-09-12T17:07:37.037 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:37.033+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:37.096 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:37.096 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:37.112 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:37.113 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:37.118 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:37.119 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:37.119 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:37.119 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:37.119 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.76 2024-09-12T17:07:37.119 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:37.119 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 77 2024-09-12T17:07:37.129 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:37.129 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:37.129 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00871926 s, 1.2 GB/s 2024-09-12T17:07:37.130 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:37.130 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:37.134 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:37.146 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:37.146 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:37.167 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:37.167 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:37.179 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:37.177+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:37.189 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:37.190 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:37.211 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:37.211 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:37.216 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.77 2024-09-12T17:07:37.216 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:37.216 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 78 2024-09-12T17:07:37.226 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T17:07:37.227 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:37.227 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:37.227 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00868968 s, 1.2 GB/s 2024-09-12T17:07:37.232 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:37.233 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:37.238 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:37.232+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:37.317 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:37.317 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:37.326 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.78 2024-09-12T17:07:37.326 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:37.326 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 79 2024-09-12T17:07:37.336 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:37.339 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:37.332+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:37.340 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:37.340 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:37.340 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121574 s, 863 MB/s 2024-09-12T17:07:37.426 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.79 2024-09-12T17:07:37.426 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:37.427 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 80 2024-09-12T17:07:37.437 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:37.437 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:37.437 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0088014 s, 1.2 GB/s 2024-09-12T17:07:37.439 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:37.432+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:37.464 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:37.464 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:37.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:37.528 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.80 2024-09-12T17:07:37.528 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:37.528 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 81 2024-09-12T17:07:37.541 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:37.536+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:37.542 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:37.542 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:37.542 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0117665 s, 891 MB/s 2024-09-12T17:07:37.615 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:37.615 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:37.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:37.647 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.81 2024-09-12T17:07:37.648 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:37.648 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 82 2024-09-12T17:07:37.662 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:37.662 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:37.662 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119629 s, 877 MB/s 2024-09-12T17:07:37.679 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:37.677+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:37.746 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:37.741+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:37.752 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:37.752 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:37.770 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:37.790 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.82 2024-09-12T17:07:37.791 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:37.791 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 83 2024-09-12T17:07:37.805 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:37.805 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:37.805 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120617 s, 869 MB/s 2024-09-12T17:07:37.847 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:37.840+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:37.941 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:37.941 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:37.949 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.83 2024-09-12T17:07:37.949 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:37.949 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 84 2024-09-12T17:07:37.950 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:37.945+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:37.957 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:07:37.963 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:37.963 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:37.963 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0136318 s, 769 MB/s 2024-09-12T17:07:38.051 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:38.049+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:38.087 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.84 2024-09-12T17:07:38.087 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:38.087 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 85 2024-09-12T17:07:38.093 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:38.093 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:38.102 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:38.102 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:38.102 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0118184 s, 887 MB/s 2024-09-12T17:07:38.111 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:07:38.154 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:38.149+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:38.226 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T17:07:38.235 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.85 2024-09-12T17:07:38.235 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:38.235 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 86 2024-09-12T17:07:38.248 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:38.248 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:38.248 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108957 s, 962 MB/s 2024-09-12T17:07:38.255 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:38.248+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:38.298 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:38.298 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:38.314 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:07:38.360 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:38.356+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:38.360 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.86 2024-09-12T17:07:38.360 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:38.360 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 87 2024-09-12T17:07:38.372 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:38.373 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:38.373 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104683 s, 1.0 GB/s 2024-09-12T17:07:38.450 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:38.451 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:38.459 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:38.452+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:38.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:07:38.486 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.87 2024-09-12T17:07:38.486 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:38.486 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 88 2024-09-12T17:07:38.500 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:38.500 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:38.500 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113614 s, 923 MB/s 2024-09-12T17:07:38.559 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:38.556+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:38.621 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.88 2024-09-12T17:07:38.621 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:38.621 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 89 2024-09-12T17:07:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:38.633 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:38.634 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:38.634 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:38.634 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114803 s, 913 MB/s 2024-09-12T17:07:38.649 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:07:38.692 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:38.688+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:38.747 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.89 2024-09-12T17:07:38.747 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:38.747 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 90 2024-09-12T17:07:38.759 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:38.759 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:38.760 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104564 s, 1.0 GB/s 2024-09-12T17:07:38.761 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:38.757+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:38.847 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:38.848 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:38.858 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 3, 4, 5, 6, 7] out_osds: [1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T17:07:38.858 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T17:07:38.862 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:38.856+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:38.863 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:07:38.882 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.90 2024-09-12T17:07:38.882 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:38.882 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 91 2024-09-12T17:07:38.895 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:38.895 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:38.895 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120515 s, 870 MB/s 2024-09-12T17:07:38.963 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:38.961+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:38.993 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.91 2024-09-12T17:07:38.993 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:38.993 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 92 2024-09-12T17:07:39.004 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:39.004 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:39.004 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0089141 s, 1.2 GB/s 2024-09-12T17:07:39.035 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:39.035 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:39.058 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:07:39.097 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.92 2024-09-12T17:07:39.097 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:39.098 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 93 2024-09-12T17:07:39.098 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:39.092+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:39.107 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:39.107 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:39.107 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00893238 s, 1.2 GB/s 2024-09-12T17:07:39.165 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:39.160+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:39.209 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.93 2024-09-12T17:07:39.209 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:39.209 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 94 2024-09-12T17:07:39.220 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:39.220 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:39.220 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00905402 s, 1.2 GB/s 2024-09-12T17:07:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T17:07:39.230 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:39.231 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:39.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T17:07:39.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:07:39.257 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:07:39.306 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:39.300+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:39.330 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.94 2024-09-12T17:07:39.330 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:39.330 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 95 2024-09-12T17:07:39.341 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:39.341 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:39.341 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00925025 s, 1.1 GB/s 2024-09-12T17:07:39.366 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:39.360+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:39.455 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:39.455 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:39.457 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.95 2024-09-12T17:07:39.457 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:39.457 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 96 2024-09-12T17:07:39.468 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:39.464+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:39.468 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:39.468 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:39.468 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00890748 s, 1.2 GB/s 2024-09-12T17:07:39.472 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:39.472 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:39.487 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:39.488 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:39.491 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:39.491 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:39.510 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:07:39.510 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:39.511 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:39.533 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:39.534 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:39.558 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:39.559 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:39.571 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:39.565+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:39.584 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:39.584 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:39.586 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.96 2024-09-12T17:07:39.586 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:39.586 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 97 2024-09-12T17:07:39.600 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:39.600 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:39.600 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0130077 s, 806 MB/s 2024-09-12T17:07:39.613 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:39.613 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:39.668 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:39.668 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:39.668 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1170 3.21 3:87f83b83:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.357682634, 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019752527999999998, 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.669 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1170 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.670 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307314+0000", 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.734e-06 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308952+0000", 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016376190000000001 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308985+0000", 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3624000000000002e-05 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.671 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308999+0000", 2024-09-12T17:07:39.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3127e-05 2024-09-12T17:07:39.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309087+0000", 2024-09-12T17:07:39.672 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8244000000000004e-05 2024-09-12T17:07:39.672 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.672 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.672 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.672 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309212+0000", 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012551500000000001 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309309+0000", 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7157000000000005e-05 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.314345+0000", 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050351900000000002 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.673 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.326922+0000", 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012577319 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327013+0000", 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0801e-05 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327065+0000", 2024-09-12T17:07:39.674 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2197999999999997e-05 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1173 3.1c 3:3ac09143:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.325322018000001, 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023664096999999999, 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.675 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1173 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:39.676 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339676+0000", 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341224+0000", 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015477679999999999 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.677 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341253+0000", 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9094999999999998e-05 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341267+0000", 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3624e-05 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341349+0000", 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1766000000000003e-05 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.678 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341485+0000", 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013647099999999999 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341587+0000", 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010150899999999999 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.345980+0000", 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043931990000000004 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.679 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363206+0000", 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017225963 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363278+0000", 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2577999999999995e-05 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363337+0000", 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8839999999999999e-05 2024-09-12T17:07:39.680 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1218 3.21 3:84169186:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 27.636501397, 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018163809, 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.681 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1218 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.682 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028495+0000", 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7850000000000001e-06 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030091+0000", 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015958260000000001 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030124+0000", 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2990000000000001e-05 2024-09-12T17:07:39.683 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030144+0000", 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9381e-05 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030232+0000", 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8494999999999999e-05 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.684 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030355+0000", 2024-09-12T17:07:39.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012280700000000001 2024-09-12T17:07:39.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:39.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030508+0000", 2024-09-12T17:07:39.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015261300000000001 2024-09-12T17:07:39.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.685 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.685 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.685 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.035197+0000", 2024-09-12T17:07:39.685 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046889339999999996 2024-09-12T17:07:39.685 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046453+0000", 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011256339000000001 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046565+0000", 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112521 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.686 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046658+0000", 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2118000000000001e-05 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1235 3.1c 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 27.107015663999999, 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027479018000000001, 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.687 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1235 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.688 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557983+0000", 2024-09-12T17:07:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.941e-06 2024-09-12T17:07:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560826+0000", 2024-09-12T17:07:39.689 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028422479999999999 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560855+0000", 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8999000000000001e-05 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560870+0000", 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5231999999999999e-05 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.690 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560956+0000", 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6391999999999995e-05 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561123+0000", 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016676199999999999 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561284+0000", 2024-09-12T17:07:39.691 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160672 2024-09-12T17:07:39.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.567185+0000", 2024-09-12T17:07:39.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059013720000000002 2024-09-12T17:07:39.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.692 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.692 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585343+0000", 2024-09-12T17:07:39.692 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018157514999999999 2024-09-12T17:07:39.692 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.692 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585409+0000", 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6210999999999993e-05 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585458+0000", 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9673999999999999e-05 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.693 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1373 3.2d e64/24 3:b512a50c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_5:head v 64'8, mlcod=64'6)", 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.472424501999999, 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018448697999999999, 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.694 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192572+0000", 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6789999999999999e-06 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198743+0000", 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061702900000000001 2024-09-12T17:07:39.695 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198764+0000", 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1016999999999999e-05 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198774+0000", 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0387999999999999e-05 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.696 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198892+0000", 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117761 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198917+0000", 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5060999999999999e-05 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.210945+0000", 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012028492 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.697 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.211019+0000", 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4010000000000005e-05 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1407 3.21 3:85243711:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.873153015, 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020947763000000001, 2024-09-12T17:07:39.698 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1407 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.699 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791845+0000", 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.683e-06 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796758+0000", 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049128230000000002 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.700 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796800+0000", 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2613e-05 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796819+0000", 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8632999999999999e-05 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796934+0000", 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011525499999999999 2024-09-12T17:07:39.701 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797083+0000", 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149376 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797216+0000", 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132848 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.804681+0000", 2024-09-12T17:07:39.702 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0074645960000000004 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812614+0000", 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079326510000000006 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812720+0000", 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106909 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812790+0000", 2024-09-12T17:07:39.703 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9375999999999994e-05 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1416 3.0 3:03f8363f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.754532975, 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023938686000000001, 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.704 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1416 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:39.705 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910465+0000", 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8569999999999999e-06 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912455+0000", 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019900009999999999 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912491+0000", 2024-09-12T17:07:39.706 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5522000000000003e-05 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912506+0000", 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5928000000000001e-05 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912607+0000", 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010094099999999999 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.707 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912784+0000", 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000176851 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912927+0000", 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142502 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.918121+0000", 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051943290000000001 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.708 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934276+0000", 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016155426000000001 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934347+0000", 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0970000000000007e-05 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934401+0000", 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3359000000000002e-05 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.709 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1421 3.2e 3:76cf3736:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.705060469999999, 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018499980999999999, 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.710 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1421 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.711 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959937+0000", 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962168+0000", 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002231004 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962202+0000", 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3704000000000001e-05 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.712 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962218+0000", 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5732000000000001e-05 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962302+0000", 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4165999999999993e-05 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962472+0000", 2024-09-12T17:07:39.713 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000169863 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962643+0000", 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017084000000000001 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.967183+0000", 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045406090000000001 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.714 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978294+0000", 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011110480000000001 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978376+0000", 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2522999999999996e-05 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978435+0000", 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8425999999999999e-05 2024-09-12T17:07:39.715 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1899 3.21 3:87e83b37:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.TqvupIMz_YBVo8UQwbzZKEaVUuoNehW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.499595+0000", 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.1654003670000002, 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021513126, 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.716 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1899 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.499595+0000", 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.499595+0000", 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.717 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.499598+0000", 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7330000000000001e-06 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502077+0000", 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024790229999999999 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.718 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502119+0000", 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2008999999999997e-05 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502135+0000", 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5619000000000001e-05 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502246+0000", 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011110799999999999 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.719 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502494+0000", 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024810700000000002 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502713+0000", 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021841800000000001 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.511955+0000", 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0092418729999999994 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.720 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.520919+0000", 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089645000000000002 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.521032+0000", 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112383 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.521108+0000", 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6353000000000006e-05 2024-09-12T17:07:39.721 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1941 3.0 3:027dd256:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.vaucv35rBclacx5OUimU27x8JBlyouo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:31.426933+0000", 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.238062137, 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017902310000000001, 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.722 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1941 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.426933+0000", 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.426933+0000", 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.723 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.426936+0000", 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4640000000000002e-06 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.428466+0000", 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001529667 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.724 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.428496+0000", 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0173999999999999e-05 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.428508+0000", 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1666e-05 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.428588+0000", 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9604999999999994e-05 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.725 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.428722+0000", 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000134105 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.428839+0000", 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117365 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.433882+0000", 2024-09-12T17:07:39.726 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050430500000000003 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.444704+0000", 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010821949000000001 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.444774+0000", 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0198999999999997e-05 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.727 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.444835+0000", 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.1066000000000001e-05 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1975 3.1c 3:3805ec2a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.jnyWlqSvXNPIAN3dK-0eL-Xl-MeMoAE_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:32.015571+0000", 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.6494238780000003, 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024966074000000001, 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.728 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1975 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.015571+0000", 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.729 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.015571+0000", 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.015576+0000", 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9729999999999997e-06 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.019608+0000", 2024-09-12T17:07:39.730 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040314599999999997 2024-09-12T17:07:39.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.019653+0000", 2024-09-12T17:07:39.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4990000000000001e-05 2024-09-12T17:07:39.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.731 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.731 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.019673+0000", 2024-09-12T17:07:39.731 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9927000000000001e-05 2024-09-12T17:07:39.731 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.731 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.019839+0000", 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016682900000000001 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.020109+0000", 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026921399999999999 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.020341+0000", 2024-09-12T17:07:39.732 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023246900000000001 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.034871+0000", 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014529495999999999 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.040325+0000", 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054543109999999999 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.733 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.040416+0000", 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1506000000000001e-05 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.040537+0000", 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120899 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1981 3.2e 3:75b4d622:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.DHv_qNfW1ugGvVwwMJm3RIrQK33ulM0_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:39.734 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:32.169675+0000", 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.4953205680000003, 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019548751999999999, 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1981 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.735 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.169675+0000", 2024-09-12T17:07:39.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.169675+0000", 2024-09-12T17:07:39.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.736 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.736 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.736 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.736 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.169679+0000", 2024-09-12T17:07:39.736 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1799999999999998e-06 2024-09-12T17:07:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172140+0000", 2024-09-12T17:07:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024608870000000001 2024-09-12T17:07:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172175+0000", 2024-09-12T17:07:39.737 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5775999999999998e-05 2024-09-12T17:07:39.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172191+0000", 2024-09-12T17:07:39.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5235999999999999e-05 2024-09-12T17:07:39.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.738 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.738 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172355+0000", 2024-09-12T17:07:39.738 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000164883 2024-09-12T17:07:39.738 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.738 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172758+0000", 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040222800000000003 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.173172+0000", 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041465000000000002 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.183831+0000", 2024-09-12T17:07:39.739 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010658495 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.188992+0000", 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051616229999999997 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.189081+0000", 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8790999999999997e-05 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.740 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.741 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.189223+0000", 2024-09-12T17:07:39.741 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142003 2024-09-12T17:07:39.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.741 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.741 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.741 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.741 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.742 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1984 3.38 3:1dd59a50:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.40:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:39.742 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:32.193565+0000", 2024-09-12T17:07:39.742 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.4714300360000001, 2024-09-12T17:07:39.742 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019128305000000002, 2024-09-12T17:07:39.742 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.742 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.742 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.742 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.742 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1984 2024-09-12T17:07:39.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.743 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.193565+0000", 2024-09-12T17:07:39.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.743 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.743 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.743 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.743 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.193565+0000", 2024-09-12T17:07:39.743 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.193568+0000", 2024-09-12T17:07:39.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.897e-06 2024-09-12T17:07:39.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.744 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.744 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.744 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.195649+0000", 2024-09-12T17:07:39.744 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020805620000000002 2024-09-12T17:07:39.744 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.195684+0000", 2024-09-12T17:07:39.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5944e-05 2024-09-12T17:07:39.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.745 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.745 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.745 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.195702+0000", 2024-09-12T17:07:39.745 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7374e-05 2024-09-12T17:07:39.745 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.195806+0000", 2024-09-12T17:07:39.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104104 2024-09-12T17:07:39.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.746 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.746 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.746 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.196006+0000", 2024-09-12T17:07:39.746 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020045600000000001 2024-09-12T17:07:39.746 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.196745+0000", 2024-09-12T17:07:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073819200000000004 2024-09-12T17:07:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.205729+0000", 2024-09-12T17:07:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089840010000000001 2024-09-12T17:07:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.747 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.212556+0000", 2024-09-12T17:07:39.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068270429999999997 2024-09-12T17:07:39.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.748 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.212636+0000", 2024-09-12T17:07:39.748 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0408000000000007e-05 2024-09-12T17:07:39.748 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.748 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.748 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.749 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.212693+0000", 2024-09-12T17:07:39.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7324000000000002e-05 2024-09-12T17:07:39.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.749 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.749 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.749 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.749 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.749 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1987 3.21 3:87fea81b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.WuniG_VTTofaI6Y_i6SAkiz4T-cD3pD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:39.749 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:32.295771+0000", 2024-09-12T17:07:39.749 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 7.3692236839999996, 2024-09-12T17:07:39.749 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017969545999999999, 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1987 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.295771+0000", 2024-09-12T17:07:39.750 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.295771+0000", 2024-09-12T17:07:39.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.751 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.751 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.295774+0000", 2024-09-12T17:07:39.751 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0819999999999999e-06 2024-09-12T17:07:39.751 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.751 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297227+0000", 2024-09-12T17:07:39.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014524410000000001 2024-09-12T17:07:39.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297254+0000", 2024-09-12T17:07:39.752 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7538e-05 2024-09-12T17:07:39.752 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.752 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.752 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.752 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297268+0000", 2024-09-12T17:07:39.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3084e-05 2024-09-12T17:07:39.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297344+0000", 2024-09-12T17:07:39.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6428999999999996e-05 2024-09-12T17:07:39.753 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.753 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.753 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.753 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297491+0000", 2024-09-12T17:07:39.753 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014728500000000001 2024-09-12T17:07:39.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:39.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297596+0000", 2024-09-12T17:07:39.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104641 2024-09-12T17:07:39.754 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.754 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.754 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.754 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.302509+0000", 2024-09-12T17:07:39.754 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049128119999999999 2024-09-12T17:07:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.313653+0000", 2024-09-12T17:07:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011144708 2024-09-12T17:07:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.313693+0000", 2024-09-12T17:07:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9499000000000002e-05 2024-09-12T17:07:39.755 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.756 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.756 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.313741+0000", 2024-09-12T17:07:39.756 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8026999999999999e-05 2024-09-12T17:07:39.756 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.756 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.756 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.756 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.756 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.756 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2125 3.4 3:235ee04f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.q5_4TTRRhSFZvQfgJaK5ATByAODjVXJ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:39.756 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.263750+0000", 2024-09-12T17:07:39.757 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.4012447339999996, 2024-09-12T17:07:39.757 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027555090000000001, 2024-09-12T17:07:39.757 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.757 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.757 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.757 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.757 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.757 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.757 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2125 2024-09-12T17:07:39.757 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.758 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.263750+0000", 2024-09-12T17:07:39.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.758 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.758 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.758 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.263750+0000", 2024-09-12T17:07:39.758 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.758 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.263754+0000", 2024-09-12T17:07:39.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.331e-06 2024-09-12T17:07:39.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.759 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.265927+0000", 2024-09-12T17:07:39.759 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021734250000000001 2024-09-12T17:07:39.759 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.759 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.759 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.265962+0000", 2024-09-12T17:07:39.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5333999999999997e-05 2024-09-12T17:07:39.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.760 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.265981+0000", 2024-09-12T17:07:39.760 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8147000000000001e-05 2024-09-12T17:07:39.760 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.760 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.760 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.266129+0000", 2024-09-12T17:07:39.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148002 2024-09-12T17:07:39.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.266264+0000", 2024-09-12T17:07:39.761 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000135251 2024-09-12T17:07:39.761 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.761 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.761 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:39.761 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.266358+0000", 2024-09-12T17:07:39.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4231e-05 2024-09-12T17:07:39.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.271446+0000", 2024-09-12T17:07:39.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050883359999999997 2024-09-12T17:07:39.762 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.762 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.762 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.762 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.291215+0000", 2024-09-12T17:07:39.762 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019768941000000002 2024-09-12T17:07:39.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.291274+0000", 2024-09-12T17:07:39.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8304999999999998e-05 2024-09-12T17:07:39.763 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.763 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.763 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.763 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.291305+0000", 2024-09-12T17:07:39.763 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1786999999999999e-05 2024-09-12T17:07:39.763 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.764 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.764 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.764 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.764 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.764 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2126 3.21 3:86f88542:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.q5_4TTRRhSFZvQfgJaK5ATByAODjVXJ_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:39.764 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.268288+0000", 2024-09-12T17:07:39.764 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.3967066629999998, 2024-09-12T17:07:39.764 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020887334, 2024-09-12T17:07:39.764 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.764 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.764 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.765 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.765 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.765 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.765 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2126 2024-09-12T17:07:39.765 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.765 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.765 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.765 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.268288+0000", 2024-09-12T17:07:39.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.268288+0000", 2024-09-12T17:07:39.766 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.766 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.766 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.766 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.766 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.268291+0000", 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6299999999999998e-06 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.269586+0000", 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001295109 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.269607+0000", 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0608e-05 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.767 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.269621+0000", 2024-09-12T17:07:39.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4375999999999999e-05 2024-09-12T17:07:39.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.768 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.269698+0000", 2024-09-12T17:07:39.768 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6497999999999998e-05 2024-09-12T17:07:39.768 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.768 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.768 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.269840+0000", 2024-09-12T17:07:39.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014262899999999999 2024-09-12T17:07:39.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:39.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.269981+0000", 2024-09-12T17:07:39.769 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014041600000000001 2024-09-12T17:07:39.769 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.769 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.769 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.769 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.273902+0000", 2024-09-12T17:07:39.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039212420000000001 2024-09-12T17:07:39.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.289101+0000", 2024-09-12T17:07:39.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015199538 2024-09-12T17:07:39.770 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.770 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.770 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.770 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.289143+0000", 2024-09-12T17:07:39.770 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1056999999999997e-05 2024-09-12T17:07:39.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.771 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.771 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.289176+0000", 2024-09-12T17:07:39.771 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3231000000000001e-05 2024-09-12T17:07:39.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.771 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.771 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.771 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.771 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.771 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2137 3.4 3:2101eb5b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.-SdXmNUYFTeVbonk8GPVYzJxRUjygU-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:39.772 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.531627+0000", 2024-09-12T17:07:39.772 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.1333678420000002, 2024-09-12T17:07:39.772 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021855896999999999, 2024-09-12T17:07:39.772 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.772 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.772 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.772 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.773 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.773 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2137 2024-09-12T17:07:39.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.773 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.773 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.773 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.773 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.531627+0000", 2024-09-12T17:07:39.773 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.773 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.531627+0000", 2024-09-12T17:07:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.531630+0000", 2024-09-12T17:07:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1760000000000002e-06 2024-09-12T17:07:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.774 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.533530+0000", 2024-09-12T17:07:39.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018992429999999999 2024-09-12T17:07:39.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.533560+0000", 2024-09-12T17:07:39.775 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.025e-05 2024-09-12T17:07:39.775 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.775 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.775 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.775 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.533575+0000", 2024-09-12T17:07:39.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5277e-05 2024-09-12T17:07:39.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.533683+0000", 2024-09-12T17:07:39.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010754100000000001 2024-09-12T17:07:39.776 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.776 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.776 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.776 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.533816+0000", 2024-09-12T17:07:39.776 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013308499999999999 2024-09-12T17:07:39.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:39.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.533943+0000", 2024-09-12T17:07:39.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012688900000000001 2024-09-12T17:07:39.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.777 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.777 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.777 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.542988+0000", 2024-09-12T17:07:39.777 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0090456000000000009 2024-09-12T17:07:39.777 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.553393+0000", 2024-09-12T17:07:39.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010404564999999999 2024-09-12T17:07:39.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.778 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.553447+0000", 2024-09-12T17:07:39.778 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3965999999999998e-05 2024-09-12T17:07:39.778 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.778 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.778 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.779 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.553483+0000", 2024-09-12T17:07:39.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6304999999999999e-05 2024-09-12T17:07:39.779 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.779 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.779 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.779 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.779 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.779 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2149 3.4 3:22ceee78:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.ztW9hYOXCpwN7-3xmpmJlE3tun-JKcC_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:39.779 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.814873+0000", 2024-09-12T17:07:39.779 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.850122169, 2024-09-12T17:07:39.779 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020723927999999999, 2024-09-12T17:07:39.780 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.780 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.780 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.780 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.780 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2149 2024-09-12T17:07:39.780 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.780 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.780 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.814873+0000", 2024-09-12T17:07:39.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.814873+0000", 2024-09-12T17:07:39.781 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.781 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.781 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.781 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.781 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.814879+0000", 2024-09-12T17:07:39.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5899999999999998e-06 2024-09-12T17:07:39.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.817039+0000", 2024-09-12T17:07:39.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021602750000000001 2024-09-12T17:07:39.782 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.782 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.782 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.782 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.817088+0000", 2024-09-12T17:07:39.782 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9499999999999997e-05 2024-09-12T17:07:39.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.817110+0000", 2024-09-12T17:07:39.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1297e-05 2024-09-12T17:07:39.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.783 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.783 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.817292+0000", 2024-09-12T17:07:39.783 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000182809 2024-09-12T17:07:39.783 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.783 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.817642+0000", 2024-09-12T17:07:39.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034923799999999998 2024-09-12T17:07:39.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:39.784 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.817883+0000", 2024-09-12T17:07:39.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024093000000000001 2024-09-12T17:07:39.784 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.784 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.784 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.824524+0000", 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066410339999999997 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.835418+0000", 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010894309 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.835514+0000", 2024-09-12T17:07:39.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6479999999999998e-05 2024-09-12T17:07:39.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.835597+0000", 2024-09-12T17:07:39.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2466000000000006e-05 2024-09-12T17:07:39.786 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.786 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.786 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.786 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2164 3.21 3:85d46b70:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.70:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:39.787 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.149959+0000", 2024-09-12T17:07:39.787 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.515035857, 2024-09-12T17:07:39.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023326969999999999, 2024-09-12T17:07:39.787 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.787 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.787 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.787 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:39.787 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:39.787 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:39.787 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2164 2024-09-12T17:07:39.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.788 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.149959+0000", 2024-09-12T17:07:39.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.149959+0000", 2024-09-12T17:07:39.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.149963+0000", 2024-09-12T17:07:39.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6239999999999999e-06 2024-09-12T17:07:39.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.152527+0000", 2024-09-12T17:07:39.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00256412 2024-09-12T17:07:39.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.152572+0000", 2024-09-12T17:07:39.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5232999999999999e-05 2024-09-12T17:07:39.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.152592+0000", 2024-09-12T17:07:39.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9692999999999999e-05 2024-09-12T17:07:39.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.152764+0000", 2024-09-12T17:07:39.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000172499 2024-09-12T17:07:39.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.153028+0000", 2024-09-12T17:07:39.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026360199999999999 2024-09-12T17:07:39.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:39.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.153879+0000", 2024-09-12T17:07:39.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085114800000000003 2024-09-12T17:07:39.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:39.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.171316+0000", 2024-09-12T17:07:39.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017436963 2024-09-12T17:07:39.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.792 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.792 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:39.792 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.173119+0000", 2024-09-12T17:07:39.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001803147 2024-09-12T17:07:39.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.173217+0000", 2024-09-12T17:07:39.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7387999999999997e-05 2024-09-12T17:07:39.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.173286+0000", 2024-09-12T17:07:39.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9553000000000003e-05 2024-09-12T17:07:39.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.797 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.798 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:2173 3.2d e73/24 3:b4393a9e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.Wj90S10sGnKqRbk_9HpntodOyKiVSPB_1:head v 73'13, mlcod=71'11)", 2024-09-12T17:07:39.798 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.429621+0000", 2024-09-12T17:07:39.798 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.235373842, 2024-09-12T17:07:39.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017766627, 2024-09-12T17:07:39.798 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:39.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:39.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:39.798 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:39.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.798 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:39.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.429621+0000", 2024-09-12T17:07:39.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:39.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.429621+0000", 2024-09-12T17:07:39.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:39.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:39.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.429622+0000", 2024-09-12T17:07:39.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8599999999999998e-07 2024-09-12T17:07:39.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:39.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.436644+0000", 2024-09-12T17:07:39.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0070222779999999999 2024-09-12T17:07:39.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:39.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.436677+0000", 2024-09-12T17:07:39.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2823000000000001e-05 2024-09-12T17:07:39.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:39.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.436692+0000", 2024-09-12T17:07:39.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5043e-05 2024-09-12T17:07:39.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:39.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.436852+0000", 2024-09-12T17:07:39.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015991900000000001 2024-09-12T17:07:39.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.436915+0000", 2024-09-12T17:07:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3468999999999998e-05 2024-09-12T17:07:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.447247+0000", 2024-09-12T17:07:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.01033194 2024-09-12T17:07:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:39.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:39.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.447388+0000", 2024-09-12T17:07:39.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000140569 2024-09-12T17:07:39.803 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.803 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.803 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.803 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:39.803 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:39.803 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:39.805 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:07:39.806 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.97 2024-09-12T17:07:39.806 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:39.806 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 98 2024-09-12T17:07:39.806 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:39.806 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:39.806 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00891095 s, 1.2 GB/s 2024-09-12T17:07:39.807 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:39.801+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:39.809 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.98 2024-09-12T17:07:39.810 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:39.810 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 99 2024-09-12T17:07:39.823 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:39.823 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:39.823 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113006 s, 928 MB/s 2024-09-12T17:07:39.906 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:39.900+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:39.922 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.99 2024-09-12T17:07:39.922 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:39.922 INFO:tasks.workunit.client.0.smithi017.stdout:uploading file - part 100 2024-09-12T17:07:39.937 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records in 2024-09-12T17:07:39.937 INFO:tasks.workunit.client.0.smithi017.stderr:1+0 records out 2024-09-12T17:07:39.937 INFO:tasks.workunit.client.0.smithi017.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012058 s, 870 MB/s 2024-09-12T17:07:39.951 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:39.951 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:39.951 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:39.967 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:07:40.030 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:40.025+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:40.131 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:40.124+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:40.158 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:40.158 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:40.158 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:40.158 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:40.159 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:40.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:07:40.238 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T17:07:40.240 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:40.232+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:40.255 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T17:07:40.267 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-12T17:07:40.360 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1201 3.8 3:114be366:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.543917468, 2024-09-12T17:07:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021172410999999999, 2024-09-12T17:07:40.360 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1201 2024-09-12T17:07:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:40.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812956+0000", 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3050000000000001e-06 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816133+0000", 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031766699999999999 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816165+0000", 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2197999999999999e-05 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816177+0000", 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1973999999999999e-05 2024-09-12T17:07:40.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816249+0000", 2024-09-12T17:07:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1898999999999997e-05 2024-09-12T17:07:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816385+0000", 2024-09-12T17:07:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013646400000000001 2024-09-12T17:07:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816513+0000", 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128097 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.821736+0000", 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052224869999999996 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834015+0000", 2024-09-12T17:07:40.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012279784 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834087+0000", 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1935999999999997e-05 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834125+0000", 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7596999999999999e-05 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.366 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1202 3.2 3:421b0e45:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.534133681, 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018086743999999998, 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.367 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1202 2024-09-12T17:07:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822739+0000", 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2589999999999999e-06 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824478+0000", 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001739256 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824502+0000", 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3952999999999999e-05 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824514+0000", 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2031999999999999e-05 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824577+0000", 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2793999999999995e-05 2024-09-12T17:07:40.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824714+0000", 2024-09-12T17:07:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013785199999999999 2024-09-12T17:07:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824862+0000", 2024-09-12T17:07:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147751 2024-09-12T17:07:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.830267+0000", 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054052670000000001 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840734+0000", 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010466938 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840780+0000", 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5831999999999998e-05 2024-09-12T17:07:40.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840823+0000", 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2809999999999998e-05 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1210 3.29 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.413389420000001, 2024-09-12T17:07:40.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021481673, 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1210 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:40.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:40.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943483+0000", 2024-09-12T17:07:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6520000000000002e-06 2024-09-12T17:07:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945771+0000", 2024-09-12T17:07:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022874829999999999 2024-09-12T17:07:40.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945806+0000", 2024-09-12T17:07:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4836999999999999e-05 2024-09-12T17:07:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945820+0000", 2024-09-12T17:07:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939e-05 2024-09-12T17:07:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945888+0000", 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7702999999999999e-05 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946027+0000", 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000139135 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946146+0000", 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118742 2024-09-12T17:07:40.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.950285+0000", 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041384880000000001 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964885+0000", 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014600594 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964928+0000", 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2536000000000001e-05 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964962+0000", 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4564000000000003e-05 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1216 3.33 3:cf30ff9d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:40.380 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.348904645000001, 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023290796999999999, 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1216 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007968+0000", 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0580000000000002e-06 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009686+0000", 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017173920000000001 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009718+0000", 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2632999999999997e-05 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009734+0000", 2024-09-12T17:07:40.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6011999999999998e-05 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009834+0000", 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9947999999999999e-05 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010000+0000", 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016520599999999999 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010133+0000", 2024-09-12T17:07:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133676 2024-09-12T17:07:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.015744+0000", 2024-09-12T17:07:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056104570000000001 2024-09-12T17:07:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031150+0000", 2024-09-12T17:07:40.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015405894999999999 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031209+0000", 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9247999999999999e-05 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031256+0000", 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7271999999999997e-05 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1230 3.24 3:257b3201:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 27.873635594, 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018874753000000001, 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1230 2024-09-12T17:07:40.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483238+0000", 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2880000000000001e-06 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485868+0000", 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026303490000000001 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485904+0000", 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5513999999999999e-05 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485920+0000", 2024-09-12T17:07:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6201999999999998e-05 2024-09-12T17:07:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486092+0000", 2024-09-12T17:07:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017220700000000001 2024-09-12T17:07:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486500+0000", 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040771200000000002 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486750+0000", 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025026699999999998 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.500598+0000", 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013848226 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.501939+0000", 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013409839999999999 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502016+0000", 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6908000000000003e-05 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502109+0000", 2024-09-12T17:07:40.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3096000000000004e-05 2024-09-12T17:07:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1387 3.8 3:122cdcfa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 24.018581254000001, 2024-09-12T17:07:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018409291000000001, 2024-09-12T17:07:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.393 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1387 2024-09-12T17:07:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:40.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338292+0000", 2024-09-12T17:07:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.631e-06 2024-09-12T17:07:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340227+0000", 2024-09-12T17:07:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001934217 2024-09-12T17:07:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340262+0000", 2024-09-12T17:07:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5893999999999999e-05 2024-09-12T17:07:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340278+0000", 2024-09-12T17:07:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5325e-05 2024-09-12T17:07:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340387+0000", 2024-09-12T17:07:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010876 2024-09-12T17:07:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340570+0000", 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018296299999999999 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340735+0000", 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568400000000001 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.345914+0000", 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051783319999999999 2024-09-12T17:07:40.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356536+0000", 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010622529 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356632+0000", 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5927000000000005e-05 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356698+0000", 2024-09-12T17:07:40.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6029000000000001e-05 2024-09-12T17:07:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1733 3.33 3:cd3b7926:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.M8SFsRZfEjvXnxNc1Ny07cg_vtwVJ9y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T17:07:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.289271662000001, 2024-09-12T17:07:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024112788, 2024-09-12T17:07:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1733 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067603+0000", 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.707e-06 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072541+0000", 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049382710000000002 2024-09-12T17:07:40.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072582+0000", 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0392999999999998e-05 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072606+0000", 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4303000000000001e-05 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072745+0000", 2024-09-12T17:07:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013889300000000001 2024-09-12T17:07:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072967+0000", 2024-09-12T17:07:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022192800000000001 2024-09-12T17:07:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.073233+0000", 2024-09-12T17:07:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026631499999999999 2024-09-12T17:07:40.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.086312+0000", 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013078579 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091563+0000", 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052509369999999998 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091648+0000", 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5051999999999998e-05 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091711+0000", 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3410000000000004e-05 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1887 3.33 3:cf01266b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.yI34Oa84OEb7C49UYPF9HCMJS_d1s3T_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:40.406 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.093784305, 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018315027000000001, 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1887 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.407 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263090+0000", 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0239999999999999e-06 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265411+0000", 2024-09-12T17:07:40.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00232132 2024-09-12T17:07:40.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265443+0000", 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1718999999999999e-05 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265455+0000", 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2143999999999999e-05 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265535+0000", 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9659000000000004e-05 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265655+0000", 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120902 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265755+0000", 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9761999999999998e-05 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.272399+0000", 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066442510000000003 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281321+0000", 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089219669999999994 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281358+0000", 2024-09-12T17:07:40.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6355e-05 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281401+0000", 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2923999999999998e-05 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1920 3.8 3:11cda29a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.31:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:40.417 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.4430157060000006, 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022252124000000002, 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1920 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913858+0000", 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0770000000000001e-06 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917854+0000", 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039960600000000001 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917898+0000", 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3689999999999997e-05 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917917+0000", 2024-09-12T17:07:40.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9233e-05 2024-09-12T17:07:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.918051+0000", 2024-09-12T17:07:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133969 2024-09-12T17:07:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.918315+0000", 2024-09-12T17:07:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000263355 2024-09-12T17:07:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.919198+0000", 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00088375200000000002 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.928506+0000", 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0093070960000000008 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936025+0000", 2024-09-12T17:07:40.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075193400000000002 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936073+0000", 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8012e-05 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936106+0000", 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3540000000000001e-05 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1938 3.19 3:9addcbec:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.34:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.023875211, 2024-09-12T17:07:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020463775, 2024-09-12T17:07:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.424 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1938 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332997+0000", 2024-09-12T17:07:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5100000000000001e-06 2024-09-12T17:07:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337007+0000", 2024-09-12T17:07:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040099979999999999 2024-09-12T17:07:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337054+0000", 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6826000000000002e-05 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337073+0000", 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8743e-05 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337189+0000", 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116507 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337415+0000", 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022530099999999999 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.338022+0000", 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00060701600000000004 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.347566+0000", 2024-09-12T17:07:40.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0095447150000000005 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353379+0000", 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058124170000000003 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353425+0000", 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5824e-05 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353459+0000", 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3918000000000003e-05 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2101 3.24 3:25ca6521:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.4pZZCgy-wBJXiNQ0J0vFl8TPz4X_i3J_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.5460855520000001, 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018837217999999999, 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2101 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810788+0000", 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0069999999999999e-06 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812434+0000", 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016459020000000001 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812468+0000", 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3173999999999998e-05 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812482+0000", 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3985000000000001e-05 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812582+0000", 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100801 2024-09-12T17:07:40.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812780+0000", 2024-09-12T17:07:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000197219 2024-09-12T17:07:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812965+0000", 2024-09-12T17:07:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018523500000000001 2024-09-12T17:07:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.818504+0000", 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055390429999999996 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829488+0000", 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010984551 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829565+0000", 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7106000000000003e-05 2024-09-12T17:07:40.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829622+0000", 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6195e-05 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2107 3.27 3:e6a067b7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.Yyze1zZ5yDQsQYVWfVwDqF36m9lCinJ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.4451172679999997, 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020701105000000001, 2024-09-12T17:07:40.436 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2107 2024-09-12T17:07:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911756+0000", 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.557e-06 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913489+0000", 2024-09-12T17:07:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001732623 2024-09-12T17:07:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913518+0000", 2024-09-12T17:07:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8949e-05 2024-09-12T17:07:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913530+0000", 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1691999999999999e-05 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913612+0000", 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2706000000000004e-05 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913803+0000", 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000190695 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913972+0000", 2024-09-12T17:07:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000169536 2024-09-12T17:07:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.919843+0000", 2024-09-12T17:07:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058703280000000002 2024-09-12T17:07:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932289+0000", 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0124463 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932386+0000", 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7108999999999995e-05 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932454+0000", 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7609999999999998e-05 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2134 3.19 3:9a3dd654:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.65:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.9272294399999996, 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021094020000000002, 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2134 2024-09-12T17:07:40.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429643+0000", 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.588e-06 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431844+0000", 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022009040000000001 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431875+0000", 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1217999999999998e-05 2024-09-12T17:07:40.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431889+0000", 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.432039+0000", 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015003799999999999 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.432481+0000", 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00044164399999999999 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.433634+0000", 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011532059999999999 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.449117+0000", 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015483241999999999 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450419+0000", 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001301466 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450606+0000", 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000187009 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450735+0000", 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012906199999999999 2024-09-12T17:07:40.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2143 3.7 3:e0f27ed8:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.WqbBAH1T3u9gjF2P42eNw2YQ0hm2xWo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.655215+0000", 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.7016551570000003, 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019844753999999999, 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.449 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2143 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.655215+0000", 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.655215+0000", 2024-09-12T17:07:40.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.655219+0000", 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8600000000000003e-06 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657519+0000", 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023000149999999999 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657547+0000", 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8489000000000001e-05 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657559+0000", 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058999999999999e-05 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657657+0000", 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7965000000000001e-05 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657816+0000", 2024-09-12T17:07:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001584 2024-09-12T17:07:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657946+0000", 2024-09-12T17:07:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000130667 2024-09-12T17:07:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.662762+0000", 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048154859999999999 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.674927+0000", 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012165364 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.674997+0000", 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0173999999999996e-05 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.675060+0000", 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2274999999999996e-05 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2179 3.33 3:cc4cab85:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.BhsaRTISTLDImeesX85vqIql3rkxI1u_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.575783+0000", 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.781087383, 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.065094399999999997, 2024-09-12T17:07:40.455 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2179 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.575783+0000", 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.575783+0000", 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.575787+0000", 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9530000000000001e-06 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579440+0000", 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036530640000000001 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579477+0000", 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7845000000000001e-05 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579492+0000", 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4275e-05 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579676+0000", 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000184031 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579895+0000", 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219302 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.580106+0000", 2024-09-12T17:07:40.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000210922 2024-09-12T17:07:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639924+0000", 2024-09-12T17:07:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.059817951000000001 2024-09-12T17:07:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.640589+0000", 2024-09-12T17:07:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066520200000000005 2024-09-12T17:07:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.640754+0000", 2024-09-12T17:07:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016527600000000001 2024-09-12T17:07:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.640877+0000", 2024-09-12T17:07:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012257899999999999 2024-09-12T17:07:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2180 3.8 3:123ed638:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.BhsaRTISTLDImeesX85vqIql3rkxI1u_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.586208+0000", 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.7706622799999998, 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052320799000000001, 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2180 2024-09-12T17:07:40.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.586208+0000", 2024-09-12T17:07:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.586208+0000", 2024-09-12T17:07:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.586210+0000", 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.661e-06 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587685+0000", 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014748249999999999 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587706+0000", 2024-09-12T17:07:40.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0996e-05 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587718+0000", 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2001000000000001e-05 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587815+0000", 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6900999999999999e-05 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587993+0000", 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017817899999999999 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.588130+0000", 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013711600000000001 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636926+0000", 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048795660999999997 2024-09-12T17:07:40.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.638267+0000", 2024-09-12T17:07:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013408770000000001 2024-09-12T17:07:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.638393+0000", 2024-09-12T17:07:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012611 2024-09-12T17:07:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.638529+0000", 2024-09-12T17:07:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013547200000000001 2024-09-12T17:07:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop_reply(client.4434.0:2179 3.33 e73/24 ondisk, result = 0)", 2024-09-12T17:07:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.591277+0000", 2024-09-12T17:07:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.7655928140000001, 2024-09-12T17:07:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048673934000000002, 2024-09-12T17:07:40.468 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591277+0000", 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591277+0000", 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.469 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591279+0000", 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.717e-06 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591288+0000", 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8799999999999997e-06 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.470 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.631851+0000", 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040563601999999997 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.631880+0000", 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8779999999999999e-05 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639863+0000", 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079828290000000003 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.471 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639887+0000", 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4156999999999999e-05 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639951+0000", 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.472 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop_reply(client.4434.0:2180 3.8 e73/51 ondisk, result = 0)", 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.594180+0000", 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.7626902969999998, 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04275955, 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594180+0000", 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.473 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594180+0000", 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594181+0000", 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.683e-06 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594190+0000", 2024-09-12T17:07:40.474 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6079999999999996e-06 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.632075+0000", 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037884843000000001 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.632268+0000", 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019365300000000001 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.475 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636902+0000", 2024-09-12T17:07:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004633936 2024-09-12T17:07:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636917+0000", 2024-09-12T17:07:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4324e-05 2024-09-12T17:07:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636939+0000", 2024-09-12T17:07:40.476 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2503000000000001e-05 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:2195 3.c e73/24 3:337f05fc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.DSvxz4vaxxy0dMg8hp4VJxR3sCjbrFE_1:head v 73'10, mlcod=72'8)", 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.777412+0000", 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 3.579457911, 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018679920999999999, 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.477 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.777412+0000", 2024-09-12T17:07:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.478 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.777412+0000", 2024-09-12T17:07:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.777416+0000", 2024-09-12T17:07:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0029999999999996e-06 2024-09-12T17:07:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.479 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783541+0000", 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061247070000000001 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783584+0000", 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3498999999999998e-05 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783610+0000", 2024-09-12T17:07:40.480 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5406999999999999e-05 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783809+0000", 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019944900000000001 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783882+0000", 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3308999999999999e-05 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.481 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.796030+0000", 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012147217 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.796092+0000", 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2329999999999994e-05 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.482 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2327 3.33 3:ce967cb5:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.MVmoorSq8SMskXgSj5cJmk32Q3--ssn_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:39.530634+0000", 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 0.82623588400000003, 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026980457999999999, 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2327 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:40.483 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.530634+0000", 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.530634+0000", 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.530636+0000", 2024-09-12T17:07:40.484 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-06 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532507+0000", 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001870802 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532533+0000", 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6098e-05 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.485 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532547+0000", 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3944000000000001e-05 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532632+0000", 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4894000000000004e-05 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532791+0000", 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015956799999999999 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.486 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532920+0000", 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012916699999999999 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.538587+0000", 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056661130000000004 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.557478+0000", 2024-09-12T17:07:40.487 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018891181999999999 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.557556+0000", 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7875999999999998e-05 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.557615+0000", 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8941999999999999e-05 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.488 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:40.489 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:40.489 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:40.489 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:40.356+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:40.490 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:07:40.492 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:40.489+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:40.593 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:40.588+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:40.622 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:40.622 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:40.622 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:40.622 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:40.637 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:07:40.694 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:40.688+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:40.764 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:40.764 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:40.764 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:40.765 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:40.765 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:40.779 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:07:40.795 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:40.788+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:40.896 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:40.893+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:40.909 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1188 3.31 3:8d857c15:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:40.909 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.410552624000001, 2024-09-12T17:07:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019168672000000001, 2024-09-12T17:07:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1188 2024-09-12T17:07:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.910 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493824+0000", 2024-09-12T17:07:40.911 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.553e-06 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497820+0000", 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039958659999999998 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497855+0000", 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4956000000000002e-05 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.912 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497872+0000", 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6863000000000001e-05 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497996+0000", 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124306 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498229+0000", 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023307699999999999 2024-09-12T17:07:40.913 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498994+0000", 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076469699999999995 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.507996+0000", 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090021540000000001 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512687+0000", 2024-09-12T17:07:40.914 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046905360000000004 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512861+0000", 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017420399999999999 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512990+0000", 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012946 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.915 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1232 3.14 3:2967aafe:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.384099716000001, 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019509183999999999, 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1232 2024-09-12T17:07:40.916 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:40.917 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520278+0000", 2024-09-12T17:07:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9539999999999998e-06 2024-09-12T17:07:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525478+0000", 2024-09-12T17:07:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005199665 2024-09-12T17:07:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.918 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525520+0000", 2024-09-12T17:07:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2391999999999997e-05 2024-09-12T17:07:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525542+0000", 2024-09-12T17:07:40.919 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1613000000000001e-05 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525676+0000", 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013434300000000001 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525933+0000", 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025640400000000001 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.920 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.526162+0000", 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228722 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.534431+0000", 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082696019999999992 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539449+0000", 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050177099999999999 2024-09-12T17:07:40.921 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539640+0000", 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190812 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539784+0000", 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143967 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.922 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1234 3.3 3:c0bf349d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.358928770999999, 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019413466000000001, 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1234 2024-09-12T17:07:40.923 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.924 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545450+0000", 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.313e-06 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549431+0000", 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039813139999999997 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549472+0000", 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0828999999999998e-05 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.925 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549491+0000", 2024-09-12T17:07:40.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9055999999999998e-05 2024-09-12T17:07:40.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.926 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.926 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549627+0000", 2024-09-12T17:07:40.926 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013646700000000001 2024-09-12T17:07:40.926 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.926 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549859+0000", 2024-09-12T17:07:40.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023186100000000001 2024-09-12T17:07:40.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:40.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.550208+0000", 2024-09-12T17:07:40.927 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000348372 2024-09-12T17:07:40.927 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.927 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.927 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:40.927 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.559516+0000", 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093083260000000004 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564688+0000", 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051717849999999999 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564783+0000", 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4821000000000006e-05 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.928 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564859+0000", 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6322000000000006e-05 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1235 3.1c e63/45 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.341862634999998, 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023527869, 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.929 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.930 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562514+0000", 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570603+0000", 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080886359999999997 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570630+0000", 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7276000000000001e-05 2024-09-12T17:07:40.931 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570642+0000", 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2153e-05 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570805+0000", 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016319899999999999 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.932 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570900+0000", 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4988000000000006e-05 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.585884+0000", 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014984046000000001 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.586039+0000", 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155184 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.933 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1247 3.1a 3:58056b43:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.203336593, 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021958978000000001, 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:40.934 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1247 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.935 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701041+0000", 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9399999999999998e-06 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705529+0000", 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044889789999999997 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705569+0000", 2024-09-12T17:07:40.936 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9606e-05 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705588+0000", 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9375999999999999e-05 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705756+0000", 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016734200000000001 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.937 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706045+0000", 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028885400000000001 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706343+0000", 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029790300000000002 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720973+0000", 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014630684 2024-09-12T17:07:40.938 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:40.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722653+0000", 2024-09-12T17:07:40.939 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016799790000000001 2024-09-12T17:07:40.939 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.939 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.939 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.939 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722878+0000", 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022488799999999999 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722997+0000", 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118427 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1376 3.3 3:c01937d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:40.940 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:40.941 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.685147686000001, 2024-09-12T17:07:40.941 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020435229999999999, 2024-09-12T17:07:40.941 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.941 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.941 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.941 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:40.941 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:40.941 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.942 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1376 2024-09-12T17:07:40.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.942 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:40.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.942 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.942 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.942 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.942 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:40.942 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219230+0000", 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.23e-06 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223391+0000", 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041610629999999996 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.943 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223425+0000", 2024-09-12T17:07:40.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4167e-05 2024-09-12T17:07:40.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223443+0000", 2024-09-12T17:07:40.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8105999999999999e-05 2024-09-12T17:07:40.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.944 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.944 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.944 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223562+0000", 2024-09-12T17:07:40.944 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118861 2024-09-12T17:07:40.944 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223840+0000", 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027762099999999998 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.224077+0000", 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023720100000000001 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:40.945 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.232976+0000", 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0088992900000000007 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239478+0000", 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065023609999999999 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239574+0000", 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5527999999999997e-05 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.946 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239662+0000", 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7801999999999997e-05 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1382 3.1a 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.618480733999998, 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020895593, 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.947 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1382 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.948 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285897+0000", 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6669999999999998e-06 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290617+0000", 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047198689999999998 2024-09-12T17:07:40.949 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290657+0000", 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0201999999999999e-05 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290676+0000", 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9293e-05 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.950 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290860+0000", 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000183353 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291264+0000", 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040463800000000002 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291676+0000", 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041151499999999999 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.951 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301391+0000", 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0097147350000000004 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306412+0000", 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050210790000000003 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306636+0000", 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000224589 2024-09-12T17:07:40.952 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.953 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.953 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306789+0000", 2024-09-12T17:07:40.953 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015265299999999999 2024-09-12T17:07:40.953 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.953 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.953 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.953 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.953 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.953 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1385 3.34 3:2f3cb087:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:40.953 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:40.953 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.586455628, 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024744103999999999, 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1385 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:40.954 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317922+0000", 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.157e-06 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.955 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322800+0000", 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048785879999999997 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322846+0000", 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5732999999999997e-05 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322866+0000", 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0415999999999999e-05 2024-09-12T17:07:40.956 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323048+0000", 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018128 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323496+0000", 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044786400000000002 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:40.957 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323919+0000", 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042374399999999999 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.340076+0000", 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016156925999999999 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342379+0000", 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023025189999999998 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.958 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342546+0000", 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016719599999999999 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342663+0000", 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116681 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.959 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1409 3.a e64/24 3:53d4fdcd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_3:head v 64'6, mlcod=64'4)", 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.082976085999999, 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021472076, 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.960 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:40.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821402+0000", 2024-09-12T17:07:40.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4699999999999998e-06 2024-09-12T17:07:40.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828337+0000", 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069354229999999996 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828387+0000", 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9908999999999999e-05 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828412+0000", 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5389999999999999e-05 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828587+0000", 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017425599999999999 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828654+0000", 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7708999999999998e-05 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842774+0000", 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014119860999999999 2024-09-12T17:07:40.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842870+0000", 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6057999999999994e-05 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1417 3.14 3:29a29b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.981647680999998, 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.034043223999999997, 2024-09-12T17:07:40.964 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1417 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922731+0000", 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1099999999999996e-06 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930785+0000", 2024-09-12T17:07:40.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080541020000000005 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930841+0000", 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6005999999999999e-05 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930869+0000", 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8602000000000002e-05 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931049+0000", 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017998299999999999 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931287+0000", 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000237712 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931510+0000", 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022283200000000001 2024-09-12T17:07:40.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941891+0000", 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010380785 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.955891+0000", 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014000207000000001 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956636+0000", 2024-09-12T17:07:40.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00074503099999999995 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956770+0000", 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013385400000000001 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1420 3.3 3:c118c659:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:40.970 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.952353864999999, 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022394282000000001, 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1420 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952024+0000", 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1760000000000003e-06 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958458+0000", 2024-09-12T17:07:40.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064335770000000002 2024-09-12T17:07:40.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958492+0000", 2024-09-12T17:07:40.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4309e-05 2024-09-12T17:07:40.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.973 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.973 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.973 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958508+0000", 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5699999999999999e-05 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958717+0000", 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020871900000000001 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959163+0000", 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000446007 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959583+0000", 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042026800000000001 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.970389+0000", 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010806375999999999 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974044+0000", 2024-09-12T17:07:40.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003654352 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974232+0000", 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018811899999999999 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974415+0000", 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018267899999999999 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1896 3.2c e71/24 3:3773d78b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.27:head v 71'8, mlcod=71'6)", 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.500317658, 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021824796, 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:40.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404059+0000", 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.537e-06 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408616+0000", 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045564799999999999 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408657+0000", 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1968000000000002e-05 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408676+0000", 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8445999999999999e-05 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408880+0000", 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020370100000000001 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408952+0000", 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2226999999999998e-05 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.425787+0000", 2024-09-12T17:07:40.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016835383999999998 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.425881+0000", 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4053000000000002e-05 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1917 3.1a 3:5b4c0dd7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.P_wej9y73GH8iAzyXzEiqKNwtELtJTp_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:40.981 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.020405265999999, 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026569157999999999, 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1917 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:40.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883971+0000", 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4030000000000001e-06 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890727+0000", 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067561080000000003 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890770+0000", 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2614999999999998e-05 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890794+0000", 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3808999999999999e-05 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890964+0000", 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000169956 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.891223+0000", 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025883600000000003 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.891466+0000", 2024-09-12T17:07:40.985 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000242883 2024-09-12T17:07:40.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.909542+0000", 2024-09-12T17:07:40.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018076262999999999 2024-09-12T17:07:40.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:40.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910349+0000", 2024-09-12T17:07:40.986 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080699299999999999 2024-09-12T17:07:40.986 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.986 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910447+0000", 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8301999999999995e-05 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910538+0000", 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0989999999999994e-05 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1923 3.1d e71/24 3:bbfa0a4b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.RvdbUUXkO22SF-kwzRd4VKnEQTGoFzf_1:head v 71'2, mlcod=0'0)", 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8700623140000001, 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020143629, 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.988 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034315+0000", 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.123e-06 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.989 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038477+0000", 2024-09-12T17:07:40.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041615999999999997 2024-09-12T17:07:40.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038520+0000", 2024-09-12T17:07:40.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3705000000000003e-05 2024-09-12T17:07:40.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038539+0000", 2024-09-12T17:07:40.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8825999999999999e-05 2024-09-12T17:07:40.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038679+0000", 2024-09-12T17:07:40.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000140051 2024-09-12T17:07:40.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038729+0000", 2024-09-12T17:07:40.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9455e-05 2024-09-12T17:07:40.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:40.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054300+0000", 2024-09-12T17:07:40.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015571000999999999 2024-09-12T17:07:40.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:40.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054455+0000", 2024-09-12T17:07:40.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015586800000000001 2024-09-12T17:07:40.993 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.993 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:40.993 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:40.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.993 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1926 3.9 3:92ed9a0c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.32:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:40.993 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:40.993 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8448288789999996, 2024-09-12T17:07:40.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019336487999999999, 2024-09-12T17:07:40.993 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:40.994 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:40.994 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:40.994 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:40.994 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:40.994 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:40.994 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1926 2024-09-12T17:07:40.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.994 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:40.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:40.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:40.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:40.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:40.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:40.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:40.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059548+0000", 2024-09-12T17:07:40.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T17:07:40.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:40.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063544+0000", 2024-09-12T17:07:40.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039964340000000001 2024-09-12T17:07:40.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:40.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063587+0000", 2024-09-12T17:07:40.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2701000000000003e-05 2024-09-12T17:07:40.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:40.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063605+0000", 2024-09-12T17:07:40.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8065999999999999e-05 2024-09-12T17:07:40.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:40.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063745+0000", 2024-09-12T17:07:40.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014033000000000001 2024-09-12T17:07:40.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:40.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.064004+0000", 2024-09-12T17:07:40.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025869899999999998 2024-09-12T17:07:40.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:40.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.064666+0000", 2024-09-12T17:07:40.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00066141599999999996 2024-09-12T17:07:40.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:40.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.074813+0000", 2024-09-12T17:07:40.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010147168 2024-09-12T17:07:40.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:40.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:40.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078769+0000", 2024-09-12T17:07:40.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039561680000000004 2024-09-12T17:07:40.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:40.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078837+0000", 2024-09-12T17:07:41.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8089000000000005e-05 2024-09-12T17:07:41.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078882+0000", 2024-09-12T17:07:41.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4827000000000003e-05 2024-09-12T17:07:41.000 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.000 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.001 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.001 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1975 3.1c e71/45 3:3805ec2a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.jnyWlqSvXNPIAN3dK-0eL-Xl-MeMoAE_1:head v 71'6, mlcod=64'4)", 2024-09-12T17:07:41.001 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:41.001 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.8831359279999997, 2024-09-12T17:07:41.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019266097999999999, 2024-09-12T17:07:41.001 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.001 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.001 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.001 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:41.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:41.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021241+0000", 2024-09-12T17:07:41.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0369999999999999e-06 2024-09-12T17:07:41.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027374+0000", 2024-09-12T17:07:41.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061327090000000001 2024-09-12T17:07:41.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027417+0000", 2024-09-12T17:07:41.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2966000000000002e-05 2024-09-12T17:07:41.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027435+0000", 2024-09-12T17:07:41.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7796e-05 2024-09-12T17:07:41.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027586+0000", 2024-09-12T17:07:41.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015143000000000001 2024-09-12T17:07:41.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027623+0000", 2024-09-12T17:07:41.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6535000000000002e-05 2024-09-12T17:07:41.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.040387+0000", 2024-09-12T17:07:41.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012764463 2024-09-12T17:07:41.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.040504+0000", 2024-09-12T17:07:41.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117162 2024-09-12T17:07:41.006 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.006 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.006 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.007 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2131 3.34 3:2ed641cc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.zMHhD2lKVde2GeFxbpVTls1jtnLcDP5_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:41.007 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:41.007 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.5094290409999997, 2024-09-12T17:07:41.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025713333000000001, 2024-09-12T17:07:41.007 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.007 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.007 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.007 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.007 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.007 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.007 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2131 2024-09-12T17:07:41.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.008 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:41.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:41.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394949+0000", 2024-09-12T17:07:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6799999999999999e-06 2024-09-12T17:07:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399541+0000", 2024-09-12T17:07:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004591955 2024-09-12T17:07:41.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399595+0000", 2024-09-12T17:07:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4694000000000002e-05 2024-09-12T17:07:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399622+0000", 2024-09-12T17:07:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6466e-05 2024-09-12T17:07:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399826+0000", 2024-09-12T17:07:41.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020443600000000001 2024-09-12T17:07:41.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.400245+0000", 2024-09-12T17:07:41.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041897400000000002 2024-09-12T17:07:41.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:41.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.400666+0000", 2024-09-12T17:07:41.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042066199999999998 2024-09-12T17:07:41.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420138+0000", 2024-09-12T17:07:41.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019472382 2024-09-12T17:07:41.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420297+0000", 2024-09-12T17:07:41.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158214 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420498+0000", 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020172899999999999 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420658+0000", 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016014100000000001 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.013 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.014 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.014 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2146 3.2c e73/24 3:35eb2578:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.67:head v 73'11, mlcod=71'9)", 2024-09-12T17:07:41.014 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:41.014 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.217500351, 2024-09-12T17:07:41.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018962961, 2024-09-12T17:07:41.014 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.014 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.014 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.014 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:41.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:41.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686876+0000", 2024-09-12T17:07:41.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6740000000000001e-06 2024-09-12T17:07:41.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691317+0000", 2024-09-12T17:07:41.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044404900000000001 2024-09-12T17:07:41.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691352+0000", 2024-09-12T17:07:41.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5355999999999998e-05 2024-09-12T17:07:41.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691370+0000", 2024-09-12T17:07:41.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7584999999999999e-05 2024-09-12T17:07:41.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691503+0000", 2024-09-12T17:07:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013263199999999999 2024-09-12T17:07:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691545+0000", 2024-09-12T17:07:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2886000000000002e-05 2024-09-12T17:07:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.705738+0000", 2024-09-12T17:07:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014192885000000001 2024-09-12T17:07:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.705837+0000", 2024-09-12T17:07:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8453000000000001e-05 2024-09-12T17:07:41.019 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2198 3.1 e73/24 3:829b5d0c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.74:head v 73'6, mlcod=72'4)", 2024-09-12T17:07:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.805329+0000", 2024-09-12T17:07:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.09904504, 2024-09-12T17:07:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019490977999999999, 2024-09-12T17:07:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.805329+0000", 2024-09-12T17:07:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.805329+0000", 2024-09-12T17:07:41.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.805331+0000", 2024-09-12T17:07:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.672e-06 2024-09-12T17:07:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810780+0000", 2024-09-12T17:07:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054493110000000001 2024-09-12T17:07:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.022 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810807+0000", 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7126000000000001e-05 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810825+0000", 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7747000000000001e-05 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810971+0000", 2024-09-12T17:07:41.023 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014580600000000001 2024-09-12T17:07:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.811038+0000", 2024-09-12T17:07:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7477999999999993e-05 2024-09-12T17:07:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.824762+0000", 2024-09-12T17:07:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013723384 2024-09-12T17:07:41.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.824820+0000", 2024-09-12T17:07:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8454e-05 2024-09-12T17:07:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2204 3.31 3:8c16fd85:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.75:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.953186+0000", 2024-09-12T17:07:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 3.9511879510000001, 2024-09-12T17:07:41.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022095528, 2024-09-12T17:07:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2204 2024-09-12T17:07:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.953186+0000", 2024-09-12T17:07:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.953186+0000", 2024-09-12T17:07:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.953189+0000", 2024-09-12T17:07:41.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2030000000000001e-06 2024-09-12T17:07:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957694+0000", 2024-09-12T17:07:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045044159999999998 2024-09-12T17:07:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957733+0000", 2024-09-12T17:07:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8899000000000001e-05 2024-09-12T17:07:41.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957749+0000", 2024-09-12T17:07:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6402999999999999e-05 2024-09-12T17:07:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957890+0000", 2024-09-12T17:07:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014088100000000001 2024-09-12T17:07:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.958158+0000", 2024-09-12T17:07:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026755799999999999 2024-09-12T17:07:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.959046+0000", 2024-09-12T17:07:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00088877100000000001 2024-09-12T17:07:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.974849+0000", 2024-09-12T17:07:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015802248000000001 2024-09-12T17:07:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.975083+0000", 2024-09-12T17:07:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023468600000000001 2024-09-12T17:07:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.975203+0000", 2024-09-12T17:07:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119919 2024-09-12T17:07:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.975282+0000", 2024-09-12T17:07:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8543999999999999e-05 2024-09-12T17:07:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.036 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.036 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:41.038 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:07:41.039 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:41.032+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:41.139 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:41.137+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:41.218 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:41.219 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:41.219 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:41.219 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:41.234 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:07:41.259 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.3 to 1 (10000) 2024-09-12T17:07:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T17:07:41.279 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:41.277+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:41.296 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-12T17:07:41.384 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:41.380+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:41.407 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:41.407 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:41.407 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:41.407 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:41.407 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:41.422 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:07:41.443 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:41.436+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:41.544 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:41.540+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:41.557 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:41.557 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:41.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:41.557 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:41.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.557 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1239 3.16 3:6b2cb9ce:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:41.557 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:41.557 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.951445583000002, 2024-09-12T17:07:41.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021398218, 2024-09-12T17:07:41.558 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.558 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.558 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.558 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.558 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.558 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1239 2024-09-12T17:07:41.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.558 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600991+0000", 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9559999999999999e-06 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606170+0000", 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051789460000000002 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606222+0000", 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1422000000000003e-05 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606249+0000", 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7163000000000001e-05 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606450+0000", 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000201325 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606877+0000", 2024-09-12T17:07:41.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042682799999999997 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.607298+0000", 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042127700000000001 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.615845+0000", 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0085471260000000004 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622186+0000", 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063410690000000004 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622292+0000", 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105305 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622385+0000", 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3801000000000005e-05 2024-09-12T17:07:41.563 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1251 3.1d 3:ba0891d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.809106066999998, 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020778814999999999, 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.564 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1251 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:41.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743330+0000", 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7000000000000002e-06 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748572+0000", 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052414710000000002 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748616+0000", 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4369000000000002e-05 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748636+0000", 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9582999999999999e-05 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748778+0000", 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141867 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749017+0000", 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000239218 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749233+0000", 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021619799999999999 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.756641+0000", 2024-09-12T17:07:41.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074078089999999996 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763784+0000", 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0071433809999999999 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763958+0000", 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000173862 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.764106+0000", 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014735700000000001 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1259 3.5 3:a1f83edd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.3962182, 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024500529, 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.570 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1259 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156217+0000", 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8940000000000002e-06 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160482+0000", 2024-09-12T17:07:41.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042645269999999997 2024-09-12T17:07:41.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160513+0000", 2024-09-12T17:07:41.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1228e-05 2024-09-12T17:07:41.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160526+0000", 2024-09-12T17:07:41.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2976000000000001e-05 2024-09-12T17:07:41.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160624+0000", 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8048999999999996e-05 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160825+0000", 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020054799999999999 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160997+0000", 2024-09-12T17:07:41.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017260499999999999 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.169300+0000", 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083027050000000005 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180595+0000", 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011294465 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180660+0000", 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5616000000000003e-05 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180715+0000", 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4916000000000001e-05 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.576 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1262 3.5 3:a3a998f2:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:41.577 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:41.577 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.341585488, 2024-09-12T17:07:41.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020328525, 2024-09-12T17:07:41.577 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.577 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.577 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.577 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.577 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.577 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.577 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1262 2024-09-12T17:07:41.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.577 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210850+0000", 2024-09-12T17:07:41.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.005e-06 2024-09-12T17:07:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214862+0000", 2024-09-12T17:07:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040120640000000001 2024-09-12T17:07:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214903+0000", 2024-09-12T17:07:41.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0831999999999998e-05 2024-09-12T17:07:41.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214940+0000", 2024-09-12T17:07:41.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7036000000000003e-05 2024-09-12T17:07:41.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215059+0000", 2024-09-12T17:07:41.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118631 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215237+0000", 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017834900000000001 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215406+0000", 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016896200000000001 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.221184+0000", 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057780130000000002 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231002+0000", 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0098174969999999997 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231096+0000", 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4204999999999997e-05 2024-09-12T17:07:41.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231176+0000", 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9931000000000004e-05 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1264 3.c 3:30907361:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.320662503000001, 2024-09-12T17:07:41.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021106314000000001, 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1264 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:41.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231772+0000", 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1560000000000002e-06 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235787+0000", 2024-09-12T17:07:41.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040149790000000001 2024-09-12T17:07:41.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235824+0000", 2024-09-12T17:07:41.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6956000000000003e-05 2024-09-12T17:07:41.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235843+0000", 2024-09-12T17:07:41.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8315999999999999e-05 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235954+0000", 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111601 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236135+0000", 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000180941 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:41.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236302+0000", 2024-09-12T17:07:41.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016626600000000001 2024-09-12T17:07:41.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242422+0000", 2024-09-12T17:07:41.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061200730000000002 2024-09-12T17:07:41.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.588 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252655+0000", 2024-09-12T17:07:41.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010232978 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252749+0000", 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4481000000000006e-05 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252877+0000", 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012756700000000001 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.589 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1265 3.22 3:44204d7e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.310174318000001, 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021506441000000001, 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.590 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1265 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242262+0000", 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7299999999999999e-06 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246237+0000", 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039746989999999999 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246272+0000", 2024-09-12T17:07:41.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5589000000000001e-05 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246290+0000", 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7107000000000001e-05 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246410+0000", 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119984 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246589+0000", 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000179853 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246748+0000", 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158536 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252569+0000", 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058212810000000002 2024-09-12T17:07:41.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263464+0000", 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010894406000000001 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263627+0000", 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000163833 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263765+0000", 2024-09-12T17:07:41.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013742299999999999 2024-09-12T17:07:41.596 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.596 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.596 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.596 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1269 3.c 3:3287b6aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:41.596 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:41.596 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.261547146000002, 2024-09-12T17:07:41.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019007443999999998, 2024-09-12T17:07:41.596 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1269 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290890+0000", 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2529999999999998e-06 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294907+0000", 2024-09-12T17:07:41.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004017189 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294952+0000", 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5252e-05 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294971+0000", 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8606000000000001e-05 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295107+0000", 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000135654 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295466+0000", 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000359448 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295948+0000", 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000482079 2024-09-12T17:07:41.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.308012+0000", 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012064210000000001 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309570+0000", 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015580839999999999 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309758+0000", 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000187522 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309893+0000", 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013514700000000001 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1275 3.16 3:68cda83e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:41.602 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.198850004000001, 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019055547999999999, 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1275 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:41.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:41.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353586+0000", 2024-09-12T17:07:41.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0769999999999999e-06 2024-09-12T17:07:41.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359376+0000", 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057904100000000002 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359400+0000", 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3805999999999999e-05 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359412+0000", 2024-09-12T17:07:41.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2404e-05 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359522+0000", 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109685 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359767+0000", 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024471399999999999 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.360035+0000", 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026762699999999999 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372243+0000", 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012208169 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372526+0000", 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028289599999999998 2024-09-12T17:07:41.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372581+0000", 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5747e-05 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372638+0000", 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7012999999999998e-05 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1390 3.2f 3:f51d0419:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.175657277999999, 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019302698, 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1390 2024-09-12T17:07:41.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376779+0000", 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8700000000000002e-06 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381020+0000", 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042401660000000001 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381069+0000", 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9279e-05 2024-09-12T17:07:41.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381098+0000", 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9110000000000001e-05 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381276+0000", 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017790199999999999 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381577+0000", 2024-09-12T17:07:41.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030131400000000001 2024-09-12T17:07:41.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:41.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381798+0000", 2024-09-12T17:07:41.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022053200000000001 2024-09-12T17:07:41.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.391131+0000", 2024-09-12T17:07:41.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093337400000000001 2024-09-12T17:07:41.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395755+0000", 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004624034 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395932+0000", 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000176317 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.396078+0000", 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000146434 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1408 3.2a 3:56341a86:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.748568153000001, 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.030673474999999999, 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1408 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803868+0000", 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1130000000000001e-06 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808291+0000", 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044233120000000004 2024-09-12T17:07:41.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808331+0000", 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9869000000000001e-05 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808351+0000", 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9673e-05 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808511+0000", 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015999699999999999 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808843+0000", 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033221900000000003 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.809106+0000", 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026355900000000002 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.827691+0000", 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018584471000000002 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834339+0000", 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066477790000000004 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834448+0000", 2024-09-12T17:07:41.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109578 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834538+0000", 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9905000000000001e-05 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1884 3.16 3:6a49863c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.25:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:41.621 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.394310328, 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02557398, 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1884 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158125+0000", 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1399999999999998e-06 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163204+0000", 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050792720000000001 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163244+0000", 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0522000000000003e-05 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163262+0000", 2024-09-12T17:07:41.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7872000000000001e-05 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163395+0000", 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013291799999999999 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163698+0000", 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030317700000000001 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:41.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.164523+0000", 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082438900000000002 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.181881+0000", 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017357991999999999 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183465+0000", 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015843509999999999 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183583+0000", 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118025 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183696+0000", 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113322 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1923 3.1d 3:bbfa0a4b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.RvdbUUXkO22SF-kwzRd4VKnEQTGoFzf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.527338473, 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.029952679999999999, 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1923 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.628 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:41.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:41.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025097+0000", 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6599999999999999e-06 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033262+0000", 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0081647409999999997 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033304+0000", 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2138000000000002e-05 2024-09-12T17:07:41.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033322+0000", 2024-09-12T17:07:41.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8059000000000001e-05 2024-09-12T17:07:41.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033512+0000", 2024-09-12T17:07:41.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019057199999999999 2024-09-12T17:07:41.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033775+0000", 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026250299999999998 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034023+0000", 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024751999999999999 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.047403+0000", 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013380845000000001 2024-09-12T17:07:41.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054890+0000", 2024-09-12T17:07:41.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074861529999999997 2024-09-12T17:07:41.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054976+0000", 2024-09-12T17:07:41.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6644999999999995e-05 2024-09-12T17:07:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.055047+0000", 2024-09-12T17:07:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0844000000000001e-05 2024-09-12T17:07:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1990 3.28 3:17f1f290:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.41:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:41.638 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.2346414540000001, 2024-09-12T17:07:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019908233000000001, 2024-09-12T17:07:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1990 2024-09-12T17:07:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317794+0000", 2024-09-12T17:07:41.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.993e-06 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323013+0000", 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052182490000000003 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323051+0000", 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8343000000000002e-05 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323069+0000", 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8082000000000001e-05 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323264+0000", 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019453499999999999 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323530+0000", 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026603999999999999 2024-09-12T17:07:41.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.324371+0000", 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00084152599999999999 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.336666+0000", 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012295276000000001 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337488+0000", 2024-09-12T17:07:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082180399999999998 2024-09-12T17:07:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337622+0000", 2024-09-12T17:07:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000133864 2024-09-12T17:07:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337700+0000", 2024-09-12T17:07:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7521000000000005e-05 2024-09-12T17:07:41.644 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2125 3.4 e73/51 3:235ee04f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.q5_4TTRRhSFZvQfgJaK5ATByAODjVXJ_1:head v 73'6, mlcod=71'4)", 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.2852358700000002, 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024265888999999999, 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0299999999999999e-07 2024-09-12T17:07:41.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274450+0000", 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0072528879999999999 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274475+0000", 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5185e-05 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274491+0000", 2024-09-12T17:07:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5305999999999999e-05 2024-09-12T17:07:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274624+0000", 2024-09-12T17:07:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000132915 2024-09-12T17:07:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274681+0000", 2024-09-12T17:07:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7340999999999999e-05 2024-09-12T17:07:41.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.291377+0000", 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016695451 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.291463+0000", 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6299999999999997e-05 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2128 3.5 3:a25f4989:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.64:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.2570092900000001, 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019706656999999999, 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2128 2024-09-12T17:07:41.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295427+0000", 2024-09-12T17:07:41.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4060000000000001e-06 2024-09-12T17:07:41.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299816+0000", 2024-09-12T17:07:41.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043890029999999998 2024-09-12T17:07:41.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299855+0000", 2024-09-12T17:07:41.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8955000000000002e-05 2024-09-12T17:07:41.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299873+0000", 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8359000000000002e-05 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.300038+0000", 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016448100000000001 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.300335+0000", 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029776899999999997 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.301250+0000", 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00091437699999999996 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.313996+0000", 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012745975 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.314902+0000", 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00090575699999999998 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.315023+0000", 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012113899999999999 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.315130+0000", 2024-09-12T17:07:41.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010743600000000001 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2158 3.3a 3:5f23622e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.69:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.5642457700000003, 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025287745, 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.656 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2158 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:41.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988190+0000", 2024-09-12T17:07:41.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.897e-06 2024-09-12T17:07:41.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992248+0000", 2024-09-12T17:07:41.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040576420000000002 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992288+0000", 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9959000000000001e-05 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992305+0000", 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7813999999999999e-05 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992495+0000", 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018977800000000001 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992759+0000", 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026367399999999998 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.993586+0000", 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082746299999999996 2024-09-12T17:07:41.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.002363+0000", 2024-09-12T17:07:41.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087768069999999993 2024-09-12T17:07:41.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013296+0000", 2024-09-12T17:07:41.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010932871 2024-09-12T17:07:41.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013408+0000", 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111709 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013475+0000", 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7131000000000005e-05 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2161 3.5 3:a0815047:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.1213Daer3gr3KDhM5kgqYBB_xC83lvZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:41.662 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 5.4258500659999997, 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020142651000000001, 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2161 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:41.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:41.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126586+0000", 2024-09-12T17:07:41.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9830000000000001e-06 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130385+0000", 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037997009999999999 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130415+0000", 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9529000000000001e-05 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130427+0000", 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2351000000000001e-05 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130516+0000", 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8214999999999995e-05 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130663+0000", 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147145 2024-09-12T17:07:41.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130793+0000", 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012986700000000001 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.138966+0000", 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0081739810000000003 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.667 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146483+0000", 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.007516928 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146599+0000", 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115932 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146725+0000", 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000126019 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.668 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2195 3.c 3:337f05fc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.DSvxz4vaxxy0dMg8hp4VJxR3sCjbrFE_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.773024+0000", 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 4.7794092189999997, 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023923855000000001, 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.669 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2195 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.773024+0000", 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.773024+0000", 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.773027+0000", 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.574e-06 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777123+0000", 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040961000000000001 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777166+0000", 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2972000000000001e-05 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777185+0000", 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9269000000000001e-05 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777284+0000", 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8240999999999997e-05 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777444+0000", 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016014999999999999 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777586+0000", 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000142428 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.784298+0000", 2024-09-12T17:07:41.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067112430000000004 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.796855+0000", 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012557474000000001 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.796906+0000", 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0518e-05 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.674 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.796947+0000", 2024-09-12T17:07:41.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1885999999999998e-05 2024-09-12T17:07:41.675 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.675 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.675 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.675 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2330 3.c 3:312d3416:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.96:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:41.675 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:39.563180+0000", 2024-09-12T17:07:41.675 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.9892529460000001, 2024-09-12T17:07:41.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021299865000000001, 2024-09-12T17:07:41.675 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.676 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.676 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.676 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.676 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.676 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.676 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2330 2024-09-12T17:07:41.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.676 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.563180+0000", 2024-09-12T17:07:41.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.563180+0000", 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.563182+0000", 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6259999999999999e-06 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567288+0000", 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041051120000000002 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567319+0000", 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1788999999999997e-05 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567344+0000", 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4213e-05 2024-09-12T17:07:41.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567493+0000", 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014904799999999999 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567854+0000", 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036099500000000002 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:41.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.568778+0000", 2024-09-12T17:07:41.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00092410500000000004 2024-09-12T17:07:41.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.583477+0000", 2024-09-12T17:07:41.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014699031 2024-09-12T17:07:41.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.584281+0000", 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080444299999999995 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.584387+0000", 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105753 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.584480+0000", 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2750000000000005e-05 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2351 3.1d 3:b93c23bf:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.-9Whj7OyWidDksiwzT19FTZdXgAbEF9_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:39.995677+0000", 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 1.556756059, 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020208282000000001, 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:41.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2351 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.995677+0000", 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.995677+0000", 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.995679+0000", 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6390000000000001e-06 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999600+0000", 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003920219 2024-09-12T17:07:41.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999638+0000", 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8590999999999997e-05 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999662+0000", 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3366e-05 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:41.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999859+0000", 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000197617 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.000117+0000", 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025815099999999998 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.000396+0000", 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027906099999999999 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.010299+0000", 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0099028009999999993 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.015705+0000", 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054053230000000001 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.015810+0000", 2024-09-12T17:07:41.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105287 2024-09-12T17:07:41.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:41.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:41.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:41.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.015885+0000", 2024-09-12T17:07:41.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5227000000000003e-05 2024-09-12T17:07:41.688 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.688 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.688 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.688 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:41.688 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:41.688 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:41.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:07:41.690 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:41.691 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:41.685+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:41.791 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:41.788+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:41.844 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:41.844 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:41.861 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:41.861 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:41.870 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:41.870 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:41.870 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:41.870 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:41.878 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:41.878 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:41.885 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:41.894 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:41.894 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:41.913 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:41.913 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:41.927 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:41.924+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:41.931 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:41.932 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:41.951 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:41.951 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:41.969 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:41.970 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:41.992 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:41.988+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:42.056 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:42.056 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:42.070 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:42.115 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:42.112+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:42.194 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:42.188+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:42.243 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:42.244 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:42.259 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:42.261 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.4 to 1 (10000) 2024-09-12T17:07:42.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-12T17:07:42.303 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:42.300+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:42.386 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:42.386 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:42.396 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:42.392+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:42.403 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:42.499 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:42.496+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:42.577 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:42.578 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:42.592 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:42.597 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:42.592+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:42.698 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:42.692+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:42.767 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:42.767 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:42.784 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:07:42.828 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:42.824+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:42.899 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:42.896+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:42.917 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:42.917 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:42.936 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:07:43.000 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:42.996+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:43.102 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:43.096+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:43.145 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:43.145 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:43.161 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:07:43.208 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:43.204+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:43.273 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.5 to 1 (10000) 2024-09-12T17:07:43.292 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:43.292 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:43.299 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-12T17:07:43.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T17:07:43.303 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:43.300+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:43.308 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:07:43.440 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:43.436+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:43.505 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:43.500+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:43.522 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:43.522 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:43.536 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:07:43.623 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:43.620+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:43.693 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:43.693 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:43.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:07:43.708 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:43.704+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:43.808 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:43.804+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:43.871 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:43.871 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:43.888 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:07:43.909 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:43.904+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:43.988 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:07:44.011 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:44.008+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:44.049 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:44.064 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:07:44.112 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:44.108+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:44.131 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:44.131 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:44.161 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:44.161 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:44.177 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:44.177 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:44.187 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:44.187 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:44.188 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:44.188 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:44.188 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:44.194 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:44.194 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:44.202 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:07:44.213 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:44.208+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:44.217 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:44.217 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:44.238 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:44.238 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:44.258 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:44.259 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:44.277 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is set 2024-09-12T17:07:44.280 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.6 to 1 (10000) 2024-09-12T17:07:44.284 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:44.284 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:44.314 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-12T17:07:44.315 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:44.308+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:44.333 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:44.333 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:44.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:44.334 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:44.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.334 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1170 3.21 3:87f83b83:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:44.334 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:44.334 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.022871733000002, 2024-09-12T17:07:44.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019752527999999998, 2024-09-12T17:07:44.334 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.334 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.334 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.334 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1170 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.335 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307312+0000", 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.307314+0000", 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.734e-06 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308952+0000", 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016376190000000001 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308985+0000", 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3624000000000002e-05 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.308999+0000", 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3127e-05 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309087+0000", 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8244000000000004e-05 2024-09-12T17:07:44.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309212+0000", 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012551500000000001 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.309309+0000", 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7157000000000005e-05 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.314345+0000", 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050351900000000002 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.326922+0000", 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012577319 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327013+0000", 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.0801e-05 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.327065+0000", 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.2197999999999997e-05 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1173 3.1c 3:3ac09143:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.990511116999997, 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023664096999999999, 2024-09-12T17:07:44.340 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1173 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339673+0000", 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.339676+0000", 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2839999999999998e-06 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341224+0000", 2024-09-12T17:07:44.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015477679999999999 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341253+0000", 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.9094999999999998e-05 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341267+0000", 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3624e-05 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341349+0000", 2024-09-12T17:07:44.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.1766000000000003e-05 2024-09-12T17:07:44.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341485+0000", 2024-09-12T17:07:44.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013647099999999999 2024-09-12T17:07:44.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:44.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.341587+0000", 2024-09-12T17:07:44.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010150899999999999 2024-09-12T17:07:44.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.345980+0000", 2024-09-12T17:07:44.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0043931990000000004 2024-09-12T17:07:44.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363206+0000", 2024-09-12T17:07:44.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017225963 2024-09-12T17:07:44.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363278+0000", 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.2577999999999995e-05 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.363337+0000", 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8839999999999999e-05 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.346 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1218 3.21 3:84169186:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.301690495999999, 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018163809, 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1218 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028494+0000", 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.028495+0000", 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7850000000000001e-06 2024-09-12T17:07:44.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030091+0000", 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0015958260000000001 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030124+0000", 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2990000000000001e-05 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030144+0000", 2024-09-12T17:07:44.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9381e-05 2024-09-12T17:07:44.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030232+0000", 2024-09-12T17:07:44.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8494999999999999e-05 2024-09-12T17:07:44.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030355+0000", 2024-09-12T17:07:44.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012280700000000001 2024-09-12T17:07:44.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.030508+0000", 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015261300000000001 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.035197+0000", 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0046889339999999996 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046453+0000", 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011256339000000001 2024-09-12T17:07:44.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046565+0000", 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112521 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.046658+0000", 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.2118000000000001e-05 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1235 3.1c 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 31.772204763000001, 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027479018000000001, 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1235 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557979+0000", 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.557983+0000", 2024-09-12T17:07:44.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.941e-06 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560826+0000", 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0028422479999999999 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560855+0000", 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8999000000000001e-05 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560870+0000", 2024-09-12T17:07:44.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5231999999999999e-05 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.560956+0000", 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6391999999999995e-05 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561123+0000", 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016676199999999999 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:44.356 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.561284+0000", 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000160672 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.567185+0000", 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0059013720000000002 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585343+0000", 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018157514999999999 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.357 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585409+0000", 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6210999999999993e-05 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.585458+0000", 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9673999999999999e-05 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:1373 3.2d e64/24 3:b512a50c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_5:head v 64'8, mlcod=64'6)", 2024-09-12T17:07:44.358 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.137613601000002, 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018448697999999999, 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192571+0000", 2024-09-12T17:07:44.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.192572+0000", 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6789999999999999e-06 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198743+0000", 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061702900000000001 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198764+0000", 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1016999999999999e-05 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198774+0000", 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.0387999999999999e-05 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198892+0000", 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000117761 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.198917+0000", 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5060999999999999e-05 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.210945+0000", 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012028492 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.211019+0000", 2024-09-12T17:07:44.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.4010000000000005e-05 2024-09-12T17:07:44.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.363 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.363 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.363 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1407 3.21 3:85243711:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:44.363 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:44.363 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 27.538342113999999, 2024-09-12T17:07:44.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020947763000000001, 2024-09-12T17:07:44.363 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.363 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.363 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1407 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791842+0000", 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.791845+0000", 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.683e-06 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796758+0000", 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049128230000000002 2024-09-12T17:07:44.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796800+0000", 2024-09-12T17:07:44.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2613e-05 2024-09-12T17:07:44.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796819+0000", 2024-09-12T17:07:44.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8632999999999999e-05 2024-09-12T17:07:44.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.796934+0000", 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011525499999999999 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797083+0000", 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000149376 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.797216+0000", 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000132848 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.804681+0000", 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0074645960000000004 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812614+0000", 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079326510000000006 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812720+0000", 2024-09-12T17:07:44.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000106909 2024-09-12T17:07:44.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.369 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.369 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.812790+0000", 2024-09-12T17:07:44.369 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9375999999999994e-05 2024-09-12T17:07:44.369 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.369 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.369 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.369 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.369 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1416 3.0 3:03f8363f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:44.369 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 27.419722073999999, 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023938686000000001, 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1416 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910462+0000", 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.910465+0000", 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8569999999999999e-06 2024-09-12T17:07:44.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912455+0000", 2024-09-12T17:07:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0019900009999999999 2024-09-12T17:07:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912491+0000", 2024-09-12T17:07:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5522000000000003e-05 2024-09-12T17:07:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912506+0000", 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5928000000000001e-05 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912607+0000", 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010094099999999999 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912784+0000", 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000176851 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.912927+0000", 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142502 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.918121+0000", 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051943290000000001 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934276+0000", 2024-09-12T17:07:44.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.016155426000000001 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934347+0000", 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0970000000000007e-05 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.934401+0000", 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3359000000000002e-05 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.375 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1421 3.2e 3:76cf3736:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 27.370249568999999, 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018499980999999999, 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.376 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1421 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959935+0000", 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.959937+0000", 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6340000000000001e-06 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962168+0000", 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.002231004 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962202+0000", 2024-09-12T17:07:44.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3704000000000001e-05 2024-09-12T17:07:44.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962218+0000", 2024-09-12T17:07:44.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5732000000000001e-05 2024-09-12T17:07:44.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962302+0000", 2024-09-12T17:07:44.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4165999999999993e-05 2024-09-12T17:07:44.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962472+0000", 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000169863 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.962643+0000", 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017084000000000001 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.967183+0000", 2024-09-12T17:07:44.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0045406090000000001 2024-09-12T17:07:44.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978294+0000", 2024-09-12T17:07:44.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011110480000000001 2024-09-12T17:07:44.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978376+0000", 2024-09-12T17:07:44.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2522999999999996e-05 2024-09-12T17:07:44.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.978435+0000", 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8425999999999999e-05 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1899 3.21 3:87e83b37:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.TqvupIMz_YBVo8UQwbzZKEaVUuoNehW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.499595+0000", 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.830589465999999, 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021513126, 2024-09-12T17:07:44.382 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1899 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.499595+0000", 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.499595+0000", 2024-09-12T17:07:44.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.499598+0000", 2024-09-12T17:07:44.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7330000000000001e-06 2024-09-12T17:07:44.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502077+0000", 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024790229999999999 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502119+0000", 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2008999999999997e-05 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502135+0000", 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5619000000000001e-05 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502246+0000", 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00011110799999999999 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502494+0000", 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024810700000000002 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.502713+0000", 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00021841800000000001 2024-09-12T17:07:44.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.511955+0000", 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0092418729999999994 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.520919+0000", 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089645000000000002 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.521032+0000", 2024-09-12T17:07:44.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000112383 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.521108+0000", 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6353000000000006e-05 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1975 3.1c 3:3805ec2a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.jnyWlqSvXNPIAN3dK-0eL-Xl-MeMoAE_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:32.015571+0000", 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.314612976999999, 2024-09-12T17:07:44.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024966074000000001, 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1975 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.015571+0000", 2024-09-12T17:07:44.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.015571+0000", 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.015576+0000", 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9729999999999997e-06 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.019608+0000", 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040314599999999997 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.019653+0000", 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.4990000000000001e-05 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.019673+0000", 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9927000000000001e-05 2024-09-12T17:07:44.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.019839+0000", 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016682900000000001 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.020109+0000", 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026921399999999999 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:44.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.020341+0000", 2024-09-12T17:07:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00023246900000000001 2024-09-12T17:07:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.034871+0000", 2024-09-12T17:07:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014529495999999999 2024-09-12T17:07:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.040325+0000", 2024-09-12T17:07:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054543109999999999 2024-09-12T17:07:44.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.040416+0000", 2024-09-12T17:07:44.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.1506000000000001e-05 2024-09-12T17:07:44.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.394 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.040537+0000", 2024-09-12T17:07:44.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120899 2024-09-12T17:07:44.394 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.394 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.394 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.395 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1981 3.2e 3:75b4d622:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.DHv_qNfW1ugGvVwwMJm3RIrQK33ulM0_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:44.395 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:32.169675+0000", 2024-09-12T17:07:44.395 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.160509666999999, 2024-09-12T17:07:44.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019548751999999999, 2024-09-12T17:07:44.395 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.395 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.395 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.395 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.395 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.395 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1981 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.169675+0000", 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.169675+0000", 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.169679+0000", 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1799999999999998e-06 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172140+0000", 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0024608870000000001 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172175+0000", 2024-09-12T17:07:44.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5775999999999998e-05 2024-09-12T17:07:44.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172191+0000", 2024-09-12T17:07:44.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5235999999999999e-05 2024-09-12T17:07:44.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172355+0000", 2024-09-12T17:07:44.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000164883 2024-09-12T17:07:44.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.172758+0000", 2024-09-12T17:07:44.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040222800000000003 2024-09-12T17:07:44.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:44.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.173172+0000", 2024-09-12T17:07:44.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00041465000000000002 2024-09-12T17:07:44.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.183831+0000", 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010658495 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.188992+0000", 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051616229999999997 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.189081+0000", 2024-09-12T17:07:44.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8790999999999997e-05 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.189223+0000", 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000142003 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1984 3.38 3:1dd59a50:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.40:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:32.193565+0000", 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.136619135, 2024-09-12T17:07:44.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019128305000000002, 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1984 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.193565+0000", 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.193565+0000", 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.193568+0000", 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.897e-06 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.195649+0000", 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0020805620000000002 2024-09-12T17:07:44.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.195684+0000", 2024-09-12T17:07:44.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5944e-05 2024-09-12T17:07:44.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.195702+0000", 2024-09-12T17:07:44.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.7374e-05 2024-09-12T17:07:44.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.195806+0000", 2024-09-12T17:07:44.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104104 2024-09-12T17:07:44.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.196006+0000", 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00020045600000000001 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.196745+0000", 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00073819200000000004 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.205729+0000", 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089840010000000001 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.212556+0000", 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0068270429999999997 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.212636+0000", 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.0408000000000007e-05 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.212693+0000", 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.7324000000000002e-05 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1987 3.21 3:87fea81b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.WuniG_VTTofaI6Y_i6SAkiz4T-cD3pD_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:32.295771+0000", 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.034412783000001, 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017969545999999999, 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1987 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.411 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.295771+0000", 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.295771+0000", 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.295774+0000", 2024-09-12T17:07:44.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0819999999999999e-06 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297227+0000", 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014524410000000001 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297254+0000", 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.7538e-05 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297268+0000", 2024-09-12T17:07:44.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3084e-05 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297344+0000", 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6428999999999996e-05 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297491+0000", 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014728500000000001 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.297596+0000", 2024-09-12T17:07:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000104641 2024-09-12T17:07:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.302509+0000", 2024-09-12T17:07:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049128119999999999 2024-09-12T17:07:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.313653+0000", 2024-09-12T17:07:44.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.011144708 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.313693+0000", 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9499000000000002e-05 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:32.313741+0000", 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8026999999999999e-05 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2125 3.4 3:235ee04f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.q5_4TTRRhSFZvQfgJaK5ATByAODjVXJ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.263750+0000", 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.0664338329999996, 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.027555090000000001, 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2125 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.263750+0000", 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.263750+0000", 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.263754+0000", 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.331e-06 2024-09-12T17:07:44.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.265927+0000", 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021734250000000001 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.265962+0000", 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5333999999999997e-05 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.265981+0000", 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8147000000000001e-05 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.266129+0000", 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000148002 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.266264+0000", 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000135251 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.266358+0000", 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.4231e-05 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.271446+0000", 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0050883359999999997 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.291215+0000", 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019768941000000002 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.291274+0000", 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8304999999999998e-05 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.291305+0000", 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1786999999999999e-05 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2126 3.21 3:86f88542:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.q5_4TTRRhSFZvQfgJaK5ATByAODjVXJ_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.268288+0000", 2024-09-12T17:07:44.422 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.0618957620000007, 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020887334, 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2126 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.423 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.268288+0000", 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.268288+0000", 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.268291+0000", 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6299999999999998e-06 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.269586+0000", 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001295109 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.269607+0000", 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0608e-05 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.269621+0000", 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4375999999999999e-05 2024-09-12T17:07:44.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.269698+0000", 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6497999999999998e-05 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.269840+0000", 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014262899999999999 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.269981+0000", 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00014041600000000001 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.273902+0000", 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039212420000000001 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.289101+0000", 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015199538 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.289143+0000", 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.1056999999999997e-05 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.289176+0000", 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3231000000000001e-05 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.428 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2137 3.4 3:2101eb5b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.-SdXmNUYFTeVbonk8GPVYzJxRUjygU-_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.531627+0000", 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.7985569409999993, 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021855896999999999, 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2137 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.531627+0000", 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.531627+0000", 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.531630+0000", 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1760000000000002e-06 2024-09-12T17:07:44.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.533530+0000", 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0018992429999999999 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.533560+0000", 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.025e-05 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.533575+0000", 2024-09-12T17:07:44.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5277e-05 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.533683+0000", 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010754100000000001 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.533816+0000", 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013308499999999999 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.533943+0000", 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012688900000000001 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.542988+0000", 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0090456000000000009 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.553393+0000", 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010404564999999999 2024-09-12T17:07:44.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.553447+0000", 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.3965999999999998e-05 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.553483+0000", 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6304999999999999e-05 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.435 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2149 3.4 3:22ceee78:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.ztW9hYOXCpwN7-3xmpmJlE3tun-JKcC_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:44.435 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.814873+0000", 2024-09-12T17:07:44.435 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.5153112679999996, 2024-09-12T17:07:44.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020723927999999999, 2024-09-12T17:07:44.435 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.435 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.435 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.435 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.435 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2149 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.814873+0000", 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.814873+0000", 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.814879+0000", 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.5899999999999998e-06 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.817039+0000", 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0021602750000000001 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.817088+0000", 2024-09-12T17:07:44.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.9499999999999997e-05 2024-09-12T17:07:44.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.817110+0000", 2024-09-12T17:07:44.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.1297e-05 2024-09-12T17:07:44.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.438 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.438 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.817292+0000", 2024-09-12T17:07:44.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000182809 2024-09-12T17:07:44.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.817642+0000", 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00034923799999999998 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.817883+0000", 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00024093000000000001 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.824524+0000", 2024-09-12T17:07:44.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066410339999999997 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.835418+0000", 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010894309 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.835514+0000", 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6479999999999998e-05 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.835597+0000", 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2466000000000006e-05 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2164 3.21 3:85d46b70:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.70:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.149959+0000", 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.180224956, 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023326969999999999, 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.441 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2164 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.149959+0000", 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.149959+0000", 2024-09-12T17:07:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.149963+0000", 2024-09-12T17:07:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6239999999999999e-06 2024-09-12T17:07:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.152527+0000", 2024-09-12T17:07:44.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00256412 2024-09-12T17:07:44.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.152572+0000", 2024-09-12T17:07:44.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5232999999999999e-05 2024-09-12T17:07:44.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.152592+0000", 2024-09-12T17:07:44.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9692999999999999e-05 2024-09-12T17:07:44.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.152764+0000", 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000172499 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.153028+0000", 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026360199999999999 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.445 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.153879+0000", 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00085114800000000003 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.171316+0000", 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.017436963 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.173119+0000", 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001803147 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.173217+0000", 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7387999999999997e-05 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.173286+0000", 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9553000000000003e-05 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2333 3.21 3:85674b1d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.3X6E9t6BSKdZ_wF5dt0v3AITb3yWAvO_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:39.655964+0000", 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.6742197970000001, 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020741156, 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2333 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.448 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.655964+0000", 2024-09-12T17:07:44.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.655964+0000", 2024-09-12T17:07:44.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.655968+0000", 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5030000000000002e-06 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.658479+0000", 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0025111449999999998 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.658511+0000", 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2410999999999999e-05 2024-09-12T17:07:44.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.658526+0000", 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4541e-05 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.658603+0000", 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.674e-05 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.658734+0000", 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013126899999999999 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.658855+0000", 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120702 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.666406+0000", 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075511119999999996 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.676628+0000", 2024-09-12T17:07:44.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010221927 2024-09-12T17:07:44.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.676671+0000", 2024-09-12T17:07:44.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3152000000000003e-05 2024-09-12T17:07:44.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.676706+0000", 2024-09-12T17:07:44.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4653999999999997e-05 2024-09-12T17:07:44.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.454 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.454 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.454 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2339 3.0 3:00fe3be9:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.Sc29DosjXCuyWrnnsqT4DWnOVqTNvvX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:44.454 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:39.761638+0000", 2024-09-12T17:07:44.454 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 4.5685460689999999, 2024-09-12T17:07:44.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019532553000000001, 2024-09-12T17:07:44.455 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.455 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.455 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.455 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.455 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2339 2024-09-12T17:07:44.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.455 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.455 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.455 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.761638+0000", 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.761638+0000", 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.761642+0000", 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8240000000000001e-06 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.762878+0000", 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001235613 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.762906+0000", 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8832000000000001e-05 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.762919+0000", 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2588e-05 2024-09-12T17:07:44.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.762988+0000", 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.9334999999999999e-05 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.763115+0000", 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000126208 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.763215+0000", 2024-09-12T17:07:44.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100504 2024-09-12T17:07:44.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.768028+0000", 2024-09-12T17:07:44.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048133170000000001 2024-09-12T17:07:44.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.781001+0000", 2024-09-12T17:07:44.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012972585999999999 2024-09-12T17:07:44.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.781100+0000", 2024-09-12T17:07:44.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9162999999999999e-05 2024-09-12T17:07:44.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.461 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.461 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.781171+0000", 2024-09-12T17:07:44.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0582999999999998e-05 2024-09-12T17:07:44.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.461 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.461 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.461 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.461 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:44.463 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:07:44.504 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:44.500+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:44.564 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:44.560+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:44.623 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:44.624 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:44.624 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:44.624 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:44.640 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:07:44.684 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:44.680+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:44.766 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:44.764+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:44.798 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:44.798 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:44.798 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:44.811 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:07:44.867 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:44.864+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:44.943 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:44.943 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:44.943 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:44.943 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1201 3.8 3:114be366:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.127306795000003, 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021172410999999999, 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1201 2024-09-12T17:07:44.944 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.945 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812956+0000", 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3050000000000001e-06 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816133+0000", 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031766699999999999 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816165+0000", 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2197999999999999e-05 2024-09-12T17:07:44.946 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816177+0000", 2024-09-12T17:07:44.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1973999999999999e-05 2024-09-12T17:07:44.947 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.947 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.947 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.947 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816249+0000", 2024-09-12T17:07:44.947 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1898999999999997e-05 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816385+0000", 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013646400000000001 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816513+0000", 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128097 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.948 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.821736+0000", 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052224869999999996 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834015+0000", 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012279784 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834087+0000", 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1935999999999997e-05 2024-09-12T17:07:44.949 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834125+0000", 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7596999999999999e-05 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1202 3.2 3:421b0e45:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 33.117523007999999, 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018086743999999998, 2024-09-12T17:07:44.950 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1202 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.951 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:44.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.952 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.952 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.952 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822739+0000", 2024-09-12T17:07:44.952 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2589999999999999e-06 2024-09-12T17:07:44.952 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.953 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.953 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824478+0000", 2024-09-12T17:07:44.953 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001739256 2024-09-12T17:07:44.953 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.953 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824502+0000", 2024-09-12T17:07:44.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3952999999999999e-05 2024-09-12T17:07:44.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.954 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.954 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.954 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824514+0000", 2024-09-12T17:07:44.954 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2031999999999999e-05 2024-09-12T17:07:44.954 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824577+0000", 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2793999999999995e-05 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824714+0000", 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013785199999999999 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:44.955 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824862+0000", 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147751 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.830267+0000", 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054052670000000001 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840734+0000", 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010466938 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.956 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840780+0000", 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5831999999999998e-05 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840823+0000", 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2809999999999998e-05 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.957 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1210 3.29 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.996778747, 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021481673, 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1210 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.958 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.959 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943483+0000", 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6520000000000002e-06 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945771+0000", 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022874829999999999 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945806+0000", 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4836999999999999e-05 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.960 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945820+0000", 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939e-05 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945888+0000", 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7702999999999999e-05 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946027+0000", 2024-09-12T17:07:44.961 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000139135 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946146+0000", 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118742 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.950285+0000", 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041384880000000001 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.962 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964885+0000", 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014600594 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964928+0000", 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2536000000000001e-05 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964962+0000", 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4564000000000003e-05 2024-09-12T17:07:44.963 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1216 3.33 3:cf30ff9d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.932293971999997, 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023290796999999999, 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.964 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1216 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.965 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007968+0000", 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0580000000000002e-06 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009686+0000", 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017173920000000001 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.966 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009718+0000", 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2632999999999997e-05 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009734+0000", 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6011999999999998e-05 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009834+0000", 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9947999999999999e-05 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.967 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010000+0000", 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016520599999999999 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010133+0000", 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133676 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.015744+0000", 2024-09-12T17:07:44.968 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056104570000000001 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031150+0000", 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015405894999999999 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031209+0000", 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9247999999999999e-05 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.969 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031256+0000", 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7271999999999997e-05 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1230 3.24 3:257b3201:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.457024920999999, 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018874753000000001, 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.970 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1230 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.971 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483238+0000", 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2880000000000001e-06 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485868+0000", 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026303490000000001 2024-09-12T17:07:44.972 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485904+0000", 2024-09-12T17:07:44.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5513999999999999e-05 2024-09-12T17:07:44.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.973 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485920+0000", 2024-09-12T17:07:44.973 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6201999999999998e-05 2024-09-12T17:07:44.973 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.973 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.973 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486092+0000", 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017220700000000001 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486500+0000", 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040771200000000002 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486750+0000", 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025026699999999998 2024-09-12T17:07:44.974 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.500598+0000", 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013848226 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.501939+0000", 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013409839999999999 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.975 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502016+0000", 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6908000000000003e-05 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502109+0000", 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3096000000000004e-05 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1387 3.8 3:122cdcfa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:44.976 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 28.601970581, 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018409291000000001, 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1387 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.977 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338292+0000", 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.631e-06 2024-09-12T17:07:44.978 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340227+0000", 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001934217 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340262+0000", 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5893999999999999e-05 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.979 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340278+0000", 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5325e-05 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340387+0000", 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010876 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340570+0000", 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018296299999999999 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.980 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340735+0000", 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568400000000001 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.345914+0000", 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051783319999999999 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356536+0000", 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010622529 2024-09-12T17:07:44.981 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356632+0000", 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5927000000000005e-05 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356698+0000", 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6029000000000001e-05 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.982 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1733 3.33 3:cd3b7926:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.M8SFsRZfEjvXnxNc1Ny07cg_vtwVJ9y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.872660989, 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024112788, 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1733 2024-09-12T17:07:44.983 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.984 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067603+0000", 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.707e-06 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072541+0000", 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049382710000000002 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072582+0000", 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0392999999999998e-05 2024-09-12T17:07:44.985 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.986 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.986 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.986 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072606+0000", 2024-09-12T17:07:44.986 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4303000000000001e-05 2024-09-12T17:07:44.986 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.987 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072745+0000", 2024-09-12T17:07:44.987 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013889300000000001 2024-09-12T17:07:44.987 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.987 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.987 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072967+0000", 2024-09-12T17:07:44.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022192800000000001 2024-09-12T17:07:44.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:44.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.073233+0000", 2024-09-12T17:07:44.988 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026631499999999999 2024-09-12T17:07:44.988 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.988 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.988 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.988 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.086312+0000", 2024-09-12T17:07:44.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013078579 2024-09-12T17:07:44.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.989 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.989 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091563+0000", 2024-09-12T17:07:44.989 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052509369999999998 2024-09-12T17:07:44.989 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.989 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091648+0000", 2024-09-12T17:07:44.990 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5051999999999998e-05 2024-09-12T17:07:44.990 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.990 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.990 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.990 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091711+0000", 2024-09-12T17:07:44.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3410000000000004e-05 2024-09-12T17:07:44.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.991 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.991 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.991 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.991 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.991 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1887 3.33 3:cf01266b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.yI34Oa84OEb7C49UYPF9HCMJS_d1s3T_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:44.991 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:44.991 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.677173632000001, 2024-09-12T17:07:44.991 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018315027000000001, 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1887 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:44.992 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263090+0000", 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0239999999999999e-06 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.993 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265411+0000", 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00232132 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265443+0000", 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1718999999999999e-05 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265455+0000", 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2143999999999999e-05 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.994 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:44.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265535+0000", 2024-09-12T17:07:44.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9659000000000004e-05 2024-09-12T17:07:44.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:44.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265655+0000", 2024-09-12T17:07:44.995 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120902 2024-09-12T17:07:44.995 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.995 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.995 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:44.995 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265755+0000", 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9761999999999998e-05 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.272399+0000", 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066442510000000003 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281321+0000", 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089219669999999994 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.996 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281358+0000", 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6355e-05 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281401+0000", 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2923999999999998e-05 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.997 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1920 3.8 3:11cda29a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.31:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.026405033, 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022252124000000002, 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1920 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:44.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913858+0000", 2024-09-12T17:07:44.999 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0770000000000001e-06 2024-09-12T17:07:45.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:45.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917854+0000", 2024-09-12T17:07:45.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039960600000000001 2024-09-12T17:07:45.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.000 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:45.000 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917898+0000", 2024-09-12T17:07:45.000 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3689999999999997e-05 2024-09-12T17:07:45.000 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.000 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917917+0000", 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9233e-05 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.918051+0000", 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133969 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.918315+0000", 2024-09-12T17:07:45.001 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000263355 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.919198+0000", 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00088375200000000002 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.928506+0000", 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0093070960000000008 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.002 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936025+0000", 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075193400000000002 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936073+0000", 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8012e-05 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936106+0000", 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3540000000000001e-05 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.003 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1938 3.19 3:9addcbec:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.34:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.607264538000001, 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020463775, 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.004 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1938 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.005 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332997+0000", 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5100000000000001e-06 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337007+0000", 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040099979999999999 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337054+0000", 2024-09-12T17:07:45.006 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6826000000000002e-05 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337073+0000", 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8743e-05 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337189+0000", 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116507 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:45.007 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337415+0000", 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022530099999999999 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.338022+0000", 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00060701600000000004 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.347566+0000", 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0095447150000000005 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.008 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353379+0000", 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058124170000000003 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353425+0000", 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5824e-05 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353459+0000", 2024-09-12T17:07:45.009 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3918000000000003e-05 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2101 3.24 3:25ca6521:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.4pZZCgy-wBJXiNQ0J0vFl8TPz4X_i3J_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.129474879, 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018837217999999999, 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.010 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2101 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:45.011 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810788+0000", 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0069999999999999e-06 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812434+0000", 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016459020000000001 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:45.012 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812468+0000", 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3173999999999998e-05 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812482+0000", 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3985000000000001e-05 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812582+0000", 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100801 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.013 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812780+0000", 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000197219 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812965+0000", 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018523500000000001 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.818504+0000", 2024-09-12T17:07:45.014 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055390429999999996 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829488+0000", 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010984551 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829565+0000", 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7106000000000003e-05 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.015 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829622+0000", 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6195e-05 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2107 3.27 3:e6a067b7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.Yyze1zZ5yDQsQYVWfVwDqF36m9lCinJ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 10.028506595, 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020701105000000001, 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:45.016 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:45.017 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:45.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:45.017 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.017 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2107 2024-09-12T17:07:45.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.017 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:45.017 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.017 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:45.017 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:45.017 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.017 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911756+0000", 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.557e-06 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:45.018 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913489+0000", 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001732623 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913518+0000", 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8949e-05 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913530+0000", 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1691999999999999e-05 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.019 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913612+0000", 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2706000000000004e-05 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913803+0000", 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000190695 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913972+0000", 2024-09-12T17:07:45.020 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000169536 2024-09-12T17:07:45.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:45.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.919843+0000", 2024-09-12T17:07:45.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058703280000000002 2024-09-12T17:07:45.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.021 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.021 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932289+0000", 2024-09-12T17:07:45.021 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0124463 2024-09-12T17:07:45.021 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.021 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932386+0000", 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7108999999999995e-05 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932454+0000", 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7609999999999998e-05 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.022 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2134 3.19 3:9a3dd654:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.65:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.5106187670000004, 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021094020000000002, 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2134 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:45.023 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:45.024 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429643+0000", 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.588e-06 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431844+0000", 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022009040000000001 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431875+0000", 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1217999999999998e-05 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.025 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431889+0000", 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.432039+0000", 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015003799999999999 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.432481+0000", 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00044164399999999999 2024-09-12T17:07:45.026 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.433634+0000", 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011532059999999999 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.449117+0000", 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015483241999999999 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.027 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450419+0000", 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001301466 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450606+0000", 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000187009 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450735+0000", 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012906199999999999 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.028 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2143 3.7 3:e0f27ed8:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.WqbBAH1T3u9gjF2P42eNw2YQ0hm2xWo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.655215+0000", 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.2850444840000002, 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019844753999999999, 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:45.029 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2143 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.655215+0000", 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.655215+0000", 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.030 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.655219+0000", 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8600000000000003e-06 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657519+0000", 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023000149999999999 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657547+0000", 2024-09-12T17:07:45.031 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8489000000000001e-05 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657559+0000", 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058999999999999e-05 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657657+0000", 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7965000000000001e-05 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.032 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657816+0000", 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001584 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657946+0000", 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000130667 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.662762+0000", 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048154859999999999 2024-09-12T17:07:45.033 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.674927+0000", 2024-09-12T17:07:45.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012165364 2024-09-12T17:07:45.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:45.034 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.674997+0000", 2024-09-12T17:07:45.034 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0173999999999996e-05 2024-09-12T17:07:45.034 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.034 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.034 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.675060+0000", 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2274999999999996e-05 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2179 3.33 3:cc4cab85:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.BhsaRTISTLDImeesX85vqIql3rkxI1u_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.575783+0000", 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3644767099999999, 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.065094399999999997, 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:45.035 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2179 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.575783+0000", 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.036 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.575783+0000", 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.575787+0000", 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9530000000000001e-06 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579440+0000", 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036530640000000001 2024-09-12T17:07:45.037 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579477+0000", 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7845000000000001e-05 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579492+0000", 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4275e-05 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579676+0000", 2024-09-12T17:07:45.038 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000184031 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579895+0000", 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219302 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.580106+0000", 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000210922 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.039 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639924+0000", 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.059817951000000001 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.640589+0000", 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066520200000000005 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.640754+0000", 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016527600000000001 2024-09-12T17:07:45.040 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.640877+0000", 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012257899999999999 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2180 3.8 3:123ed638:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.BhsaRTISTLDImeesX85vqIql3rkxI1u_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.586208+0000", 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3540516070000006, 2024-09-12T17:07:45.041 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052320799000000001, 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2180 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.586208+0000", 2024-09-12T17:07:45.042 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.586208+0000", 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.586210+0000", 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.661e-06 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.043 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587685+0000", 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014748249999999999 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587706+0000", 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0996e-05 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587718+0000", 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2001000000000001e-05 2024-09-12T17:07:45.044 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:45.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587815+0000", 2024-09-12T17:07:45.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6900999999999999e-05 2024-09-12T17:07:45.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:45.045 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587993+0000", 2024-09-12T17:07:45.045 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017817899999999999 2024-09-12T17:07:45.045 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.045 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.045 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.588130+0000", 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013711600000000001 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636926+0000", 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048795660999999997 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.638267+0000", 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013408770000000001 2024-09-12T17:07:45.046 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.638393+0000", 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012611 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.638529+0000", 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013547200000000001 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.047 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop_reply(client.4434.0:2179 3.33 e73/24 ondisk, result = 0)", 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.591277+0000", 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3489821410000005, 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048673934000000002, 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591277+0000", 2024-09-12T17:07:45.048 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:45.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591277+0000", 2024-09-12T17:07:45.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.049 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:45.049 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591279+0000", 2024-09-12T17:07:45.049 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.717e-06 2024-09-12T17:07:45.049 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.049 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591288+0000", 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8799999999999997e-06 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.631851+0000", 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040563601999999997 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.631880+0000", 2024-09-12T17:07:45.050 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8779999999999999e-05 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639863+0000", 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079828290000000003 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639887+0000", 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4156999999999999e-05 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639951+0000", 2024-09-12T17:07:45.051 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T17:07:45.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.052 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.052 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.052 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.052 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.052 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop_reply(client.4434.0:2180 3.8 e73/51 ondisk, result = 0)", 2024-09-12T17:07:45.052 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.594180+0000", 2024-09-12T17:07:45.052 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.3460796239999997, 2024-09-12T17:07:45.052 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04275955, 2024-09-12T17:07:45.052 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:45.052 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:45.052 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594180+0000", 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594180+0000", 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:45.053 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594181+0000", 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.683e-06 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594190+0000", 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6079999999999996e-06 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.632075+0000", 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037884843000000001 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.054 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.632268+0000", 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019365300000000001 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636902+0000", 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004633936 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636917+0000", 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4324e-05 2024-09-12T17:07:45.055 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636939+0000", 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2503000000000001e-05 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:2195 3.c e73/24 3:337f05fc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.DSvxz4vaxxy0dMg8hp4VJxR3sCjbrFE_1:head v 73'10, mlcod=72'8)", 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.777412+0000", 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 8.1628472379999995, 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018679920999999999, 2024-09-12T17:07:45.056 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.777412+0000", 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.777412+0000", 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.057 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.777416+0000", 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0029999999999996e-06 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783541+0000", 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061247070000000001 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783584+0000", 2024-09-12T17:07:45.058 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3498999999999998e-05 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783610+0000", 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5406999999999999e-05 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783809+0000", 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019944900000000001 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.059 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783882+0000", 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3308999999999999e-05 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.796030+0000", 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012147217 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.796092+0000", 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2329999999999994e-05 2024-09-12T17:07:45.060 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.061 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.061 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.061 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.061 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.061 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2327 3.33 3:ce967cb5:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.MVmoorSq8SMskXgSj5cJmk32Q3--ssn_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:45.061 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:39.530634+0000", 2024-09-12T17:07:45.061 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 5.4096252109999998, 2024-09-12T17:07:45.061 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026980457999999999, 2024-09-12T17:07:45.061 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:45.061 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:45.061 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.061 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2327 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.530634+0000", 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.530634+0000", 2024-09-12T17:07:45.062 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.530636+0000", 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-06 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532507+0000", 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001870802 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.063 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532533+0000", 2024-09-12T17:07:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6098e-05 2024-09-12T17:07:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532547+0000", 2024-09-12T17:07:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3944000000000001e-05 2024-09-12T17:07:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532632+0000", 2024-09-12T17:07:45.064 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4894000000000004e-05 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532791+0000", 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015956799999999999 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532920+0000", 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012916699999999999 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.065 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.538587+0000", 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056661130000000004 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.557478+0000", 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018891181999999999 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.557556+0000", 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7875999999999998e-05 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:45.066 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:45.067 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:45.067 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.557615+0000", 2024-09-12T17:07:45.067 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8941999999999999e-05 2024-09-12T17:07:45.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.067 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.067 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:45.067 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:45.067 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:45.069 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:07:45.069 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:45.064+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:45.170 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:45.164+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:45.204 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:45.204 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:45.204 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:45.204 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:45.218 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:07:45.271 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:45.264+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:45.290 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.7 to 1 (10000) 2024-09-12T17:07:45.311 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T17:07:45.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:07:45.348 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:45.348 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:45.348 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:45.363 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:07:45.396 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:45.392+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:45.473 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:45.468+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:45.501 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:45.502 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:45.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:45.502 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:45.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.502 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1188 3.31 3:8d857c15:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:45.502 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:45.502 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.003390625999998, 2024-09-12T17:07:45.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019168672000000001, 2024-09-12T17:07:45.502 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.502 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.502 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.503 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.503 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.503 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.503 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1188 2024-09-12T17:07:45.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.503 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:45.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493824+0000", 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.553e-06 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.504 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497820+0000", 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039958659999999998 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497855+0000", 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4956000000000002e-05 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497872+0000", 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6863000000000001e-05 2024-09-12T17:07:45.505 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497996+0000", 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124306 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498229+0000", 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023307699999999999 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498994+0000", 2024-09-12T17:07:45.506 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076469699999999995 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.507996+0000", 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090021540000000001 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512687+0000", 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046905360000000004 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.507 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512861+0000", 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017420399999999999 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512990+0000", 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012946 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.508 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1232 3.14 3:2967aafe:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:45.509 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:45.509 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.976937718000002, 2024-09-12T17:07:45.509 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019509183999999999, 2024-09-12T17:07:45.509 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.509 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.509 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.509 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.509 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.509 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.509 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1232 2024-09-12T17:07:45.509 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.509 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:45.510 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.510 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.510 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.510 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.510 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520278+0000", 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9539999999999998e-06 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525478+0000", 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005199665 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.511 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525520+0000", 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2391999999999997e-05 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525542+0000", 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1613000000000001e-05 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525676+0000", 2024-09-12T17:07:45.512 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013434300000000001 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525933+0000", 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025640400000000001 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.526162+0000", 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228722 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.513 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.534431+0000", 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082696019999999992 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539449+0000", 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050177099999999999 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539640+0000", 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190812 2024-09-12T17:07:45.514 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539784+0000", 2024-09-12T17:07:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143967 2024-09-12T17:07:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1234 3.3 3:c0bf349d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:45.515 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.951766773000003, 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019413466000000001, 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1234 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.516 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:45.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:45.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.517 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.517 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.517 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545450+0000", 2024-09-12T17:07:45.517 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.313e-06 2024-09-12T17:07:45.517 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549431+0000", 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039813139999999997 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549472+0000", 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0828999999999998e-05 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.518 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549491+0000", 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9055999999999998e-05 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549627+0000", 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013646700000000001 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549859+0000", 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023186100000000001 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.519 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:45.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.550208+0000", 2024-09-12T17:07:45.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000348372 2024-09-12T17:07:45.520 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.520 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.520 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.520 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.559516+0000", 2024-09-12T17:07:45.520 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093083260000000004 2024-09-12T17:07:45.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564688+0000", 2024-09-12T17:07:45.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051717849999999999 2024-09-12T17:07:45.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.521 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.521 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.521 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564783+0000", 2024-09-12T17:07:45.521 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4821000000000006e-05 2024-09-12T17:07:45.521 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564859+0000", 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6322000000000006e-05 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1235 3.1c e63/45 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.934700636999999, 2024-09-12T17:07:45.522 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023527869, 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:45.523 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562514+0000", 2024-09-12T17:07:45.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:45.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.524 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.524 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570603+0000", 2024-09-12T17:07:45.524 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080886359999999997 2024-09-12T17:07:45.524 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.524 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570630+0000", 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7276000000000001e-05 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570642+0000", 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2153e-05 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570805+0000", 2024-09-12T17:07:45.525 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016319899999999999 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570900+0000", 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4988000000000006e-05 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.585884+0000", 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014984046000000001 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.526 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.586039+0000", 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155184 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1247 3.1a 3:58056b43:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.796174594999997, 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021958978000000001, 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.527 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1247 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.528 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701041+0000", 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9399999999999998e-06 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705529+0000", 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044889789999999997 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.529 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705569+0000", 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9606e-05 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705588+0000", 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9375999999999999e-05 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705756+0000", 2024-09-12T17:07:45.530 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016734200000000001 2024-09-12T17:07:45.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706045+0000", 2024-09-12T17:07:45.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028885400000000001 2024-09-12T17:07:45.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.531 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:45.531 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706343+0000", 2024-09-12T17:07:45.531 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029790300000000002 2024-09-12T17:07:45.531 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.531 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720973+0000", 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014630684 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722653+0000", 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016799790000000001 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722878+0000", 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022488799999999999 2024-09-12T17:07:45.532 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.533 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.533 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722997+0000", 2024-09-12T17:07:45.533 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118427 2024-09-12T17:07:45.533 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.533 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.533 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.533 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.533 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.533 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1376 3.3 3:c01937d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:45.533 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:45.533 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.277985688000001, 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020435229999999999, 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1376 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.534 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:45.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:45.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.535 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.535 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.535 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219230+0000", 2024-09-12T17:07:45.535 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.23e-06 2024-09-12T17:07:45.535 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223391+0000", 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041610629999999996 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223425+0000", 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4167e-05 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.536 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223443+0000", 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8105999999999999e-05 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223562+0000", 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118861 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223840+0000", 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027762099999999998 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.537 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:45.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.224077+0000", 2024-09-12T17:07:45.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023720100000000001 2024-09-12T17:07:45.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.232976+0000", 2024-09-12T17:07:45.538 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0088992900000000007 2024-09-12T17:07:45.538 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.538 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.538 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.538 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239478+0000", 2024-09-12T17:07:45.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065023609999999999 2024-09-12T17:07:45.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239574+0000", 2024-09-12T17:07:45.539 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5527999999999997e-05 2024-09-12T17:07:45.539 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.539 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.539 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.539 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239662+0000", 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7801999999999997e-05 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1382 3.1a 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.211318735999999, 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020895593, 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.540 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1382 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.541 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285897+0000", 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6669999999999998e-06 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290617+0000", 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047198689999999998 2024-09-12T17:07:45.542 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290657+0000", 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0201999999999999e-05 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290676+0000", 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9293e-05 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290860+0000", 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000183353 2024-09-12T17:07:45.543 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291264+0000", 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040463800000000002 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291676+0000", 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041151499999999999 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.544 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301391+0000", 2024-09-12T17:07:45.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0097147350000000004 2024-09-12T17:07:45.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306412+0000", 2024-09-12T17:07:45.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050210790000000003 2024-09-12T17:07:45.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.545 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.545 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.545 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306636+0000", 2024-09-12T17:07:45.545 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000224589 2024-09-12T17:07:45.545 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.546 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.546 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306789+0000", 2024-09-12T17:07:45.546 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015265299999999999 2024-09-12T17:07:45.546 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.546 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.546 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.546 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.546 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.546 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1385 3.34 3:2f3cb087:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:45.546 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:45.546 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.17929363, 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024744103999999999, 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1385 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:45.547 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:45.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.548 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.548 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317922+0000", 2024-09-12T17:07:45.548 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.157e-06 2024-09-12T17:07:45.548 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.548 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322800+0000", 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048785879999999997 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322846+0000", 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5732999999999997e-05 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322866+0000", 2024-09-12T17:07:45.549 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0415999999999999e-05 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323048+0000", 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018128 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323496+0000", 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044786400000000002 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:45.550 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323919+0000", 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042374399999999999 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.340076+0000", 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016156925999999999 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342379+0000", 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023025189999999998 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.551 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342546+0000", 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016719599999999999 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342663+0000", 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116681 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.552 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1409 3.a e64/24 3:53d4fdcd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_3:head v 64'6, mlcod=64'4)", 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.675814087999999, 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021472076, 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.553 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:45.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821402+0000", 2024-09-12T17:07:45.554 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4699999999999998e-06 2024-09-12T17:07:45.554 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.554 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.554 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.554 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828337+0000", 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069354229999999996 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828387+0000", 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9908999999999999e-05 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828412+0000", 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5389999999999999e-05 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.555 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828587+0000", 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017425599999999999 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828654+0000", 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7708999999999998e-05 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842774+0000", 2024-09-12T17:07:45.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014119860999999999 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842870+0000", 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6057999999999994e-05 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1417 3.14 3:29a29b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:45.557 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.574485682999999, 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.034043223999999997, 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1417 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922731+0000", 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1099999999999996e-06 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930785+0000", 2024-09-12T17:07:45.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080541020000000005 2024-09-12T17:07:45.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930841+0000", 2024-09-12T17:07:45.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6005999999999999e-05 2024-09-12T17:07:45.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930869+0000", 2024-09-12T17:07:45.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8602000000000002e-05 2024-09-12T17:07:45.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931049+0000", 2024-09-12T17:07:45.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017998299999999999 2024-09-12T17:07:45.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931287+0000", 2024-09-12T17:07:45.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000237712 2024-09-12T17:07:45.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931510+0000", 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022283200000000001 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941891+0000", 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010380785 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.955891+0000", 2024-09-12T17:07:45.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014000207000000001 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956636+0000", 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00074503099999999995 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956770+0000", 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013385400000000001 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.563 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.564 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1420 3.3 3:c118c659:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:45.564 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:45.564 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.545191867, 2024-09-12T17:07:45.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022394282000000001, 2024-09-12T17:07:45.564 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.564 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.564 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.564 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1420 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.565 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952024+0000", 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1760000000000003e-06 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958458+0000", 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064335770000000002 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958492+0000", 2024-09-12T17:07:45.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4309e-05 2024-09-12T17:07:45.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958508+0000", 2024-09-12T17:07:45.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5699999999999999e-05 2024-09-12T17:07:45.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958717+0000", 2024-09-12T17:07:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020871900000000001 2024-09-12T17:07:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959163+0000", 2024-09-12T17:07:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000446007 2024-09-12T17:07:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959583+0000", 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042026800000000001 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.970389+0000", 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010806375999999999 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974044+0000", 2024-09-12T17:07:45.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003654352 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974232+0000", 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018811899999999999 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974415+0000", 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018267899999999999 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.570 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1896 3.2c e71/24 3:3773d78b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.27:head v 71'8, mlcod=71'6)", 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.093155660000001, 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021824796, 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:45.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:45.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404059+0000", 2024-09-12T17:07:45.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.537e-06 2024-09-12T17:07:45.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408616+0000", 2024-09-12T17:07:45.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045564799999999999 2024-09-12T17:07:45.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408657+0000", 2024-09-12T17:07:45.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1968000000000002e-05 2024-09-12T17:07:45.573 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408676+0000", 2024-09-12T17:07:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8445999999999999e-05 2024-09-12T17:07:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408880+0000", 2024-09-12T17:07:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020370100000000001 2024-09-12T17:07:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.574 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408952+0000", 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2226999999999998e-05 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.425787+0000", 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016835383999999998 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.425881+0000", 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4053000000000002e-05 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.575 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1917 3.1a 3:5b4c0dd7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.P_wej9y73GH8iAzyXzEiqKNwtELtJTp_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.613243268, 2024-09-12T17:07:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026569157999999999, 2024-09-12T17:07:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1917 2024-09-12T17:07:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883971+0000", 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4030000000000001e-06 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890727+0000", 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067561080000000003 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890770+0000", 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2614999999999998e-05 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890794+0000", 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3808999999999999e-05 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890964+0000", 2024-09-12T17:07:45.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000169956 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.891223+0000", 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025883600000000003 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.891466+0000", 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000242883 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.909542+0000", 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018076262999999999 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910349+0000", 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080699299999999999 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910447+0000", 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8301999999999995e-05 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910538+0000", 2024-09-12T17:07:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0989999999999994e-05 2024-09-12T17:07:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1923 3.1d e71/24 3:bbfa0a4b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.RvdbUUXkO22SF-kwzRd4VKnEQTGoFzf_1:head v 71'2, mlcod=0'0)", 2024-09-12T17:07:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.462900316000001, 2024-09-12T17:07:45.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020143629, 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:45.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034315+0000", 2024-09-12T17:07:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.123e-06 2024-09-12T17:07:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038477+0000", 2024-09-12T17:07:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041615999999999997 2024-09-12T17:07:45.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038520+0000", 2024-09-12T17:07:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3705000000000003e-05 2024-09-12T17:07:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038539+0000", 2024-09-12T17:07:45.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8825999999999999e-05 2024-09-12T17:07:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038679+0000", 2024-09-12T17:07:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000140051 2024-09-12T17:07:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038729+0000", 2024-09-12T17:07:45.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9455e-05 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054300+0000", 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015571000999999999 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054455+0000", 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015586800000000001 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.587 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1926 3.9 3:92ed9a0c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.32:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.437666881, 2024-09-12T17:07:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019336487999999999, 2024-09-12T17:07:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.588 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1926 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059548+0000", 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063544+0000", 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039964340000000001 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063587+0000", 2024-09-12T17:07:45.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2701000000000003e-05 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063605+0000", 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8065999999999999e-05 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063745+0000", 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014033000000000001 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.064004+0000", 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025869899999999998 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.064666+0000", 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00066141599999999996 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.074813+0000", 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010147168 2024-09-12T17:07:45.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078769+0000", 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039561680000000004 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078837+0000", 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8089000000000005e-05 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078882+0000", 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4827000000000003e-05 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1975 3.1c e71/45 3:3805ec2a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.jnyWlqSvXNPIAN3dK-0eL-Xl-MeMoAE_1:head v 71'6, mlcod=64'4)", 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.47597393, 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019266097999999999, 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.594 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.595 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021241+0000", 2024-09-12T17:07:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0369999999999999e-06 2024-09-12T17:07:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027374+0000", 2024-09-12T17:07:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061327090000000001 2024-09-12T17:07:45.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027417+0000", 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2966000000000002e-05 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027435+0000", 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7796e-05 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027586+0000", 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015143000000000001 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027623+0000", 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6535000000000002e-05 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.040387+0000", 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012764463 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.040504+0000", 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117162 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2131 3.34 3:2ed641cc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.zMHhD2lKVde2GeFxbpVTls1jtnLcDP5_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.102267042999999, 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025713333000000001, 2024-09-12T17:07:45.599 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2131 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394949+0000", 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6799999999999999e-06 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.601 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399541+0000", 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004591955 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399595+0000", 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4694000000000002e-05 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399622+0000", 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6466e-05 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399826+0000", 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020443600000000001 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.400245+0000", 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041897400000000002 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.400666+0000", 2024-09-12T17:07:45.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042066199999999998 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420138+0000", 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019472382 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420297+0000", 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158214 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420498+0000", 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020172899999999999 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420658+0000", 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016014100000000001 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.605 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2146 3.2c e73/24 3:35eb2578:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.67:head v 73'11, mlcod=71'9)", 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.8103383530000006, 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018962961, 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686876+0000", 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6740000000000001e-06 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691317+0000", 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044404900000000001 2024-09-12T17:07:45.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691352+0000", 2024-09-12T17:07:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5355999999999998e-05 2024-09-12T17:07:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691370+0000", 2024-09-12T17:07:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7584999999999999e-05 2024-09-12T17:07:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691503+0000", 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013263199999999999 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691545+0000", 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2886000000000002e-05 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.705738+0000", 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014192885000000001 2024-09-12T17:07:45.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.705837+0000", 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8453000000000001e-05 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2198 3.1 e73/24 3:829b5d0c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.74:head v 73'6, mlcod=72'4)", 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.805329+0000", 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.6918830420000006, 2024-09-12T17:07:45.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019490977999999999, 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.805329+0000", 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.805329+0000", 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.805331+0000", 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.672e-06 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810780+0000", 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054493110000000001 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810807+0000", 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7126000000000001e-05 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810825+0000", 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7747000000000001e-05 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810971+0000", 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014580600000000001 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.811038+0000", 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7477999999999993e-05 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.824762+0000", 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013723384 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.824820+0000", 2024-09-12T17:07:45.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8454e-05 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2204 3.31 3:8c16fd85:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.75:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.953186+0000", 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 8.5440259530000002, 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022095528, 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:45.615 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2204 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.953186+0000", 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.953186+0000", 2024-09-12T17:07:45.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.953189+0000", 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2030000000000001e-06 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957694+0000", 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045044159999999998 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957733+0000", 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8899000000000001e-05 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957749+0000", 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6402999999999999e-05 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957890+0000", 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014088100000000001 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.958158+0000", 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026755799999999999 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.959046+0000", 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00088877100000000001 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.974849+0000", 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015802248000000001 2024-09-12T17:07:45.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.975083+0000", 2024-09-12T17:07:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023468600000000001 2024-09-12T17:07:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.975203+0000", 2024-09-12T17:07:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119919 2024-09-12T17:07:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:45.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.975282+0000", 2024-09-12T17:07:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8543999999999999e-05 2024-09-12T17:07:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:45.621 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:45.621 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:45.622 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:07:45.623 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:45.616+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:45.700 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:07:45.706 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:07:45.715 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2024-09-12T17:07:45.285390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2055889677,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":2226,"num_read_kb":1160585,"num_write":2425,"num_write_kb":2049991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":12583995,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1462,"ondisk_log_size":1462,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":4269412,"kb_used_data":4021944,"kb_used_omap":10,"kb_used_meta":247285,"kb_avail":656333468,"statfs":{"total":676457349120,"available":672085471232,"internally_reserved":0,"allocated":4118470656,"data_stored":4115236146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11157,"internal_metadata":253219947},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":178257920,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":209,"num_read_kb":147573,"num_write":238,"num_write_kb":174114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.025896"},"pg_stats":[{"pgid":"3.3f","version":"74'15","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397900+0000","last_change":"2024-09-12T17:05:47.561581+0000","last_active":"2024-09-12T17:07:42.397900+0000","last_peered":"2024-09-12T17:07:42.397900+0000","last_clean":"2024-09-12T17:07:42.397900+0000","last_became_active":"2024-09-12T17:05:47.560791+0000","last_became_peered":"2024-09-12T17:05:47.560791+0000","last_unstale":"2024-09-12T17:07:42.397900+0000","last_undegraded":"2024-09-12T17:07:42.397900+0000","last_fullsized":"2024-09-12T17:07:42.397900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:23.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":11,"num_read_kb":28674,"num_write":47,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"75'25","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264897+0000","last_change":"2024-09-12T17:05:49.558060+0000","last_active":"2024-09-12T17:07:42.264897+0000","last_peered":"2024-09-12T17:07:42.264897+0000","last_clean":"2024-09-12T17:07:42.264897+0000","last_became_active":"2024-09-12T17:05:49.557287+0000","last_became_peered":"2024-09-12T17:05:49.557287+0000","last_unstale":"2024-09-12T17:07:42.264897+0000","last_undegraded":"2024-09-12T17:07:42.264897+0000","last_fullsized":"2024-09-12T17:07:42.264897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":71,"num_write":36,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"71'3","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.439155+0000","last_change":"2024-09-12T17:06:08.637922+0000","last_active":"2024-09-12T17:07:42.439155+0000","last_peered":"2024-09-12T17:07:42.439155+0000","last_clean":"2024-09-12T17:07:42.439155+0000","last_became_active":"2024-09-12T17:06:08.637579+0000","last_became_peered":"2024-09-12T17:06:08.637579+0000","last_unstale":"2024-09-12T17:07:42.439155+0000","last_undegraded":"2024-09-12T17:07:42.439155+0000","last_fullsized":"2024-09-12T17:07:42.439155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:14.737798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":118,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396363+0000","last_change":"2024-09-12T17:06:39.844511+0000","last_active":"2024-09-12T17:07:42.396363+0000","last_peered":"2024-09-12T17:07:42.396363+0000","last_clean":"2024-09-12T17:07:42.396363+0000","last_became_active":"2024-09-12T17:06:39.844037+0000","last_became_peered":"2024-09-12T17:06:39.844037+0000","last_unstale":"2024-09-12T17:07:42.396363+0000","last_undegraded":"2024-09-12T17:07:42.396363+0000","last_fullsized":"2024-09-12T17:07:42.396363+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:31.148232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"75'12","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437869+0000","last_change":"2024-09-12T17:05:47.523052+0000","last_active":"2024-09-12T17:07:42.437869+0000","last_peered":"2024-09-12T17:07:42.437869+0000","last_clean":"2024-09-12T17:07:42.437869+0000","last_became_active":"2024-09-12T17:05:47.522544+0000","last_became_peered":"2024-09-12T17:05:47.522544+0000","last_unstale":"2024-09-12T17:07:42.437869+0000","last_undegraded":"2024-09-12T17:07:42.437869+0000","last_fullsized":"2024-09-12T17:07:42.437869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"75'17","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550473+0000","last_change":"2024-09-12T17:05:49.549990+0000","last_active":"2024-09-12T17:07:42.550473+0000","last_peered":"2024-09-12T17:07:42.550473+0000","last_clean":"2024-09-12T17:07:42.550473+0000","last_became_active":"2024-09-12T17:05:49.549241+0000","last_became_peered":"2024-09-12T17:05:49.549241+0000","last_unstale":"2024-09-12T17:07:42.550473+0000","last_undegraded":"2024-09-12T17:07:42.550473+0000","last_fullsized":"2024-09-12T17:07:42.550473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.601256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":48,"num_write":25,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266769+0000","last_change":"2024-09-12T17:06:27.748679+0000","last_active":"2024-09-12T17:07:42.266769+0000","last_peered":"2024-09-12T17:07:42.266769+0000","last_clean":"2024-09-12T17:07:42.266769+0000","last_became_active":"2024-09-12T17:06:27.748390+0000","last_became_peered":"2024-09-12T17:06:27.748390+0000","last_unstale":"2024-09-12T17:07:42.266769+0000","last_undegraded":"2024-09-12T17:07:42.266769+0000","last_fullsized":"2024-09-12T17:07:42.266769+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:58.547350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":8193,"num_write":40,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437118+0000","last_change":"2024-09-12T17:05:49.542142+0000","last_active":"2024-09-12T17:07:42.437118+0000","last_peered":"2024-09-12T17:07:42.437118+0000","last_clean":"2024-09-12T17:07:42.437118+0000","last_became_active":"2024-09-12T17:05:49.541354+0000","last_became_peered":"2024-09-12T17:05:49.541354+0000","last_unstale":"2024-09-12T17:07:42.437118+0000","last_undegraded":"2024-09-12T17:07:42.437118+0000","last_fullsized":"2024-09-12T17:07:42.437118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.147865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"72'6","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397085+0000","last_change":"2024-09-12T17:05:47.556154+0000","last_active":"2024-09-12T17:07:42.397085+0000","last_peered":"2024-09-12T17:07:42.397085+0000","last_clean":"2024-09-12T17:07:42.397085+0000","last_became_active":"2024-09-12T17:05:47.555396+0000","last_became_peered":"2024-09-12T17:05:47.555396+0000","last_unstale":"2024-09-12T17:07:42.397085+0000","last_undegraded":"2024-09-12T17:07:42.397085+0000","last_fullsized":"2024-09-12T17:07:42.397085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:27.784208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551590+0000","last_change":"2024-09-12T17:05:49.529344+0000","last_active":"2024-09-12T17:07:42.551590+0000","last_peered":"2024-09-12T17:07:42.551590+0000","last_clean":"2024-09-12T17:07:42.551590+0000","last_became_active":"2024-09-12T17:05:49.528184+0000","last_became_peered":"2024-09-12T17:05:49.528184+0000","last_unstale":"2024-09-12T17:07:42.551590+0000","last_undegraded":"2024-09-12T17:07:42.551590+0000","last_fullsized":"2024-09-12T17:07:42.551590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:18.357328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"74'9","reported_seq":129,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265424+0000","last_change":"2024-09-12T17:05:47.532931+0000","last_active":"2024-09-12T17:07:42.265424+0000","last_peered":"2024-09-12T17:07:42.265424+0000","last_clean":"2024-09-12T17:07:42.265424+0000","last_became_active":"2024-09-12T17:05:47.531427+0000","last_became_peered":"2024-09-12T17:05:47.531427+0000","last_unstale":"2024-09-12T17:07:42.265424+0000","last_undegraded":"2024-09-12T17:07:42.265424+0000","last_fullsized":"2024-09-12T17:07:42.265424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":25,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552307+0000","last_change":"2024-09-12T17:05:49.550694+0000","last_active":"2024-09-12T17:07:42.552307+0000","last_peered":"2024-09-12T17:07:42.552307+0000","last_clean":"2024-09-12T17:07:42.552307+0000","last_became_active":"2024-09-12T17:05:49.549066+0000","last_became_peered":"2024-09-12T17:05:49.549066+0000","last_unstale":"2024-09-12T17:07:42.552307+0000","last_undegraded":"2024-09-12T17:07:42.552307+0000","last_fullsized":"2024-09-12T17:07:42.552307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:24.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"74'6","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397020+0000","last_change":"2024-09-12T17:05:47.560085+0000","last_active":"2024-09-12T17:07:42.397020+0000","last_peered":"2024-09-12T17:07:42.397020+0000","last_clean":"2024-09-12T17:07:42.397020+0000","last_became_active":"2024-09-12T17:05:47.559160+0000","last_became_peered":"2024-09-12T17:05:47.559160+0000","last_unstale":"2024-09-12T17:07:42.397020+0000","last_undegraded":"2024-09-12T17:07:42.397020+0000","last_fullsized":"2024-09-12T17:07:42.397020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:06.664677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":14,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'2","reported_seq":123,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266713+0000","last_change":"2024-09-12T17:06:39.830436+0000","last_active":"2024-09-12T17:07:42.266713+0000","last_peered":"2024-09-12T17:07:42.266713+0000","last_clean":"2024-09-12T17:07:42.266713+0000","last_became_active":"2024-09-12T17:06:39.830025+0000","last_became_peered":"2024-09-12T17:06:39.830025+0000","last_unstale":"2024-09-12T17:07:42.266713+0000","last_undegraded":"2024-09-12T17:07:42.266713+0000","last_fullsized":"2024-09-12T17:07:42.266713+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:00.000353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'7","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264951+0000","last_change":"2024-09-12T17:06:27.748750+0000","last_active":"2024-09-12T17:07:42.264951+0000","last_peered":"2024-09-12T17:07:42.264951+0000","last_clean":"2024-09-12T17:07:42.264951+0000","last_became_active":"2024-09-12T17:06:27.748329+0000","last_became_peered":"2024-09-12T17:06:27.748329+0000","last_unstale":"2024-09-12T17:07:42.264951+0000","last_undegraded":"2024-09-12T17:07:42.264951+0000","last_fullsized":"2024-09-12T17:07:42.264951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:26.773943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":12289,"num_write":31,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267602+0000","last_change":"2024-09-12T17:07:28.190678+0000","last_active":"2024-09-12T17:07:42.267602+0000","last_peered":"2024-09-12T17:07:42.267602+0000","last_clean":"2024-09-12T17:07:42.267602+0000","last_became_active":"2024-09-12T17:07:28.190245+0000","last_became_peered":"2024-09-12T17:07:28.190245+0000","last_unstale":"2024-09-12T17:07:42.267602+0000","last_undegraded":"2024-09-12T17:07:42.267602+0000","last_fullsized":"2024-09-12T17:07:42.267602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:04.220150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549445+0000","last_change":"2024-09-12T17:05:49.549575+0000","last_active":"2024-09-12T17:07:42.549445+0000","last_peered":"2024-09-12T17:07:42.549445+0000","last_clean":"2024-09-12T17:07:42.549445+0000","last_became_active":"2024-09-12T17:05:49.548292+0000","last_became_peered":"2024-09-12T17:05:49.548292+0000","last_unstale":"2024-09-12T17:07:42.549445+0000","last_undegraded":"2024-09-12T17:07:42.549445+0000","last_fullsized":"2024-09-12T17:07:42.549445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"73'5","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398083+0000","last_change":"2024-09-12T17:05:47.559881+0000","last_active":"2024-09-12T17:07:42.398083+0000","last_peered":"2024-09-12T17:07:42.398083+0000","last_clean":"2024-09-12T17:07:42.398083+0000","last_became_active":"2024-09-12T17:05:47.559165+0000","last_became_peered":"2024-09-12T17:05:47.559165+0000","last_unstale":"2024-09-12T17:07:42.398083+0000","last_undegraded":"2024-09-12T17:07:42.398083+0000","last_fullsized":"2024-09-12T17:07:42.398083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:35.318480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":13,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":118,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396628+0000","last_change":"2024-09-12T17:06:39.837035+0000","last_active":"2024-09-12T17:07:42.396628+0000","last_peered":"2024-09-12T17:07:42.396628+0000","last_clean":"2024-09-12T17:07:42.396628+0000","last_became_active":"2024-09-12T17:06:39.836671+0000","last_became_peered":"2024-09-12T17:06:39.836671+0000","last_unstale":"2024-09-12T17:07:42.396628+0000","last_undegraded":"2024-09-12T17:07:42.396628+0000","last_fullsized":"2024-09-12T17:07:42.396628+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:50.677836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"74'9","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551929+0000","last_change":"2024-09-12T17:05:47.528338+0000","last_active":"2024-09-12T17:07:42.551929+0000","last_peered":"2024-09-12T17:07:42.551929+0000","last_clean":"2024-09-12T17:07:42.551929+0000","last_became_active":"2024-09-12T17:05:47.527533+0000","last_became_peered":"2024-09-12T17:05:47.527533+0000","last_unstale":"2024-09-12T17:07:42.551929+0000","last_undegraded":"2024-09-12T17:07:42.551929+0000","last_fullsized":"2024-09-12T17:07:42.551929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.693731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":16385,"num_write":41,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"74'15","reported_seq":127,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265552+0000","last_change":"2024-09-12T17:05:49.543097+0000","last_active":"2024-09-12T17:07:42.265552+0000","last_peered":"2024-09-12T17:07:42.265552+0000","last_clean":"2024-09-12T17:07:42.265552+0000","last_became_active":"2024-09-12T17:05:49.542113+0000","last_became_peered":"2024-09-12T17:05:49.542113+0000","last_unstale":"2024-09-12T17:07:42.265552+0000","last_undegraded":"2024-09-12T17:07:42.265552+0000","last_fullsized":"2024-09-12T17:07:42.265552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":42,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"73'10","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552566+0000","last_change":"2024-09-12T17:05:47.529868+0000","last_active":"2024-09-12T17:07:42.552566+0000","last_peered":"2024-09-12T17:07:42.552566+0000","last_clean":"2024-09-12T17:07:42.552566+0000","last_became_active":"2024-09-12T17:05:47.529083+0000","last_became_peered":"2024-09-12T17:05:47.529083+0000","last_unstale":"2024-09-12T17:07:42.552566+0000","last_undegraded":"2024-09-12T17:07:42.552566+0000","last_fullsized":"2024-09-12T17:07:42.552566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:16.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":32769,"num_write":34,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266187+0000","last_change":"2024-09-12T17:05:49.548084+0000","last_active":"2024-09-12T17:07:42.266187+0000","last_peered":"2024-09-12T17:07:42.266187+0000","last_clean":"2024-09-12T17:07:42.266187+0000","last_became_active":"2024-09-12T17:05:49.539930+0000","last_became_peered":"2024-09-12T17:05:49.539930+0000","last_unstale":"2024-09-12T17:07:42.266187+0000","last_undegraded":"2024-09-12T17:07:42.266187+0000","last_fullsized":"2024-09-12T17:07:42.266187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:11.453390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"73'6","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551044+0000","last_change":"2024-09-12T17:05:47.548316+0000","last_active":"2024-09-12T17:07:42.551044+0000","last_peered":"2024-09-12T17:07:42.551044+0000","last_clean":"2024-09-12T17:07:42.551044+0000","last_became_active":"2024-09-12T17:05:47.547430+0000","last_became_peered":"2024-09-12T17:05:47.547430+0000","last_unstale":"2024-09-12T17:07:42.551044+0000","last_undegraded":"2024-09-12T17:07:42.551044+0000","last_fullsized":"2024-09-12T17:07:42.551044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:21.143073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266667+0000","last_change":"2024-09-12T17:05:49.556144+0000","last_active":"2024-09-12T17:07:42.266667+0000","last_peered":"2024-09-12T17:07:42.266667+0000","last_clean":"2024-09-12T17:07:42.266667+0000","last_became_active":"2024-09-12T17:05:49.555033+0000","last_became_peered":"2024-09-12T17:05:49.555033+0000","last_unstale":"2024-09-12T17:07:42.266667+0000","last_undegraded":"2024-09-12T17:07:42.266667+0000","last_fullsized":"2024-09-12T17:07:42.266667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:08.056726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548577+0000","last_change":"2024-09-12T17:05:47.511375+0000","last_active":"2024-09-12T17:07:42.548577+0000","last_peered":"2024-09-12T17:07:42.548577+0000","last_clean":"2024-09-12T17:07:42.548577+0000","last_became_active":"2024-09-12T17:05:47.510364+0000","last_became_peered":"2024-09-12T17:05:47.510364+0000","last_unstale":"2024-09-12T17:07:42.548577+0000","last_undegraded":"2024-09-12T17:07:42.548577+0000","last_fullsized":"2024-09-12T17:07:42.548577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.553550+0000","last_change":"2024-09-12T17:06:39.840952+0000","last_active":"2024-09-12T17:07:42.553550+0000","last_peered":"2024-09-12T17:07:42.553550+0000","last_clean":"2024-09-12T17:07:42.553550+0000","last_became_active":"2024-09-12T17:06:39.840447+0000","last_became_peered":"2024-09-12T17:06:39.840447+0000","last_unstale":"2024-09-12T17:07:42.553550+0000","last_undegraded":"2024-09-12T17:07:42.553550+0000","last_fullsized":"2024-09-12T17:07:42.553550+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:07.838698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"74'4","reported_seq":129,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437101+0000","last_change":"2024-09-12T17:06:39.827079+0000","last_active":"2024-09-12T17:07:42.437101+0000","last_peered":"2024-09-12T17:07:42.437101+0000","last_clean":"2024-09-12T17:07:42.437101+0000","last_became_active":"2024-09-12T17:06:39.826789+0000","last_became_peered":"2024-09-12T17:06:39.826789+0000","last_unstale":"2024-09-12T17:07:42.437101+0000","last_undegraded":"2024-09-12T17:07:42.437101+0000","last_fullsized":"2024-09-12T17:07:42.437101+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:19.572209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":12,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"68'1","reported_seq":98,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548669+0000","last_change":"2024-09-12T17:05:57.588515+0000","last_active":"2024-09-12T17:07:42.548669+0000","last_peered":"2024-09-12T17:07:42.548669+0000","last_clean":"2024-09-12T17:07:42.548669+0000","last_became_active":"2024-09-12T17:05:57.587891+0000","last_became_peered":"2024-09-12T17:05:57.587891+0000","last_unstale":"2024-09-12T17:07:42.548669+0000","last_undegraded":"2024-09-12T17:07:42.548669+0000","last_fullsized":"2024-09-12T17:07:42.548669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:24.257847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549552+0000","last_change":"2024-09-12T17:06:08.622184+0000","last_active":"2024-09-12T17:07:42.549552+0000","last_peered":"2024-09-12T17:07:42.549552+0000","last_clean":"2024-09-12T17:07:42.549552+0000","last_became_active":"2024-09-12T17:06:08.621375+0000","last_became_peered":"2024-09-12T17:06:08.621375+0000","last_unstale":"2024-09-12T17:07:42.549552+0000","last_undegraded":"2024-09-12T17:07:42.549552+0000","last_fullsized":"2024-09-12T17:07:42.549552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:24.931655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"73'11","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397633+0000","last_change":"2024-09-12T17:05:47.557687+0000","last_active":"2024-09-12T17:07:42.397633+0000","last_peered":"2024-09-12T17:07:42.397633+0000","last_clean":"2024-09-12T17:07:42.397633+0000","last_became_active":"2024-09-12T17:05:47.556980+0000","last_became_peered":"2024-09-12T17:05:47.556980+0000","last_unstale":"2024-09-12T17:07:42.397633+0000","last_undegraded":"2024-09-12T17:07:42.397633+0000","last_fullsized":"2024-09-12T17:07:42.397633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.891909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":13,"num_read_kb":30723,"num_write":35,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265998+0000","last_change":"2024-09-12T17:06:39.826825+0000","last_active":"2024-09-12T17:07:42.265998+0000","last_peered":"2024-09-12T17:07:42.265998+0000","last_clean":"2024-09-12T17:07:42.265998+0000","last_became_active":"2024-09-12T17:06:39.826367+0000","last_became_peered":"2024-09-12T17:06:39.826367+0000","last_unstale":"2024-09-12T17:07:42.265998+0000","last_undegraded":"2024-09-12T17:07:42.265998+0000","last_fullsized":"2024-09-12T17:07:42.265998+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:30.571880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"68'11","reported_seq":123,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438055+0000","last_change":"2024-09-12T17:05:53.537592+0000","last_active":"2024-09-12T17:07:42.438055+0000","last_peered":"2024-09-12T17:07:42.438055+0000","last_clean":"2024-09-12T17:07:42.438055+0000","last_became_active":"2024-09-12T17:05:53.536921+0000","last_became_peered":"2024-09-12T17:05:53.536921+0000","last_unstale":"2024-09-12T17:07:42.438055+0000","last_undegraded":"2024-09-12T17:07:42.438055+0000","last_fullsized":"2024-09-12T17:07:42.438055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:25.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397277+0000","last_change":"2024-09-12T17:05:55.559431+0000","last_active":"2024-09-12T17:07:42.397277+0000","last_peered":"2024-09-12T17:07:42.397277+0000","last_clean":"2024-09-12T17:07:42.397277+0000","last_became_active":"2024-09-12T17:05:55.558297+0000","last_became_peered":"2024-09-12T17:05:55.558297+0000","last_unstale":"2024-09-12T17:07:42.397277+0000","last_undegraded":"2024-09-12T17:07:42.397277+0000","last_fullsized":"2024-09-12T17:07:42.397277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"68'1","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264812+0000","last_change":"2024-09-12T17:05:57.592599+0000","last_active":"2024-09-12T17:07:42.264812+0000","last_peered":"2024-09-12T17:07:42.264812+0000","last_clean":"2024-09-12T17:07:42.264812+0000","last_became_active":"2024-09-12T17:05:57.591877+0000","last_became_peered":"2024-09-12T17:05:57.591877+0000","last_unstale":"2024-09-12T17:07:42.264812+0000","last_undegraded":"2024-09-12T17:07:42.264812+0000","last_fullsized":"2024-09-12T17:07:42.264812+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:57.557525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"68'6","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266473+0000","last_change":"2024-09-12T17:05:49.546093+0000","last_active":"2024-09-12T17:07:42.266473+0000","last_peered":"2024-09-12T17:07:42.266473+0000","last_clean":"2024-09-12T17:07:42.266473+0000","last_became_active":"2024-09-12T17:05:49.544425+0000","last_became_peered":"2024-09-12T17:05:49.544425+0000","last_unstale":"2024-09-12T17:07:42.266473+0000","last_undegraded":"2024-09-12T17:07:42.266473+0000","last_fullsized":"2024-09-12T17:07:42.266473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.495950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"72'6","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437180+0000","last_change":"2024-09-12T17:05:47.535295+0000","last_active":"2024-09-12T17:07:42.437180+0000","last_peered":"2024-09-12T17:07:42.437180+0000","last_clean":"2024-09-12T17:07:42.437180+0000","last_became_active":"2024-09-12T17:05:47.534833+0000","last_became_peered":"2024-09-12T17:05:47.534833+0000","last_unstale":"2024-09-12T17:07:42.437180+0000","last_undegraded":"2024-09-12T17:07:42.437180+0000","last_fullsized":"2024-09-12T17:07:42.437180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549735+0000","last_change":"2024-09-12T17:05:51.533888+0000","last_active":"2024-09-12T17:07:42.549735+0000","last_peered":"2024-09-12T17:07:42.549735+0000","last_clean":"2024-09-12T17:07:42.549735+0000","last_became_active":"2024-09-12T17:05:51.533164+0000","last_became_peered":"2024-09-12T17:05:51.533164+0000","last_unstale":"2024-09-12T17:07:42.549735+0000","last_undegraded":"2024-09-12T17:07:42.549735+0000","last_fullsized":"2024-09-12T17:07:42.549735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:33.007858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549714+0000","last_change":"2024-09-12T17:05:53.549534+0000","last_active":"2024-09-12T17:07:42.549714+0000","last_peered":"2024-09-12T17:07:42.549714+0000","last_clean":"2024-09-12T17:07:42.549714+0000","last_became_active":"2024-09-12T17:05:53.548824+0000","last_became_peered":"2024-09-12T17:05:53.548824+0000","last_unstale":"2024-09-12T17:07:42.549714+0000","last_undegraded":"2024-09-12T17:07:42.549714+0000","last_fullsized":"2024-09-12T17:07:42.549714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.765832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549670+0000","last_change":"2024-09-12T17:05:55.557468+0000","last_active":"2024-09-12T17:07:42.549670+0000","last_peered":"2024-09-12T17:07:42.549670+0000","last_clean":"2024-09-12T17:07:42.549670+0000","last_became_active":"2024-09-12T17:05:55.556689+0000","last_became_peered":"2024-09-12T17:05:55.556689+0000","last_unstale":"2024-09-12T17:07:42.549670+0000","last_undegraded":"2024-09-12T17:07:42.549670+0000","last_fullsized":"2024-09-12T17:07:42.549670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:56.879576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436558+0000","last_change":"2024-09-12T17:05:57.589569+0000","last_active":"2024-09-12T17:07:42.436558+0000","last_peered":"2024-09-12T17:07:42.436558+0000","last_clean":"2024-09-12T17:07:42.436558+0000","last_became_active":"2024-09-12T17:05:57.588649+0000","last_became_peered":"2024-09-12T17:05:57.588649+0000","last_unstale":"2024-09-12T17:07:42.436558+0000","last_undegraded":"2024-09-12T17:07:42.436558+0000","last_fullsized":"2024-09-12T17:07:42.436558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"68'10","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.439279+0000","last_change":"2024-09-12T17:05:49.531436+0000","last_active":"2024-09-12T17:07:42.439279+0000","last_peered":"2024-09-12T17:07:42.439279+0000","last_clean":"2024-09-12T17:07:42.439279+0000","last_became_active":"2024-09-12T17:05:49.530687+0000","last_became_peered":"2024-09-12T17:05:49.530687+0000","last_unstale":"2024-09-12T17:07:42.439279+0000","last_undegraded":"2024-09-12T17:07:42.439279+0000","last_fullsized":"2024-09-12T17:07:42.439279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'9","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397175+0000","last_change":"2024-09-12T17:05:47.564709+0000","last_active":"2024-09-12T17:07:42.397175+0000","last_peered":"2024-09-12T17:07:42.397175+0000","last_clean":"2024-09-12T17:07:42.397175+0000","last_became_active":"2024-09-12T17:05:47.564189+0000","last_became_peered":"2024-09-12T17:05:47.564189+0000","last_unstale":"2024-09-12T17:07:42.397175+0000","last_undegraded":"2024-09-12T17:07:42.397175+0000","last_fullsized":"2024-09-12T17:07:42.397175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":33,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":115,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551255+0000","last_change":"2024-09-12T17:06:39.833068+0000","last_active":"2024-09-12T17:07:42.551255+0000","last_peered":"2024-09-12T17:07:42.551255+0000","last_clean":"2024-09-12T17:07:42.551255+0000","last_became_active":"2024-09-12T17:06:39.832764+0000","last_became_peered":"2024-09-12T17:06:39.832764+0000","last_unstale":"2024-09-12T17:07:42.551255+0000","last_undegraded":"2024-09-12T17:07:42.551255+0000","last_fullsized":"2024-09-12T17:07:42.551255+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:33.183935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":120,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266524+0000","last_change":"2024-09-12T17:05:53.549328+0000","last_active":"2024-09-12T17:07:42.266524+0000","last_peered":"2024-09-12T17:07:42.266524+0000","last_clean":"2024-09-12T17:07:42.266524+0000","last_became_active":"2024-09-12T17:05:53.548968+0000","last_became_peered":"2024-09-12T17:05:53.548968+0000","last_unstale":"2024-09-12T17:07:42.266524+0000","last_undegraded":"2024-09-12T17:07:42.266524+0000","last_fullsized":"2024-09-12T17:07:42.266524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:36.974950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"68'12","reported_seq":153,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397109+0000","last_change":"2024-09-12T17:06:08.641591+0000","last_active":"2024-09-12T17:07:42.397109+0000","last_peered":"2024-09-12T17:07:42.397109+0000","last_clean":"2024-09-12T17:07:42.397109+0000","last_became_active":"2024-09-12T17:06:08.630653+0000","last_became_peered":"2024-09-12T17:06:08.630653+0000","last_unstale":"2024-09-12T17:07:42.397109+0000","last_undegraded":"2024-09-12T17:07:42.397109+0000","last_fullsized":"2024-09-12T17:07:42.397109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:31.735105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549732+0000","last_change":"2024-09-12T17:05:58.122522+0000","last_active":"2024-09-12T17:07:42.549732+0000","last_peered":"2024-09-12T17:07:42.549732+0000","last_clean":"2024-09-12T17:07:42.549732+0000","last_became_active":"2024-09-12T17:05:58.121871+0000","last_became_peered":"2024-09-12T17:05:58.121871+0000","last_unstale":"2024-09-12T17:07:42.549732+0000","last_undegraded":"2024-09-12T17:07:42.549732+0000","last_fullsized":"2024-09-12T17:07:42.549732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:22.625236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550799+0000","last_change":"2024-09-12T17:05:49.528766+0000","last_active":"2024-09-12T17:07:42.550799+0000","last_peered":"2024-09-12T17:07:42.550799+0000","last_clean":"2024-09-12T17:07:42.550799+0000","last_became_active":"2024-09-12T17:05:49.527758+0000","last_became_peered":"2024-09-12T17:05:49.527758+0000","last_unstale":"2024-09-12T17:07:42.550799+0000","last_undegraded":"2024-09-12T17:07:42.550799+0000","last_fullsized":"2024-09-12T17:07:42.550799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:06.399711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"74'14","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549077+0000","last_change":"2024-09-12T17:05:47.521727+0000","last_active":"2024-09-12T17:07:42.549077+0000","last_peered":"2024-09-12T17:07:42.549077+0000","last_clean":"2024-09-12T17:07:42.549077+0000","last_became_active":"2024-09-12T17:05:47.520943+0000","last_became_peered":"2024-09-12T17:05:47.520943+0000","last_unstale":"2024-09-12T17:07:42.549077+0000","last_undegraded":"2024-09-12T17:07:42.549077+0000","last_fullsized":"2024-09-12T17:07:42.549077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:24.772296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52428800,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":9,"num_read_kb":28673,"num_write":22,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"29'1","reported_seq":116,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266459+0000","last_change":"2024-09-12T17:05:51.556202+0000","last_active":"2024-09-12T17:07:42.266459+0000","last_peered":"2024-09-12T17:07:42.266459+0000","last_clean":"2024-09-12T17:07:42.266459+0000","last_became_active":"2024-09-12T17:05:51.555420+0000","last_became_peered":"2024-09-12T17:05:51.555420+0000","last_unstale":"2024-09-12T17:07:42.266459+0000","last_undegraded":"2024-09-12T17:07:42.266459+0000","last_fullsized":"2024-09-12T17:07:42.266459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:56.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"68'10","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396993+0000","last_change":"2024-09-12T17:05:53.554159+0000","last_active":"2024-09-12T17:07:42.396993+0000","last_peered":"2024-09-12T17:07:42.396993+0000","last_clean":"2024-09-12T17:07:42.396993+0000","last_became_active":"2024-09-12T17:05:53.553333+0000","last_became_peered":"2024-09-12T17:05:53.553333+0000","last_unstale":"2024-09-12T17:07:42.396993+0000","last_undegraded":"2024-09-12T17:07:42.396993+0000","last_fullsized":"2024-09-12T17:07:42.396993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:53.266475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"68'11","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550096+0000","last_change":"2024-09-12T17:05:55.556502+0000","last_active":"2024-09-12T17:07:42.550096+0000","last_peered":"2024-09-12T17:07:42.550096+0000","last_clean":"2024-09-12T17:07:42.550096+0000","last_became_active":"2024-09-12T17:05:55.555879+0000","last_became_peered":"2024-09-12T17:05:55.555879+0000","last_unstale":"2024-09-12T17:07:42.550096+0000","last_undegraded":"2024-09-12T17:07:42.550096+0000","last_fullsized":"2024-09-12T17:07:42.550096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:18.672296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265168+0000","last_change":"2024-09-12T17:05:49.553404+0000","last_active":"2024-09-12T17:07:42.265168+0000","last_peered":"2024-09-12T17:07:42.265168+0000","last_clean":"2024-09-12T17:07:42.265168+0000","last_became_active":"2024-09-12T17:05:49.552637+0000","last_became_peered":"2024-09-12T17:05:49.552637+0000","last_unstale":"2024-09-12T17:07:42.265168+0000","last_undegraded":"2024-09-12T17:07:42.265168+0000","last_fullsized":"2024-09-12T17:07:42.265168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"75'6","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398277+0000","last_change":"2024-09-12T17:05:47.562949+0000","last_active":"2024-09-12T17:07:42.398277+0000","last_peered":"2024-09-12T17:07:42.398277+0000","last_clean":"2024-09-12T17:07:42.398277+0000","last_became_active":"2024-09-12T17:05:47.562465+0000","last_became_peered":"2024-09-12T17:05:47.562465+0000","last_unstale":"2024-09-12T17:07:42.398277+0000","last_undegraded":"2024-09-12T17:07:42.398277+0000","last_fullsized":"2024-09-12T17:07:42.398277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5,"num_read_kb":12289,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396130+0000","last_change":"2024-09-12T17:05:51.542349+0000","last_active":"2024-09-12T17:07:42.396130+0000","last_peered":"2024-09-12T17:07:42.396130+0000","last_clean":"2024-09-12T17:07:42.396130+0000","last_became_active":"2024-09-12T17:05:51.541205+0000","last_became_peered":"2024-09-12T17:05:51.541205+0000","last_unstale":"2024-09-12T17:07:42.396130+0000","last_undegraded":"2024-09-12T17:07:42.396130+0000","last_fullsized":"2024-09-12T17:07:42.396130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"68'21","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265125+0000","last_change":"2024-09-12T17:05:53.560400+0000","last_active":"2024-09-12T17:07:42.265125+0000","last_peered":"2024-09-12T17:07:42.265125+0000","last_clean":"2024-09-12T17:07:42.265125+0000","last_became_active":"2024-09-12T17:05:53.559463+0000","last_became_peered":"2024-09-12T17:05:53.559463+0000","last_unstale":"2024-09-12T17:07:42.265125+0000","last_undegraded":"2024-09-12T17:07:42.265125+0000","last_fullsized":"2024-09-12T17:07:42.265125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265789+0000","last_change":"2024-09-12T17:06:08.636081+0000","last_active":"2024-09-12T17:07:42.265789+0000","last_peered":"2024-09-12T17:07:42.265789+0000","last_clean":"2024-09-12T17:07:42.265789+0000","last_became_active":"2024-09-12T17:06:08.634190+0000","last_became_peered":"2024-09-12T17:06:08.634190+0000","last_unstale":"2024-09-12T17:07:42.265789+0000","last_undegraded":"2024-09-12T17:07:42.265789+0000","last_fullsized":"2024-09-12T17:07:42.265789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:48.398088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265785+0000","last_change":"2024-09-12T17:05:57.599403+0000","last_active":"2024-09-12T17:07:42.265785+0000","last_peered":"2024-09-12T17:07:42.265785+0000","last_clean":"2024-09-12T17:07:42.265785+0000","last_became_active":"2024-09-12T17:05:57.598703+0000","last_became_peered":"2024-09-12T17:05:57.598703+0000","last_unstale":"2024-09-12T17:07:42.265785+0000","last_undegraded":"2024-09-12T17:07:42.265785+0000","last_fullsized":"2024-09-12T17:07:42.265785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'17","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550308+0000","last_change":"2024-09-12T17:06:39.840827+0000","last_active":"2024-09-12T17:07:42.550308+0000","last_peered":"2024-09-12T17:07:42.550308+0000","last_clean":"2024-09-12T17:07:42.550308+0000","last_became_active":"2024-09-12T17:06:39.840262+0000","last_became_peered":"2024-09-12T17:06:39.840262+0000","last_unstale":"2024-09-12T17:07:42.550308+0000","last_undegraded":"2024-09-12T17:07:42.550308+0000","last_fullsized":"2024-09-12T17:07:42.550308+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:21.967358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":48,"num_write":25,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"72'7","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397747+0000","last_change":"2024-09-12T17:05:47.563411+0000","last_active":"2024-09-12T17:07:42.397747+0000","last_peered":"2024-09-12T17:07:42.397747+0000","last_clean":"2024-09-12T17:07:42.397747+0000","last_became_active":"2024-09-12T17:05:47.562812+0000","last_became_peered":"2024-09-12T17:05:47.562812+0000","last_unstale":"2024-09-12T17:07:42.397747+0000","last_undegraded":"2024-09-12T17:07:42.397747+0000","last_fullsized":"2024-09-12T17:07:42.397747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:57.659986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":15,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265565+0000","last_change":"2024-09-12T17:05:51.548944+0000","last_active":"2024-09-12T17:07:42.265565+0000","last_peered":"2024-09-12T17:07:42.265565+0000","last_clean":"2024-09-12T17:07:42.265565+0000","last_became_active":"2024-09-12T17:05:51.544649+0000","last_became_peered":"2024-09-12T17:05:51.544649+0000","last_unstale":"2024-09-12T17:07:42.265565+0000","last_undegraded":"2024-09-12T17:07:42.265565+0000","last_fullsized":"2024-09-12T17:07:42.265565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:01.468390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"68'10","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549379+0000","last_change":"2024-09-12T17:05:53.552838+0000","last_active":"2024-09-12T17:07:42.549379+0000","last_peered":"2024-09-12T17:07:42.549379+0000","last_clean":"2024-09-12T17:07:42.549379+0000","last_became_active":"2024-09-12T17:05:53.550042+0000","last_became_peered":"2024-09-12T17:05:53.550042+0000","last_unstale":"2024-09-12T17:07:42.549379+0000","last_undegraded":"2024-09-12T17:07:42.549379+0000","last_fullsized":"2024-09-12T17:07:42.549379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548079+0000","last_change":"2024-09-12T17:05:55.558761+0000","last_active":"2024-09-12T17:07:42.548079+0000","last_peered":"2024-09-12T17:07:42.548079+0000","last_clean":"2024-09-12T17:07:42.548079+0000","last_became_active":"2024-09-12T17:05:55.557930+0000","last_became_peered":"2024-09-12T17:05:55.557930+0000","last_unstale":"2024-09-12T17:07:42.548079+0000","last_undegraded":"2024-09-12T17:07:42.548079+0000","last_fullsized":"2024-09-12T17:07:42.548079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.015675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551895+0000","last_change":"2024-09-12T17:05:57.592611+0000","last_active":"2024-09-12T17:07:42.551895+0000","last_peered":"2024-09-12T17:07:42.551895+0000","last_clean":"2024-09-12T17:07:42.551895+0000","last_became_active":"2024-09-12T17:05:57.591855+0000","last_became_peered":"2024-09-12T17:05:57.591855+0000","last_unstale":"2024-09-12T17:07:42.551895+0000","last_undegraded":"2024-09-12T17:07:42.551895+0000","last_fullsized":"2024-09-12T17:07:42.551895+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:02.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551894+0000","last_change":"2024-09-12T17:06:39.832132+0000","last_active":"2024-09-12T17:07:42.551894+0000","last_peered":"2024-09-12T17:07:42.551894+0000","last_clean":"2024-09-12T17:07:42.551894+0000","last_became_active":"2024-09-12T17:06:39.831461+0000","last_became_peered":"2024-09-12T17:06:39.831461+0000","last_unstale":"2024-09-12T17:07:42.551894+0000","last_undegraded":"2024-09-12T17:07:42.551894+0000","last_fullsized":"2024-09-12T17:07:42.551894+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:42.442840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"74'9","reported_seq":129,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398209+0000","last_change":"2024-09-12T17:05:47.562243+0000","last_active":"2024-09-12T17:07:42.398209+0000","last_peered":"2024-09-12T17:07:42.398209+0000","last_clean":"2024-09-12T17:07:42.398209+0000","last_became_active":"2024-09-12T17:05:47.561587+0000","last_became_peered":"2024-09-12T17:05:47.561587+0000","last_unstale":"2024-09-12T17:07:42.398209+0000","last_undegraded":"2024-09-12T17:07:42.398209+0000","last_fullsized":"2024-09-12T17:07:42.398209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":9,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"29'1","reported_seq":117,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266498+0000","last_change":"2024-09-12T17:05:51.542843+0000","last_active":"2024-09-12T17:07:42.266498+0000","last_peered":"2024-09-12T17:07:42.266498+0000","last_clean":"2024-09-12T17:07:42.266498+0000","last_became_active":"2024-09-12T17:05:51.542457+0000","last_became_peered":"2024-09-12T17:05:51.542457+0000","last_unstale":"2024-09-12T17:07:42.266498+0000","last_undegraded":"2024-09-12T17:07:42.266498+0000","last_fullsized":"2024-09-12T17:07:42.266498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.837373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"68'16","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397684+0000","last_change":"2024-09-12T17:05:53.548729+0000","last_active":"2024-09-12T17:07:42.397684+0000","last_peered":"2024-09-12T17:07:42.397684+0000","last_clean":"2024-09-12T17:07:42.397684+0000","last_became_active":"2024-09-12T17:05:53.547990+0000","last_became_peered":"2024-09-12T17:05:53.547990+0000","last_unstale":"2024-09-12T17:07:42.397684+0000","last_undegraded":"2024-09-12T17:07:42.397684+0000","last_fullsized":"2024-09-12T17:07:42.397684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:22.845485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"68'12","reported_seq":152,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436226+0000","last_change":"2024-09-12T17:06:08.647202+0000","last_active":"2024-09-12T17:07:42.436226+0000","last_peered":"2024-09-12T17:07:42.436226+0000","last_clean":"2024-09-12T17:07:42.436226+0000","last_became_active":"2024-09-12T17:06:08.641797+0000","last_became_peered":"2024-09-12T17:06:08.641797+0000","last_unstale":"2024-09-12T17:07:42.436226+0000","last_undegraded":"2024-09-12T17:07:42.436226+0000","last_fullsized":"2024-09-12T17:07:42.436226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:53.582414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437839+0000","last_change":"2024-09-12T17:05:57.596229+0000","last_active":"2024-09-12T17:07:42.437839+0000","last_peered":"2024-09-12T17:07:42.437839+0000","last_clean":"2024-09-12T17:07:42.437839+0000","last_became_active":"2024-09-12T17:05:57.595658+0000","last_became_peered":"2024-09-12T17:05:57.595658+0000","last_unstale":"2024-09-12T17:07:42.437839+0000","last_undegraded":"2024-09-12T17:07:42.437839+0000","last_fullsized":"2024-09-12T17:07:42.437839+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.644627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437917+0000","last_change":"2024-09-12T17:07:28.187204+0000","last_active":"2024-09-12T17:07:42.437917+0000","last_peered":"2024-09-12T17:07:42.437917+0000","last_clean":"2024-09-12T17:07:42.437917+0000","last_became_active":"2024-09-12T17:07:28.186345+0000","last_became_peered":"2024-09-12T17:07:28.186345+0000","last_unstale":"2024-09-12T17:07:42.437917+0000","last_undegraded":"2024-09-12T17:07:42.437917+0000","last_fullsized":"2024-09-12T17:07:42.437917+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:33.292654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"75'11","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266095+0000","last_change":"2024-09-12T17:05:47.535946+0000","last_active":"2024-09-12T17:07:42.266095+0000","last_peered":"2024-09-12T17:07:42.266095+0000","last_clean":"2024-09-12T17:07:42.266095+0000","last_became_active":"2024-09-12T17:05:47.534607+0000","last_became_peered":"2024-09-12T17:05:47.534607+0000","last_unstale":"2024-09-12T17:07:42.266095+0000","last_undegraded":"2024-09-12T17:07:42.266095+0000","last_fullsized":"2024-09-12T17:07:42.266095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":10,"num_read_kb":18435,"num_write":43,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266195+0000","last_change":"2024-09-12T17:05:51.548391+0000","last_active":"2024-09-12T17:07:42.266195+0000","last_peered":"2024-09-12T17:07:42.266195+0000","last_clean":"2024-09-12T17:07:42.266195+0000","last_became_active":"2024-09-12T17:05:51.547939+0000","last_became_peered":"2024-09-12T17:05:51.547939+0000","last_unstale":"2024-09-12T17:07:42.266195+0000","last_undegraded":"2024-09-12T17:07:42.266195+0000","last_fullsized":"2024-09-12T17:07:42.266195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:08.848247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"68'14","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436525+0000","last_change":"2024-09-12T17:05:53.535756+0000","last_active":"2024-09-12T17:07:42.436525+0000","last_peered":"2024-09-12T17:07:42.436525+0000","last_clean":"2024-09-12T17:07:42.436525+0000","last_became_active":"2024-09-12T17:05:53.535062+0000","last_became_peered":"2024-09-12T17:05:53.535062+0000","last_unstale":"2024-09-12T17:07:42.436525+0000","last_undegraded":"2024-09-12T17:07:42.436525+0000","last_fullsized":"2024-09-12T17:07:42.436525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265308+0000","last_change":"2024-09-12T17:05:55.564010+0000","last_active":"2024-09-12T17:07:42.265308+0000","last_peered":"2024-09-12T17:07:42.265308+0000","last_clean":"2024-09-12T17:07:42.265308+0000","last_became_active":"2024-09-12T17:05:55.563125+0000","last_became_peered":"2024-09-12T17:05:55.563125+0000","last_unstale":"2024-09-12T17:07:42.265308+0000","last_undegraded":"2024-09-12T17:07:42.265308+0000","last_fullsized":"2024-09-12T17:07:42.265308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:00.697571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550496+0000","last_change":"2024-09-12T17:06:39.826819+0000","last_active":"2024-09-12T17:07:42.550496+0000","last_peered":"2024-09-12T17:07:42.550496+0000","last_clean":"2024-09-12T17:07:42.550496+0000","last_became_active":"2024-09-12T17:06:39.826592+0000","last_became_peered":"2024-09-12T17:06:39.826592+0000","last_unstale":"2024-09-12T17:07:42.550496+0000","last_undegraded":"2024-09-12T17:07:42.550496+0000","last_fullsized":"2024-09-12T17:07:42.550496+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:08.789104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551267+0000","last_change":"2024-09-12T17:05:49.544092+0000","last_active":"2024-09-12T17:07:42.551267+0000","last_peered":"2024-09-12T17:07:42.551267+0000","last_clean":"2024-09-12T17:07:42.551267+0000","last_became_active":"2024-09-12T17:05:49.543307+0000","last_became_peered":"2024-09-12T17:05:49.543307+0000","last_unstale":"2024-09-12T17:07:42.551267+0000","last_undegraded":"2024-09-12T17:07:42.551267+0000","last_fullsized":"2024-09-12T17:07:42.551267+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:36.286410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"74'7","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548276+0000","last_change":"2024-09-12T17:05:47.526678+0000","last_active":"2024-09-12T17:07:42.548276+0000","last_peered":"2024-09-12T17:07:42.548276+0000","last_clean":"2024-09-12T17:07:42.548276+0000","last_became_active":"2024-09-12T17:05:47.525696+0000","last_became_peered":"2024-09-12T17:05:47.525696+0000","last_unstale":"2024-09-12T17:07:42.548276+0000","last_undegraded":"2024-09-12T17:07:42.548276+0000","last_fullsized":"2024-09-12T17:07:42.548276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:59.012258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":10243,"num_write":23,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266723+0000","last_change":"2024-09-12T17:05:51.543404+0000","last_active":"2024-09-12T17:07:42.266723+0000","last_peered":"2024-09-12T17:07:42.266723+0000","last_clean":"2024-09-12T17:07:42.266723+0000","last_became_active":"2024-09-12T17:05:51.542737+0000","last_became_peered":"2024-09-12T17:05:51.542737+0000","last_unstale":"2024-09-12T17:07:42.266723+0000","last_undegraded":"2024-09-12T17:07:42.266723+0000","last_fullsized":"2024-09-12T17:07:42.266723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:30.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"68'12","reported_seq":143,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549941+0000","last_change":"2024-09-12T17:06:08.660885+0000","last_active":"2024-09-12T17:07:42.549941+0000","last_peered":"2024-09-12T17:07:42.549941+0000","last_clean":"2024-09-12T17:07:42.549941+0000","last_became_active":"2024-09-12T17:06:08.644254+0000","last_became_peered":"2024-09-12T17:06:08.644254+0000","last_unstale":"2024-09-12T17:07:42.549941+0000","last_undegraded":"2024-09-12T17:07:42.549941+0000","last_fullsized":"2024-09-12T17:07:42.549941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:19.001428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438117+0000","last_change":"2024-09-12T17:05:55.565575+0000","last_active":"2024-09-12T17:07:42.438117+0000","last_peered":"2024-09-12T17:07:42.438117+0000","last_clean":"2024-09-12T17:07:42.438117+0000","last_became_active":"2024-09-12T17:05:55.564802+0000","last_became_peered":"2024-09-12T17:05:55.564802+0000","last_unstale":"2024-09-12T17:07:42.438117+0000","last_undegraded":"2024-09-12T17:07:42.438117+0000","last_fullsized":"2024-09-12T17:07:42.438117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548180+0000","last_change":"2024-09-12T17:05:57.592294+0000","last_active":"2024-09-12T17:07:42.548180+0000","last_peered":"2024-09-12T17:07:42.548180+0000","last_clean":"2024-09-12T17:07:42.548180+0000","last_became_active":"2024-09-12T17:05:57.591389+0000","last_became_peered":"2024-09-12T17:05:57.591389+0000","last_unstale":"2024-09-12T17:07:42.548180+0000","last_undegraded":"2024-09-12T17:07:42.548180+0000","last_fullsized":"2024-09-12T17:07:42.548180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'10","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.553626+0000","last_change":"2024-09-12T17:05:49.553177+0000","last_active":"2024-09-12T17:07:42.553626+0000","last_peered":"2024-09-12T17:07:42.553626+0000","last_clean":"2024-09-12T17:07:42.553626+0000","last_became_active":"2024-09-12T17:05:49.552270+0000","last_became_peered":"2024-09-12T17:05:49.552270+0000","last_unstale":"2024-09-12T17:07:42.553626+0000","last_undegraded":"2024-09-12T17:07:42.553626+0000","last_fullsized":"2024-09-12T17:07:42.553626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:34.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"74'8","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552444+0000","last_change":"2024-09-12T17:05:47.543064+0000","last_active":"2024-09-12T17:07:42.552444+0000","last_peered":"2024-09-12T17:07:42.552444+0000","last_clean":"2024-09-12T17:07:42.552444+0000","last_became_active":"2024-09-12T17:05:47.542362+0000","last_became_peered":"2024-09-12T17:05:47.542362+0000","last_unstale":"2024-09-12T17:07:42.552444+0000","last_undegraded":"2024-09-12T17:07:42.552444+0000","last_fullsized":"2024-09-12T17:07:42.552444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551565+0000","last_change":"2024-09-12T17:06:39.836405+0000","last_active":"2024-09-12T17:07:42.551565+0000","last_peered":"2024-09-12T17:07:42.551565+0000","last_clean":"2024-09-12T17:07:42.551565+0000","last_became_active":"2024-09-12T17:06:39.825263+0000","last_became_peered":"2024-09-12T17:06:39.825263+0000","last_unstale":"2024-09-12T17:07:42.551565+0000","last_undegraded":"2024-09-12T17:07:42.551565+0000","last_fullsized":"2024-09-12T17:07:42.551565+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:36.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"68'16","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266630+0000","last_change":"2024-09-12T17:05:53.554531+0000","last_active":"2024-09-12T17:07:42.266630+0000","last_peered":"2024-09-12T17:07:42.266630+0000","last_clean":"2024-09-12T17:07:42.266630+0000","last_became_active":"2024-09-12T17:05:53.554131+0000","last_became_peered":"2024-09-12T17:05:53.554131+0000","last_unstale":"2024-09-12T17:07:42.266630+0000","last_undegraded":"2024-09-12T17:07:42.266630+0000","last_fullsized":"2024-09-12T17:07:42.266630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"68'11","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267023+0000","last_change":"2024-09-12T17:05:55.559204+0000","last_active":"2024-09-12T17:07:42.267023+0000","last_peered":"2024-09-12T17:07:42.267023+0000","last_clean":"2024-09-12T17:07:42.267023+0000","last_became_active":"2024-09-12T17:05:55.556488+0000","last_became_peered":"2024-09-12T17:05:55.556488+0000","last_unstale":"2024-09-12T17:07:42.267023+0000","last_undegraded":"2024-09-12T17:07:42.267023+0000","last_fullsized":"2024-09-12T17:07:42.267023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:15.167640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436041+0000","last_change":"2024-09-12T17:06:39.827108+0000","last_active":"2024-09-12T17:07:42.436041+0000","last_peered":"2024-09-12T17:07:42.436041+0000","last_clean":"2024-09-12T17:07:42.436041+0000","last_became_active":"2024-09-12T17:06:39.826743+0000","last_became_peered":"2024-09-12T17:06:39.826743+0000","last_unstale":"2024-09-12T17:07:42.436041+0000","last_undegraded":"2024-09-12T17:07:42.436041+0000","last_fullsized":"2024-09-12T17:07:42.436041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:01.886898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"68'6","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550965+0000","last_change":"2024-09-12T17:05:49.562360+0000","last_active":"2024-09-12T17:07:42.550965+0000","last_peered":"2024-09-12T17:07:42.550965+0000","last_clean":"2024-09-12T17:07:42.550965+0000","last_became_active":"2024-09-12T17:05:49.561200+0000","last_became_peered":"2024-09-12T17:05:49.561200+0000","last_unstale":"2024-09-12T17:07:42.550965+0000","last_undegraded":"2024-09-12T17:07:42.550965+0000","last_fullsized":"2024-09-12T17:07:42.550965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.915600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"72'7","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549400+0000","last_change":"2024-09-12T17:05:47.542018+0000","last_active":"2024-09-12T17:07:42.549400+0000","last_peered":"2024-09-12T17:07:42.549400+0000","last_clean":"2024-09-12T17:07:42.549400+0000","last_became_active":"2024-09-12T17:05:47.540484+0000","last_became_peered":"2024-09-12T17:05:47.540484+0000","last_unstale":"2024-09-12T17:07:42.549400+0000","last_undegraded":"2024-09-12T17:07:42.549400+0000","last_fullsized":"2024-09-12T17:07:42.549400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:13.571666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":12291,"num_write":31,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266766+0000","last_change":"2024-09-12T17:05:51.556083+0000","last_active":"2024-09-12T17:07:42.266766+0000","last_peered":"2024-09-12T17:07:42.266766+0000","last_clean":"2024-09-12T17:07:42.266766+0000","last_became_active":"2024-09-12T17:05:51.554176+0000","last_became_peered":"2024-09-12T17:05:51.554176+0000","last_unstale":"2024-09-12T17:07:42.266766+0000","last_undegraded":"2024-09-12T17:07:42.266766+0000","last_fullsized":"2024-09-12T17:07:42.266766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:02.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":120,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549991+0000","last_change":"2024-09-12T17:05:53.553304+0000","last_active":"2024-09-12T17:07:42.549991+0000","last_peered":"2024-09-12T17:07:42.549991+0000","last_clean":"2024-09-12T17:07:42.549991+0000","last_became_active":"2024-09-12T17:05:53.552545+0000","last_became_peered":"2024-09-12T17:05:53.552545+0000","last_unstale":"2024-09-12T17:07:42.549991+0000","last_undegraded":"2024-09-12T17:07:42.549991+0000","last_fullsized":"2024-09-12T17:07:42.549991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"68'12","reported_seq":151,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552126+0000","last_change":"2024-09-12T17:06:39.850569+0000","last_active":"2024-09-12T17:07:42.552126+0000","last_peered":"2024-09-12T17:07:42.552126+0000","last_clean":"2024-09-12T17:07:42.552126+0000","last_became_active":"2024-09-12T17:06:39.833047+0000","last_became_peered":"2024-09-12T17:06:39.833047+0000","last_unstale":"2024-09-12T17:07:42.552126+0000","last_undegraded":"2024-09-12T17:07:42.552126+0000","last_fullsized":"2024-09-12T17:07:42.552126+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:57.371602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550308+0000","last_change":"2024-09-12T17:05:57.597870+0000","last_active":"2024-09-12T17:07:42.550308+0000","last_peered":"2024-09-12T17:07:42.550308+0000","last_clean":"2024-09-12T17:07:42.550308+0000","last_became_active":"2024-09-12T17:05:57.597076+0000","last_became_peered":"2024-09-12T17:05:57.597076+0000","last_unstale":"2024-09-12T17:07:42.550308+0000","last_undegraded":"2024-09-12T17:07:42.550308+0000","last_fullsized":"2024-09-12T17:07:42.550308+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.648974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"68'6","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551123+0000","last_change":"2024-09-12T17:06:39.839387+0000","last_active":"2024-09-12T17:07:42.551123+0000","last_peered":"2024-09-12T17:07:42.551123+0000","last_clean":"2024-09-12T17:07:42.551123+0000","last_became_active":"2024-09-12T17:06:39.839045+0000","last_became_peered":"2024-09-12T17:06:39.839045+0000","last_unstale":"2024-09-12T17:07:42.551123+0000","last_undegraded":"2024-09-12T17:07:42.551123+0000","last_fullsized":"2024-09-12T17:07:42.551123+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:44.982821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'8","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.547553+0000","last_change":"2024-09-12T17:06:39.830841+0000","last_active":"2024-09-12T17:07:42.547553+0000","last_peered":"2024-09-12T17:07:42.547553+0000","last_clean":"2024-09-12T17:07:42.547553+0000","last_became_active":"2024-09-12T17:06:39.830523+0000","last_became_peered":"2024-09-12T17:06:39.830523+0000","last_unstale":"2024-09-12T17:07:42.547553+0000","last_undegraded":"2024-09-12T17:07:42.547553+0000","last_fullsized":"2024-09-12T17:07:42.547553+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:06.748336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550509+0000","last_change":"2024-09-12T17:05:51.540047+0000","last_active":"2024-09-12T17:07:42.550509+0000","last_peered":"2024-09-12T17:07:42.550509+0000","last_clean":"2024-09-12T17:07:42.550509+0000","last_became_active":"2024-09-12T17:05:51.539302+0000","last_became_peered":"2024-09-12T17:05:51.539302+0000","last_unstale":"2024-09-12T17:07:42.550509+0000","last_undegraded":"2024-09-12T17:07:42.550509+0000","last_fullsized":"2024-09-12T17:07:42.550509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:21.253801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"68'20","reported_seq":159,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265827+0000","last_change":"2024-09-12T17:06:08.682493+0000","last_active":"2024-09-12T17:07:42.265827+0000","last_peered":"2024-09-12T17:07:42.265827+0000","last_clean":"2024-09-12T17:07:42.265827+0000","last_became_active":"2024-09-12T17:06:08.630893+0000","last_became_peered":"2024-09-12T17:06:08.630893+0000","last_unstale":"2024-09-12T17:07:42.265827+0000","last_undegraded":"2024-09-12T17:07:42.265827+0000","last_fullsized":"2024-09-12T17:07:42.265827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:29.374168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15301,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551036+0000","last_change":"2024-09-12T17:05:55.566749+0000","last_active":"2024-09-12T17:07:42.551036+0000","last_peered":"2024-09-12T17:07:42.551036+0000","last_clean":"2024-09-12T17:07:42.551036+0000","last_became_active":"2024-09-12T17:05:55.565979+0000","last_became_peered":"2024-09-12T17:05:55.565979+0000","last_unstale":"2024-09-12T17:07:42.551036+0000","last_undegraded":"2024-09-12T17:07:42.551036+0000","last_fullsized":"2024-09-12T17:07:42.551036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265704+0000","last_change":"2024-09-12T17:06:08.635235+0000","last_active":"2024-09-12T17:07:42.265704+0000","last_peered":"2024-09-12T17:07:42.265704+0000","last_clean":"2024-09-12T17:07:42.265704+0000","last_became_active":"2024-09-12T17:06:08.633107+0000","last_became_peered":"2024-09-12T17:06:08.633107+0000","last_unstale":"2024-09-12T17:07:42.265704+0000","last_undegraded":"2024-09-12T17:07:42.265704+0000","last_fullsized":"2024-09-12T17:07:42.265704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552416+0000","last_change":"2024-09-12T17:05:49.539487+0000","last_active":"2024-09-12T17:07:42.552416+0000","last_peered":"2024-09-12T17:07:42.552416+0000","last_clean":"2024-09-12T17:07:42.552416+0000","last_became_active":"2024-09-12T17:05:49.538713+0000","last_became_peered":"2024-09-12T17:05:49.538713+0000","last_unstale":"2024-09-12T17:07:42.552416+0000","last_undegraded":"2024-09-12T17:07:42.552416+0000","last_fullsized":"2024-09-12T17:07:42.552416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.731614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":223,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397767+0000","last_change":"2024-09-12T17:05:35.688483+0000","last_active":"2024-09-12T17:07:42.397767+0000","last_peered":"2024-09-12T17:07:42.397767+0000","last_clean":"2024-09-12T17:07:42.397767+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:07:42.397767+0000","last_undegraded":"2024-09-12T17:07:42.397767+0000","last_fullsized":"2024-09-12T17:07:42.397767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_clean_scrub_stamp":"2024-09-12T17:05:34.151079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266307+0000","last_change":"2024-09-12T17:05:42.225793+0000","last_active":"2024-09-12T17:07:42.266307+0000","last_peered":"2024-09-12T17:07:42.266307+0000","last_clean":"2024-09-12T17:07:42.266307+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:07:42.266307+0000","last_undegraded":"2024-09-12T17:07:42.266307+0000","last_fullsized":"2024-09-12T17:07:42.266307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:54.880257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"73'10","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549019+0000","last_change":"2024-09-12T17:05:47.526243+0000","last_active":"2024-09-12T17:07:42.549019+0000","last_peered":"2024-09-12T17:07:42.549019+0000","last_clean":"2024-09-12T17:07:42.549019+0000","last_became_active":"2024-09-12T17:05:47.525694+0000","last_became_peered":"2024-09-12T17:05:47.525694+0000","last_unstale":"2024-09-12T17:07:42.549019+0000","last_undegraded":"2024-09-12T17:07:42.549019+0000","last_fullsized":"2024-09-12T17:07:42.549019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":8,"num_read_kb":24577,"num_write":34,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398441+0000","last_change":"2024-09-12T17:05:51.548356+0000","last_active":"2024-09-12T17:07:42.398441+0000","last_peered":"2024-09-12T17:07:42.398441+0000","last_clean":"2024-09-12T17:07:42.398441+0000","last_became_active":"2024-09-12T17:05:51.547503+0000","last_became_peered":"2024-09-12T17:05:51.547503+0000","last_unstale":"2024-09-12T17:07:42.398441+0000","last_undegraded":"2024-09-12T17:07:42.398441+0000","last_fullsized":"2024-09-12T17:07:42.398441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:47.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"68'16","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266930+0000","last_change":"2024-09-12T17:05:53.546057+0000","last_active":"2024-09-12T17:07:42.266930+0000","last_peered":"2024-09-12T17:07:42.266930+0000","last_clean":"2024-09-12T17:07:42.266930+0000","last_became_active":"2024-09-12T17:05:53.545266+0000","last_became_peered":"2024-09-12T17:05:53.545266+0000","last_unstale":"2024-09-12T17:07:42.266930+0000","last_undegraded":"2024-09-12T17:07:42.266930+0000","last_fullsized":"2024-09-12T17:07:42.266930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438098+0000","last_change":"2024-09-12T17:05:55.562246+0000","last_active":"2024-09-12T17:07:42.438098+0000","last_peered":"2024-09-12T17:07:42.438098+0000","last_clean":"2024-09-12T17:07:42.438098+0000","last_became_active":"2024-09-12T17:05:55.561410+0000","last_became_peered":"2024-09-12T17:05:55.561410+0000","last_unstale":"2024-09-12T17:07:42.438098+0000","last_undegraded":"2024-09-12T17:07:42.438098+0000","last_fullsized":"2024-09-12T17:07:42.438098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.373235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"68'2","reported_seq":99,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548833+0000","last_change":"2024-09-12T17:05:57.593095+0000","last_active":"2024-09-12T17:07:42.548833+0000","last_peered":"2024-09-12T17:07:42.548833+0000","last_clean":"2024-09-12T17:07:42.548833+0000","last_became_active":"2024-09-12T17:05:57.592287+0000","last_became_peered":"2024-09-12T17:05:57.592287+0000","last_unstale":"2024-09-12T17:07:42.548833+0000","last_undegraded":"2024-09-12T17:07:42.548833+0000","last_fullsized":"2024-09-12T17:07:42.548833+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:52.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.439110+0000","last_change":"2024-09-12T17:06:39.821819+0000","last_active":"2024-09-12T17:07:42.439110+0000","last_peered":"2024-09-12T17:07:42.439110+0000","last_clean":"2024-09-12T17:07:42.439110+0000","last_became_active":"2024-09-12T17:06:39.821483+0000","last_became_peered":"2024-09-12T17:06:39.821483+0000","last_unstale":"2024-09-12T17:07:42.439110+0000","last_undegraded":"2024-09-12T17:07:42.439110+0000","last_fullsized":"2024-09-12T17:07:42.439110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.063250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397377+0000","last_change":"2024-09-12T17:06:08.624247+0000","last_active":"2024-09-12T17:07:42.397377+0000","last_peered":"2024-09-12T17:07:42.397377+0000","last_clean":"2024-09-12T17:07:42.397377+0000","last_became_active":"2024-09-12T17:06:08.621563+0000","last_became_peered":"2024-09-12T17:06:08.621563+0000","last_unstale":"2024-09-12T17:07:42.397377+0000","last_undegraded":"2024-09-12T17:07:42.397377+0000","last_fullsized":"2024-09-12T17:07:42.397377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:50.183253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'12","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436689+0000","last_change":"2024-09-12T17:05:47.544269+0000","last_active":"2024-09-12T17:07:42.436689+0000","last_peered":"2024-09-12T17:07:42.436689+0000","last_clean":"2024-09-12T17:07:42.436689+0000","last_became_active":"2024-09-12T17:05:47.543531+0000","last_became_peered":"2024-09-12T17:05:47.543531+0000","last_unstale":"2024-09-12T17:07:42.436689+0000","last_undegraded":"2024-09-12T17:07:42.436689+0000","last_fullsized":"2024-09-12T17:07:42.436689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:55.688363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":36,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267017+0000","last_change":"2024-09-12T17:06:39.826949+0000","last_active":"2024-09-12T17:07:42.267017+0000","last_peered":"2024-09-12T17:07:42.267017+0000","last_clean":"2024-09-12T17:07:42.267017+0000","last_became_active":"2024-09-12T17:06:39.826492+0000","last_became_peered":"2024-09-12T17:06:39.826492+0000","last_unstale":"2024-09-12T17:07:42.267017+0000","last_undegraded":"2024-09-12T17:07:42.267017+0000","last_fullsized":"2024-09-12T17:07:42.267017+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:23.591675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"68'33","reported_seq":206,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265982+0000","last_change":"2024-09-12T17:06:08.665804+0000","last_active":"2024-09-12T17:07:42.265982+0000","last_peered":"2024-09-12T17:07:42.265982+0000","last_clean":"2024-09-12T17:07:42.265982+0000","last_became_active":"2024-09-12T17:06:08.623506+0000","last_became_peered":"2024-09-12T17:06:08.623506+0000","last_unstale":"2024-09-12T17:07:42.265982+0000","last_undegraded":"2024-09-12T17:07:42.265982+0000","last_fullsized":"2024-09-12T17:07:42.265982+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:51.575992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":50,"num_read_kb":35,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396717+0000","last_change":"2024-09-12T17:05:55.556362+0000","last_active":"2024-09-12T17:07:42.396717+0000","last_peered":"2024-09-12T17:07:42.396717+0000","last_clean":"2024-09-12T17:07:42.396717+0000","last_became_active":"2024-09-12T17:05:55.555625+0000","last_became_peered":"2024-09-12T17:05:55.555625+0000","last_unstale":"2024-09-12T17:07:42.396717+0000","last_undegraded":"2024-09-12T17:07:42.396717+0000","last_fullsized":"2024-09-12T17:07:42.396717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"68'5","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266047+0000","last_change":"2024-09-12T17:06:39.828783+0000","last_active":"2024-09-12T17:07:42.266047+0000","last_peered":"2024-09-12T17:07:42.266047+0000","last_clean":"2024-09-12T17:07:42.266047+0000","last_became_active":"2024-09-12T17:06:39.828474+0000","last_became_peered":"2024-09-12T17:06:39.828474+0000","last_unstale":"2024-09-12T17:07:42.266047+0000","last_undegraded":"2024-09-12T17:07:42.266047+0000","last_fullsized":"2024-09-12T17:07:42.266047+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:02.940971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266851+0000","last_change":"2024-09-12T17:06:08.631456+0000","last_active":"2024-09-12T17:07:42.266851+0000","last_peered":"2024-09-12T17:07:42.266851+0000","last_clean":"2024-09-12T17:07:42.266851+0000","last_became_active":"2024-09-12T17:06:08.630632+0000","last_became_peered":"2024-09-12T17:06:08.630632+0000","last_unstale":"2024-09-12T17:07:42.266851+0000","last_undegraded":"2024-09-12T17:07:42.266851+0000","last_fullsized":"2024-09-12T17:07:42.266851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:55.277877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265941+0000","last_change":"2024-09-12T17:05:42.677413+0000","last_active":"2024-09-12T17:07:42.265941+0000","last_peered":"2024-09-12T17:07:42.265941+0000","last_clean":"2024-09-12T17:07:42.265941+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:07:42.265941+0000","last_undegraded":"2024-09-12T17:07:42.265941+0000","last_fullsized":"2024-09-12T17:07:42.265941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.836885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'10","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266175+0000","last_change":"2024-09-12T17:06:39.822864+0000","last_active":"2024-09-12T17:07:42.266175+0000","last_peered":"2024-09-12T17:07:42.266175+0000","last_clean":"2024-09-12T17:07:42.266175+0000","last_became_active":"2024-09-12T17:06:39.822575+0000","last_became_peered":"2024-09-12T17:06:39.822575+0000","last_unstale":"2024-09-12T17:07:42.266175+0000","last_undegraded":"2024-09-12T17:07:42.266175+0000","last_fullsized":"2024-09-12T17:07:42.266175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:21.169064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":26,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267145+0000","last_change":"2024-09-12T17:05:51.557262+0000","last_active":"2024-09-12T17:07:42.267145+0000","last_peered":"2024-09-12T17:07:42.267145+0000","last_clean":"2024-09-12T17:07:42.267145+0000","last_became_active":"2024-09-12T17:05:51.556959+0000","last_became_peered":"2024-09-12T17:05:51.556959+0000","last_unstale":"2024-09-12T17:07:42.267145+0000","last_undegraded":"2024-09-12T17:07:42.267145+0000","last_fullsized":"2024-09-12T17:07:42.267145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.963181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":147,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397662+0000","last_change":"2024-09-12T17:05:53.555384+0000","last_active":"2024-09-12T17:07:42.397662+0000","last_peered":"2024-09-12T17:07:42.397662+0000","last_clean":"2024-09-12T17:07:42.397662+0000","last_became_active":"2024-09-12T17:05:53.554063+0000","last_became_peered":"2024-09-12T17:05:53.554063+0000","last_unstale":"2024-09-12T17:07:42.397662+0000","last_undegraded":"2024-09-12T17:07:42.397662+0000","last_fullsized":"2024-09-12T17:07:42.397662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436721+0000","last_change":"2024-09-12T17:05:55.547595+0000","last_active":"2024-09-12T17:07:42.436721+0000","last_peered":"2024-09-12T17:07:42.436721+0000","last_clean":"2024-09-12T17:07:42.436721+0000","last_became_active":"2024-09-12T17:05:55.546700+0000","last_became_peered":"2024-09-12T17:05:55.546700+0000","last_unstale":"2024-09-12T17:07:42.436721+0000","last_undegraded":"2024-09-12T17:07:42.436721+0000","last_fullsized":"2024-09-12T17:07:42.436721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548847+0000","last_change":"2024-09-12T17:05:57.587955+0000","last_active":"2024-09-12T17:07:42.548847+0000","last_peered":"2024-09-12T17:07:42.548847+0000","last_clean":"2024-09-12T17:07:42.548847+0000","last_became_active":"2024-09-12T17:05:57.587199+0000","last_became_peered":"2024-09-12T17:05:57.587199+0000","last_unstale":"2024-09-12T17:07:42.548847+0000","last_undegraded":"2024-09-12T17:07:42.548847+0000","last_fullsized":"2024-09-12T17:07:42.548847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.422656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266583+0000","last_change":"2024-09-12T17:06:08.605923+0000","last_active":"2024-09-12T17:07:42.266583+0000","last_peered":"2024-09-12T17:07:42.266583+0000","last_clean":"2024-09-12T17:07:42.266583+0000","last_became_active":"2024-09-12T17:06:08.605402+0000","last_became_peered":"2024-09-12T17:06:08.605402+0000","last_unstale":"2024-09-12T17:07:42.266583+0000","last_undegraded":"2024-09-12T17:07:42.266583+0000","last_fullsized":"2024-09-12T17:07:42.266583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":143,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265669+0000","last_change":"2024-09-12T17:06:39.837990+0000","last_active":"2024-09-12T17:07:42.265669+0000","last_peered":"2024-09-12T17:07:42.265669+0000","last_clean":"2024-09-12T17:07:42.265669+0000","last_became_active":"2024-09-12T17:06:39.826297+0000","last_became_peered":"2024-09-12T17:06:39.826297+0000","last_unstale":"2024-09-12T17:07:42.265669+0000","last_undegraded":"2024-09-12T17:07:42.265669+0000","last_fullsized":"2024-09-12T17:07:42.265669+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:00.390165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'10","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550340+0000","last_change":"2024-09-12T17:05:47.546543+0000","last_active":"2024-09-12T17:07:42.550340+0000","last_peered":"2024-09-12T17:07:42.550340+0000","last_clean":"2024-09-12T17:07:42.550340+0000","last_became_active":"2024-09-12T17:05:47.545554+0000","last_became_peered":"2024-09-12T17:05:47.545554+0000","last_unstale":"2024-09-12T17:07:42.550340+0000","last_undegraded":"2024-09-12T17:07:42.550340+0000","last_fullsized":"2024-09-12T17:07:42.550340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:07.148131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":13,"num_read_kb":28675,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":115,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437583+0000","last_change":"2024-09-12T17:06:39.843517+0000","last_active":"2024-09-12T17:07:42.437583+0000","last_peered":"2024-09-12T17:07:42.437583+0000","last_clean":"2024-09-12T17:07:42.437583+0000","last_became_active":"2024-09-12T17:06:39.842597+0000","last_became_peered":"2024-09-12T17:06:39.842597+0000","last_unstale":"2024-09-12T17:07:42.437583+0000","last_undegraded":"2024-09-12T17:07:42.437583+0000","last_fullsized":"2024-09-12T17:07:42.437583+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:37.568258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":123,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550282+0000","last_change":"2024-09-12T17:05:53.551499+0000","last_active":"2024-09-12T17:07:42.550282+0000","last_peered":"2024-09-12T17:07:42.550282+0000","last_clean":"2024-09-12T17:07:42.550282+0000","last_became_active":"2024-09-12T17:05:53.550857+0000","last_became_peered":"2024-09-12T17:05:53.550857+0000","last_unstale":"2024-09-12T17:07:42.550282+0000","last_undegraded":"2024-09-12T17:07:42.550282+0000","last_fullsized":"2024-09-12T17:07:42.550282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551890+0000","last_change":"2024-09-12T17:05:55.571619+0000","last_active":"2024-09-12T17:07:42.551890+0000","last_peered":"2024-09-12T17:07:42.551890+0000","last_clean":"2024-09-12T17:07:42.551890+0000","last_became_active":"2024-09-12T17:05:55.570991+0000","last_became_peered":"2024-09-12T17:05:55.570991+0000","last_unstale":"2024-09-12T17:07:42.551890+0000","last_undegraded":"2024-09-12T17:07:42.551890+0000","last_fullsized":"2024-09-12T17:07:42.551890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:02.401831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"68'1","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264482+0000","last_change":"2024-09-12T17:05:57.590482+0000","last_active":"2024-09-12T17:07:42.264482+0000","last_peered":"2024-09-12T17:07:42.264482+0000","last_clean":"2024-09-12T17:07:42.264482+0000","last_became_active":"2024-09-12T17:05:57.589542+0000","last_became_peered":"2024-09-12T17:05:57.589542+0000","last_unstale":"2024-09-12T17:07:42.264482+0000","last_undegraded":"2024-09-12T17:07:42.264482+0000","last_fullsized":"2024-09-12T17:07:42.264482+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:20.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265288+0000","last_change":"2024-09-12T17:06:08.636568+0000","last_active":"2024-09-12T17:07:42.265288+0000","last_peered":"2024-09-12T17:07:42.265288+0000","last_clean":"2024-09-12T17:07:42.265288+0000","last_became_active":"2024-09-12T17:06:08.635747+0000","last_became_peered":"2024-09-12T17:06:08.635747+0000","last_unstale":"2024-09-12T17:07:42.265288+0000","last_undegraded":"2024-09-12T17:07:42.265288+0000","last_fullsized":"2024-09-12T17:07:42.265288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:16.750038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"74'15","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266575+0000","last_change":"2024-09-12T17:05:47.525858+0000","last_active":"2024-09-12T17:07:42.266575+0000","last_peered":"2024-09-12T17:07:42.266575+0000","last_clean":"2024-09-12T17:07:42.266575+0000","last_became_active":"2024-09-12T17:05:47.525258+0000","last_became_peered":"2024-09-12T17:05:47.525258+0000","last_unstale":"2024-09-12T17:07:42.266575+0000","last_undegraded":"2024-09-12T17:07:42.266575+0000","last_fullsized":"2024-09-12T17:07:42.266575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":39,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437048+0000","last_change":"2024-09-12T17:06:39.832937+0000","last_active":"2024-09-12T17:07:42.437048+0000","last_peered":"2024-09-12T17:07:42.437048+0000","last_clean":"2024-09-12T17:07:42.437048+0000","last_became_active":"2024-09-12T17:06:39.832667+0000","last_became_peered":"2024-09-12T17:06:39.832667+0000","last_unstale":"2024-09-12T17:07:42.437048+0000","last_undegraded":"2024-09-12T17:07:42.437048+0000","last_fullsized":"2024-09-12T17:07:42.437048+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:00.390165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437311+0000","last_change":"2024-09-12T17:05:51.544848+0000","last_active":"2024-09-12T17:07:42.437311+0000","last_peered":"2024-09-12T17:07:42.437311+0000","last_clean":"2024-09-12T17:07:42.437311+0000","last_became_active":"2024-09-12T17:05:51.544078+0000","last_became_peered":"2024-09-12T17:05:51.544078+0000","last_unstale":"2024-09-12T17:07:42.437311+0000","last_undegraded":"2024-09-12T17:07:42.437311+0000","last_fullsized":"2024-09-12T17:07:42.437311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"68'20","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436264+0000","last_change":"2024-09-12T17:05:53.540181+0000","last_active":"2024-09-12T17:07:42.436264+0000","last_peered":"2024-09-12T17:07:42.436264+0000","last_clean":"2024-09-12T17:07:42.436264+0000","last_became_active":"2024-09-12T17:05:53.539372+0000","last_became_peered":"2024-09-12T17:05:53.539372+0000","last_unstale":"2024-09-12T17:07:42.436264+0000","last_undegraded":"2024-09-12T17:07:42.436264+0000","last_fullsized":"2024-09-12T17:07:42.436264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:58.931466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550666+0000","last_change":"2024-09-12T17:05:55.554060+0000","last_active":"2024-09-12T17:07:42.550666+0000","last_peered":"2024-09-12T17:07:42.550666+0000","last_clean":"2024-09-12T17:07:42.550666+0000","last_became_active":"2024-09-12T17:05:55.553263+0000","last_became_peered":"2024-09-12T17:05:55.553263+0000","last_unstale":"2024-09-12T17:07:42.550666+0000","last_undegraded":"2024-09-12T17:07:42.550666+0000","last_fullsized":"2024-09-12T17:07:42.550666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:44.303469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437559+0000","last_change":"2024-09-12T17:05:58.121180+0000","last_active":"2024-09-12T17:07:42.437559+0000","last_peered":"2024-09-12T17:07:42.437559+0000","last_clean":"2024-09-12T17:07:42.437559+0000","last_became_active":"2024-09-12T17:05:58.119755+0000","last_became_peered":"2024-09-12T17:05:58.119755+0000","last_unstale":"2024-09-12T17:07:42.437559+0000","last_undegraded":"2024-09-12T17:07:42.437559+0000","last_fullsized":"2024-09-12T17:07:42.437559+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437922+0000","last_change":"2024-09-12T17:05:49.550213+0000","last_active":"2024-09-12T17:07:42.437922+0000","last_peered":"2024-09-12T17:07:42.437922+0000","last_clean":"2024-09-12T17:07:42.437922+0000","last_became_active":"2024-09-12T17:05:49.549583+0000","last_became_peered":"2024-09-12T17:05:49.549583+0000","last_unstale":"2024-09-12T17:07:42.437922+0000","last_undegraded":"2024-09-12T17:07:42.437922+0000","last_fullsized":"2024-09-12T17:07:42.437922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:05.085326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"75'10","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266984+0000","last_change":"2024-09-12T17:06:39.829536+0000","last_active":"2024-09-12T17:07:42.266984+0000","last_peered":"2024-09-12T17:07:42.266984+0000","last_clean":"2024-09-12T17:07:42.266984+0000","last_became_active":"2024-09-12T17:06:39.828971+0000","last_became_peered":"2024-09-12T17:06:39.828971+0000","last_unstale":"2024-09-12T17:07:42.266984+0000","last_undegraded":"2024-09-12T17:07:42.266984+0000","last_fullsized":"2024-09-12T17:07:42.266984+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:06.423987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398444+0000","last_change":"2024-09-12T17:05:42.218804+0000","last_active":"2024-09-12T17:07:42.398444+0000","last_peered":"2024-09-12T17:07:42.398444+0000","last_clean":"2024-09-12T17:07:42.398444+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:07:42.398444+0000","last_undegraded":"2024-09-12T17:07:42.398444+0000","last_fullsized":"2024-09-12T17:07:42.398444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:48.189931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550160+0000","last_change":"2024-09-12T17:05:51.545963+0000","last_active":"2024-09-12T17:07:42.550160+0000","last_peered":"2024-09-12T17:07:42.550160+0000","last_clean":"2024-09-12T17:07:42.550160+0000","last_became_active":"2024-09-12T17:05:51.545225+0000","last_became_peered":"2024-09-12T17:05:51.545225+0000","last_unstale":"2024-09-12T17:07:42.550160+0000","last_undegraded":"2024-09-12T17:07:42.550160+0000","last_fullsized":"2024-09-12T17:07:42.550160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:40.407563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":120,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549237+0000","last_change":"2024-09-12T17:06:39.848324+0000","last_active":"2024-09-12T17:07:42.549237+0000","last_peered":"2024-09-12T17:07:42.549237+0000","last_clean":"2024-09-12T17:07:42.549237+0000","last_became_active":"2024-09-12T17:06:39.832103+0000","last_became_peered":"2024-09-12T17:06:39.832103+0000","last_unstale":"2024-09-12T17:07:42.549237+0000","last_undegraded":"2024-09-12T17:07:42.549237+0000","last_fullsized":"2024-09-12T17:07:42.549237+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:11.548413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"68'12","reported_seq":144,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264909+0000","last_change":"2024-09-12T17:06:08.666682+0000","last_active":"2024-09-12T17:07:42.264909+0000","last_peered":"2024-09-12T17:07:42.264909+0000","last_clean":"2024-09-12T17:07:42.264909+0000","last_became_active":"2024-09-12T17:06:08.623453+0000","last_became_peered":"2024-09-12T17:06:08.623453+0000","last_unstale":"2024-09-12T17:07:42.264909+0000","last_undegraded":"2024-09-12T17:07:42.264909+0000","last_fullsized":"2024-09-12T17:07:42.264909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:58.215239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551111+0000","last_change":"2024-09-12T17:05:58.118437+0000","last_active":"2024-09-12T17:07:42.551111+0000","last_peered":"2024-09-12T17:07:42.551111+0000","last_clean":"2024-09-12T17:07:42.551111+0000","last_became_active":"2024-09-12T17:05:58.117710+0000","last_became_peered":"2024-09-12T17:05:58.117710+0000","last_unstale":"2024-09-12T17:07:42.551111+0000","last_undegraded":"2024-09-12T17:07:42.551111+0000","last_fullsized":"2024-09-12T17:07:42.551111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:00.239807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265096+0000","last_change":"2024-09-12T17:06:27.817661+0000","last_active":"2024-09-12T17:07:42.265096+0000","last_peered":"2024-09-12T17:07:42.265096+0000","last_clean":"2024-09-12T17:07:42.265096+0000","last_became_active":"2024-09-12T17:06:27.817451+0000","last_became_peered":"2024-09-12T17:06:27.817451+0000","last_unstale":"2024-09-12T17:07:42.265096+0000","last_undegraded":"2024-09-12T17:07:42.265096+0000","last_fullsized":"2024-09-12T17:07:42.265096+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:31.000633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"73'7","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550668+0000","last_change":"2024-09-12T17:05:47.535321+0000","last_active":"2024-09-12T17:07:42.550668+0000","last_peered":"2024-09-12T17:07:42.550668+0000","last_clean":"2024-09-12T17:07:42.550668+0000","last_became_active":"2024-09-12T17:05:47.534790+0000","last_became_peered":"2024-09-12T17:05:47.534790+0000","last_unstale":"2024-09-12T17:07:42.550668+0000","last_undegraded":"2024-09-12T17:07:42.550668+0000","last_fullsized":"2024-09-12T17:07:42.550668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":15,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552298+0000","last_change":"2024-09-12T17:06:08.647883+0000","last_active":"2024-09-12T17:07:42.552298+0000","last_peered":"2024-09-12T17:07:42.552298+0000","last_clean":"2024-09-12T17:07:42.552298+0000","last_became_active":"2024-09-12T17:06:08.647190+0000","last_became_peered":"2024-09-12T17:06:08.647190+0000","last_unstale":"2024-09-12T17:07:42.552298+0000","last_undegraded":"2024-09-12T17:07:42.552298+0000","last_fullsized":"2024-09-12T17:07:42.552298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:20.412411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550403+0000","last_change":"2024-09-12T17:05:51.533668+0000","last_active":"2024-09-12T17:07:42.550403+0000","last_peered":"2024-09-12T17:07:42.550403+0000","last_clean":"2024-09-12T17:07:42.550403+0000","last_became_active":"2024-09-12T17:05:51.532795+0000","last_became_peered":"2024-09-12T17:05:51.532795+0000","last_unstale":"2024-09-12T17:07:42.550403+0000","last_undegraded":"2024-09-12T17:07:42.550403+0000","last_fullsized":"2024-09-12T17:07:42.550403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.655645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":120,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550460+0000","last_change":"2024-09-12T17:05:53.544503+0000","last_active":"2024-09-12T17:07:42.550460+0000","last_peered":"2024-09-12T17:07:42.550460+0000","last_clean":"2024-09-12T17:07:42.550460+0000","last_became_active":"2024-09-12T17:05:53.543495+0000","last_became_peered":"2024-09-12T17:05:53.543495+0000","last_unstale":"2024-09-12T17:07:42.550460+0000","last_undegraded":"2024-09-12T17:07:42.550460+0000","last_fullsized":"2024-09-12T17:07:42.550460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.721968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"68'11","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549928+0000","last_change":"2024-09-12T17:05:55.567580+0000","last_active":"2024-09-12T17:07:42.549928+0000","last_peered":"2024-09-12T17:07:42.549928+0000","last_clean":"2024-09-12T17:07:42.549928+0000","last_became_active":"2024-09-12T17:05:55.566652+0000","last_became_peered":"2024-09-12T17:05:55.566652+0000","last_unstale":"2024-09-12T17:07:42.549928+0000","last_undegraded":"2024-09-12T17:07:42.549928+0000","last_fullsized":"2024-09-12T17:07:42.549928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:28.904117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"68'2","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436897+0000","last_change":"2024-09-12T17:05:57.585098+0000","last_active":"2024-09-12T17:07:42.436897+0000","last_peered":"2024-09-12T17:07:42.436897+0000","last_clean":"2024-09-12T17:07:42.436897+0000","last_became_active":"2024-09-12T17:05:57.584326+0000","last_became_peered":"2024-09-12T17:05:57.584326+0000","last_unstale":"2024-09-12T17:07:42.436897+0000","last_undegraded":"2024-09-12T17:07:42.436897+0000","last_fullsized":"2024-09-12T17:07:42.436897+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550112+0000","last_change":"2024-09-12T17:05:49.553294+0000","last_active":"2024-09-12T17:07:42.550112+0000","last_peered":"2024-09-12T17:07:42.550112+0000","last_clean":"2024-09-12T17:07:42.550112+0000","last_became_active":"2024-09-12T17:05:49.551726+0000","last_became_peered":"2024-09-12T17:05:49.551726+0000","last_unstale":"2024-09-12T17:07:42.550112+0000","last_undegraded":"2024-09-12T17:07:42.550112+0000","last_fullsized":"2024-09-12T17:07:42.550112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:50.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"74'6","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.439339+0000","last_change":"2024-09-12T17:06:39.825017+0000","last_active":"2024-09-12T17:07:42.439339+0000","last_peered":"2024-09-12T17:07:42.439339+0000","last_clean":"2024-09-12T17:07:42.439339+0000","last_became_active":"2024-09-12T17:06:39.824735+0000","last_became_peered":"2024-09-12T17:06:39.824735+0000","last_unstale":"2024-09-12T17:07:42.439339+0000","last_undegraded":"2024-09-12T17:07:42.439339+0000","last_fullsized":"2024-09-12T17:07:42.439339+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:26.552415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":16385,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552453+0000","last_change":"2024-09-12T17:05:42.680975+0000","last_active":"2024-09-12T17:07:42.552453+0000","last_peered":"2024-09-12T17:07:42.552453+0000","last_clean":"2024-09-12T17:07:42.552453+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:07:42.552453+0000","last_undegraded":"2024-09-12T17:07:42.552453+0000","last_fullsized":"2024-09-12T17:07:42.552453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.660350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":115,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.547945+0000","last_change":"2024-09-12T17:06:39.839220+0000","last_active":"2024-09-12T17:07:42.547945+0000","last_peered":"2024-09-12T17:07:42.547945+0000","last_clean":"2024-09-12T17:07:42.547945+0000","last_became_active":"2024-09-12T17:06:39.838943+0000","last_became_peered":"2024-09-12T17:06:39.838943+0000","last_unstale":"2024-09-12T17:07:42.547945+0000","last_undegraded":"2024-09-12T17:07:42.547945+0000","last_fullsized":"2024-09-12T17:07:42.547945+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:40.303504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"68'24","reported_seq":145,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396311+0000","last_change":"2024-09-12T17:05:53.554751+0000","last_active":"2024-09-12T17:07:42.396311+0000","last_peered":"2024-09-12T17:07:42.396311+0000","last_clean":"2024-09-12T17:07:42.396311+0000","last_became_active":"2024-09-12T17:05:53.553914+0000","last_became_peered":"2024-09-12T17:05:53.553914+0000","last_unstale":"2024-09-12T17:07:42.396311+0000","last_undegraded":"2024-09-12T17:07:42.396311+0000","last_fullsized":"2024-09-12T17:07:42.396311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15520,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":107,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548341+0000","last_change":"2024-09-12T17:06:08.605576+0000","last_active":"2024-09-12T17:07:42.548341+0000","last_peered":"2024-09-12T17:07:42.548341+0000","last_clean":"2024-09-12T17:07:42.548341+0000","last_became_active":"2024-09-12T17:06:08.605191+0000","last_became_peered":"2024-09-12T17:06:08.605191+0000","last_unstale":"2024-09-12T17:07:42.548341+0000","last_undegraded":"2024-09-12T17:07:42.548341+0000","last_fullsized":"2024-09-12T17:07:42.548341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:13.198865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265815+0000","last_change":"2024-09-12T17:05:57.605829+0000","last_active":"2024-09-12T17:07:42.265815+0000","last_peered":"2024-09-12T17:07:42.265815+0000","last_clean":"2024-09-12T17:07:42.265815+0000","last_became_active":"2024-09-12T17:05:57.605041+0000","last_became_peered":"2024-09-12T17:05:57.605041+0000","last_unstale":"2024-09-12T17:07:42.265815+0000","last_undegraded":"2024-09-12T17:07:42.265815+0000","last_fullsized":"2024-09-12T17:07:42.265815+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437905+0000","last_change":"2024-09-12T17:05:57.594498+0000","last_active":"2024-09-12T17:07:42.437905+0000","last_peered":"2024-09-12T17:07:42.437905+0000","last_clean":"2024-09-12T17:07:42.437905+0000","last_became_active":"2024-09-12T17:05:57.590196+0000","last_became_peered":"2024-09-12T17:05:57.590196+0000","last_unstale":"2024-09-12T17:07:42.437905+0000","last_undegraded":"2024-09-12T17:07:42.437905+0000","last_fullsized":"2024-09-12T17:07:42.437905+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.543735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549978+0000","last_change":"2024-09-12T17:05:49.562121+0000","last_active":"2024-09-12T17:07:42.549978+0000","last_peered":"2024-09-12T17:07:42.549978+0000","last_clean":"2024-09-12T17:07:42.549978+0000","last_became_active":"2024-09-12T17:05:49.561429+0000","last_became_peered":"2024-09-12T17:05:49.561429+0000","last_unstale":"2024-09-12T17:07:42.549978+0000","last_undegraded":"2024-09-12T17:07:42.549978+0000","last_fullsized":"2024-09-12T17:07:42.549978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:47.663366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"74'9","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551066+0000","last_change":"2024-09-12T17:05:47.557270+0000","last_active":"2024-09-12T17:07:42.551066+0000","last_peered":"2024-09-12T17:07:42.551066+0000","last_clean":"2024-09-12T17:07:42.551066+0000","last_became_active":"2024-09-12T17:05:47.556417+0000","last_became_peered":"2024-09-12T17:05:47.556417+0000","last_unstale":"2024-09-12T17:07:42.551066+0000","last_undegraded":"2024-09-12T17:07:42.551066+0000","last_fullsized":"2024-09-12T17:07:42.551066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:00.210632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":7,"num_read_kb":20481,"num_write":25,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265221+0000","last_change":"2024-09-12T17:06:39.827362+0000","last_active":"2024-09-12T17:07:42.265221+0000","last_peered":"2024-09-12T17:07:42.265221+0000","last_clean":"2024-09-12T17:07:42.265221+0000","last_became_active":"2024-09-12T17:06:39.826734+0000","last_became_peered":"2024-09-12T17:06:39.826734+0000","last_unstale":"2024-09-12T17:07:42.265221+0000","last_undegraded":"2024-09-12T17:07:42.265221+0000","last_fullsized":"2024-09-12T17:07:42.265221+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:10:55.849780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.11","version":"68'12","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.547730+0000","last_change":"2024-09-12T17:05:53.542230+0000","last_active":"2024-09-12T17:07:42.547730+0000","last_peered":"2024-09-12T17:07:42.547730+0000","last_clean":"2024-09-12T17:07:42.547730+0000","last_became_active":"2024-09-12T17:05:53.541653+0000","last_became_peered":"2024-09-12T17:05:53.541653+0000","last_unstale":"2024-09-12T17:07:42.547730+0000","last_undegraded":"2024-09-12T17:07:42.547730+0000","last_fullsized":"2024-09-12T17:07:42.547730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548045+0000","last_change":"2024-09-12T17:05:55.556535+0000","last_active":"2024-09-12T17:07:42.548045+0000","last_peered":"2024-09-12T17:07:42.548045+0000","last_clean":"2024-09-12T17:07:42.548045+0000","last_became_active":"2024-09-12T17:05:55.555755+0000","last_became_peered":"2024-09-12T17:05:55.555755+0000","last_unstale":"2024-09-12T17:07:42.548045+0000","last_undegraded":"2024-09-12T17:07:42.548045+0000","last_fullsized":"2024-09-12T17:07:42.548045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.707384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"68'1","reported_seq":98,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550015+0000","last_change":"2024-09-12T17:05:57.593418+0000","last_active":"2024-09-12T17:07:42.550015+0000","last_peered":"2024-09-12T17:07:42.550015+0000","last_clean":"2024-09-12T17:07:42.550015+0000","last_became_active":"2024-09-12T17:05:57.592746+0000","last_became_peered":"2024-09-12T17:05:57.592746+0000","last_unstale":"2024-09-12T17:07:42.550015+0000","last_undegraded":"2024-09-12T17:07:42.550015+0000","last_fullsized":"2024-09-12T17:07:42.550015+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:24.794382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"68'6","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552147+0000","last_change":"2024-09-12T17:06:08.623185+0000","last_active":"2024-09-12T17:07:42.552147+0000","last_peered":"2024-09-12T17:07:42.552147+0000","last_clean":"2024-09-12T17:07:42.552147+0000","last_became_active":"2024-09-12T17:06:08.620344+0000","last_became_peered":"2024-09-12T17:06:08.620344+0000","last_unstale":"2024-09-12T17:07:42.552147+0000","last_undegraded":"2024-09-12T17:07:42.552147+0000","last_fullsized":"2024-09-12T17:07:42.552147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:12.424042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398108+0000","last_change":"2024-09-12T17:05:47.559497+0000","last_active":"2024-09-12T17:07:42.398108+0000","last_peered":"2024-09-12T17:07:42.398108+0000","last_clean":"2024-09-12T17:07:42.398108+0000","last_became_active":"2024-09-12T17:05:47.558641+0000","last_became_peered":"2024-09-12T17:05:47.558641+0000","last_unstale":"2024-09-12T17:07:42.398108+0000","last_undegraded":"2024-09-12T17:07:42.398108+0000","last_fullsized":"2024-09-12T17:07:42.398108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:00.096304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":16385,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548704+0000","last_change":"2024-09-12T17:05:51.539784+0000","last_active":"2024-09-12T17:07:42.548704+0000","last_peered":"2024-09-12T17:07:42.548704+0000","last_clean":"2024-09-12T17:07:42.548704+0000","last_became_active":"2024-09-12T17:05:51.539275+0000","last_became_peered":"2024-09-12T17:05:51.539275+0000","last_unstale":"2024-09-12T17:07:42.548704+0000","last_undegraded":"2024-09-12T17:07:42.548704+0000","last_fullsized":"2024-09-12T17:07:42.548704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"46'5","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436208+0000","last_change":"2024-09-12T17:05:53.544731+0000","last_active":"2024-09-12T17:07:42.436208+0000","last_peered":"2024-09-12T17:07:42.436208+0000","last_clean":"2024-09-12T17:07:42.436208+0000","last_became_active":"2024-09-12T17:05:53.544127+0000","last_became_peered":"2024-09-12T17:05:53.544127+0000","last_unstale":"2024-09-12T17:07:42.436208+0000","last_undegraded":"2024-09-12T17:07:42.436208+0000","last_fullsized":"2024-09-12T17:07:42.436208+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:04.351698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396307+0000","last_change":"2024-09-12T17:05:55.571541+0000","last_active":"2024-09-12T17:07:42.396307+0000","last_peered":"2024-09-12T17:07:42.396307+0000","last_clean":"2024-09-12T17:07:42.396307+0000","last_became_active":"2024-09-12T17:05:55.570822+0000","last_became_peered":"2024-09-12T17:05:55.570822+0000","last_unstale":"2024-09-12T17:07:42.396307+0000","last_undegraded":"2024-09-12T17:07:42.396307+0000","last_fullsized":"2024-09-12T17:07:42.396307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'2","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437474+0000","last_change":"2024-09-12T17:06:39.824882+0000","last_active":"2024-09-12T17:07:42.437474+0000","last_peered":"2024-09-12T17:07:42.437474+0000","last_clean":"2024-09-12T17:07:42.437474+0000","last_became_active":"2024-09-12T17:06:39.824583+0000","last_became_peered":"2024-09-12T17:06:39.824583+0000","last_unstale":"2024-09-12T17:07:42.437474+0000","last_undegraded":"2024-09-12T17:07:42.437474+0000","last_fullsized":"2024-09-12T17:07:42.437474+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:51.674260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548030+0000","last_change":"2024-09-12T17:05:49.520508+0000","last_active":"2024-09-12T17:07:42.548030+0000","last_peered":"2024-09-12T17:07:42.548030+0000","last_clean":"2024-09-12T17:07:42.548030+0000","last_became_active":"2024-09-12T17:05:49.519721+0000","last_became_peered":"2024-09-12T17:05:49.519721+0000","last_unstale":"2024-09-12T17:07:42.548030+0000","last_undegraded":"2024-09-12T17:07:42.548030+0000","last_fullsized":"2024-09-12T17:07:42.548030+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"71'8","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266941+0000","last_change":"2024-09-12T17:05:47.539549+0000","last_active":"2024-09-12T17:07:42.266941+0000","last_peered":"2024-09-12T17:07:42.266941+0000","last_clean":"2024-09-12T17:07:42.266941+0000","last_became_active":"2024-09-12T17:05:47.538581+0000","last_became_peered":"2024-09-12T17:05:47.538581+0000","last_unstale":"2024-09-12T17:07:42.266941+0000","last_undegraded":"2024-09-12T17:07:42.266941+0000","last_fullsized":"2024-09-12T17:07:42.266941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.448924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.395666+0000","last_change":"2024-09-12T17:05:51.530541+0000","last_active":"2024-09-12T17:07:42.395666+0000","last_peered":"2024-09-12T17:07:42.395666+0000","last_clean":"2024-09-12T17:07:42.395666+0000","last_became_active":"2024-09-12T17:05:51.527515+0000","last_became_peered":"2024-09-12T17:05:51.527515+0000","last_unstale":"2024-09-12T17:07:42.395666+0000","last_undegraded":"2024-09-12T17:07:42.395666+0000","last_fullsized":"2024-09-12T17:07:42.395666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"68'13","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548561+0000","last_change":"2024-09-12T17:05:53.555017+0000","last_active":"2024-09-12T17:07:42.548561+0000","last_peered":"2024-09-12T17:07:42.548561+0000","last_clean":"2024-09-12T17:07:42.548561+0000","last_became_active":"2024-09-12T17:05:53.551154+0000","last_became_peered":"2024-09-12T17:05:53.551154+0000","last_unstale":"2024-09-12T17:07:42.548561+0000","last_undegraded":"2024-09-12T17:07:42.548561+0000","last_fullsized":"2024-09-12T17:07:42.548561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:50.736153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549809+0000","last_change":"2024-09-12T17:05:55.570872+0000","last_active":"2024-09-12T17:07:42.549809+0000","last_peered":"2024-09-12T17:07:42.549809+0000","last_clean":"2024-09-12T17:07:42.549809+0000","last_became_active":"2024-09-12T17:05:55.570137+0000","last_became_peered":"2024-09-12T17:05:55.570137+0000","last_unstale":"2024-09-12T17:07:42.549809+0000","last_undegraded":"2024-09-12T17:07:42.549809+0000","last_fullsized":"2024-09-12T17:07:42.549809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.684868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265682+0000","last_change":"2024-09-12T17:05:57.597088+0000","last_active":"2024-09-12T17:07:42.265682+0000","last_peered":"2024-09-12T17:07:42.265682+0000","last_clean":"2024-09-12T17:07:42.265682+0000","last_became_active":"2024-09-12T17:05:57.596377+0000","last_became_peered":"2024-09-12T17:05:57.596377+0000","last_unstale":"2024-09-12T17:07:42.265682+0000","last_undegraded":"2024-09-12T17:07:42.265682+0000","last_fullsized":"2024-09-12T17:07:42.265682+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"68'2","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.547721+0000","last_change":"2024-09-12T17:06:39.826867+0000","last_active":"2024-09-12T17:07:42.547721+0000","last_peered":"2024-09-12T17:07:42.547721+0000","last_clean":"2024-09-12T17:07:42.547721+0000","last_became_active":"2024-09-12T17:06:39.826559+0000","last_became_peered":"2024-09-12T17:06:39.826559+0000","last_unstale":"2024-09-12T17:07:42.547721+0000","last_undegraded":"2024-09-12T17:07:42.547721+0000","last_fullsized":"2024-09-12T17:07:42.547721+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:56.581333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"73'7","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.439026+0000","last_change":"2024-09-12T17:05:47.526555+0000","last_active":"2024-09-12T17:07:42.439026+0000","last_peered":"2024-09-12T17:07:42.439026+0000","last_clean":"2024-09-12T17:07:42.439026+0000","last_became_active":"2024-09-12T17:05:47.525874+0000","last_became_peered":"2024-09-12T17:05:47.525874+0000","last_unstale":"2024-09-12T17:07:42.439026+0000","last_undegraded":"2024-09-12T17:07:42.439026+0000","last_fullsized":"2024-09-12T17:07:42.439026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":12291,"num_write":15,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549362+0000","last_change":"2024-09-12T17:05:51.540509+0000","last_active":"2024-09-12T17:07:42.549362+0000","last_peered":"2024-09-12T17:07:42.549362+0000","last_clean":"2024-09-12T17:07:42.549362+0000","last_became_active":"2024-09-12T17:05:51.539607+0000","last_became_peered":"2024-09-12T17:05:51.539607+0000","last_unstale":"2024-09-12T17:07:42.549362+0000","last_undegraded":"2024-09-12T17:07:42.549362+0000","last_fullsized":"2024-09-12T17:07:42.549362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:02.652624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"68'10","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396338+0000","last_change":"2024-09-12T17:05:53.549324+0000","last_active":"2024-09-12T17:07:42.396338+0000","last_peered":"2024-09-12T17:07:42.396338+0000","last_clean":"2024-09-12T17:07:42.396338+0000","last_became_active":"2024-09-12T17:05:53.548561+0000","last_became_peered":"2024-09-12T17:05:53.548561+0000","last_unstale":"2024-09-12T17:07:42.396338+0000","last_undegraded":"2024-09-12T17:07:42.396338+0000","last_fullsized":"2024-09-12T17:07:42.396338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:47.932776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436909+0000","last_change":"2024-09-12T17:05:55.561467+0000","last_active":"2024-09-12T17:07:42.436909+0000","last_peered":"2024-09-12T17:07:42.436909+0000","last_clean":"2024-09-12T17:07:42.436909+0000","last_became_active":"2024-09-12T17:05:55.560708+0000","last_became_peered":"2024-09-12T17:05:55.560708+0000","last_unstale":"2024-09-12T17:07:42.436909+0000","last_undegraded":"2024-09-12T17:07:42.436909+0000","last_fullsized":"2024-09-12T17:07:42.436909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"75'23","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552239+0000","last_change":"2024-09-12T17:05:49.547097+0000","last_active":"2024-09-12T17:07:42.552239+0000","last_peered":"2024-09-12T17:07:42.552239+0000","last_clean":"2024-09-12T17:07:42.552239+0000","last_became_active":"2024-09-12T17:05:49.546232+0000","last_became_peered":"2024-09-12T17:05:49.546232+0000","last_unstale":"2024-09-12T17:07:42.552239+0000","last_undegraded":"2024-09-12T17:07:42.552239+0000","last_fullsized":"2024-09-12T17:07:42.552239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":66,"num_write":34,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"74'8","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.547654+0000","last_change":"2024-09-12T17:05:47.521779+0000","last_active":"2024-09-12T17:07:42.547654+0000","last_peered":"2024-09-12T17:07:42.547654+0000","last_clean":"2024-09-12T17:07:42.547654+0000","last_became_active":"2024-09-12T17:05:47.521097+0000","last_became_peered":"2024-09-12T17:05:47.521097+0000","last_unstale":"2024-09-12T17:07:42.547654+0000","last_undegraded":"2024-09-12T17:07:42.547654+0000","last_fullsized":"2024-09-12T17:07:42.547654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:37.072896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":16,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438879+0000","last_change":"2024-09-12T17:05:51.525803+0000","last_active":"2024-09-12T17:07:42.438879+0000","last_peered":"2024-09-12T17:07:42.438879+0000","last_clean":"2024-09-12T17:07:42.438879+0000","last_became_active":"2024-09-12T17:05:51.525457+0000","last_became_peered":"2024-09-12T17:05:51.525457+0000","last_unstale":"2024-09-12T17:07:42.438879+0000","last_undegraded":"2024-09-12T17:07:42.438879+0000","last_fullsized":"2024-09-12T17:07:42.438879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"68'16","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266250+0000","last_change":"2024-09-12T17:06:39.861432+0000","last_active":"2024-09-12T17:07:42.266250+0000","last_peered":"2024-09-12T17:07:42.266250+0000","last_clean":"2024-09-12T17:07:42.266250+0000","last_became_active":"2024-09-12T17:06:39.842347+0000","last_became_peered":"2024-09-12T17:06:39.842347+0000","last_unstale":"2024-09-12T17:07:42.266250+0000","last_undegraded":"2024-09-12T17:07:42.266250+0000","last_fullsized":"2024-09-12T17:07:42.266250+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:59.659342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15411,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":22,"num_write":18,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265819+0000","last_change":"2024-09-12T17:05:55.563312+0000","last_active":"2024-09-12T17:07:42.265819+0000","last_peered":"2024-09-12T17:07:42.265819+0000","last_clean":"2024-09-12T17:07:42.265819+0000","last_became_active":"2024-09-12T17:05:55.562405+0000","last_became_peered":"2024-09-12T17:05:55.562405+0000","last_unstale":"2024-09-12T17:07:42.265819+0000","last_undegraded":"2024-09-12T17:07:42.265819+0000","last_fullsized":"2024-09-12T17:07:42.265819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548245+0000","last_change":"2024-09-12T17:05:58.121110+0000","last_active":"2024-09-12T17:07:42.548245+0000","last_peered":"2024-09-12T17:07:42.548245+0000","last_clean":"2024-09-12T17:07:42.548245+0000","last_became_active":"2024-09-12T17:05:58.120367+0000","last_became_peered":"2024-09-12T17:05:58.120367+0000","last_unstale":"2024-09-12T17:07:42.548245+0000","last_undegraded":"2024-09-12T17:07:42.548245+0000","last_fullsized":"2024-09-12T17:07:42.548245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.439033+0000","last_change":"2024-09-12T17:05:49.532377+0000","last_active":"2024-09-12T17:07:42.439033+0000","last_peered":"2024-09-12T17:07:42.439033+0000","last_clean":"2024-09-12T17:07:42.439033+0000","last_became_active":"2024-09-12T17:05:49.531975+0000","last_became_peered":"2024-09-12T17:05:49.531975+0000","last_unstale":"2024-09-12T17:07:42.439033+0000","last_undegraded":"2024-09-12T17:07:42.439033+0000","last_fullsized":"2024-09-12T17:07:42.439033+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"73'9","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548086+0000","last_change":"2024-09-12T17:06:39.839448+0000","last_active":"2024-09-12T17:07:42.548086+0000","last_peered":"2024-09-12T17:07:42.548086+0000","last_clean":"2024-09-12T17:07:42.548086+0000","last_became_active":"2024-09-12T17:06:39.839082+0000","last_became_peered":"2024-09-12T17:06:39.839082+0000","last_unstale":"2024-09-12T17:07:42.548086+0000","last_undegraded":"2024-09-12T17:07:42.548086+0000","last_fullsized":"2024-09-12T17:07:42.548086+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:24.708409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":41,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552007+0000","last_change":"2024-09-12T17:05:51.546117+0000","last_active":"2024-09-12T17:07:42.552007+0000","last_peered":"2024-09-12T17:07:42.552007+0000","last_clean":"2024-09-12T17:07:42.552007+0000","last_became_active":"2024-09-12T17:05:51.545154+0000","last_became_peered":"2024-09-12T17:05:51.545154+0000","last_unstale":"2024-09-12T17:07:42.552007+0000","last_undegraded":"2024-09-12T17:07:42.552007+0000","last_fullsized":"2024-09-12T17:07:42.552007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:49.670591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"68'17","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398107+0000","last_change":"2024-09-12T17:05:53.558834+0000","last_active":"2024-09-12T17:07:42.398107+0000","last_peered":"2024-09-12T17:07:42.398107+0000","last_clean":"2024-09-12T17:07:42.398107+0000","last_became_active":"2024-09-12T17:05:53.558086+0000","last_became_peered":"2024-09-12T17:05:53.558086+0000","last_unstale":"2024-09-12T17:07:42.398107+0000","last_undegraded":"2024-09-12T17:07:42.398107+0000","last_fullsized":"2024-09-12T17:07:42.398107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:43.690058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552019+0000","last_change":"2024-09-12T17:06:08.626154+0000","last_active":"2024-09-12T17:07:42.552019+0000","last_peered":"2024-09-12T17:07:42.552019+0000","last_clean":"2024-09-12T17:07:42.552019+0000","last_became_active":"2024-09-12T17:06:08.625118+0000","last_became_peered":"2024-09-12T17:06:08.625118+0000","last_unstale":"2024-09-12T17:07:42.552019+0000","last_undegraded":"2024-09-12T17:07:42.552019+0000","last_fullsized":"2024-09-12T17:07:42.552019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:11.146823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.12","version":"68'2","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549423+0000","last_change":"2024-09-12T17:05:57.597468+0000","last_active":"2024-09-12T17:07:42.549423+0000","last_peered":"2024-09-12T17:07:42.549423+0000","last_clean":"2024-09-12T17:07:42.549423+0000","last_became_active":"2024-09-12T17:05:57.596651+0000","last_became_peered":"2024-09-12T17:05:57.596651+0000","last_unstale":"2024-09-12T17:07:42.549423+0000","last_undegraded":"2024-09-12T17:07:42.549423+0000","last_fullsized":"2024-09-12T17:07:42.549423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.466145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549778+0000","last_change":"2024-09-12T17:06:39.842588+0000","last_active":"2024-09-12T17:07:42.549778+0000","last_peered":"2024-09-12T17:07:42.549778+0000","last_clean":"2024-09-12T17:07:42.549778+0000","last_became_active":"2024-09-12T17:06:39.842241+0000","last_became_peered":"2024-09-12T17:06:39.842241+0000","last_unstale":"2024-09-12T17:07:42.549778+0000","last_undegraded":"2024-09-12T17:07:42.549778+0000","last_fullsized":"2024-09-12T17:07:42.549778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:38.260106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"73'7","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550878+0000","last_change":"2024-09-12T17:06:39.821271+0000","last_active":"2024-09-12T17:07:42.550878+0000","last_peered":"2024-09-12T17:07:42.550878+0000","last_clean":"2024-09-12T17:07:42.550878+0000","last_became_active":"2024-09-12T17:06:39.820916+0000","last_became_peered":"2024-09-12T17:06:39.820916+0000","last_unstale":"2024-09-12T17:07:42.550878+0000","last_undegraded":"2024-09-12T17:07:42.550878+0000","last_fullsized":"2024-09-12T17:07:42.550878+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:18.377128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":15,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551666+0000","last_change":"2024-09-12T17:05:51.539916+0000","last_active":"2024-09-12T17:07:42.551666+0000","last_peered":"2024-09-12T17:07:42.551666+0000","last_clean":"2024-09-12T17:07:42.551666+0000","last_became_active":"2024-09-12T17:05:51.539054+0000","last_became_peered":"2024-09-12T17:05:51.539054+0000","last_unstale":"2024-09-12T17:07:42.551666+0000","last_undegraded":"2024-09-12T17:07:42.551666+0000","last_fullsized":"2024-09-12T17:07:42.551666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:11.640578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"68'12","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550946+0000","last_change":"2024-09-12T17:05:53.557081+0000","last_active":"2024-09-12T17:07:42.550946+0000","last_peered":"2024-09-12T17:07:42.550946+0000","last_clean":"2024-09-12T17:07:42.550946+0000","last_became_active":"2024-09-12T17:05:53.556357+0000","last_became_peered":"2024-09-12T17:05:53.556357+0000","last_unstale":"2024-09-12T17:07:42.550946+0000","last_undegraded":"2024-09-12T17:07:42.550946+0000","last_fullsized":"2024-09-12T17:07:42.550946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:10.984649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550217+0000","last_change":"2024-09-12T17:06:08.622595+0000","last_active":"2024-09-12T17:07:42.550217+0000","last_peered":"2024-09-12T17:07:42.550217+0000","last_clean":"2024-09-12T17:07:42.550217+0000","last_became_active":"2024-09-12T17:06:08.621706+0000","last_became_peered":"2024-09-12T17:06:08.621706+0000","last_unstale":"2024-09-12T17:07:42.550217+0000","last_undegraded":"2024-09-12T17:07:42.550217+0000","last_fullsized":"2024-09-12T17:07:42.550217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:49.649692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264960+0000","last_change":"2024-09-12T17:05:57.596779+0000","last_active":"2024-09-12T17:07:42.264960+0000","last_peered":"2024-09-12T17:07:42.264960+0000","last_clean":"2024-09-12T17:07:42.264960+0000","last_became_active":"2024-09-12T17:05:57.596005+0000","last_became_peered":"2024-09-12T17:05:57.596005+0000","last_unstale":"2024-09-12T17:07:42.264960+0000","last_undegraded":"2024-09-12T17:07:42.264960+0000","last_fullsized":"2024-09-12T17:07:42.264960+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266855+0000","last_change":"2024-09-12T17:06:39.829250+0000","last_active":"2024-09-12T17:07:42.266855+0000","last_peered":"2024-09-12T17:07:42.266855+0000","last_clean":"2024-09-12T17:07:42.266855+0000","last_became_active":"2024-09-12T17:06:39.828475+0000","last_became_peered":"2024-09-12T17:06:39.828475+0000","last_unstale":"2024-09-12T17:07:42.266855+0000","last_undegraded":"2024-09-12T17:07:42.266855+0000","last_fullsized":"2024-09-12T17:07:42.266855+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:00.338345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"74'12","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437059+0000","last_change":"2024-09-12T17:05:47.546051+0000","last_active":"2024-09-12T17:07:42.437059+0000","last_peered":"2024-09-12T17:07:42.437059+0000","last_clean":"2024-09-12T17:07:42.437059+0000","last_became_active":"2024-09-12T17:05:47.545466+0000","last_became_peered":"2024-09-12T17:05:47.545466+0000","last_unstale":"2024-09-12T17:07:42.437059+0000","last_undegraded":"2024-09-12T17:07:42.437059+0000","last_fullsized":"2024-09-12T17:07:42.437059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":5,"num_read_kb":18432,"num_write":28,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551829+0000","last_change":"2024-09-12T17:06:39.840769+0000","last_active":"2024-09-12T17:07:42.551829+0000","last_peered":"2024-09-12T17:07:42.551829+0000","last_clean":"2024-09-12T17:07:42.551829+0000","last_became_active":"2024-09-12T17:06:39.840073+0000","last_became_peered":"2024-09-12T17:06:39.840073+0000","last_unstale":"2024-09-12T17:07:42.551829+0000","last_undegraded":"2024-09-12T17:07:42.551829+0000","last_fullsized":"2024-09-12T17:07:42.551829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:58.993772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"70'11","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550208+0000","last_change":"2024-09-12T17:05:53.561278+0000","last_active":"2024-09-12T17:07:42.550208+0000","last_peered":"2024-09-12T17:07:42.550208+0000","last_clean":"2024-09-12T17:07:42.550208+0000","last_became_active":"2024-09-12T17:05:53.559688+0000","last_became_peered":"2024-09-12T17:05:53.559688+0000","last_unstale":"2024-09-12T17:07:42.550208+0000","last_undegraded":"2024-09-12T17:07:42.550208+0000","last_fullsized":"2024-09-12T17:07:42.550208+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:37.392549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"68'11","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551688+0000","last_change":"2024-09-12T17:05:55.576227+0000","last_active":"2024-09-12T17:07:42.551688+0000","last_peered":"2024-09-12T17:07:42.551688+0000","last_clean":"2024-09-12T17:07:42.551688+0000","last_became_active":"2024-09-12T17:05:55.571966+0000","last_became_peered":"2024-09-12T17:05:55.571966+0000","last_unstale":"2024-09-12T17:07:42.551688+0000","last_undegraded":"2024-09-12T17:07:42.551688+0000","last_fullsized":"2024-09-12T17:07:42.551688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:24.680106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.395567+0000","last_change":"2024-09-12T17:05:57.595153+0000","last_active":"2024-09-12T17:07:42.395567+0000","last_peered":"2024-09-12T17:07:42.395567+0000","last_clean":"2024-09-12T17:07:42.395567+0000","last_became_active":"2024-09-12T17:05:57.594396+0000","last_became_peered":"2024-09-12T17:05:57.594396+0000","last_unstale":"2024-09-12T17:07:42.395567+0000","last_undegraded":"2024-09-12T17:07:42.395567+0000","last_fullsized":"2024-09-12T17:07:42.395567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:27.040243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549857+0000","last_change":"2024-09-12T17:05:49.543269+0000","last_active":"2024-09-12T17:07:42.549857+0000","last_peered":"2024-09-12T17:07:42.549857+0000","last_clean":"2024-09-12T17:07:42.549857+0000","last_became_active":"2024-09-12T17:05:49.542414+0000","last_became_peered":"2024-09-12T17:05:49.542414+0000","last_unstale":"2024-09-12T17:07:42.549857+0000","last_undegraded":"2024-09-12T17:07:42.549857+0000","last_fullsized":"2024-09-12T17:07:42.549857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:00.645399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"75'12","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266420+0000","last_change":"2024-09-12T17:06:27.785226+0000","last_active":"2024-09-12T17:07:42.266420+0000","last_peered":"2024-09-12T17:07:42.266420+0000","last_clean":"2024-09-12T17:07:42.266420+0000","last_became_active":"2024-09-12T17:06:27.784897+0000","last_became_peered":"2024-09-12T17:06:27.784897+0000","last_unstale":"2024-09-12T17:07:42.266420+0000","last_undegraded":"2024-09-12T17:07:42.266420+0000","last_fullsized":"2024-09-12T17:07:42.266420+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:25.368283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":28,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396593+0000","last_change":"2024-09-12T17:05:51.528322+0000","last_active":"2024-09-12T17:07:42.396593+0000","last_peered":"2024-09-12T17:07:42.396593+0000","last_clean":"2024-09-12T17:07:42.396593+0000","last_became_active":"2024-09-12T17:05:51.527501+0000","last_became_peered":"2024-09-12T17:05:51.527501+0000","last_unstale":"2024-09-12T17:07:42.396593+0000","last_undegraded":"2024-09-12T17:07:42.396593+0000","last_fullsized":"2024-09-12T17:07:42.396593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"68'16","reported_seq":152,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265194+0000","last_change":"2024-09-12T17:06:39.852541+0000","last_active":"2024-09-12T17:07:42.265194+0000","last_peered":"2024-09-12T17:07:42.265194+0000","last_clean":"2024-09-12T17:07:42.265194+0000","last_became_active":"2024-09-12T17:06:39.830991+0000","last_became_peered":"2024-09-12T17:06:39.830991+0000","last_unstale":"2024-09-12T17:07:42.265194+0000","last_undegraded":"2024-09-12T17:07:42.265194+0000","last_fullsized":"2024-09-12T17:07:42.265194+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:39.574386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.435864+0000","last_change":"2024-09-12T17:05:55.567202+0000","last_active":"2024-09-12T17:07:42.435864+0000","last_peered":"2024-09-12T17:07:42.435864+0000","last_clean":"2024-09-12T17:07:42.435864+0000","last_became_active":"2024-09-12T17:05:55.564710+0000","last_became_peered":"2024-09-12T17:05:55.564710+0000","last_unstale":"2024-09-12T17:07:42.435864+0000","last_undegraded":"2024-09-12T17:07:42.435864+0000","last_fullsized":"2024-09-12T17:07:42.435864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398624+0000","last_change":"2024-09-12T17:05:57.604052+0000","last_active":"2024-09-12T17:07:42.398624+0000","last_peered":"2024-09-12T17:07:42.398624+0000","last_clean":"2024-09-12T17:07:42.398624+0000","last_became_active":"2024-09-12T17:05:57.603285+0000","last_became_peered":"2024-09-12T17:05:57.603285+0000","last_unstale":"2024-09-12T17:07:42.398624+0000","last_undegraded":"2024-09-12T17:07:42.398624+0000","last_fullsized":"2024-09-12T17:07:42.398624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:31.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'6","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550589+0000","last_change":"2024-09-12T17:05:49.548224+0000","last_active":"2024-09-12T17:07:42.550589+0000","last_peered":"2024-09-12T17:07:42.550589+0000","last_clean":"2024-09-12T17:07:42.550589+0000","last_became_active":"2024-09-12T17:05:49.541007+0000","last_became_peered":"2024-09-12T17:05:49.541007+0000","last_unstale":"2024-09-12T17:07:42.550589+0000","last_undegraded":"2024-09-12T17:07:42.550589+0000","last_fullsized":"2024-09-12T17:07:42.550589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:59.768842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"75'4","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266516+0000","last_change":"2024-09-12T17:05:47.543197+0000","last_active":"2024-09-12T17:07:42.266516+0000","last_peered":"2024-09-12T17:07:42.266516+0000","last_clean":"2024-09-12T17:07:42.266516+0000","last_became_active":"2024-09-12T17:05:47.542345+0000","last_became_peered":"2024-09-12T17:05:47.542345+0000","last_unstale":"2024-09-12T17:07:42.266516+0000","last_undegraded":"2024-09-12T17:07:42.266516+0000","last_fullsized":"2024-09-12T17:07:42.266516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.858635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266040+0000","last_change":"2024-09-12T17:05:51.556256+0000","last_active":"2024-09-12T17:07:42.266040+0000","last_peered":"2024-09-12T17:07:42.266040+0000","last_clean":"2024-09-12T17:07:42.266040+0000","last_became_active":"2024-09-12T17:05:51.554248+0000","last_became_peered":"2024-09-12T17:05:51.554248+0000","last_unstale":"2024-09-12T17:07:42.266040+0000","last_undegraded":"2024-09-12T17:07:42.266040+0000","last_fullsized":"2024-09-12T17:07:42.266040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"68'10","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.435967+0000","last_change":"2024-09-12T17:06:39.844736+0000","last_active":"2024-09-12T17:07:42.435967+0000","last_peered":"2024-09-12T17:07:42.435967+0000","last_clean":"2024-09-12T17:07:42.435967+0000","last_became_active":"2024-09-12T17:06:39.831389+0000","last_became_peered":"2024-09-12T17:06:39.831389+0000","last_unstale":"2024-09-12T17:07:42.435967+0000","last_undegraded":"2024-09-12T17:07:42.435967+0000","last_fullsized":"2024-09-12T17:07:42.435967+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:33.010189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549049+0000","last_change":"2024-09-12T17:05:55.567605+0000","last_active":"2024-09-12T17:07:42.549049+0000","last_peered":"2024-09-12T17:07:42.549049+0000","last_clean":"2024-09-12T17:07:42.549049+0000","last_became_active":"2024-09-12T17:05:55.566774+0000","last_became_peered":"2024-09-12T17:05:55.566774+0000","last_unstale":"2024-09-12T17:07:42.549049+0000","last_undegraded":"2024-09-12T17:07:42.549049+0000","last_fullsized":"2024-09-12T17:07:42.549049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:25.935376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550082+0000","last_change":"2024-09-12T17:05:58.121216+0000","last_active":"2024-09-12T17:07:42.550082+0000","last_peered":"2024-09-12T17:07:42.550082+0000","last_clean":"2024-09-12T17:07:42.550082+0000","last_became_active":"2024-09-12T17:05:58.120364+0000","last_became_peered":"2024-09-12T17:05:58.120364+0000","last_unstale":"2024-09-12T17:07:42.550082+0000","last_undegraded":"2024-09-12T17:07:42.550082+0000","last_fullsized":"2024-09-12T17:07:42.550082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548226+0000","last_change":"2024-09-12T17:05:49.549956+0000","last_active":"2024-09-12T17:07:42.548226+0000","last_peered":"2024-09-12T17:07:42.548226+0000","last_clean":"2024-09-12T17:07:42.548226+0000","last_became_active":"2024-09-12T17:05:49.549481+0000","last_became_peered":"2024-09-12T17:05:49.549481+0000","last_unstale":"2024-09-12T17:07:42.548226+0000","last_undegraded":"2024-09-12T17:07:42.548226+0000","last_fullsized":"2024-09-12T17:07:42.548226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"74'9","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550475+0000","last_change":"2024-09-12T17:05:47.510898+0000","last_active":"2024-09-12T17:07:42.550475+0000","last_peered":"2024-09-12T17:07:42.550475+0000","last_clean":"2024-09-12T17:07:42.550475+0000","last_became_active":"2024-09-12T17:05:47.510462+0000","last_became_peered":"2024-09-12T17:05:47.510462+0000","last_unstale":"2024-09-12T17:07:42.550475+0000","last_undegraded":"2024-09-12T17:07:42.550475+0000","last_fullsized":"2024-09-12T17:07:42.550475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":25,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549176+0000","last_change":"2024-09-12T17:05:51.541454+0000","last_active":"2024-09-12T17:07:42.549176+0000","last_peered":"2024-09-12T17:07:42.549176+0000","last_clean":"2024-09-12T17:07:42.549176+0000","last_became_active":"2024-09-12T17:05:51.539938+0000","last_became_peered":"2024-09-12T17:05:51.539938+0000","last_unstale":"2024-09-12T17:07:42.549176+0000","last_undegraded":"2024-09-12T17:07:42.549176+0000","last_fullsized":"2024-09-12T17:07:42.549176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:18.328350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"68'6","reported_seq":116,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549642+0000","last_change":"2024-09-12T17:05:53.555764+0000","last_active":"2024-09-12T17:07:42.549642+0000","last_peered":"2024-09-12T17:07:42.549642+0000","last_clean":"2024-09-12T17:07:42.549642+0000","last_became_active":"2024-09-12T17:05:53.552095+0000","last_became_peered":"2024-09-12T17:05:53.552095+0000","last_unstale":"2024-09-12T17:07:42.549642+0000","last_undegraded":"2024-09-12T17:07:42.549642+0000","last_fullsized":"2024-09-12T17:07:42.549642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549717+0000","last_change":"2024-09-12T17:05:55.571520+0000","last_active":"2024-09-12T17:07:42.549717+0000","last_peered":"2024-09-12T17:07:42.549717+0000","last_clean":"2024-09-12T17:07:42.549717+0000","last_became_active":"2024-09-12T17:05:55.570863+0000","last_became_peered":"2024-09-12T17:05:55.570863+0000","last_unstale":"2024-09-12T17:07:42.549717+0000","last_undegraded":"2024-09-12T17:07:42.549717+0000","last_fullsized":"2024-09-12T17:07:42.549717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397408+0000","last_change":"2024-09-12T17:06:08.629509+0000","last_active":"2024-09-12T17:07:42.397408+0000","last_peered":"2024-09-12T17:07:42.397408+0000","last_clean":"2024-09-12T17:07:42.397408+0000","last_became_active":"2024-09-12T17:06:08.628015+0000","last_became_peered":"2024-09-12T17:06:08.628015+0000","last_unstale":"2024-09-12T17:07:42.397408+0000","last_undegraded":"2024-09-12T17:07:42.397408+0000","last_fullsized":"2024-09-12T17:07:42.397408+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:38.232897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"75'19","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549566+0000","last_change":"2024-09-12T17:05:49.561555+0000","last_active":"2024-09-12T17:07:42.549566+0000","last_peered":"2024-09-12T17:07:42.549566+0000","last_clean":"2024-09-12T17:07:42.549566+0000","last_became_active":"2024-09-12T17:05:49.560875+0000","last_became_peered":"2024-09-12T17:05:49.560875+0000","last_unstale":"2024-09-12T17:07:42.549566+0000","last_undegraded":"2024-09-12T17:07:42.549566+0000","last_fullsized":"2024-09-12T17:07:42.549566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.493944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":54,"num_write":28,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"75'12","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438951+0000","last_change":"2024-09-12T17:05:47.528128+0000","last_active":"2024-09-12T17:07:42.438951+0000","last_peered":"2024-09-12T17:07:42.438951+0000","last_clean":"2024-09-12T17:07:42.438951+0000","last_became_active":"2024-09-12T17:05:47.527364+0000","last_became_peered":"2024-09-12T17:05:47.527364+0000","last_unstale":"2024-09-12T17:07:42.438951+0000","last_undegraded":"2024-09-12T17:07:42.438951+0000","last_fullsized":"2024-09-12T17:07:42.438951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":28,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265086+0000","last_change":"2024-09-12T17:06:39.854439+0000","last_active":"2024-09-12T17:07:42.265086+0000","last_peered":"2024-09-12T17:07:42.265086+0000","last_clean":"2024-09-12T17:07:42.265086+0000","last_became_active":"2024-09-12T17:06:39.835053+0000","last_became_peered":"2024-09-12T17:06:39.835053+0000","last_unstale":"2024-09-12T17:07:42.265086+0000","last_undegraded":"2024-09-12T17:07:42.265086+0000","last_fullsized":"2024-09-12T17:07:42.265086+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:31.004061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1a","version":"68'11","reported_seq":123,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550029+0000","last_change":"2024-09-12T17:05:53.548391+0000","last_active":"2024-09-12T17:07:42.550029+0000","last_peered":"2024-09-12T17:07:42.550029+0000","last_clean":"2024-09-12T17:07:42.550029+0000","last_became_active":"2024-09-12T17:05:53.547202+0000","last_became_peered":"2024-09-12T17:05:53.547202+0000","last_unstale":"2024-09-12T17:07:42.550029+0000","last_undegraded":"2024-09-12T17:07:42.550029+0000","last_fullsized":"2024-09-12T17:07:42.550029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:00.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436882+0000","last_change":"2024-09-12T17:05:55.566243+0000","last_active":"2024-09-12T17:07:42.436882+0000","last_peered":"2024-09-12T17:07:42.436882+0000","last_clean":"2024-09-12T17:07:42.436882+0000","last_became_active":"2024-09-12T17:05:55.565403+0000","last_became_peered":"2024-09-12T17:05:55.565403+0000","last_unstale":"2024-09-12T17:07:42.436882+0000","last_undegraded":"2024-09-12T17:07:42.436882+0000","last_fullsized":"2024-09-12T17:07:42.436882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551765+0000","last_change":"2024-09-12T17:05:57.589526+0000","last_active":"2024-09-12T17:07:42.551765+0000","last_peered":"2024-09-12T17:07:42.551765+0000","last_clean":"2024-09-12T17:07:42.551765+0000","last_became_active":"2024-09-12T17:05:57.588626+0000","last_became_peered":"2024-09-12T17:05:57.588626+0000","last_unstale":"2024-09-12T17:07:42.551765+0000","last_undegraded":"2024-09-12T17:07:42.551765+0000","last_fullsized":"2024-09-12T17:07:42.551765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.472663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552120+0000","last_change":"2024-09-12T17:06:08.626956+0000","last_active":"2024-09-12T17:07:42.552120+0000","last_peered":"2024-09-12T17:07:42.552120+0000","last_clean":"2024-09-12T17:07:42.552120+0000","last_became_active":"2024-09-12T17:06:08.626120+0000","last_became_peered":"2024-09-12T17:06:08.626120+0000","last_unstale":"2024-09-12T17:07:42.552120+0000","last_undegraded":"2024-09-12T17:07:42.552120+0000","last_fullsized":"2024-09-12T17:07:42.552120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:34.074694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"73'10","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549161+0000","last_change":"2024-09-12T17:05:47.532523+0000","last_active":"2024-09-12T17:07:42.549161+0000","last_peered":"2024-09-12T17:07:42.549161+0000","last_clean":"2024-09-12T17:07:42.549161+0000","last_became_active":"2024-09-12T17:05:47.531750+0000","last_became_peered":"2024-09-12T17:05:47.531750+0000","last_unstale":"2024-09-12T17:07:42.549161+0000","last_undegraded":"2024-09-12T17:07:42.549161+0000","last_fullsized":"2024-09-12T17:07:42.549161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:03.075435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":8,"num_read_kb":24577,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267285+0000","last_change":"2024-09-12T17:06:08.636344+0000","last_active":"2024-09-12T17:07:42.267285+0000","last_peered":"2024-09-12T17:07:42.267285+0000","last_clean":"2024-09-12T17:07:42.267285+0000","last_became_active":"2024-09-12T17:06:08.636028+0000","last_became_peered":"2024-09-12T17:06:08.636028+0000","last_unstale":"2024-09-12T17:07:42.267285+0000","last_undegraded":"2024-09-12T17:07:42.267285+0000","last_fullsized":"2024-09-12T17:07:42.267285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'9","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265805+0000","last_change":"2024-09-12T17:05:47.526020+0000","last_active":"2024-09-12T17:07:42.265805+0000","last_peered":"2024-09-12T17:07:42.265805+0000","last_clean":"2024-09-12T17:07:42.265805+0000","last_became_active":"2024-09-12T17:05:47.525481+0000","last_became_peered":"2024-09-12T17:05:47.525481+0000","last_unstale":"2024-09-12T17:07:42.265805+0000","last_undegraded":"2024-09-12T17:07:42.265805+0000","last_fullsized":"2024-09-12T17:07:42.265805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:05.949135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":17,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"75'23","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266219+0000","last_change":"2024-09-12T17:05:49.546848+0000","last_active":"2024-09-12T17:07:42.266219+0000","last_peered":"2024-09-12T17:07:42.266219+0000","last_clean":"2024-09-12T17:07:42.266219+0000","last_became_active":"2024-09-12T17:05:49.545382+0000","last_became_peered":"2024-09-12T17:05:49.545382+0000","last_unstale":"2024-09-12T17:07:42.266219+0000","last_undegraded":"2024-09-12T17:07:42.266219+0000","last_fullsized":"2024-09-12T17:07:42.266219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:42.832972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":66,"num_write":34,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"74'8","reported_seq":40,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265882+0000","last_change":"2024-09-12T17:07:28.249892+0000","last_active":"2024-09-12T17:07:42.265882+0000","last_peered":"2024-09-12T17:07:42.265882+0000","last_clean":"2024-09-12T17:07:42.265882+0000","last_became_active":"2024-09-12T17:07:28.191632+0000","last_became_peered":"2024-09-12T17:07:28.191632+0000","last_unstale":"2024-09-12T17:07:42.265882+0000","last_undegraded":"2024-09-12T17:07:42.265882+0000","last_fullsized":"2024-09-12T17:07:42.265882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.324862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398572+0000","last_change":"2024-09-12T17:06:08.622437+0000","last_active":"2024-09-12T17:07:42.398572+0000","last_peered":"2024-09-12T17:07:42.398572+0000","last_clean":"2024-09-12T17:07:42.398572+0000","last_became_active":"2024-09-12T17:06:08.620631+0000","last_became_peered":"2024-09-12T17:06:08.620631+0000","last_unstale":"2024-09-12T17:07:42.398572+0000","last_undegraded":"2024-09-12T17:07:42.398572+0000","last_fullsized":"2024-09-12T17:07:42.398572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:03.019920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.23","version":"71'10","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437226+0000","last_change":"2024-09-12T17:05:47.530275+0000","last_active":"2024-09-12T17:07:42.437226+0000","last_peered":"2024-09-12T17:07:42.437226+0000","last_clean":"2024-09-12T17:07:42.437226+0000","last_became_active":"2024-09-12T17:05:47.529857+0000","last_became_peered":"2024-09-12T17:05:47.529857+0000","last_unstale":"2024-09-12T17:07:42.437226+0000","last_undegraded":"2024-09-12T17:07:42.437226+0000","last_fullsized":"2024-09-12T17:07:42.437226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:47.999516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":10,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'21","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549194+0000","last_change":"2024-09-12T17:05:49.525070+0000","last_active":"2024-09-12T17:07:42.549194+0000","last_peered":"2024-09-12T17:07:42.549194+0000","last_clean":"2024-09-12T17:07:42.549194+0000","last_became_active":"2024-09-12T17:05:49.524567+0000","last_became_peered":"2024-09-12T17:05:49.524567+0000","last_unstale":"2024-09-12T17:07:42.549194+0000","last_undegraded":"2024-09-12T17:07:42.549194+0000","last_fullsized":"2024-09-12T17:07:42.549194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:34.320123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":60,"num_write":31,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"72'8","reported_seq":129,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549865+0000","last_change":"2024-09-12T17:05:47.547765+0000","last_active":"2024-09-12T17:07:42.549865+0000","last_peered":"2024-09-12T17:07:42.549865+0000","last_clean":"2024-09-12T17:07:42.549865+0000","last_became_active":"2024-09-12T17:05:47.547393+0000","last_became_peered":"2024-09-12T17:05:47.547393+0000","last_unstale":"2024-09-12T17:07:42.549865+0000","last_undegraded":"2024-09-12T17:07:42.549865+0000","last_fullsized":"2024-09-12T17:07:42.549865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:46.746261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":6,"num_read_kb":16385,"num_write":32,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550753+0000","last_change":"2024-09-12T17:05:49.561711+0000","last_active":"2024-09-12T17:07:42.550753+0000","last_peered":"2024-09-12T17:07:42.550753+0000","last_clean":"2024-09-12T17:07:42.550753+0000","last_became_active":"2024-09-12T17:05:49.560993+0000","last_became_peered":"2024-09-12T17:05:49.560993+0000","last_unstale":"2024-09-12T17:07:42.550753+0000","last_undegraded":"2024-09-12T17:07:42.550753+0000","last_fullsized":"2024-09-12T17:07:42.550753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:38.400338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"72'9","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549903+0000","last_change":"2024-09-12T17:06:08.611289+0000","last_active":"2024-09-12T17:07:42.549903+0000","last_peered":"2024-09-12T17:07:42.549903+0000","last_clean":"2024-09-12T17:07:42.549903+0000","last_became_active":"2024-09-12T17:06:08.610857+0000","last_became_peered":"2024-09-12T17:06:08.610857+0000","last_unstale":"2024-09-12T17:07:42.549903+0000","last_undegraded":"2024-09-12T17:07:42.549903+0000","last_fullsized":"2024-09-12T17:07:42.549903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:29.412900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":11,"num_read_kb":24579,"num_write":17,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"68'2","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.547868+0000","last_change":"2024-09-12T17:06:08.615771+0000","last_active":"2024-09-12T17:07:42.547868+0000","last_peered":"2024-09-12T17:07:42.547868+0000","last_clean":"2024-09-12T17:07:42.547868+0000","last_became_active":"2024-09-12T17:06:08.615451+0000","last_became_peered":"2024-09-12T17:06:08.615451+0000","last_unstale":"2024-09-12T17:07:42.547868+0000","last_undegraded":"2024-09-12T17:07:42.547868+0000","last_fullsized":"2024-09-12T17:07:42.547868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.063250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'8","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552139+0000","last_change":"2024-09-12T17:05:47.541213+0000","last_active":"2024-09-12T17:07:42.552139+0000","last_peered":"2024-09-12T17:07:42.552139+0000","last_clean":"2024-09-12T17:07:42.552139+0000","last_became_active":"2024-09-12T17:05:47.540469+0000","last_became_peered":"2024-09-12T17:05:47.540469+0000","last_unstale":"2024-09-12T17:07:42.552139+0000","last_undegraded":"2024-09-12T17:07:42.552139+0000","last_fullsized":"2024-09-12T17:07:42.552139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:26.620021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"74'21","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548886+0000","last_change":"2024-09-12T17:05:49.541113+0000","last_active":"2024-09-12T17:07:42.548886+0000","last_peered":"2024-09-12T17:07:42.548886+0000","last_clean":"2024-09-12T17:07:42.548886+0000","last_became_active":"2024-09-12T17:05:49.540395+0000","last_became_peered":"2024-09-12T17:05:49.540395+0000","last_unstale":"2024-09-12T17:07:42.548886+0000","last_undegraded":"2024-09-12T17:07:42.548886+0000","last_fullsized":"2024-09-12T17:07:42.548886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:32.506502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":60,"num_write":31,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"75'17","reported_seq":144,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550949+0000","last_change":"2024-09-12T17:05:47.539986+0000","last_active":"2024-09-12T17:07:42.550949+0000","last_peered":"2024-09-12T17:07:42.550949+0000","last_clean":"2024-09-12T17:07:42.550949+0000","last_became_active":"2024-09-12T17:05:47.539603+0000","last_became_peered":"2024-09-12T17:05:47.539603+0000","last_unstale":"2024-09-12T17:07:42.550949+0000","last_undegraded":"2024-09-12T17:07:42.550949+0000","last_fullsized":"2024-09-12T17:07:42.550949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":33,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438871+0000","last_change":"2024-09-12T17:05:49.533938+0000","last_active":"2024-09-12T17:07:42.438871+0000","last_peered":"2024-09-12T17:07:42.438871+0000","last_clean":"2024-09-12T17:07:42.438871+0000","last_became_active":"2024-09-12T17:05:49.531769+0000","last_became_peered":"2024-09-12T17:05:49.531769+0000","last_unstale":"2024-09-12T17:07:42.438871+0000","last_undegraded":"2024-09-12T17:07:42.438871+0000","last_fullsized":"2024-09-12T17:07:42.438871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:33.763423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"74'10","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265286+0000","last_change":"2024-09-12T17:05:47.525739+0000","last_active":"2024-09-12T17:07:42.265286+0000","last_peered":"2024-09-12T17:07:42.265286+0000","last_clean":"2024-09-12T17:07:42.265286+0000","last_became_active":"2024-09-12T17:05:47.524922+0000","last_became_peered":"2024-09-12T17:05:47.524922+0000","last_unstale":"2024-09-12T17:07:42.265286+0000","last_undegraded":"2024-09-12T17:07:42.265286+0000","last_fullsized":"2024-09-12T17:07:42.265286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":18,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550734+0000","last_change":"2024-09-12T17:05:49.555307+0000","last_active":"2024-09-12T17:07:42.550734+0000","last_peered":"2024-09-12T17:07:42.550734+0000","last_clean":"2024-09-12T17:07:42.550734+0000","last_became_active":"2024-09-12T17:05:49.554566+0000","last_became_peered":"2024-09-12T17:05:49.554566+0000","last_unstale":"2024-09-12T17:07:42.550734+0000","last_undegraded":"2024-09-12T17:07:42.550734+0000","last_fullsized":"2024-09-12T17:07:42.550734+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:45.017623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"73'9","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548296+0000","last_change":"2024-09-12T17:05:47.543468+0000","last_active":"2024-09-12T17:07:42.548296+0000","last_peered":"2024-09-12T17:07:42.548296+0000","last_clean":"2024-09-12T17:07:42.548296+0000","last_became_active":"2024-09-12T17:05:47.542753+0000","last_became_peered":"2024-09-12T17:05:47.542753+0000","last_unstale":"2024-09-12T17:07:42.548296+0000","last_undegraded":"2024-09-12T17:07:42.548296+0000","last_fullsized":"2024-09-12T17:07:42.548296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":33,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"73'17","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267203+0000","last_change":"2024-09-12T17:05:49.536693+0000","last_active":"2024-09-12T17:07:42.267203+0000","last_peered":"2024-09-12T17:07:42.267203+0000","last_clean":"2024-09-12T17:07:42.267203+0000","last_became_active":"2024-09-12T17:05:49.536385+0000","last_became_peered":"2024-09-12T17:05:49.536385+0000","last_unstale":"2024-09-12T17:07:42.267203+0000","last_undegraded":"2024-09-12T17:07:42.267203+0000","last_fullsized":"2024-09-12T17:07:42.267203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.024498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":48,"num_write":25,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"69'5","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265576+0000","last_change":"2024-09-12T17:05:47.545251+0000","last_active":"2024-09-12T17:07:42.265576+0000","last_peered":"2024-09-12T17:07:42.265576+0000","last_clean":"2024-09-12T17:07:42.265576+0000","last_became_active":"2024-09-12T17:05:47.544406+0000","last_became_peered":"2024-09-12T17:05:47.544406+0000","last_unstale":"2024-09-12T17:07:42.265576+0000","last_undegraded":"2024-09-12T17:07:42.265576+0000","last_fullsized":"2024-09-12T17:07:42.265576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:52.167194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":20481,"num_write":13,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"75'19","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.553542+0000","last_change":"2024-09-12T17:05:49.564446+0000","last_active":"2024-09-12T17:07:42.553542+0000","last_peered":"2024-09-12T17:07:42.553542+0000","last_clean":"2024-09-12T17:07:42.553542+0000","last_became_active":"2024-09-12T17:05:49.563625+0000","last_became_peered":"2024-09-12T17:05:49.563625+0000","last_unstale":"2024-09-12T17:07:42.553542+0000","last_undegraded":"2024-09-12T17:07:42.553542+0000","last_fullsized":"2024-09-12T17:07:42.553542+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.324265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":54,"num_write":28,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"72'10","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437393+0000","last_change":"2024-09-12T17:05:47.558422+0000","last_active":"2024-09-12T17:07:42.437393+0000","last_peered":"2024-09-12T17:07:42.437393+0000","last_clean":"2024-09-12T17:07:42.437393+0000","last_became_active":"2024-09-12T17:05:47.558047+0000","last_became_peered":"2024-09-12T17:05:47.558047+0000","last_unstale":"2024-09-12T17:07:42.437393+0000","last_undegraded":"2024-09-12T17:07:42.437393+0000","last_fullsized":"2024-09-12T17:07:42.437393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:25.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396680+0000","last_change":"2024-09-12T17:05:49.522750+0000","last_active":"2024-09-12T17:07:42.396680+0000","last_peered":"2024-09-12T17:07:42.396680+0000","last_clean":"2024-09-12T17:07:42.396680+0000","last_became_active":"2024-09-12T17:05:49.522097+0000","last_became_peered":"2024-09-12T17:05:49.522097+0000","last_unstale":"2024-09-12T17:07:42.396680+0000","last_undegraded":"2024-09-12T17:07:42.396680+0000","last_fullsized":"2024-09-12T17:07:42.396680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"73'11","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552023+0000","last_change":"2024-09-12T17:05:47.552865+0000","last_active":"2024-09-12T17:07:42.552023+0000","last_peered":"2024-09-12T17:07:42.552023+0000","last_clean":"2024-09-12T17:07:42.552023+0000","last_became_active":"2024-09-12T17:05:47.552207+0000","last_became_peered":"2024-09-12T17:05:47.552207+0000","last_unstale":"2024-09-12T17:07:42.552023+0000","last_undegraded":"2024-09-12T17:07:42.552023+0000","last_fullsized":"2024-09-12T17:07:42.552023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:00.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":35,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436516+0000","last_change":"2024-09-12T17:06:39.829239+0000","last_active":"2024-09-12T17:07:42.436516+0000","last_peered":"2024-09-12T17:07:42.436516+0000","last_clean":"2024-09-12T17:07:42.436516+0000","last_became_active":"2024-09-12T17:06:39.828894+0000","last_became_peered":"2024-09-12T17:06:39.828894+0000","last_unstale":"2024-09-12T17:07:42.436516+0000","last_undegraded":"2024-09-12T17:07:42.436516+0000","last_fullsized":"2024-09-12T17:07:42.436516+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:00.000353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"74'14","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398678+0000","last_change":"2024-09-12T17:05:47.561338+0000","last_active":"2024-09-12T17:07:42.398678+0000","last_peered":"2024-09-12T17:07:42.398678+0000","last_clean":"2024-09-12T17:07:42.398678+0000","last_became_active":"2024-09-12T17:05:47.560439+0000","last_became_peered":"2024-09-12T17:05:47.560439+0000","last_unstale":"2024-09-12T17:07:42.398678+0000","last_undegraded":"2024-09-12T17:07:42.398678+0000","last_fullsized":"2024-09-12T17:07:42.398678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:58.530869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":14,"num_read_kb":36867,"num_write":22,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":74,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264694+0000","last_change":"2024-09-12T17:06:27.819106+0000","last_active":"2024-09-12T17:07:42.264694+0000","last_peered":"2024-09-12T17:07:42.264694+0000","last_clean":"2024-09-12T17:07:42.264694+0000","last_became_active":"2024-09-12T17:06:27.818761+0000","last_became_peered":"2024-09-12T17:06:27.818761+0000","last_unstale":"2024-09-12T17:07:42.264694+0000","last_undegraded":"2024-09-12T17:07:42.264694+0000","last_fullsized":"2024-09-12T17:07:42.264694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:29.107938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"74'8","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267384+0000","last_change":"2024-09-12T17:05:47.512066+0000","last_active":"2024-09-12T17:07:42.267384+0000","last_peered":"2024-09-12T17:07:42.267384+0000","last_clean":"2024-09-12T17:07:42.267384+0000","last_became_active":"2024-09-12T17:05:47.511470+0000","last_became_peered":"2024-09-12T17:05:47.511470+0000","last_unstale":"2024-09-12T17:07:42.267384+0000","last_undegraded":"2024-09-12T17:07:42.267384+0000","last_fullsized":"2024-09-12T17:07:42.267384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:38.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396081+0000","last_change":"2024-09-12T17:05:49.523060+0000","last_active":"2024-09-12T17:07:42.396081+0000","last_peered":"2024-09-12T17:07:42.396081+0000","last_clean":"2024-09-12T17:07:42.396081+0000","last_became_active":"2024-09-12T17:05:49.522157+0000","last_became_peered":"2024-09-12T17:05:49.522157+0000","last_unstale":"2024-09-12T17:07:42.396081+0000","last_undegraded":"2024-09-12T17:07:42.396081+0000","last_fullsized":"2024-09-12T17:07:42.396081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"71'5","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267144+0000","last_change":"2024-09-12T17:05:47.538305+0000","last_active":"2024-09-12T17:07:42.267144+0000","last_peered":"2024-09-12T17:07:42.267144+0000","last_clean":"2024-09-12T17:07:42.267144+0000","last_became_active":"2024-09-12T17:05:47.535569+0000","last_became_peered":"2024-09-12T17:05:47.535569+0000","last_unstale":"2024-09-12T17:07:42.267144+0000","last_undegraded":"2024-09-12T17:07:42.267144+0000","last_fullsized":"2024-09-12T17:07:42.267144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:24.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'5","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265171+0000","last_change":"2024-09-12T17:05:47.537712+0000","last_active":"2024-09-12T17:07:42.265171+0000","last_peered":"2024-09-12T17:07:42.265171+0000","last_clean":"2024-09-12T17:07:42.265171+0000","last_became_active":"2024-09-12T17:05:47.536958+0000","last_became_peered":"2024-09-12T17:05:47.536958+0000","last_unstale":"2024-09-12T17:07:42.265171+0000","last_undegraded":"2024-09-12T17:07:42.265171+0000","last_fullsized":"2024-09-12T17:07:42.265171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438820+0000","last_change":"2024-09-12T17:05:49.544841+0000","last_active":"2024-09-12T17:07:42.438820+0000","last_peered":"2024-09-12T17:07:42.438820+0000","last_clean":"2024-09-12T17:07:42.438820+0000","last_became_active":"2024-09-12T17:05:49.538757+0000","last_became_peered":"2024-09-12T17:05:49.538757+0000","last_unstale":"2024-09-12T17:07:42.438820+0000","last_undegraded":"2024-09-12T17:07:42.438820+0000","last_fullsized":"2024-09-12T17:07:42.438820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.976348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'8","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549842+0000","last_change":"2024-09-12T17:06:39.839407+0000","last_active":"2024-09-12T17:07:42.549842+0000","last_peered":"2024-09-12T17:07:42.549842+0000","last_clean":"2024-09-12T17:07:42.549842+0000","last_became_active":"2024-09-12T17:06:39.838968+0000","last_became_peered":"2024-09-12T17:06:39.838968+0000","last_unstale":"2024-09-12T17:07:42.549842+0000","last_undegraded":"2024-09-12T17:07:42.549842+0000","last_fullsized":"2024-09-12T17:07:42.549842+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:26.351659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":12291,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266694+0000","last_change":"2024-09-12T17:05:49.552327+0000","last_active":"2024-09-12T17:07:42.266694+0000","last_peered":"2024-09-12T17:07:42.266694+0000","last_clean":"2024-09-12T17:07:42.266694+0000","last_became_active":"2024-09-12T17:05:49.551604+0000","last_became_peered":"2024-09-12T17:05:49.551604+0000","last_unstale":"2024-09-12T17:07:42.266694+0000","last_undegraded":"2024-09-12T17:07:42.266694+0000","last_fullsized":"2024-09-12T17:07:42.266694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:55.648527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1089,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":21,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":87628,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":719,"num_read_kb":487,"num_write":447,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":1018,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":119892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1015,"num_read_kb":775,"num_write":393,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2055208960,"num_objects":540,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":540,"num_whiteouts":0,"num_read":370,"num_read_kb":1159213,"num_write":1440,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4110417920,"data_stored":4110417920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":560,"ondisk_log_size":560,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":626744,"kb_used_data":591388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93745096,"statfs":{"total":96636764160,"available":95994978304,"internally_reserved":0,"allocated":605581312,"data_stored":605099569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542174,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":529848,"kb_used_data":494500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93841992,"statfs":{"total":96636764160,"available":96094199808,"internally_reserved":0,"allocated":506368000,"data_stored":505928571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":658960,"kb_used_data":623608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93712880,"statfs":{"total":96636764160,"available":95961989120,"internally_reserved":0,"allocated":638574592,"data_stored":638073679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":701892,"kb_used_data":666540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93669948,"statfs":{"total":96636764160,"available":95918026752,"internally_reserved":0,"allocated":682536960,"data_stored":682096935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":667092,"kb_used_data":631744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93704748,"statfs":{"total":96636764160,"available":95953661952,"internally_reserved":0,"allocated":646905856,"data_stored":646422885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":495028,"kb_used_data":459672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93876812,"statfs":{"total":96636764160,"available":96129855488,"internally_reserved":0,"allocated":470704128,"data_stored":470269135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":0,"seq":60129542173,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542174,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589848,"kb_used_data":554492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93781992,"statfs":{"total":96636764160,"available":96032759808,"internally_reserved":0,"allocated":567799808,"data_stored":567345372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":566231040,"data_stored":566231040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":469762048,"data_stored":469762048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":645922816,"data_stored":645922816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":681574400,"data_stored":681574400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":637534208,"data_stored":637534208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":505413632,"data_stored":505413632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":603979776,"data_stored":603979776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":17797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":1678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":17248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":40676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":17620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":23993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":21,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:07:45.729 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:07:45.730 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:45.724+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:45.802 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:45.802 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:45.802 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:45.802 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:45.819 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:07:45.863 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:45.860+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:45.932 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:45.928+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:45.993 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:45.993 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:45.993 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:45.993 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:45.993 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:46.008 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:07:46.033 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:46.028+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:46.086 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:07:46.093 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:07:46.104 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-09-12T17:07:45.955676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2055889677,"num_objects":754,"num_object_clones":0,"num_object_copies":1508,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":754,"num_whiteouts":0,"num_read":2226,"num_read_kb":1160585,"num_write":2425,"num_write_kb":2049991,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":55,"num_bytes_recovered":12583995,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1462,"ondisk_log_size":1462,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":4269412,"kb_used_data":4021944,"kb_used_omap":10,"kb_used_meta":247285,"kb_avail":656333468,"statfs":{"total":676457349120,"available":672085471232,"internally_reserved":0,"allocated":4118470656,"data_stored":4115236146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11157,"internal_metadata":253219947},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":178257920,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":209,"num_read_kb":147573,"num_write":238,"num_write_kb":174114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001179"},"pg_stats":[{"pgid":"3.3f","version":"74'15","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397900+0000","last_change":"2024-09-12T17:05:47.561581+0000","last_active":"2024-09-12T17:07:42.397900+0000","last_peered":"2024-09-12T17:07:42.397900+0000","last_clean":"2024-09-12T17:07:42.397900+0000","last_became_active":"2024-09-12T17:05:47.560791+0000","last_became_peered":"2024-09-12T17:05:47.560791+0000","last_unstale":"2024-09-12T17:07:42.397900+0000","last_undegraded":"2024-09-12T17:07:42.397900+0000","last_fullsized":"2024-09-12T17:07:42.397900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:23.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":11,"num_read_kb":28674,"num_write":47,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"75'25","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264897+0000","last_change":"2024-09-12T17:05:49.558060+0000","last_active":"2024-09-12T17:07:42.264897+0000","last_peered":"2024-09-12T17:07:42.264897+0000","last_clean":"2024-09-12T17:07:42.264897+0000","last_became_active":"2024-09-12T17:05:49.557287+0000","last_became_peered":"2024-09-12T17:05:49.557287+0000","last_unstale":"2024-09-12T17:07:42.264897+0000","last_undegraded":"2024-09-12T17:07:42.264897+0000","last_fullsized":"2024-09-12T17:07:42.264897+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":93,"num_read_kb":71,"num_write":36,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"71'3","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.439155+0000","last_change":"2024-09-12T17:06:08.637922+0000","last_active":"2024-09-12T17:07:42.439155+0000","last_peered":"2024-09-12T17:07:42.439155+0000","last_clean":"2024-09-12T17:07:42.439155+0000","last_became_active":"2024-09-12T17:06:08.637579+0000","last_became_peered":"2024-09-12T17:06:08.637579+0000","last_unstale":"2024-09-12T17:07:42.439155+0000","last_undegraded":"2024-09-12T17:07:42.439155+0000","last_fullsized":"2024-09-12T17:07:42.439155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:14.737798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":118,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396363+0000","last_change":"2024-09-12T17:06:39.844511+0000","last_active":"2024-09-12T17:07:42.396363+0000","last_peered":"2024-09-12T17:07:42.396363+0000","last_clean":"2024-09-12T17:07:42.396363+0000","last_became_active":"2024-09-12T17:06:39.844037+0000","last_became_peered":"2024-09-12T17:06:39.844037+0000","last_unstale":"2024-09-12T17:07:42.396363+0000","last_undegraded":"2024-09-12T17:07:42.396363+0000","last_fullsized":"2024-09-12T17:07:42.396363+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:57:31.148232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"75'12","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437869+0000","last_change":"2024-09-12T17:05:47.523052+0000","last_active":"2024-09-12T17:07:42.437869+0000","last_peered":"2024-09-12T17:07:42.437869+0000","last_clean":"2024-09-12T17:07:42.437869+0000","last_became_active":"2024-09-12T17:05:47.522544+0000","last_became_peered":"2024-09-12T17:05:47.522544+0000","last_unstale":"2024-09-12T17:07:42.437869+0000","last_undegraded":"2024-09-12T17:07:42.437869+0000","last_fullsized":"2024-09-12T17:07:42.437869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"75'17","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550473+0000","last_change":"2024-09-12T17:05:49.549990+0000","last_active":"2024-09-12T17:07:42.550473+0000","last_peered":"2024-09-12T17:07:42.550473+0000","last_clean":"2024-09-12T17:07:42.550473+0000","last_became_active":"2024-09-12T17:05:49.549241+0000","last_became_peered":"2024-09-12T17:05:49.549241+0000","last_unstale":"2024-09-12T17:07:42.550473+0000","last_undegraded":"2024-09-12T17:07:42.550473+0000","last_fullsized":"2024-09-12T17:07:42.550473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.601256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":48,"num_write":25,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"75'8","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266769+0000","last_change":"2024-09-12T17:06:27.748679+0000","last_active":"2024-09-12T17:07:42.266769+0000","last_peered":"2024-09-12T17:07:42.266769+0000","last_clean":"2024-09-12T17:07:42.266769+0000","last_became_active":"2024-09-12T17:06:27.748390+0000","last_became_peered":"2024-09-12T17:06:27.748390+0000","last_unstale":"2024-09-12T17:07:42.266769+0000","last_undegraded":"2024-09-12T17:07:42.266769+0000","last_fullsized":"2024-09-12T17:07:42.266769+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:58.547350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":8193,"num_write":40,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437118+0000","last_change":"2024-09-12T17:05:49.542142+0000","last_active":"2024-09-12T17:07:42.437118+0000","last_peered":"2024-09-12T17:07:42.437118+0000","last_clean":"2024-09-12T17:07:42.437118+0000","last_became_active":"2024-09-12T17:05:49.541354+0000","last_became_peered":"2024-09-12T17:05:49.541354+0000","last_unstale":"2024-09-12T17:07:42.437118+0000","last_undegraded":"2024-09-12T17:07:42.437118+0000","last_fullsized":"2024-09-12T17:07:42.437118+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.147865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"72'6","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397085+0000","last_change":"2024-09-12T17:05:47.556154+0000","last_active":"2024-09-12T17:07:42.397085+0000","last_peered":"2024-09-12T17:07:42.397085+0000","last_clean":"2024-09-12T17:07:42.397085+0000","last_became_active":"2024-09-12T17:05:47.555396+0000","last_became_peered":"2024-09-12T17:05:47.555396+0000","last_unstale":"2024-09-12T17:07:42.397085+0000","last_undegraded":"2024-09-12T17:07:42.397085+0000","last_fullsized":"2024-09-12T17:07:42.397085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:27.784208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":22,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551590+0000","last_change":"2024-09-12T17:05:49.529344+0000","last_active":"2024-09-12T17:07:42.551590+0000","last_peered":"2024-09-12T17:07:42.551590+0000","last_clean":"2024-09-12T17:07:42.551590+0000","last_became_active":"2024-09-12T17:05:49.528184+0000","last_became_peered":"2024-09-12T17:05:49.528184+0000","last_unstale":"2024-09-12T17:07:42.551590+0000","last_undegraded":"2024-09-12T17:07:42.551590+0000","last_fullsized":"2024-09-12T17:07:42.551590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:18.357328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"74'9","reported_seq":129,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265424+0000","last_change":"2024-09-12T17:05:47.532931+0000","last_active":"2024-09-12T17:07:42.265424+0000","last_peered":"2024-09-12T17:07:42.265424+0000","last_clean":"2024-09-12T17:07:42.265424+0000","last_became_active":"2024-09-12T17:05:47.531427+0000","last_became_peered":"2024-09-12T17:05:47.531427+0000","last_unstale":"2024-09-12T17:07:42.265424+0000","last_undegraded":"2024-09-12T17:07:42.265424+0000","last_fullsized":"2024-09-12T17:07:42.265424+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":25,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552307+0000","last_change":"2024-09-12T17:05:49.550694+0000","last_active":"2024-09-12T17:07:42.552307+0000","last_peered":"2024-09-12T17:07:42.552307+0000","last_clean":"2024-09-12T17:07:42.552307+0000","last_became_active":"2024-09-12T17:05:49.549066+0000","last_became_peered":"2024-09-12T17:05:49.549066+0000","last_unstale":"2024-09-12T17:07:42.552307+0000","last_undegraded":"2024-09-12T17:07:42.552307+0000","last_fullsized":"2024-09-12T17:07:42.552307+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:24.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"74'6","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397020+0000","last_change":"2024-09-12T17:05:47.560085+0000","last_active":"2024-09-12T17:07:42.397020+0000","last_peered":"2024-09-12T17:07:42.397020+0000","last_clean":"2024-09-12T17:07:42.397020+0000","last_became_active":"2024-09-12T17:05:47.559160+0000","last_became_peered":"2024-09-12T17:05:47.559160+0000","last_unstale":"2024-09-12T17:07:42.397020+0000","last_undegraded":"2024-09-12T17:07:42.397020+0000","last_fullsized":"2024-09-12T17:07:42.397020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:06.664677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":10240,"num_write":14,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'2","reported_seq":123,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266713+0000","last_change":"2024-09-12T17:06:39.830436+0000","last_active":"2024-09-12T17:07:42.266713+0000","last_peered":"2024-09-12T17:07:42.266713+0000","last_clean":"2024-09-12T17:07:42.266713+0000","last_became_active":"2024-09-12T17:06:39.830025+0000","last_became_peered":"2024-09-12T17:06:39.830025+0000","last_unstale":"2024-09-12T17:07:42.266713+0000","last_undegraded":"2024-09-12T17:07:42.266713+0000","last_fullsized":"2024-09-12T17:07:42.266713+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:00.000353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"73'7","reported_seq":85,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264951+0000","last_change":"2024-09-12T17:06:27.748750+0000","last_active":"2024-09-12T17:07:42.264951+0000","last_peered":"2024-09-12T17:07:42.264951+0000","last_clean":"2024-09-12T17:07:42.264951+0000","last_became_active":"2024-09-12T17:06:27.748329+0000","last_became_peered":"2024-09-12T17:06:27.748329+0000","last_unstale":"2024-09-12T17:07:42.264951+0000","last_undegraded":"2024-09-12T17:07:42.264951+0000","last_fullsized":"2024-09-12T17:07:42.264951+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:26.773943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5,"num_read_kb":12289,"num_write":31,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267602+0000","last_change":"2024-09-12T17:07:28.190678+0000","last_active":"2024-09-12T17:07:42.267602+0000","last_peered":"2024-09-12T17:07:42.267602+0000","last_clean":"2024-09-12T17:07:42.267602+0000","last_became_active":"2024-09-12T17:07:28.190245+0000","last_became_peered":"2024-09-12T17:07:28.190245+0000","last_unstale":"2024-09-12T17:07:42.267602+0000","last_undegraded":"2024-09-12T17:07:42.267602+0000","last_fullsized":"2024-09-12T17:07:42.267602+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:04.220150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549445+0000","last_change":"2024-09-12T17:05:49.549575+0000","last_active":"2024-09-12T17:07:42.549445+0000","last_peered":"2024-09-12T17:07:42.549445+0000","last_clean":"2024-09-12T17:07:42.549445+0000","last_became_active":"2024-09-12T17:05:49.548292+0000","last_became_peered":"2024-09-12T17:05:49.548292+0000","last_unstale":"2024-09-12T17:07:42.549445+0000","last_undegraded":"2024-09-12T17:07:42.549445+0000","last_fullsized":"2024-09-12T17:07:42.549445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"73'5","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398083+0000","last_change":"2024-09-12T17:05:47.559881+0000","last_active":"2024-09-12T17:07:42.398083+0000","last_peered":"2024-09-12T17:07:42.398083+0000","last_clean":"2024-09-12T17:07:42.398083+0000","last_became_active":"2024-09-12T17:05:47.559165+0000","last_became_peered":"2024-09-12T17:05:47.559165+0000","last_unstale":"2024-09-12T17:07:42.398083+0000","last_undegraded":"2024-09-12T17:07:42.398083+0000","last_fullsized":"2024-09-12T17:07:42.398083+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:35.318480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":13,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":118,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396628+0000","last_change":"2024-09-12T17:06:39.837035+0000","last_active":"2024-09-12T17:07:42.396628+0000","last_peered":"2024-09-12T17:07:42.396628+0000","last_clean":"2024-09-12T17:07:42.396628+0000","last_became_active":"2024-09-12T17:06:39.836671+0000","last_became_peered":"2024-09-12T17:06:39.836671+0000","last_unstale":"2024-09-12T17:07:42.396628+0000","last_undegraded":"2024-09-12T17:07:42.396628+0000","last_fullsized":"2024-09-12T17:07:42.396628+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:52:50.677836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"74'9","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551929+0000","last_change":"2024-09-12T17:05:47.528338+0000","last_active":"2024-09-12T17:07:42.551929+0000","last_peered":"2024-09-12T17:07:42.551929+0000","last_clean":"2024-09-12T17:07:42.551929+0000","last_became_active":"2024-09-12T17:05:47.527533+0000","last_became_peered":"2024-09-12T17:05:47.527533+0000","last_unstale":"2024-09-12T17:07:42.551929+0000","last_undegraded":"2024-09-12T17:07:42.551929+0000","last_fullsized":"2024-09-12T17:07:42.551929+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.693731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":6,"num_read_kb":16385,"num_write":41,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"74'15","reported_seq":127,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265552+0000","last_change":"2024-09-12T17:05:49.543097+0000","last_active":"2024-09-12T17:07:42.265552+0000","last_peered":"2024-09-12T17:07:42.265552+0000","last_clean":"2024-09-12T17:07:42.265552+0000","last_became_active":"2024-09-12T17:05:49.542113+0000","last_became_peered":"2024-09-12T17:05:49.542113+0000","last_unstale":"2024-09-12T17:07:42.265552+0000","last_undegraded":"2024-09-12T17:07:42.265552+0000","last_fullsized":"2024-09-12T17:07:42.265552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":42,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"73'10","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552566+0000","last_change":"2024-09-12T17:05:47.529868+0000","last_active":"2024-09-12T17:07:42.552566+0000","last_peered":"2024-09-12T17:07:42.552566+0000","last_clean":"2024-09-12T17:07:42.552566+0000","last_became_active":"2024-09-12T17:05:47.529083+0000","last_became_peered":"2024-09-12T17:05:47.529083+0000","last_unstale":"2024-09-12T17:07:42.552566+0000","last_undegraded":"2024-09-12T17:07:42.552566+0000","last_fullsized":"2024-09-12T17:07:42.552566+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:16.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":32769,"num_write":34,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266187+0000","last_change":"2024-09-12T17:05:49.548084+0000","last_active":"2024-09-12T17:07:42.266187+0000","last_peered":"2024-09-12T17:07:42.266187+0000","last_clean":"2024-09-12T17:07:42.266187+0000","last_became_active":"2024-09-12T17:05:49.539930+0000","last_became_peered":"2024-09-12T17:05:49.539930+0000","last_unstale":"2024-09-12T17:07:42.266187+0000","last_undegraded":"2024-09-12T17:07:42.266187+0000","last_fullsized":"2024-09-12T17:07:42.266187+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:11.453390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"73'6","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551044+0000","last_change":"2024-09-12T17:05:47.548316+0000","last_active":"2024-09-12T17:07:42.551044+0000","last_peered":"2024-09-12T17:07:42.551044+0000","last_clean":"2024-09-12T17:07:42.551044+0000","last_became_active":"2024-09-12T17:05:47.547430+0000","last_became_peered":"2024-09-12T17:05:47.547430+0000","last_unstale":"2024-09-12T17:07:42.551044+0000","last_undegraded":"2024-09-12T17:07:42.551044+0000","last_fullsized":"2024-09-12T17:07:42.551044+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:21.143073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":14,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266667+0000","last_change":"2024-09-12T17:05:49.556144+0000","last_active":"2024-09-12T17:07:42.266667+0000","last_peered":"2024-09-12T17:07:42.266667+0000","last_clean":"2024-09-12T17:07:42.266667+0000","last_became_active":"2024-09-12T17:05:49.555033+0000","last_became_peered":"2024-09-12T17:05:49.555033+0000","last_unstale":"2024-09-12T17:07:42.266667+0000","last_undegraded":"2024-09-12T17:07:42.266667+0000","last_fullsized":"2024-09-12T17:07:42.266667+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:08.056726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548577+0000","last_change":"2024-09-12T17:05:47.511375+0000","last_active":"2024-09-12T17:07:42.548577+0000","last_peered":"2024-09-12T17:07:42.548577+0000","last_clean":"2024-09-12T17:07:42.548577+0000","last_became_active":"2024-09-12T17:05:47.510364+0000","last_became_peered":"2024-09-12T17:05:47.510364+0000","last_unstale":"2024-09-12T17:07:42.548577+0000","last_undegraded":"2024-09-12T17:07:42.548577+0000","last_fullsized":"2024-09-12T17:07:42.548577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.553550+0000","last_change":"2024-09-12T17:06:39.840952+0000","last_active":"2024-09-12T17:07:42.553550+0000","last_peered":"2024-09-12T17:07:42.553550+0000","last_clean":"2024-09-12T17:07:42.553550+0000","last_became_active":"2024-09-12T17:06:39.840447+0000","last_became_peered":"2024-09-12T17:06:39.840447+0000","last_unstale":"2024-09-12T17:07:42.553550+0000","last_undegraded":"2024-09-12T17:07:42.553550+0000","last_fullsized":"2024-09-12T17:07:42.553550+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:07.838698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"74'4","reported_seq":129,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437101+0000","last_change":"2024-09-12T17:06:39.827079+0000","last_active":"2024-09-12T17:07:42.437101+0000","last_peered":"2024-09-12T17:07:42.437101+0000","last_clean":"2024-09-12T17:07:42.437101+0000","last_became_active":"2024-09-12T17:06:39.826789+0000","last_became_peered":"2024-09-12T17:06:39.826789+0000","last_unstale":"2024-09-12T17:07:42.437101+0000","last_undegraded":"2024-09-12T17:07:42.437101+0000","last_fullsized":"2024-09-12T17:07:42.437101+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:19.572209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":12,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"68'1","reported_seq":98,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548669+0000","last_change":"2024-09-12T17:05:57.588515+0000","last_active":"2024-09-12T17:07:42.548669+0000","last_peered":"2024-09-12T17:07:42.548669+0000","last_clean":"2024-09-12T17:07:42.548669+0000","last_became_active":"2024-09-12T17:05:57.587891+0000","last_became_peered":"2024-09-12T17:05:57.587891+0000","last_unstale":"2024-09-12T17:07:42.548669+0000","last_undegraded":"2024-09-12T17:07:42.548669+0000","last_fullsized":"2024-09-12T17:07:42.548669+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:24.257847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549552+0000","last_change":"2024-09-12T17:06:08.622184+0000","last_active":"2024-09-12T17:07:42.549552+0000","last_peered":"2024-09-12T17:07:42.549552+0000","last_clean":"2024-09-12T17:07:42.549552+0000","last_became_active":"2024-09-12T17:06:08.621375+0000","last_became_peered":"2024-09-12T17:06:08.621375+0000","last_unstale":"2024-09-12T17:07:42.549552+0000","last_undegraded":"2024-09-12T17:07:42.549552+0000","last_fullsized":"2024-09-12T17:07:42.549552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:06:24.931655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"73'11","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397633+0000","last_change":"2024-09-12T17:05:47.557687+0000","last_active":"2024-09-12T17:07:42.397633+0000","last_peered":"2024-09-12T17:07:42.397633+0000","last_clean":"2024-09-12T17:07:42.397633+0000","last_became_active":"2024-09-12T17:05:47.556980+0000","last_became_peered":"2024-09-12T17:05:47.556980+0000","last_unstale":"2024-09-12T17:07:42.397633+0000","last_undegraded":"2024-09-12T17:07:42.397633+0000","last_fullsized":"2024-09-12T17:07:42.397633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.891909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":13,"num_read_kb":30723,"num_write":35,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265998+0000","last_change":"2024-09-12T17:06:39.826825+0000","last_active":"2024-09-12T17:07:42.265998+0000","last_peered":"2024-09-12T17:07:42.265998+0000","last_clean":"2024-09-12T17:07:42.265998+0000","last_became_active":"2024-09-12T17:06:39.826367+0000","last_became_peered":"2024-09-12T17:06:39.826367+0000","last_unstale":"2024-09-12T17:07:42.265998+0000","last_undegraded":"2024-09-12T17:07:42.265998+0000","last_fullsized":"2024-09-12T17:07:42.265998+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:30.571880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"68'11","reported_seq":123,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438055+0000","last_change":"2024-09-12T17:05:53.537592+0000","last_active":"2024-09-12T17:07:42.438055+0000","last_peered":"2024-09-12T17:07:42.438055+0000","last_clean":"2024-09-12T17:07:42.438055+0000","last_became_active":"2024-09-12T17:05:53.536921+0000","last_became_peered":"2024-09-12T17:05:53.536921+0000","last_unstale":"2024-09-12T17:07:42.438055+0000","last_undegraded":"2024-09-12T17:07:42.438055+0000","last_fullsized":"2024-09-12T17:07:42.438055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:25.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397277+0000","last_change":"2024-09-12T17:05:55.559431+0000","last_active":"2024-09-12T17:07:42.397277+0000","last_peered":"2024-09-12T17:07:42.397277+0000","last_clean":"2024-09-12T17:07:42.397277+0000","last_became_active":"2024-09-12T17:05:55.558297+0000","last_became_peered":"2024-09-12T17:05:55.558297+0000","last_unstale":"2024-09-12T17:07:42.397277+0000","last_undegraded":"2024-09-12T17:07:42.397277+0000","last_fullsized":"2024-09-12T17:07:42.397277+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"68'1","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264812+0000","last_change":"2024-09-12T17:05:57.592599+0000","last_active":"2024-09-12T17:07:42.264812+0000","last_peered":"2024-09-12T17:07:42.264812+0000","last_clean":"2024-09-12T17:07:42.264812+0000","last_became_active":"2024-09-12T17:05:57.591877+0000","last_became_peered":"2024-09-12T17:05:57.591877+0000","last_unstale":"2024-09-12T17:07:42.264812+0000","last_undegraded":"2024-09-12T17:07:42.264812+0000","last_fullsized":"2024-09-12T17:07:42.264812+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:57.557525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"68'6","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266473+0000","last_change":"2024-09-12T17:05:49.546093+0000","last_active":"2024-09-12T17:07:42.266473+0000","last_peered":"2024-09-12T17:07:42.266473+0000","last_clean":"2024-09-12T17:07:42.266473+0000","last_became_active":"2024-09-12T17:05:49.544425+0000","last_became_peered":"2024-09-12T17:05:49.544425+0000","last_unstale":"2024-09-12T17:07:42.266473+0000","last_undegraded":"2024-09-12T17:07:42.266473+0000","last_fullsized":"2024-09-12T17:07:42.266473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.495950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"72'6","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437180+0000","last_change":"2024-09-12T17:05:47.535295+0000","last_active":"2024-09-12T17:07:42.437180+0000","last_peered":"2024-09-12T17:07:42.437180+0000","last_clean":"2024-09-12T17:07:42.437180+0000","last_became_active":"2024-09-12T17:05:47.534833+0000","last_became_peered":"2024-09-12T17:05:47.534833+0000","last_unstale":"2024-09-12T17:07:42.437180+0000","last_undegraded":"2024-09-12T17:07:42.437180+0000","last_fullsized":"2024-09-12T17:07:42.437180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549735+0000","last_change":"2024-09-12T17:05:51.533888+0000","last_active":"2024-09-12T17:07:42.549735+0000","last_peered":"2024-09-12T17:07:42.549735+0000","last_clean":"2024-09-12T17:07:42.549735+0000","last_became_active":"2024-09-12T17:05:51.533164+0000","last_became_peered":"2024-09-12T17:05:51.533164+0000","last_unstale":"2024-09-12T17:07:42.549735+0000","last_undegraded":"2024-09-12T17:07:42.549735+0000","last_fullsized":"2024-09-12T17:07:42.549735+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:33.007858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549714+0000","last_change":"2024-09-12T17:05:53.549534+0000","last_active":"2024-09-12T17:07:42.549714+0000","last_peered":"2024-09-12T17:07:42.549714+0000","last_clean":"2024-09-12T17:07:42.549714+0000","last_became_active":"2024-09-12T17:05:53.548824+0000","last_became_peered":"2024-09-12T17:05:53.548824+0000","last_unstale":"2024-09-12T17:07:42.549714+0000","last_undegraded":"2024-09-12T17:07:42.549714+0000","last_fullsized":"2024-09-12T17:07:42.549714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.765832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549670+0000","last_change":"2024-09-12T17:05:55.557468+0000","last_active":"2024-09-12T17:07:42.549670+0000","last_peered":"2024-09-12T17:07:42.549670+0000","last_clean":"2024-09-12T17:07:42.549670+0000","last_became_active":"2024-09-12T17:05:55.556689+0000","last_became_peered":"2024-09-12T17:05:55.556689+0000","last_unstale":"2024-09-12T17:07:42.549670+0000","last_undegraded":"2024-09-12T17:07:42.549670+0000","last_fullsized":"2024-09-12T17:07:42.549670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:56.879576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436558+0000","last_change":"2024-09-12T17:05:57.589569+0000","last_active":"2024-09-12T17:07:42.436558+0000","last_peered":"2024-09-12T17:07:42.436558+0000","last_clean":"2024-09-12T17:07:42.436558+0000","last_became_active":"2024-09-12T17:05:57.588649+0000","last_became_peered":"2024-09-12T17:05:57.588649+0000","last_unstale":"2024-09-12T17:07:42.436558+0000","last_undegraded":"2024-09-12T17:07:42.436558+0000","last_fullsized":"2024-09-12T17:07:42.436558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"68'10","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.439279+0000","last_change":"2024-09-12T17:05:49.531436+0000","last_active":"2024-09-12T17:07:42.439279+0000","last_peered":"2024-09-12T17:07:42.439279+0000","last_clean":"2024-09-12T17:07:42.439279+0000","last_became_active":"2024-09-12T17:05:49.530687+0000","last_became_peered":"2024-09-12T17:05:49.530687+0000","last_unstale":"2024-09-12T17:07:42.439279+0000","last_undegraded":"2024-09-12T17:07:42.439279+0000","last_fullsized":"2024-09-12T17:07:42.439279+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'9","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397175+0000","last_change":"2024-09-12T17:05:47.564709+0000","last_active":"2024-09-12T17:07:42.397175+0000","last_peered":"2024-09-12T17:07:42.397175+0000","last_clean":"2024-09-12T17:07:42.397175+0000","last_became_active":"2024-09-12T17:05:47.564189+0000","last_became_peered":"2024-09-12T17:05:47.564189+0000","last_unstale":"2024-09-12T17:07:42.397175+0000","last_undegraded":"2024-09-12T17:07:42.397175+0000","last_fullsized":"2024-09-12T17:07:42.397175+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":33,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":115,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551255+0000","last_change":"2024-09-12T17:06:39.833068+0000","last_active":"2024-09-12T17:07:42.551255+0000","last_peered":"2024-09-12T17:07:42.551255+0000","last_clean":"2024-09-12T17:07:42.551255+0000","last_became_active":"2024-09-12T17:06:39.832764+0000","last_became_peered":"2024-09-12T17:06:39.832764+0000","last_unstale":"2024-09-12T17:07:42.551255+0000","last_undegraded":"2024-09-12T17:07:42.551255+0000","last_fullsized":"2024-09-12T17:07:42.551255+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:36:33.183935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":120,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266524+0000","last_change":"2024-09-12T17:05:53.549328+0000","last_active":"2024-09-12T17:07:42.266524+0000","last_peered":"2024-09-12T17:07:42.266524+0000","last_clean":"2024-09-12T17:07:42.266524+0000","last_became_active":"2024-09-12T17:05:53.548968+0000","last_became_peered":"2024-09-12T17:05:53.548968+0000","last_unstale":"2024-09-12T17:07:42.266524+0000","last_undegraded":"2024-09-12T17:07:42.266524+0000","last_fullsized":"2024-09-12T17:07:42.266524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:36.974950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"68'12","reported_seq":153,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397109+0000","last_change":"2024-09-12T17:06:08.641591+0000","last_active":"2024-09-12T17:07:42.397109+0000","last_peered":"2024-09-12T17:07:42.397109+0000","last_clean":"2024-09-12T17:07:42.397109+0000","last_became_active":"2024-09-12T17:06:08.630653+0000","last_became_peered":"2024-09-12T17:06:08.630653+0000","last_unstale":"2024-09-12T17:07:42.397109+0000","last_undegraded":"2024-09-12T17:07:42.397109+0000","last_fullsized":"2024-09-12T17:07:42.397109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:31.735105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549732+0000","last_change":"2024-09-12T17:05:58.122522+0000","last_active":"2024-09-12T17:07:42.549732+0000","last_peered":"2024-09-12T17:07:42.549732+0000","last_clean":"2024-09-12T17:07:42.549732+0000","last_became_active":"2024-09-12T17:05:58.121871+0000","last_became_peered":"2024-09-12T17:05:58.121871+0000","last_unstale":"2024-09-12T17:07:42.549732+0000","last_undegraded":"2024-09-12T17:07:42.549732+0000","last_fullsized":"2024-09-12T17:07:42.549732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:22.625236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550799+0000","last_change":"2024-09-12T17:05:49.528766+0000","last_active":"2024-09-12T17:07:42.550799+0000","last_peered":"2024-09-12T17:07:42.550799+0000","last_clean":"2024-09-12T17:07:42.550799+0000","last_became_active":"2024-09-12T17:05:49.527758+0000","last_became_peered":"2024-09-12T17:05:49.527758+0000","last_unstale":"2024-09-12T17:07:42.550799+0000","last_undegraded":"2024-09-12T17:07:42.550799+0000","last_fullsized":"2024-09-12T17:07:42.550799+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:06.399711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"74'14","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549077+0000","last_change":"2024-09-12T17:05:47.521727+0000","last_active":"2024-09-12T17:07:42.549077+0000","last_peered":"2024-09-12T17:07:42.549077+0000","last_clean":"2024-09-12T17:07:42.549077+0000","last_became_active":"2024-09-12T17:05:47.520943+0000","last_became_peered":"2024-09-12T17:05:47.520943+0000","last_unstale":"2024-09-12T17:07:42.549077+0000","last_undegraded":"2024-09-12T17:07:42.549077+0000","last_fullsized":"2024-09-12T17:07:42.549077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:24.772296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52428800,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":9,"num_read_kb":28673,"num_write":22,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"29'1","reported_seq":116,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266459+0000","last_change":"2024-09-12T17:05:51.556202+0000","last_active":"2024-09-12T17:07:42.266459+0000","last_peered":"2024-09-12T17:07:42.266459+0000","last_clean":"2024-09-12T17:07:42.266459+0000","last_became_active":"2024-09-12T17:05:51.555420+0000","last_became_peered":"2024-09-12T17:05:51.555420+0000","last_unstale":"2024-09-12T17:07:42.266459+0000","last_undegraded":"2024-09-12T17:07:42.266459+0000","last_fullsized":"2024-09-12T17:07:42.266459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:56.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"68'10","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396993+0000","last_change":"2024-09-12T17:05:53.554159+0000","last_active":"2024-09-12T17:07:42.396993+0000","last_peered":"2024-09-12T17:07:42.396993+0000","last_clean":"2024-09-12T17:07:42.396993+0000","last_became_active":"2024-09-12T17:05:53.553333+0000","last_became_peered":"2024-09-12T17:05:53.553333+0000","last_unstale":"2024-09-12T17:07:42.396993+0000","last_undegraded":"2024-09-12T17:07:42.396993+0000","last_fullsized":"2024-09-12T17:07:42.396993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:53.266475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"68'11","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550096+0000","last_change":"2024-09-12T17:05:55.556502+0000","last_active":"2024-09-12T17:07:42.550096+0000","last_peered":"2024-09-12T17:07:42.550096+0000","last_clean":"2024-09-12T17:07:42.550096+0000","last_became_active":"2024-09-12T17:05:55.555879+0000","last_became_peered":"2024-09-12T17:05:55.555879+0000","last_unstale":"2024-09-12T17:07:42.550096+0000","last_undegraded":"2024-09-12T17:07:42.550096+0000","last_fullsized":"2024-09-12T17:07:42.550096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:18.672296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265168+0000","last_change":"2024-09-12T17:05:49.553404+0000","last_active":"2024-09-12T17:07:42.265168+0000","last_peered":"2024-09-12T17:07:42.265168+0000","last_clean":"2024-09-12T17:07:42.265168+0000","last_became_active":"2024-09-12T17:05:49.552637+0000","last_became_peered":"2024-09-12T17:05:49.552637+0000","last_unstale":"2024-09-12T17:07:42.265168+0000","last_undegraded":"2024-09-12T17:07:42.265168+0000","last_fullsized":"2024-09-12T17:07:42.265168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"75'6","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398277+0000","last_change":"2024-09-12T17:05:47.562949+0000","last_active":"2024-09-12T17:07:42.398277+0000","last_peered":"2024-09-12T17:07:42.398277+0000","last_clean":"2024-09-12T17:07:42.398277+0000","last_became_active":"2024-09-12T17:05:47.562465+0000","last_became_peered":"2024-09-12T17:05:47.562465+0000","last_unstale":"2024-09-12T17:07:42.398277+0000","last_undegraded":"2024-09-12T17:07:42.398277+0000","last_fullsized":"2024-09-12T17:07:42.398277+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5,"num_read_kb":12289,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396130+0000","last_change":"2024-09-12T17:05:51.542349+0000","last_active":"2024-09-12T17:07:42.396130+0000","last_peered":"2024-09-12T17:07:42.396130+0000","last_clean":"2024-09-12T17:07:42.396130+0000","last_became_active":"2024-09-12T17:05:51.541205+0000","last_became_peered":"2024-09-12T17:05:51.541205+0000","last_unstale":"2024-09-12T17:07:42.396130+0000","last_undegraded":"2024-09-12T17:07:42.396130+0000","last_fullsized":"2024-09-12T17:07:42.396130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"68'21","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265125+0000","last_change":"2024-09-12T17:05:53.560400+0000","last_active":"2024-09-12T17:07:42.265125+0000","last_peered":"2024-09-12T17:07:42.265125+0000","last_clean":"2024-09-12T17:07:42.265125+0000","last_became_active":"2024-09-12T17:05:53.559463+0000","last_became_peered":"2024-09-12T17:05:53.559463+0000","last_unstale":"2024-09-12T17:07:42.265125+0000","last_undegraded":"2024-09-12T17:07:42.265125+0000","last_fullsized":"2024-09-12T17:07:42.265125+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9698,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265789+0000","last_change":"2024-09-12T17:06:08.636081+0000","last_active":"2024-09-12T17:07:42.265789+0000","last_peered":"2024-09-12T17:07:42.265789+0000","last_clean":"2024-09-12T17:07:42.265789+0000","last_became_active":"2024-09-12T17:06:08.634190+0000","last_became_peered":"2024-09-12T17:06:08.634190+0000","last_unstale":"2024-09-12T17:07:42.265789+0000","last_undegraded":"2024-09-12T17:07:42.265789+0000","last_fullsized":"2024-09-12T17:07:42.265789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:48.398088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265785+0000","last_change":"2024-09-12T17:05:57.599403+0000","last_active":"2024-09-12T17:07:42.265785+0000","last_peered":"2024-09-12T17:07:42.265785+0000","last_clean":"2024-09-12T17:07:42.265785+0000","last_became_active":"2024-09-12T17:05:57.598703+0000","last_became_peered":"2024-09-12T17:05:57.598703+0000","last_unstale":"2024-09-12T17:07:42.265785+0000","last_undegraded":"2024-09-12T17:07:42.265785+0000","last_fullsized":"2024-09-12T17:07:42.265785+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"75'17","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550308+0000","last_change":"2024-09-12T17:06:39.840827+0000","last_active":"2024-09-12T17:07:42.550308+0000","last_peered":"2024-09-12T17:07:42.550308+0000","last_clean":"2024-09-12T17:07:42.550308+0000","last_became_active":"2024-09-12T17:06:39.840262+0000","last_became_peered":"2024-09-12T17:06:39.840262+0000","last_unstale":"2024-09-12T17:07:42.550308+0000","last_undegraded":"2024-09-12T17:07:42.550308+0000","last_fullsized":"2024-09-12T17:07:42.550308+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:21.967358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":48,"num_write":25,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"72'7","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397747+0000","last_change":"2024-09-12T17:05:47.563411+0000","last_active":"2024-09-12T17:07:42.397747+0000","last_peered":"2024-09-12T17:07:42.397747+0000","last_clean":"2024-09-12T17:07:42.397747+0000","last_became_active":"2024-09-12T17:05:47.562812+0000","last_became_peered":"2024-09-12T17:05:47.562812+0000","last_unstale":"2024-09-12T17:07:42.397747+0000","last_undegraded":"2024-09-12T17:07:42.397747+0000","last_fullsized":"2024-09-12T17:07:42.397747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:57.659986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":15,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265565+0000","last_change":"2024-09-12T17:05:51.548944+0000","last_active":"2024-09-12T17:07:42.265565+0000","last_peered":"2024-09-12T17:07:42.265565+0000","last_clean":"2024-09-12T17:07:42.265565+0000","last_became_active":"2024-09-12T17:05:51.544649+0000","last_became_peered":"2024-09-12T17:05:51.544649+0000","last_unstale":"2024-09-12T17:07:42.265565+0000","last_undegraded":"2024-09-12T17:07:42.265565+0000","last_fullsized":"2024-09-12T17:07:42.265565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:01.468390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"68'10","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549379+0000","last_change":"2024-09-12T17:05:53.552838+0000","last_active":"2024-09-12T17:07:42.549379+0000","last_peered":"2024-09-12T17:07:42.549379+0000","last_clean":"2024-09-12T17:07:42.549379+0000","last_became_active":"2024-09-12T17:05:53.550042+0000","last_became_peered":"2024-09-12T17:05:53.550042+0000","last_unstale":"2024-09-12T17:07:42.549379+0000","last_undegraded":"2024-09-12T17:07:42.549379+0000","last_fullsized":"2024-09-12T17:07:42.549379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548079+0000","last_change":"2024-09-12T17:05:55.558761+0000","last_active":"2024-09-12T17:07:42.548079+0000","last_peered":"2024-09-12T17:07:42.548079+0000","last_clean":"2024-09-12T17:07:42.548079+0000","last_became_active":"2024-09-12T17:05:55.557930+0000","last_became_peered":"2024-09-12T17:05:55.557930+0000","last_unstale":"2024-09-12T17:07:42.548079+0000","last_undegraded":"2024-09-12T17:07:42.548079+0000","last_fullsized":"2024-09-12T17:07:42.548079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.015675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551895+0000","last_change":"2024-09-12T17:05:57.592611+0000","last_active":"2024-09-12T17:07:42.551895+0000","last_peered":"2024-09-12T17:07:42.551895+0000","last_clean":"2024-09-12T17:07:42.551895+0000","last_became_active":"2024-09-12T17:05:57.591855+0000","last_became_peered":"2024-09-12T17:05:57.591855+0000","last_unstale":"2024-09-12T17:07:42.551895+0000","last_undegraded":"2024-09-12T17:07:42.551895+0000","last_fullsized":"2024-09-12T17:07:42.551895+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:02.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551894+0000","last_change":"2024-09-12T17:06:39.832132+0000","last_active":"2024-09-12T17:07:42.551894+0000","last_peered":"2024-09-12T17:07:42.551894+0000","last_clean":"2024-09-12T17:07:42.551894+0000","last_became_active":"2024-09-12T17:06:39.831461+0000","last_became_peered":"2024-09-12T17:06:39.831461+0000","last_unstale":"2024-09-12T17:07:42.551894+0000","last_undegraded":"2024-09-12T17:07:42.551894+0000","last_fullsized":"2024-09-12T17:07:42.551894+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:31:42.442840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"74'9","reported_seq":129,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398209+0000","last_change":"2024-09-12T17:05:47.562243+0000","last_active":"2024-09-12T17:07:42.398209+0000","last_peered":"2024-09-12T17:07:42.398209+0000","last_clean":"2024-09-12T17:07:42.398209+0000","last_became_active":"2024-09-12T17:05:47.561587+0000","last_became_peered":"2024-09-12T17:05:47.561587+0000","last_unstale":"2024-09-12T17:07:42.398209+0000","last_undegraded":"2024-09-12T17:07:42.398209+0000","last_fullsized":"2024-09-12T17:07:42.398209+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":9,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"29'1","reported_seq":117,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266498+0000","last_change":"2024-09-12T17:05:51.542843+0000","last_active":"2024-09-12T17:07:42.266498+0000","last_peered":"2024-09-12T17:07:42.266498+0000","last_clean":"2024-09-12T17:07:42.266498+0000","last_became_active":"2024-09-12T17:05:51.542457+0000","last_became_peered":"2024-09-12T17:05:51.542457+0000","last_unstale":"2024-09-12T17:07:42.266498+0000","last_undegraded":"2024-09-12T17:07:42.266498+0000","last_fullsized":"2024-09-12T17:07:42.266498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.837373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"68'16","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397684+0000","last_change":"2024-09-12T17:05:53.548729+0000","last_active":"2024-09-12T17:07:42.397684+0000","last_peered":"2024-09-12T17:07:42.397684+0000","last_clean":"2024-09-12T17:07:42.397684+0000","last_became_active":"2024-09-12T17:05:53.547990+0000","last_became_peered":"2024-09-12T17:05:53.547990+0000","last_unstale":"2024-09-12T17:07:42.397684+0000","last_undegraded":"2024-09-12T17:07:42.397684+0000","last_fullsized":"2024-09-12T17:07:42.397684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:22.845485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"68'12","reported_seq":152,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436226+0000","last_change":"2024-09-12T17:06:08.647202+0000","last_active":"2024-09-12T17:07:42.436226+0000","last_peered":"2024-09-12T17:07:42.436226+0000","last_clean":"2024-09-12T17:07:42.436226+0000","last_became_active":"2024-09-12T17:06:08.641797+0000","last_became_peered":"2024-09-12T17:06:08.641797+0000","last_unstale":"2024-09-12T17:07:42.436226+0000","last_undegraded":"2024-09-12T17:07:42.436226+0000","last_fullsized":"2024-09-12T17:07:42.436226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:53.582414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437839+0000","last_change":"2024-09-12T17:05:57.596229+0000","last_active":"2024-09-12T17:07:42.437839+0000","last_peered":"2024-09-12T17:07:42.437839+0000","last_clean":"2024-09-12T17:07:42.437839+0000","last_became_active":"2024-09-12T17:05:57.595658+0000","last_became_peered":"2024-09-12T17:05:57.595658+0000","last_unstale":"2024-09-12T17:07:42.437839+0000","last_undegraded":"2024-09-12T17:07:42.437839+0000","last_fullsized":"2024-09-12T17:07:42.437839+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.644627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437917+0000","last_change":"2024-09-12T17:07:28.187204+0000","last_active":"2024-09-12T17:07:42.437917+0000","last_peered":"2024-09-12T17:07:42.437917+0000","last_clean":"2024-09-12T17:07:42.437917+0000","last_became_active":"2024-09-12T17:07:28.186345+0000","last_became_peered":"2024-09-12T17:07:28.186345+0000","last_unstale":"2024-09-12T17:07:42.437917+0000","last_undegraded":"2024-09-12T17:07:42.437917+0000","last_fullsized":"2024-09-12T17:07:42.437917+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:33.292654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"75'11","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266095+0000","last_change":"2024-09-12T17:05:47.535946+0000","last_active":"2024-09-12T17:07:42.266095+0000","last_peered":"2024-09-12T17:07:42.266095+0000","last_clean":"2024-09-12T17:07:42.266095+0000","last_became_active":"2024-09-12T17:05:47.534607+0000","last_became_peered":"2024-09-12T17:05:47.534607+0000","last_unstale":"2024-09-12T17:07:42.266095+0000","last_undegraded":"2024-09-12T17:07:42.266095+0000","last_fullsized":"2024-09-12T17:07:42.266095+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":10,"num_read_kb":18435,"num_write":43,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266195+0000","last_change":"2024-09-12T17:05:51.548391+0000","last_active":"2024-09-12T17:07:42.266195+0000","last_peered":"2024-09-12T17:07:42.266195+0000","last_clean":"2024-09-12T17:07:42.266195+0000","last_became_active":"2024-09-12T17:05:51.547939+0000","last_became_peered":"2024-09-12T17:05:51.547939+0000","last_unstale":"2024-09-12T17:07:42.266195+0000","last_undegraded":"2024-09-12T17:07:42.266195+0000","last_fullsized":"2024-09-12T17:07:42.266195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:08.848247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"68'14","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436525+0000","last_change":"2024-09-12T17:05:53.535756+0000","last_active":"2024-09-12T17:07:42.436525+0000","last_peered":"2024-09-12T17:07:42.436525+0000","last_clean":"2024-09-12T17:07:42.436525+0000","last_became_active":"2024-09-12T17:05:53.535062+0000","last_became_peered":"2024-09-12T17:05:53.535062+0000","last_unstale":"2024-09-12T17:07:42.436525+0000","last_undegraded":"2024-09-12T17:07:42.436525+0000","last_fullsized":"2024-09-12T17:07:42.436525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265308+0000","last_change":"2024-09-12T17:05:55.564010+0000","last_active":"2024-09-12T17:07:42.265308+0000","last_peered":"2024-09-12T17:07:42.265308+0000","last_clean":"2024-09-12T17:07:42.265308+0000","last_became_active":"2024-09-12T17:05:55.563125+0000","last_became_peered":"2024-09-12T17:05:55.563125+0000","last_unstale":"2024-09-12T17:07:42.265308+0000","last_undegraded":"2024-09-12T17:07:42.265308+0000","last_fullsized":"2024-09-12T17:07:42.265308+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:00.697571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550496+0000","last_change":"2024-09-12T17:06:39.826819+0000","last_active":"2024-09-12T17:07:42.550496+0000","last_peered":"2024-09-12T17:07:42.550496+0000","last_clean":"2024-09-12T17:07:42.550496+0000","last_became_active":"2024-09-12T17:06:39.826592+0000","last_became_peered":"2024-09-12T17:06:39.826592+0000","last_unstale":"2024-09-12T17:07:42.550496+0000","last_undegraded":"2024-09-12T17:07:42.550496+0000","last_fullsized":"2024-09-12T17:07:42.550496+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:08.789104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551267+0000","last_change":"2024-09-12T17:05:49.544092+0000","last_active":"2024-09-12T17:07:42.551267+0000","last_peered":"2024-09-12T17:07:42.551267+0000","last_clean":"2024-09-12T17:07:42.551267+0000","last_became_active":"2024-09-12T17:05:49.543307+0000","last_became_peered":"2024-09-12T17:05:49.543307+0000","last_unstale":"2024-09-12T17:07:42.551267+0000","last_undegraded":"2024-09-12T17:07:42.551267+0000","last_fullsized":"2024-09-12T17:07:42.551267+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:36.286410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"74'7","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548276+0000","last_change":"2024-09-12T17:05:47.526678+0000","last_active":"2024-09-12T17:07:42.548276+0000","last_peered":"2024-09-12T17:07:42.548276+0000","last_clean":"2024-09-12T17:07:42.548276+0000","last_became_active":"2024-09-12T17:05:47.525696+0000","last_became_peered":"2024-09-12T17:05:47.525696+0000","last_unstale":"2024-09-12T17:07:42.548276+0000","last_undegraded":"2024-09-12T17:07:42.548276+0000","last_fullsized":"2024-09-12T17:07:42.548276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:59.012258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":10243,"num_write":23,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266723+0000","last_change":"2024-09-12T17:05:51.543404+0000","last_active":"2024-09-12T17:07:42.266723+0000","last_peered":"2024-09-12T17:07:42.266723+0000","last_clean":"2024-09-12T17:07:42.266723+0000","last_became_active":"2024-09-12T17:05:51.542737+0000","last_became_peered":"2024-09-12T17:05:51.542737+0000","last_unstale":"2024-09-12T17:07:42.266723+0000","last_undegraded":"2024-09-12T17:07:42.266723+0000","last_fullsized":"2024-09-12T17:07:42.266723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:30.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"68'12","reported_seq":143,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549941+0000","last_change":"2024-09-12T17:06:08.660885+0000","last_active":"2024-09-12T17:07:42.549941+0000","last_peered":"2024-09-12T17:07:42.549941+0000","last_clean":"2024-09-12T17:07:42.549941+0000","last_became_active":"2024-09-12T17:06:08.644254+0000","last_became_peered":"2024-09-12T17:06:08.644254+0000","last_unstale":"2024-09-12T17:07:42.549941+0000","last_undegraded":"2024-09-12T17:07:42.549941+0000","last_fullsized":"2024-09-12T17:07:42.549941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:08:19.001428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438117+0000","last_change":"2024-09-12T17:05:55.565575+0000","last_active":"2024-09-12T17:07:42.438117+0000","last_peered":"2024-09-12T17:07:42.438117+0000","last_clean":"2024-09-12T17:07:42.438117+0000","last_became_active":"2024-09-12T17:05:55.564802+0000","last_became_peered":"2024-09-12T17:05:55.564802+0000","last_unstale":"2024-09-12T17:07:42.438117+0000","last_undegraded":"2024-09-12T17:07:42.438117+0000","last_fullsized":"2024-09-12T17:07:42.438117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548180+0000","last_change":"2024-09-12T17:05:57.592294+0000","last_active":"2024-09-12T17:07:42.548180+0000","last_peered":"2024-09-12T17:07:42.548180+0000","last_clean":"2024-09-12T17:07:42.548180+0000","last_became_active":"2024-09-12T17:05:57.591389+0000","last_became_peered":"2024-09-12T17:05:57.591389+0000","last_unstale":"2024-09-12T17:07:42.548180+0000","last_undegraded":"2024-09-12T17:07:42.548180+0000","last_fullsized":"2024-09-12T17:07:42.548180+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'10","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.553626+0000","last_change":"2024-09-12T17:05:49.553177+0000","last_active":"2024-09-12T17:07:42.553626+0000","last_peered":"2024-09-12T17:07:42.553626+0000","last_clean":"2024-09-12T17:07:42.553626+0000","last_became_active":"2024-09-12T17:05:49.552270+0000","last_became_peered":"2024-09-12T17:05:49.552270+0000","last_unstale":"2024-09-12T17:07:42.553626+0000","last_undegraded":"2024-09-12T17:07:42.553626+0000","last_fullsized":"2024-09-12T17:07:42.553626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:34.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"74'8","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552444+0000","last_change":"2024-09-12T17:05:47.543064+0000","last_active":"2024-09-12T17:07:42.552444+0000","last_peered":"2024-09-12T17:07:42.552444+0000","last_clean":"2024-09-12T17:07:42.552444+0000","last_became_active":"2024-09-12T17:05:47.542362+0000","last_became_peered":"2024-09-12T17:05:47.542362+0000","last_unstale":"2024-09-12T17:07:42.552444+0000","last_undegraded":"2024-09-12T17:07:42.552444+0000","last_fullsized":"2024-09-12T17:07:42.552444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551565+0000","last_change":"2024-09-12T17:06:39.836405+0000","last_active":"2024-09-12T17:07:42.551565+0000","last_peered":"2024-09-12T17:07:42.551565+0000","last_clean":"2024-09-12T17:07:42.551565+0000","last_became_active":"2024-09-12T17:06:39.825263+0000","last_became_peered":"2024-09-12T17:06:39.825263+0000","last_unstale":"2024-09-12T17:07:42.551565+0000","last_undegraded":"2024-09-12T17:07:42.551565+0000","last_fullsized":"2024-09-12T17:07:42.551565+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:36.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"68'16","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266630+0000","last_change":"2024-09-12T17:05:53.554531+0000","last_active":"2024-09-12T17:07:42.266630+0000","last_peered":"2024-09-12T17:07:42.266630+0000","last_clean":"2024-09-12T17:07:42.266630+0000","last_became_active":"2024-09-12T17:05:53.554131+0000","last_became_peered":"2024-09-12T17:05:53.554131+0000","last_unstale":"2024-09-12T17:07:42.266630+0000","last_undegraded":"2024-09-12T17:07:42.266630+0000","last_fullsized":"2024-09-12T17:07:42.266630+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"68'11","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267023+0000","last_change":"2024-09-12T17:05:55.559204+0000","last_active":"2024-09-12T17:07:42.267023+0000","last_peered":"2024-09-12T17:07:42.267023+0000","last_clean":"2024-09-12T17:07:42.267023+0000","last_became_active":"2024-09-12T17:05:55.556488+0000","last_became_peered":"2024-09-12T17:05:55.556488+0000","last_unstale":"2024-09-12T17:07:42.267023+0000","last_undegraded":"2024-09-12T17:07:42.267023+0000","last_fullsized":"2024-09-12T17:07:42.267023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:15.167640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436041+0000","last_change":"2024-09-12T17:06:39.827108+0000","last_active":"2024-09-12T17:07:42.436041+0000","last_peered":"2024-09-12T17:07:42.436041+0000","last_clean":"2024-09-12T17:07:42.436041+0000","last_became_active":"2024-09-12T17:06:39.826743+0000","last_became_peered":"2024-09-12T17:06:39.826743+0000","last_unstale":"2024-09-12T17:07:42.436041+0000","last_undegraded":"2024-09-12T17:07:42.436041+0000","last_fullsized":"2024-09-12T17:07:42.436041+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:01.886898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"68'6","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550965+0000","last_change":"2024-09-12T17:05:49.562360+0000","last_active":"2024-09-12T17:07:42.550965+0000","last_peered":"2024-09-12T17:07:42.550965+0000","last_clean":"2024-09-12T17:07:42.550965+0000","last_became_active":"2024-09-12T17:05:49.561200+0000","last_became_peered":"2024-09-12T17:05:49.561200+0000","last_unstale":"2024-09-12T17:07:42.550965+0000","last_undegraded":"2024-09-12T17:07:42.550965+0000","last_fullsized":"2024-09-12T17:07:42.550965+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.915600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"72'7","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549400+0000","last_change":"2024-09-12T17:05:47.542018+0000","last_active":"2024-09-12T17:07:42.549400+0000","last_peered":"2024-09-12T17:07:42.549400+0000","last_clean":"2024-09-12T17:07:42.549400+0000","last_became_active":"2024-09-12T17:05:47.540484+0000","last_became_peered":"2024-09-12T17:05:47.540484+0000","last_unstale":"2024-09-12T17:07:42.549400+0000","last_undegraded":"2024-09-12T17:07:42.549400+0000","last_fullsized":"2024-09-12T17:07:42.549400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:13.571666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":12291,"num_write":31,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266766+0000","last_change":"2024-09-12T17:05:51.556083+0000","last_active":"2024-09-12T17:07:42.266766+0000","last_peered":"2024-09-12T17:07:42.266766+0000","last_clean":"2024-09-12T17:07:42.266766+0000","last_became_active":"2024-09-12T17:05:51.554176+0000","last_became_peered":"2024-09-12T17:05:51.554176+0000","last_unstale":"2024-09-12T17:07:42.266766+0000","last_undegraded":"2024-09-12T17:07:42.266766+0000","last_fullsized":"2024-09-12T17:07:42.266766+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:02.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":120,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549991+0000","last_change":"2024-09-12T17:05:53.553304+0000","last_active":"2024-09-12T17:07:42.549991+0000","last_peered":"2024-09-12T17:07:42.549991+0000","last_clean":"2024-09-12T17:07:42.549991+0000","last_became_active":"2024-09-12T17:05:53.552545+0000","last_became_peered":"2024-09-12T17:05:53.552545+0000","last_unstale":"2024-09-12T17:07:42.549991+0000","last_undegraded":"2024-09-12T17:07:42.549991+0000","last_fullsized":"2024-09-12T17:07:42.549991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"68'12","reported_seq":151,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552126+0000","last_change":"2024-09-12T17:06:39.850569+0000","last_active":"2024-09-12T17:07:42.552126+0000","last_peered":"2024-09-12T17:07:42.552126+0000","last_clean":"2024-09-12T17:07:42.552126+0000","last_became_active":"2024-09-12T17:06:39.833047+0000","last_became_peered":"2024-09-12T17:06:39.833047+0000","last_unstale":"2024-09-12T17:07:42.552126+0000","last_undegraded":"2024-09-12T17:07:42.552126+0000","last_fullsized":"2024-09-12T17:07:42.552126+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:57.371602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550308+0000","last_change":"2024-09-12T17:05:57.597870+0000","last_active":"2024-09-12T17:07:42.550308+0000","last_peered":"2024-09-12T17:07:42.550308+0000","last_clean":"2024-09-12T17:07:42.550308+0000","last_became_active":"2024-09-12T17:05:57.597076+0000","last_became_peered":"2024-09-12T17:05:57.597076+0000","last_unstale":"2024-09-12T17:07:42.550308+0000","last_undegraded":"2024-09-12T17:07:42.550308+0000","last_fullsized":"2024-09-12T17:07:42.550308+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.648974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"68'6","reported_seq":73,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551123+0000","last_change":"2024-09-12T17:06:39.839387+0000","last_active":"2024-09-12T17:07:42.551123+0000","last_peered":"2024-09-12T17:07:42.551123+0000","last_clean":"2024-09-12T17:07:42.551123+0000","last_became_active":"2024-09-12T17:06:39.839045+0000","last_became_peered":"2024-09-12T17:06:39.839045+0000","last_unstale":"2024-09-12T17:07:42.551123+0000","last_undegraded":"2024-09-12T17:07:42.551123+0000","last_fullsized":"2024-09-12T17:07:42.551123+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:26:44.982821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"75'8","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.547553+0000","last_change":"2024-09-12T17:06:39.830841+0000","last_active":"2024-09-12T17:07:42.547553+0000","last_peered":"2024-09-12T17:07:42.547553+0000","last_clean":"2024-09-12T17:07:42.547553+0000","last_became_active":"2024-09-12T17:06:39.830523+0000","last_became_peered":"2024-09-12T17:06:39.830523+0000","last_unstale":"2024-09-12T17:07:42.547553+0000","last_undegraded":"2024-09-12T17:07:42.547553+0000","last_fullsized":"2024-09-12T17:07:42.547553+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:48:06.748336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550509+0000","last_change":"2024-09-12T17:05:51.540047+0000","last_active":"2024-09-12T17:07:42.550509+0000","last_peered":"2024-09-12T17:07:42.550509+0000","last_clean":"2024-09-12T17:07:42.550509+0000","last_became_active":"2024-09-12T17:05:51.539302+0000","last_became_peered":"2024-09-12T17:05:51.539302+0000","last_unstale":"2024-09-12T17:07:42.550509+0000","last_undegraded":"2024-09-12T17:07:42.550509+0000","last_fullsized":"2024-09-12T17:07:42.550509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:21.253801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"68'20","reported_seq":159,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265827+0000","last_change":"2024-09-12T17:06:08.682493+0000","last_active":"2024-09-12T17:07:42.265827+0000","last_peered":"2024-09-12T17:07:42.265827+0000","last_clean":"2024-09-12T17:07:42.265827+0000","last_became_active":"2024-09-12T17:06:08.630893+0000","last_became_peered":"2024-09-12T17:06:08.630893+0000","last_unstale":"2024-09-12T17:07:42.265827+0000","last_undegraded":"2024-09-12T17:07:42.265827+0000","last_fullsized":"2024-09-12T17:07:42.265827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:48:29.374168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15301,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551036+0000","last_change":"2024-09-12T17:05:55.566749+0000","last_active":"2024-09-12T17:07:42.551036+0000","last_peered":"2024-09-12T17:07:42.551036+0000","last_clean":"2024-09-12T17:07:42.551036+0000","last_became_active":"2024-09-12T17:05:55.565979+0000","last_became_peered":"2024-09-12T17:05:55.565979+0000","last_unstale":"2024-09-12T17:07:42.551036+0000","last_undegraded":"2024-09-12T17:07:42.551036+0000","last_fullsized":"2024-09-12T17:07:42.551036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265704+0000","last_change":"2024-09-12T17:06:08.635235+0000","last_active":"2024-09-12T17:07:42.265704+0000","last_peered":"2024-09-12T17:07:42.265704+0000","last_clean":"2024-09-12T17:07:42.265704+0000","last_became_active":"2024-09-12T17:06:08.633107+0000","last_became_peered":"2024-09-12T17:06:08.633107+0000","last_unstale":"2024-09-12T17:07:42.265704+0000","last_undegraded":"2024-09-12T17:07:42.265704+0000","last_fullsized":"2024-09-12T17:07:42.265704+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552416+0000","last_change":"2024-09-12T17:05:49.539487+0000","last_active":"2024-09-12T17:07:42.552416+0000","last_peered":"2024-09-12T17:07:42.552416+0000","last_clean":"2024-09-12T17:07:42.552416+0000","last_became_active":"2024-09-12T17:05:49.538713+0000","last_became_peered":"2024-09-12T17:05:49.538713+0000","last_unstale":"2024-09-12T17:07:42.552416+0000","last_undegraded":"2024-09-12T17:07:42.552416+0000","last_fullsized":"2024-09-12T17:07:42.552416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.731614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":223,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397767+0000","last_change":"2024-09-12T17:05:35.688483+0000","last_active":"2024-09-12T17:07:42.397767+0000","last_peered":"2024-09-12T17:07:42.397767+0000","last_clean":"2024-09-12T17:07:42.397767+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:07:42.397767+0000","last_undegraded":"2024-09-12T17:07:42.397767+0000","last_fullsized":"2024-09-12T17:07:42.397767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_clean_scrub_stamp":"2024-09-12T17:05:34.151079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266307+0000","last_change":"2024-09-12T17:05:42.225793+0000","last_active":"2024-09-12T17:07:42.266307+0000","last_peered":"2024-09-12T17:07:42.266307+0000","last_clean":"2024-09-12T17:07:42.266307+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:07:42.266307+0000","last_undegraded":"2024-09-12T17:07:42.266307+0000","last_fullsized":"2024-09-12T17:07:42.266307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:54.880257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"73'10","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549019+0000","last_change":"2024-09-12T17:05:47.526243+0000","last_active":"2024-09-12T17:07:42.549019+0000","last_peered":"2024-09-12T17:07:42.549019+0000","last_clean":"2024-09-12T17:07:42.549019+0000","last_became_active":"2024-09-12T17:05:47.525694+0000","last_became_peered":"2024-09-12T17:05:47.525694+0000","last_unstale":"2024-09-12T17:07:42.549019+0000","last_undegraded":"2024-09-12T17:07:42.549019+0000","last_fullsized":"2024-09-12T17:07:42.549019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":8,"num_read_kb":24577,"num_write":34,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398441+0000","last_change":"2024-09-12T17:05:51.548356+0000","last_active":"2024-09-12T17:07:42.398441+0000","last_peered":"2024-09-12T17:07:42.398441+0000","last_clean":"2024-09-12T17:07:42.398441+0000","last_became_active":"2024-09-12T17:05:51.547503+0000","last_became_peered":"2024-09-12T17:05:51.547503+0000","last_unstale":"2024-09-12T17:07:42.398441+0000","last_undegraded":"2024-09-12T17:07:42.398441+0000","last_fullsized":"2024-09-12T17:07:42.398441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:47.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"68'16","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266930+0000","last_change":"2024-09-12T17:05:53.546057+0000","last_active":"2024-09-12T17:07:42.266930+0000","last_peered":"2024-09-12T17:07:42.266930+0000","last_clean":"2024-09-12T17:07:42.266930+0000","last_became_active":"2024-09-12T17:05:53.545266+0000","last_became_peered":"2024-09-12T17:05:53.545266+0000","last_unstale":"2024-09-12T17:07:42.266930+0000","last_undegraded":"2024-09-12T17:07:42.266930+0000","last_fullsized":"2024-09-12T17:07:42.266930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438098+0000","last_change":"2024-09-12T17:05:55.562246+0000","last_active":"2024-09-12T17:07:42.438098+0000","last_peered":"2024-09-12T17:07:42.438098+0000","last_clean":"2024-09-12T17:07:42.438098+0000","last_became_active":"2024-09-12T17:05:55.561410+0000","last_became_peered":"2024-09-12T17:05:55.561410+0000","last_unstale":"2024-09-12T17:07:42.438098+0000","last_undegraded":"2024-09-12T17:07:42.438098+0000","last_fullsized":"2024-09-12T17:07:42.438098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.373235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"68'2","reported_seq":99,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548833+0000","last_change":"2024-09-12T17:05:57.593095+0000","last_active":"2024-09-12T17:07:42.548833+0000","last_peered":"2024-09-12T17:07:42.548833+0000","last_clean":"2024-09-12T17:07:42.548833+0000","last_became_active":"2024-09-12T17:05:57.592287+0000","last_became_peered":"2024-09-12T17:05:57.592287+0000","last_unstale":"2024-09-12T17:07:42.548833+0000","last_undegraded":"2024-09-12T17:07:42.548833+0000","last_fullsized":"2024-09-12T17:07:42.548833+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:52.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.439110+0000","last_change":"2024-09-12T17:06:39.821819+0000","last_active":"2024-09-12T17:07:42.439110+0000","last_peered":"2024-09-12T17:07:42.439110+0000","last_clean":"2024-09-12T17:07:42.439110+0000","last_became_active":"2024-09-12T17:06:39.821483+0000","last_became_peered":"2024-09-12T17:06:39.821483+0000","last_unstale":"2024-09-12T17:07:42.439110+0000","last_undegraded":"2024-09-12T17:07:42.439110+0000","last_fullsized":"2024-09-12T17:07:42.439110+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.063250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397377+0000","last_change":"2024-09-12T17:06:08.624247+0000","last_active":"2024-09-12T17:07:42.397377+0000","last_peered":"2024-09-12T17:07:42.397377+0000","last_clean":"2024-09-12T17:07:42.397377+0000","last_became_active":"2024-09-12T17:06:08.621563+0000","last_became_peered":"2024-09-12T17:06:08.621563+0000","last_unstale":"2024-09-12T17:07:42.397377+0000","last_undegraded":"2024-09-12T17:07:42.397377+0000","last_fullsized":"2024-09-12T17:07:42.397377+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:49:50.183253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'12","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436689+0000","last_change":"2024-09-12T17:05:47.544269+0000","last_active":"2024-09-12T17:07:42.436689+0000","last_peered":"2024-09-12T17:07:42.436689+0000","last_clean":"2024-09-12T17:07:42.436689+0000","last_became_active":"2024-09-12T17:05:47.543531+0000","last_became_peered":"2024-09-12T17:05:47.543531+0000","last_unstale":"2024-09-12T17:07:42.436689+0000","last_undegraded":"2024-09-12T17:07:42.436689+0000","last_fullsized":"2024-09-12T17:07:42.436689+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:55.688363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":36,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":114,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267017+0000","last_change":"2024-09-12T17:06:39.826949+0000","last_active":"2024-09-12T17:07:42.267017+0000","last_peered":"2024-09-12T17:07:42.267017+0000","last_clean":"2024-09-12T17:07:42.267017+0000","last_became_active":"2024-09-12T17:06:39.826492+0000","last_became_peered":"2024-09-12T17:06:39.826492+0000","last_unstale":"2024-09-12T17:07:42.267017+0000","last_undegraded":"2024-09-12T17:07:42.267017+0000","last_fullsized":"2024-09-12T17:07:42.267017+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:23.591675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"68'33","reported_seq":206,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265982+0000","last_change":"2024-09-12T17:06:08.665804+0000","last_active":"2024-09-12T17:07:42.265982+0000","last_peered":"2024-09-12T17:07:42.265982+0000","last_clean":"2024-09-12T17:07:42.265982+0000","last_became_active":"2024-09-12T17:06:08.623506+0000","last_became_peered":"2024-09-12T17:06:08.623506+0000","last_unstale":"2024-09-12T17:07:42.265982+0000","last_undegraded":"2024-09-12T17:07:42.265982+0000","last_fullsized":"2024-09-12T17:07:42.265982+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:51.575992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":50,"num_read_kb":35,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396717+0000","last_change":"2024-09-12T17:05:55.556362+0000","last_active":"2024-09-12T17:07:42.396717+0000","last_peered":"2024-09-12T17:07:42.396717+0000","last_clean":"2024-09-12T17:07:42.396717+0000","last_became_active":"2024-09-12T17:05:55.555625+0000","last_became_peered":"2024-09-12T17:05:55.555625+0000","last_unstale":"2024-09-12T17:07:42.396717+0000","last_undegraded":"2024-09-12T17:07:42.396717+0000","last_fullsized":"2024-09-12T17:07:42.396717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"68'5","reported_seq":70,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266047+0000","last_change":"2024-09-12T17:06:39.828783+0000","last_active":"2024-09-12T17:07:42.266047+0000","last_peered":"2024-09-12T17:07:42.266047+0000","last_clean":"2024-09-12T17:07:42.266047+0000","last_became_active":"2024-09-12T17:06:39.828474+0000","last_became_peered":"2024-09-12T17:06:39.828474+0000","last_unstale":"2024-09-12T17:07:42.266047+0000","last_undegraded":"2024-09-12T17:07:42.266047+0000","last_fullsized":"2024-09-12T17:07:42.266047+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:20:02.940971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":434,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266851+0000","last_change":"2024-09-12T17:06:08.631456+0000","last_active":"2024-09-12T17:07:42.266851+0000","last_peered":"2024-09-12T17:07:42.266851+0000","last_clean":"2024-09-12T17:07:42.266851+0000","last_became_active":"2024-09-12T17:06:08.630632+0000","last_became_peered":"2024-09-12T17:06:08.630632+0000","last_unstale":"2024-09-12T17:07:42.266851+0000","last_undegraded":"2024-09-12T17:07:42.266851+0000","last_fullsized":"2024-09-12T17:07:42.266851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:28:55.277877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265941+0000","last_change":"2024-09-12T17:05:42.677413+0000","last_active":"2024-09-12T17:07:42.265941+0000","last_peered":"2024-09-12T17:07:42.265941+0000","last_clean":"2024-09-12T17:07:42.265941+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:07:42.265941+0000","last_undegraded":"2024-09-12T17:07:42.265941+0000","last_fullsized":"2024-09-12T17:07:42.265941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.836885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'10","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266175+0000","last_change":"2024-09-12T17:06:39.822864+0000","last_active":"2024-09-12T17:07:42.266175+0000","last_peered":"2024-09-12T17:07:42.266175+0000","last_clean":"2024-09-12T17:07:42.266175+0000","last_became_active":"2024-09-12T17:06:39.822575+0000","last_became_peered":"2024-09-12T17:06:39.822575+0000","last_unstale":"2024-09-12T17:07:42.266175+0000","last_undegraded":"2024-09-12T17:07:42.266175+0000","last_fullsized":"2024-09-12T17:07:42.266175+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:44:21.169064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":26,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":110,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267145+0000","last_change":"2024-09-12T17:05:51.557262+0000","last_active":"2024-09-12T17:07:42.267145+0000","last_peered":"2024-09-12T17:07:42.267145+0000","last_clean":"2024-09-12T17:07:42.267145+0000","last_became_active":"2024-09-12T17:05:51.556959+0000","last_became_peered":"2024-09-12T17:05:51.556959+0000","last_unstale":"2024-09-12T17:07:42.267145+0000","last_undegraded":"2024-09-12T17:07:42.267145+0000","last_fullsized":"2024-09-12T17:07:42.267145+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.963181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":147,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397662+0000","last_change":"2024-09-12T17:05:53.555384+0000","last_active":"2024-09-12T17:07:42.397662+0000","last_peered":"2024-09-12T17:07:42.397662+0000","last_clean":"2024-09-12T17:07:42.397662+0000","last_became_active":"2024-09-12T17:05:53.554063+0000","last_became_peered":"2024-09-12T17:05:53.554063+0000","last_unstale":"2024-09-12T17:07:42.397662+0000","last_undegraded":"2024-09-12T17:07:42.397662+0000","last_fullsized":"2024-09-12T17:07:42.397662+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436721+0000","last_change":"2024-09-12T17:05:55.547595+0000","last_active":"2024-09-12T17:07:42.436721+0000","last_peered":"2024-09-12T17:07:42.436721+0000","last_clean":"2024-09-12T17:07:42.436721+0000","last_became_active":"2024-09-12T17:05:55.546700+0000","last_became_peered":"2024-09-12T17:05:55.546700+0000","last_unstale":"2024-09-12T17:07:42.436721+0000","last_undegraded":"2024-09-12T17:07:42.436721+0000","last_fullsized":"2024-09-12T17:07:42.436721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548847+0000","last_change":"2024-09-12T17:05:57.587955+0000","last_active":"2024-09-12T17:07:42.548847+0000","last_peered":"2024-09-12T17:07:42.548847+0000","last_clean":"2024-09-12T17:07:42.548847+0000","last_became_active":"2024-09-12T17:05:57.587199+0000","last_became_peered":"2024-09-12T17:05:57.587199+0000","last_unstale":"2024-09-12T17:07:42.548847+0000","last_undegraded":"2024-09-12T17:07:42.548847+0000","last_fullsized":"2024-09-12T17:07:42.548847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.422656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266583+0000","last_change":"2024-09-12T17:06:08.605923+0000","last_active":"2024-09-12T17:07:42.266583+0000","last_peered":"2024-09-12T17:07:42.266583+0000","last_clean":"2024-09-12T17:07:42.266583+0000","last_became_active":"2024-09-12T17:06:08.605402+0000","last_became_peered":"2024-09-12T17:06:08.605402+0000","last_unstale":"2024-09-12T17:07:42.266583+0000","last_undegraded":"2024-09-12T17:07:42.266583+0000","last_fullsized":"2024-09-12T17:07:42.266583+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":143,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265669+0000","last_change":"2024-09-12T17:06:39.837990+0000","last_active":"2024-09-12T17:07:42.265669+0000","last_peered":"2024-09-12T17:07:42.265669+0000","last_clean":"2024-09-12T17:07:42.265669+0000","last_became_active":"2024-09-12T17:06:39.826297+0000","last_became_peered":"2024-09-12T17:06:39.826297+0000","last_unstale":"2024-09-12T17:07:42.265669+0000","last_undegraded":"2024-09-12T17:07:42.265669+0000","last_fullsized":"2024-09-12T17:07:42.265669+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:00.390165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'10","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550340+0000","last_change":"2024-09-12T17:05:47.546543+0000","last_active":"2024-09-12T17:07:42.550340+0000","last_peered":"2024-09-12T17:07:42.550340+0000","last_clean":"2024-09-12T17:07:42.550340+0000","last_became_active":"2024-09-12T17:05:47.545554+0000","last_became_peered":"2024-09-12T17:05:47.545554+0000","last_unstale":"2024-09-12T17:07:42.550340+0000","last_undegraded":"2024-09-12T17:07:42.550340+0000","last_fullsized":"2024-09-12T17:07:42.550340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:07.148131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":13,"num_read_kb":28675,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":115,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437583+0000","last_change":"2024-09-12T17:06:39.843517+0000","last_active":"2024-09-12T17:07:42.437583+0000","last_peered":"2024-09-12T17:07:42.437583+0000","last_clean":"2024-09-12T17:07:42.437583+0000","last_became_active":"2024-09-12T17:06:39.842597+0000","last_became_peered":"2024-09-12T17:06:39.842597+0000","last_unstale":"2024-09-12T17:07:42.437583+0000","last_undegraded":"2024-09-12T17:07:42.437583+0000","last_fullsized":"2024-09-12T17:07:42.437583+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:37.568258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":123,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550282+0000","last_change":"2024-09-12T17:05:53.551499+0000","last_active":"2024-09-12T17:07:42.550282+0000","last_peered":"2024-09-12T17:07:42.550282+0000","last_clean":"2024-09-12T17:07:42.550282+0000","last_became_active":"2024-09-12T17:05:53.550857+0000","last_became_peered":"2024-09-12T17:05:53.550857+0000","last_unstale":"2024-09-12T17:07:42.550282+0000","last_undegraded":"2024-09-12T17:07:42.550282+0000","last_fullsized":"2024-09-12T17:07:42.550282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551890+0000","last_change":"2024-09-12T17:05:55.571619+0000","last_active":"2024-09-12T17:07:42.551890+0000","last_peered":"2024-09-12T17:07:42.551890+0000","last_clean":"2024-09-12T17:07:42.551890+0000","last_became_active":"2024-09-12T17:05:55.570991+0000","last_became_peered":"2024-09-12T17:05:55.570991+0000","last_unstale":"2024-09-12T17:07:42.551890+0000","last_undegraded":"2024-09-12T17:07:42.551890+0000","last_fullsized":"2024-09-12T17:07:42.551890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:02.401831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"68'1","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264482+0000","last_change":"2024-09-12T17:05:57.590482+0000","last_active":"2024-09-12T17:07:42.264482+0000","last_peered":"2024-09-12T17:07:42.264482+0000","last_clean":"2024-09-12T17:07:42.264482+0000","last_became_active":"2024-09-12T17:05:57.589542+0000","last_became_peered":"2024-09-12T17:05:57.589542+0000","last_unstale":"2024-09-12T17:07:42.264482+0000","last_undegraded":"2024-09-12T17:07:42.264482+0000","last_fullsized":"2024-09-12T17:07:42.264482+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:20.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":422,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265288+0000","last_change":"2024-09-12T17:06:08.636568+0000","last_active":"2024-09-12T17:07:42.265288+0000","last_peered":"2024-09-12T17:07:42.265288+0000","last_clean":"2024-09-12T17:07:42.265288+0000","last_became_active":"2024-09-12T17:06:08.635747+0000","last_became_peered":"2024-09-12T17:06:08.635747+0000","last_unstale":"2024-09-12T17:07:42.265288+0000","last_undegraded":"2024-09-12T17:07:42.265288+0000","last_fullsized":"2024-09-12T17:07:42.265288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:16.750038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"74'15","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266575+0000","last_change":"2024-09-12T17:05:47.525858+0000","last_active":"2024-09-12T17:07:42.266575+0000","last_peered":"2024-09-12T17:07:42.266575+0000","last_clean":"2024-09-12T17:07:42.266575+0000","last_became_active":"2024-09-12T17:05:47.525258+0000","last_became_peered":"2024-09-12T17:05:47.525258+0000","last_unstale":"2024-09-12T17:07:42.266575+0000","last_undegraded":"2024-09-12T17:07:42.266575+0000","last_fullsized":"2024-09-12T17:07:42.266575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60817408,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":39,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437048+0000","last_change":"2024-09-12T17:06:39.832937+0000","last_active":"2024-09-12T17:07:42.437048+0000","last_peered":"2024-09-12T17:07:42.437048+0000","last_clean":"2024-09-12T17:07:42.437048+0000","last_became_active":"2024-09-12T17:06:39.832667+0000","last_became_peered":"2024-09-12T17:06:39.832667+0000","last_unstale":"2024-09-12T17:07:42.437048+0000","last_undegraded":"2024-09-12T17:07:42.437048+0000","last_fullsized":"2024-09-12T17:07:42.437048+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:00.390165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437311+0000","last_change":"2024-09-12T17:05:51.544848+0000","last_active":"2024-09-12T17:07:42.437311+0000","last_peered":"2024-09-12T17:07:42.437311+0000","last_clean":"2024-09-12T17:07:42.437311+0000","last_became_active":"2024-09-12T17:05:51.544078+0000","last_became_peered":"2024-09-12T17:05:51.544078+0000","last_unstale":"2024-09-12T17:07:42.437311+0000","last_undegraded":"2024-09-12T17:07:42.437311+0000","last_fullsized":"2024-09-12T17:07:42.437311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"68'20","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436264+0000","last_change":"2024-09-12T17:05:53.540181+0000","last_active":"2024-09-12T17:07:42.436264+0000","last_peered":"2024-09-12T17:07:42.436264+0000","last_clean":"2024-09-12T17:07:42.436264+0000","last_became_active":"2024-09-12T17:05:53.539372+0000","last_became_peered":"2024-09-12T17:05:53.539372+0000","last_unstale":"2024-09-12T17:07:42.436264+0000","last_undegraded":"2024-09-12T17:07:42.436264+0000","last_fullsized":"2024-09-12T17:07:42.436264+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:58.931466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550666+0000","last_change":"2024-09-12T17:05:55.554060+0000","last_active":"2024-09-12T17:07:42.550666+0000","last_peered":"2024-09-12T17:07:42.550666+0000","last_clean":"2024-09-12T17:07:42.550666+0000","last_became_active":"2024-09-12T17:05:55.553263+0000","last_became_peered":"2024-09-12T17:05:55.553263+0000","last_unstale":"2024-09-12T17:07:42.550666+0000","last_undegraded":"2024-09-12T17:07:42.550666+0000","last_fullsized":"2024-09-12T17:07:42.550666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:44.303469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437559+0000","last_change":"2024-09-12T17:05:58.121180+0000","last_active":"2024-09-12T17:07:42.437559+0000","last_peered":"2024-09-12T17:07:42.437559+0000","last_clean":"2024-09-12T17:07:42.437559+0000","last_became_active":"2024-09-12T17:05:58.119755+0000","last_became_peered":"2024-09-12T17:05:58.119755+0000","last_unstale":"2024-09-12T17:07:42.437559+0000","last_undegraded":"2024-09-12T17:07:42.437559+0000","last_fullsized":"2024-09-12T17:07:42.437559+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437922+0000","last_change":"2024-09-12T17:05:49.550213+0000","last_active":"2024-09-12T17:07:42.437922+0000","last_peered":"2024-09-12T17:07:42.437922+0000","last_clean":"2024-09-12T17:07:42.437922+0000","last_became_active":"2024-09-12T17:05:49.549583+0000","last_became_peered":"2024-09-12T17:05:49.549583+0000","last_unstale":"2024-09-12T17:07:42.437922+0000","last_undegraded":"2024-09-12T17:07:42.437922+0000","last_fullsized":"2024-09-12T17:07:42.437922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:05.085326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"75'10","reported_seq":77,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266984+0000","last_change":"2024-09-12T17:06:39.829536+0000","last_active":"2024-09-12T17:07:42.266984+0000","last_peered":"2024-09-12T17:07:42.266984+0000","last_clean":"2024-09-12T17:07:42.266984+0000","last_became_active":"2024-09-12T17:06:39.828971+0000","last_became_peered":"2024-09-12T17:06:39.828971+0000","last_unstale":"2024-09-12T17:07:42.266984+0000","last_undegraded":"2024-09-12T17:07:42.266984+0000","last_fullsized":"2024-09-12T17:07:42.266984+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:06.423987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398444+0000","last_change":"2024-09-12T17:05:42.218804+0000","last_active":"2024-09-12T17:07:42.398444+0000","last_peered":"2024-09-12T17:07:42.398444+0000","last_clean":"2024-09-12T17:07:42.398444+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:07:42.398444+0000","last_undegraded":"2024-09-12T17:07:42.398444+0000","last_fullsized":"2024-09-12T17:07:42.398444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:48.189931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550160+0000","last_change":"2024-09-12T17:05:51.545963+0000","last_active":"2024-09-12T17:07:42.550160+0000","last_peered":"2024-09-12T17:07:42.550160+0000","last_clean":"2024-09-12T17:07:42.550160+0000","last_became_active":"2024-09-12T17:05:51.545225+0000","last_became_peered":"2024-09-12T17:05:51.545225+0000","last_unstale":"2024-09-12T17:07:42.550160+0000","last_undegraded":"2024-09-12T17:07:42.550160+0000","last_fullsized":"2024-09-12T17:07:42.550160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:40.407563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":120,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549237+0000","last_change":"2024-09-12T17:06:39.848324+0000","last_active":"2024-09-12T17:07:42.549237+0000","last_peered":"2024-09-12T17:07:42.549237+0000","last_clean":"2024-09-12T17:07:42.549237+0000","last_became_active":"2024-09-12T17:06:39.832103+0000","last_became_peered":"2024-09-12T17:06:39.832103+0000","last_unstale":"2024-09-12T17:07:42.549237+0000","last_undegraded":"2024-09-12T17:07:42.549237+0000","last_fullsized":"2024-09-12T17:07:42.549237+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:11.548413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"68'12","reported_seq":144,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264909+0000","last_change":"2024-09-12T17:06:08.666682+0000","last_active":"2024-09-12T17:07:42.264909+0000","last_peered":"2024-09-12T17:07:42.264909+0000","last_clean":"2024-09-12T17:07:42.264909+0000","last_became_active":"2024-09-12T17:06:08.623453+0000","last_became_peered":"2024-09-12T17:06:08.623453+0000","last_unstale":"2024-09-12T17:07:42.264909+0000","last_undegraded":"2024-09-12T17:07:42.264909+0000","last_fullsized":"2024-09-12T17:07:42.264909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:21:58.215239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551111+0000","last_change":"2024-09-12T17:05:58.118437+0000","last_active":"2024-09-12T17:07:42.551111+0000","last_peered":"2024-09-12T17:07:42.551111+0000","last_clean":"2024-09-12T17:07:42.551111+0000","last_became_active":"2024-09-12T17:05:58.117710+0000","last_became_peered":"2024-09-12T17:05:58.117710+0000","last_unstale":"2024-09-12T17:07:42.551111+0000","last_undegraded":"2024-09-12T17:07:42.551111+0000","last_fullsized":"2024-09-12T17:07:42.551111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:00.239807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":75,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265096+0000","last_change":"2024-09-12T17:06:27.817661+0000","last_active":"2024-09-12T17:07:42.265096+0000","last_peered":"2024-09-12T17:07:42.265096+0000","last_clean":"2024-09-12T17:07:42.265096+0000","last_became_active":"2024-09-12T17:06:27.817451+0000","last_became_peered":"2024-09-12T17:06:27.817451+0000","last_unstale":"2024-09-12T17:07:42.265096+0000","last_undegraded":"2024-09-12T17:07:42.265096+0000","last_fullsized":"2024-09-12T17:07:42.265096+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:31.000633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"73'7","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550668+0000","last_change":"2024-09-12T17:05:47.535321+0000","last_active":"2024-09-12T17:07:42.550668+0000","last_peered":"2024-09-12T17:07:42.550668+0000","last_clean":"2024-09-12T17:07:42.550668+0000","last_became_active":"2024-09-12T17:05:47.534790+0000","last_became_peered":"2024-09-12T17:05:47.534790+0000","last_unstale":"2024-09-12T17:07:42.550668+0000","last_undegraded":"2024-09-12T17:07:42.550668+0000","last_fullsized":"2024-09-12T17:07:42.550668+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":15,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552298+0000","last_change":"2024-09-12T17:06:08.647883+0000","last_active":"2024-09-12T17:07:42.552298+0000","last_peered":"2024-09-12T17:07:42.552298+0000","last_clean":"2024-09-12T17:07:42.552298+0000","last_became_active":"2024-09-12T17:06:08.647190+0000","last_became_peered":"2024-09-12T17:06:08.647190+0000","last_unstale":"2024-09-12T17:07:42.552298+0000","last_undegraded":"2024-09-12T17:07:42.552298+0000","last_fullsized":"2024-09-12T17:07:42.552298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:20.412411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550403+0000","last_change":"2024-09-12T17:05:51.533668+0000","last_active":"2024-09-12T17:07:42.550403+0000","last_peered":"2024-09-12T17:07:42.550403+0000","last_clean":"2024-09-12T17:07:42.550403+0000","last_became_active":"2024-09-12T17:05:51.532795+0000","last_became_peered":"2024-09-12T17:05:51.532795+0000","last_unstale":"2024-09-12T17:07:42.550403+0000","last_undegraded":"2024-09-12T17:07:42.550403+0000","last_fullsized":"2024-09-12T17:07:42.550403+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.655645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":120,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550460+0000","last_change":"2024-09-12T17:05:53.544503+0000","last_active":"2024-09-12T17:07:42.550460+0000","last_peered":"2024-09-12T17:07:42.550460+0000","last_clean":"2024-09-12T17:07:42.550460+0000","last_became_active":"2024-09-12T17:05:53.543495+0000","last_became_peered":"2024-09-12T17:05:53.543495+0000","last_unstale":"2024-09-12T17:07:42.550460+0000","last_undegraded":"2024-09-12T17:07:42.550460+0000","last_fullsized":"2024-09-12T17:07:42.550460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.721968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"68'11","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549928+0000","last_change":"2024-09-12T17:05:55.567580+0000","last_active":"2024-09-12T17:07:42.549928+0000","last_peered":"2024-09-12T17:07:42.549928+0000","last_clean":"2024-09-12T17:07:42.549928+0000","last_became_active":"2024-09-12T17:05:55.566652+0000","last_became_peered":"2024-09-12T17:05:55.566652+0000","last_unstale":"2024-09-12T17:07:42.549928+0000","last_undegraded":"2024-09-12T17:07:42.549928+0000","last_fullsized":"2024-09-12T17:07:42.549928+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:28.904117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"68'2","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436897+0000","last_change":"2024-09-12T17:05:57.585098+0000","last_active":"2024-09-12T17:07:42.436897+0000","last_peered":"2024-09-12T17:07:42.436897+0000","last_clean":"2024-09-12T17:07:42.436897+0000","last_became_active":"2024-09-12T17:05:57.584326+0000","last_became_peered":"2024-09-12T17:05:57.584326+0000","last_unstale":"2024-09-12T17:07:42.436897+0000","last_undegraded":"2024-09-12T17:07:42.436897+0000","last_fullsized":"2024-09-12T17:07:42.436897+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550112+0000","last_change":"2024-09-12T17:05:49.553294+0000","last_active":"2024-09-12T17:07:42.550112+0000","last_peered":"2024-09-12T17:07:42.550112+0000","last_clean":"2024-09-12T17:07:42.550112+0000","last_became_active":"2024-09-12T17:05:49.551726+0000","last_became_peered":"2024-09-12T17:05:49.551726+0000","last_unstale":"2024-09-12T17:07:42.550112+0000","last_undegraded":"2024-09-12T17:07:42.550112+0000","last_fullsized":"2024-09-12T17:07:42.550112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:50.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"74'6","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.439339+0000","last_change":"2024-09-12T17:06:39.825017+0000","last_active":"2024-09-12T17:07:42.439339+0000","last_peered":"2024-09-12T17:07:42.439339+0000","last_clean":"2024-09-12T17:07:42.439339+0000","last_became_active":"2024-09-12T17:06:39.824735+0000","last_became_peered":"2024-09-12T17:06:39.824735+0000","last_unstale":"2024-09-12T17:07:42.439339+0000","last_undegraded":"2024-09-12T17:07:42.439339+0000","last_fullsized":"2024-09-12T17:07:42.439339+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:38:26.552415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":16385,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552453+0000","last_change":"2024-09-12T17:05:42.680975+0000","last_active":"2024-09-12T17:07:42.552453+0000","last_peered":"2024-09-12T17:07:42.552453+0000","last_clean":"2024-09-12T17:07:42.552453+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:07:42.552453+0000","last_undegraded":"2024-09-12T17:07:42.552453+0000","last_fullsized":"2024-09-12T17:07:42.552453+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.660350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":115,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.547945+0000","last_change":"2024-09-12T17:06:39.839220+0000","last_active":"2024-09-12T17:07:42.547945+0000","last_peered":"2024-09-12T17:07:42.547945+0000","last_clean":"2024-09-12T17:07:42.547945+0000","last_became_active":"2024-09-12T17:06:39.838943+0000","last_became_peered":"2024-09-12T17:06:39.838943+0000","last_unstale":"2024-09-12T17:07:42.547945+0000","last_undegraded":"2024-09-12T17:07:42.547945+0000","last_fullsized":"2024-09-12T17:07:42.547945+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:40.303504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"68'24","reported_seq":145,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396311+0000","last_change":"2024-09-12T17:05:53.554751+0000","last_active":"2024-09-12T17:07:42.396311+0000","last_peered":"2024-09-12T17:07:42.396311+0000","last_clean":"2024-09-12T17:07:42.396311+0000","last_became_active":"2024-09-12T17:05:53.553914+0000","last_became_peered":"2024-09-12T17:05:53.553914+0000","last_unstale":"2024-09-12T17:07:42.396311+0000","last_undegraded":"2024-09-12T17:07:42.396311+0000","last_fullsized":"2024-09-12T17:07:42.396311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15520,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":107,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548341+0000","last_change":"2024-09-12T17:06:08.605576+0000","last_active":"2024-09-12T17:07:42.548341+0000","last_peered":"2024-09-12T17:07:42.548341+0000","last_clean":"2024-09-12T17:07:42.548341+0000","last_became_active":"2024-09-12T17:06:08.605191+0000","last_became_peered":"2024-09-12T17:06:08.605191+0000","last_unstale":"2024-09-12T17:07:42.548341+0000","last_undegraded":"2024-09-12T17:07:42.548341+0000","last_fullsized":"2024-09-12T17:07:42.548341+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:28:13.198865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265815+0000","last_change":"2024-09-12T17:05:57.605829+0000","last_active":"2024-09-12T17:07:42.265815+0000","last_peered":"2024-09-12T17:07:42.265815+0000","last_clean":"2024-09-12T17:07:42.265815+0000","last_became_active":"2024-09-12T17:05:57.605041+0000","last_became_peered":"2024-09-12T17:05:57.605041+0000","last_unstale":"2024-09-12T17:07:42.265815+0000","last_undegraded":"2024-09-12T17:07:42.265815+0000","last_fullsized":"2024-09-12T17:07:42.265815+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437905+0000","last_change":"2024-09-12T17:05:57.594498+0000","last_active":"2024-09-12T17:07:42.437905+0000","last_peered":"2024-09-12T17:07:42.437905+0000","last_clean":"2024-09-12T17:07:42.437905+0000","last_became_active":"2024-09-12T17:05:57.590196+0000","last_became_peered":"2024-09-12T17:05:57.590196+0000","last_unstale":"2024-09-12T17:07:42.437905+0000","last_undegraded":"2024-09-12T17:07:42.437905+0000","last_fullsized":"2024-09-12T17:07:42.437905+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.543735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549978+0000","last_change":"2024-09-12T17:05:49.562121+0000","last_active":"2024-09-12T17:07:42.549978+0000","last_peered":"2024-09-12T17:07:42.549978+0000","last_clean":"2024-09-12T17:07:42.549978+0000","last_became_active":"2024-09-12T17:05:49.561429+0000","last_became_peered":"2024-09-12T17:05:49.561429+0000","last_unstale":"2024-09-12T17:07:42.549978+0000","last_undegraded":"2024-09-12T17:07:42.549978+0000","last_fullsized":"2024-09-12T17:07:42.549978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:47.663366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"74'9","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551066+0000","last_change":"2024-09-12T17:05:47.557270+0000","last_active":"2024-09-12T17:07:42.551066+0000","last_peered":"2024-09-12T17:07:42.551066+0000","last_clean":"2024-09-12T17:07:42.551066+0000","last_became_active":"2024-09-12T17:05:47.556417+0000","last_became_peered":"2024-09-12T17:05:47.556417+0000","last_unstale":"2024-09-12T17:07:42.551066+0000","last_undegraded":"2024-09-12T17:07:42.551066+0000","last_fullsized":"2024-09-12T17:07:42.551066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:00.210632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":7,"num_read_kb":20481,"num_write":25,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265221+0000","last_change":"2024-09-12T17:06:39.827362+0000","last_active":"2024-09-12T17:07:42.265221+0000","last_peered":"2024-09-12T17:07:42.265221+0000","last_clean":"2024-09-12T17:07:42.265221+0000","last_became_active":"2024-09-12T17:06:39.826734+0000","last_became_peered":"2024-09-12T17:06:39.826734+0000","last_unstale":"2024-09-12T17:07:42.265221+0000","last_undegraded":"2024-09-12T17:07:42.265221+0000","last_fullsized":"2024-09-12T17:07:42.265221+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:10:55.849780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.11","version":"68'12","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.547730+0000","last_change":"2024-09-12T17:05:53.542230+0000","last_active":"2024-09-12T17:07:42.547730+0000","last_peered":"2024-09-12T17:07:42.547730+0000","last_clean":"2024-09-12T17:07:42.547730+0000","last_became_active":"2024-09-12T17:05:53.541653+0000","last_became_peered":"2024-09-12T17:05:53.541653+0000","last_unstale":"2024-09-12T17:07:42.547730+0000","last_undegraded":"2024-09-12T17:07:42.547730+0000","last_fullsized":"2024-09-12T17:07:42.547730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548045+0000","last_change":"2024-09-12T17:05:55.556535+0000","last_active":"2024-09-12T17:07:42.548045+0000","last_peered":"2024-09-12T17:07:42.548045+0000","last_clean":"2024-09-12T17:07:42.548045+0000","last_became_active":"2024-09-12T17:05:55.555755+0000","last_became_peered":"2024-09-12T17:05:55.555755+0000","last_unstale":"2024-09-12T17:07:42.548045+0000","last_undegraded":"2024-09-12T17:07:42.548045+0000","last_fullsized":"2024-09-12T17:07:42.548045+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.707384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"68'1","reported_seq":98,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550015+0000","last_change":"2024-09-12T17:05:57.593418+0000","last_active":"2024-09-12T17:07:42.550015+0000","last_peered":"2024-09-12T17:07:42.550015+0000","last_clean":"2024-09-12T17:07:42.550015+0000","last_became_active":"2024-09-12T17:05:57.592746+0000","last_became_peered":"2024-09-12T17:05:57.592746+0000","last_unstale":"2024-09-12T17:07:42.550015+0000","last_undegraded":"2024-09-12T17:07:42.550015+0000","last_fullsized":"2024-09-12T17:07:42.550015+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:24.794382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"68'6","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552147+0000","last_change":"2024-09-12T17:06:08.623185+0000","last_active":"2024-09-12T17:07:42.552147+0000","last_peered":"2024-09-12T17:07:42.552147+0000","last_clean":"2024-09-12T17:07:42.552147+0000","last_became_active":"2024-09-12T17:06:08.620344+0000","last_became_peered":"2024-09-12T17:06:08.620344+0000","last_unstale":"2024-09-12T17:07:42.552147+0000","last_undegraded":"2024-09-12T17:07:42.552147+0000","last_fullsized":"2024-09-12T17:07:42.552147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:52:12.424042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"75'6","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398108+0000","last_change":"2024-09-12T17:05:47.559497+0000","last_active":"2024-09-12T17:07:42.398108+0000","last_peered":"2024-09-12T17:07:42.398108+0000","last_clean":"2024-09-12T17:07:42.398108+0000","last_became_active":"2024-09-12T17:05:47.558641+0000","last_became_peered":"2024-09-12T17:05:47.558641+0000","last_unstale":"2024-09-12T17:07:42.398108+0000","last_undegraded":"2024-09-12T17:07:42.398108+0000","last_fullsized":"2024-09-12T17:07:42.398108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:00.096304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":16385,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548704+0000","last_change":"2024-09-12T17:05:51.539784+0000","last_active":"2024-09-12T17:07:42.548704+0000","last_peered":"2024-09-12T17:07:42.548704+0000","last_clean":"2024-09-12T17:07:42.548704+0000","last_became_active":"2024-09-12T17:05:51.539275+0000","last_became_peered":"2024-09-12T17:05:51.539275+0000","last_unstale":"2024-09-12T17:07:42.548704+0000","last_undegraded":"2024-09-12T17:07:42.548704+0000","last_fullsized":"2024-09-12T17:07:42.548704+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"46'5","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436208+0000","last_change":"2024-09-12T17:05:53.544731+0000","last_active":"2024-09-12T17:07:42.436208+0000","last_peered":"2024-09-12T17:07:42.436208+0000","last_clean":"2024-09-12T17:07:42.436208+0000","last_became_active":"2024-09-12T17:05:53.544127+0000","last_became_peered":"2024-09-12T17:05:53.544127+0000","last_unstale":"2024-09-12T17:07:42.436208+0000","last_undegraded":"2024-09-12T17:07:42.436208+0000","last_fullsized":"2024-09-12T17:07:42.436208+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:04.351698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396307+0000","last_change":"2024-09-12T17:05:55.571541+0000","last_active":"2024-09-12T17:07:42.396307+0000","last_peered":"2024-09-12T17:07:42.396307+0000","last_clean":"2024-09-12T17:07:42.396307+0000","last_became_active":"2024-09-12T17:05:55.570822+0000","last_became_peered":"2024-09-12T17:05:55.570822+0000","last_unstale":"2024-09-12T17:07:42.396307+0000","last_undegraded":"2024-09-12T17:07:42.396307+0000","last_fullsized":"2024-09-12T17:07:42.396307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'2","reported_seq":106,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437474+0000","last_change":"2024-09-12T17:06:39.824882+0000","last_active":"2024-09-12T17:07:42.437474+0000","last_peered":"2024-09-12T17:07:42.437474+0000","last_clean":"2024-09-12T17:07:42.437474+0000","last_became_active":"2024-09-12T17:06:39.824583+0000","last_became_peered":"2024-09-12T17:06:39.824583+0000","last_unstale":"2024-09-12T17:07:42.437474+0000","last_undegraded":"2024-09-12T17:07:42.437474+0000","last_fullsized":"2024-09-12T17:07:42.437474+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:51.674260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548030+0000","last_change":"2024-09-12T17:05:49.520508+0000","last_active":"2024-09-12T17:07:42.548030+0000","last_peered":"2024-09-12T17:07:42.548030+0000","last_clean":"2024-09-12T17:07:42.548030+0000","last_became_active":"2024-09-12T17:05:49.519721+0000","last_became_peered":"2024-09-12T17:05:49.519721+0000","last_unstale":"2024-09-12T17:07:42.548030+0000","last_undegraded":"2024-09-12T17:07:42.548030+0000","last_fullsized":"2024-09-12T17:07:42.548030+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"71'8","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266941+0000","last_change":"2024-09-12T17:05:47.539549+0000","last_active":"2024-09-12T17:07:42.266941+0000","last_peered":"2024-09-12T17:07:42.266941+0000","last_clean":"2024-09-12T17:07:42.266941+0000","last_became_active":"2024-09-12T17:05:47.538581+0000","last_became_peered":"2024-09-12T17:05:47.538581+0000","last_unstale":"2024-09-12T17:07:42.266941+0000","last_undegraded":"2024-09-12T17:07:42.266941+0000","last_fullsized":"2024-09-12T17:07:42.266941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.448924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":16,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.395666+0000","last_change":"2024-09-12T17:05:51.530541+0000","last_active":"2024-09-12T17:07:42.395666+0000","last_peered":"2024-09-12T17:07:42.395666+0000","last_clean":"2024-09-12T17:07:42.395666+0000","last_became_active":"2024-09-12T17:05:51.527515+0000","last_became_peered":"2024-09-12T17:05:51.527515+0000","last_unstale":"2024-09-12T17:07:42.395666+0000","last_undegraded":"2024-09-12T17:07:42.395666+0000","last_fullsized":"2024-09-12T17:07:42.395666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"68'13","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548561+0000","last_change":"2024-09-12T17:05:53.555017+0000","last_active":"2024-09-12T17:07:42.548561+0000","last_peered":"2024-09-12T17:07:42.548561+0000","last_clean":"2024-09-12T17:07:42.548561+0000","last_became_active":"2024-09-12T17:05:53.551154+0000","last_became_peered":"2024-09-12T17:05:53.551154+0000","last_unstale":"2024-09-12T17:07:42.548561+0000","last_undegraded":"2024-09-12T17:07:42.548561+0000","last_fullsized":"2024-09-12T17:07:42.548561+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:50.736153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549809+0000","last_change":"2024-09-12T17:05:55.570872+0000","last_active":"2024-09-12T17:07:42.549809+0000","last_peered":"2024-09-12T17:07:42.549809+0000","last_clean":"2024-09-12T17:07:42.549809+0000","last_became_active":"2024-09-12T17:05:55.570137+0000","last_became_peered":"2024-09-12T17:05:55.570137+0000","last_unstale":"2024-09-12T17:07:42.549809+0000","last_undegraded":"2024-09-12T17:07:42.549809+0000","last_fullsized":"2024-09-12T17:07:42.549809+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.684868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265682+0000","last_change":"2024-09-12T17:05:57.597088+0000","last_active":"2024-09-12T17:07:42.265682+0000","last_peered":"2024-09-12T17:07:42.265682+0000","last_clean":"2024-09-12T17:07:42.265682+0000","last_became_active":"2024-09-12T17:05:57.596377+0000","last_became_peered":"2024-09-12T17:05:57.596377+0000","last_unstale":"2024-09-12T17:07:42.265682+0000","last_undegraded":"2024-09-12T17:07:42.265682+0000","last_fullsized":"2024-09-12T17:07:42.265682+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"68'2","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.547721+0000","last_change":"2024-09-12T17:06:39.826867+0000","last_active":"2024-09-12T17:07:42.547721+0000","last_peered":"2024-09-12T17:07:42.547721+0000","last_clean":"2024-09-12T17:07:42.547721+0000","last_became_active":"2024-09-12T17:06:39.826559+0000","last_became_peered":"2024-09-12T17:06:39.826559+0000","last_unstale":"2024-09-12T17:07:42.547721+0000","last_undegraded":"2024-09-12T17:07:42.547721+0000","last_fullsized":"2024-09-12T17:07:42.547721+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:56.581333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"73'7","reported_seq":128,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.439026+0000","last_change":"2024-09-12T17:05:47.526555+0000","last_active":"2024-09-12T17:07:42.439026+0000","last_peered":"2024-09-12T17:07:42.439026+0000","last_clean":"2024-09-12T17:07:42.439026+0000","last_became_active":"2024-09-12T17:05:47.525874+0000","last_became_peered":"2024-09-12T17:05:47.525874+0000","last_unstale":"2024-09-12T17:07:42.439026+0000","last_undegraded":"2024-09-12T17:07:42.439026+0000","last_fullsized":"2024-09-12T17:07:42.439026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":8,"num_read_kb":12291,"num_write":15,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549362+0000","last_change":"2024-09-12T17:05:51.540509+0000","last_active":"2024-09-12T17:07:42.549362+0000","last_peered":"2024-09-12T17:07:42.549362+0000","last_clean":"2024-09-12T17:07:42.549362+0000","last_became_active":"2024-09-12T17:05:51.539607+0000","last_became_peered":"2024-09-12T17:05:51.539607+0000","last_unstale":"2024-09-12T17:07:42.549362+0000","last_undegraded":"2024-09-12T17:07:42.549362+0000","last_fullsized":"2024-09-12T17:07:42.549362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:02.652624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"68'10","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396338+0000","last_change":"2024-09-12T17:05:53.549324+0000","last_active":"2024-09-12T17:07:42.396338+0000","last_peered":"2024-09-12T17:07:42.396338+0000","last_clean":"2024-09-12T17:07:42.396338+0000","last_became_active":"2024-09-12T17:05:53.548561+0000","last_became_peered":"2024-09-12T17:05:53.548561+0000","last_unstale":"2024-09-12T17:07:42.396338+0000","last_undegraded":"2024-09-12T17:07:42.396338+0000","last_fullsized":"2024-09-12T17:07:42.396338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:47.932776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436909+0000","last_change":"2024-09-12T17:05:55.561467+0000","last_active":"2024-09-12T17:07:42.436909+0000","last_peered":"2024-09-12T17:07:42.436909+0000","last_clean":"2024-09-12T17:07:42.436909+0000","last_became_active":"2024-09-12T17:05:55.560708+0000","last_became_peered":"2024-09-12T17:05:55.560708+0000","last_unstale":"2024-09-12T17:07:42.436909+0000","last_undegraded":"2024-09-12T17:07:42.436909+0000","last_fullsized":"2024-09-12T17:07:42.436909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"75'23","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552239+0000","last_change":"2024-09-12T17:05:49.547097+0000","last_active":"2024-09-12T17:07:42.552239+0000","last_peered":"2024-09-12T17:07:42.552239+0000","last_clean":"2024-09-12T17:07:42.552239+0000","last_became_active":"2024-09-12T17:05:49.546232+0000","last_became_peered":"2024-09-12T17:05:49.546232+0000","last_unstale":"2024-09-12T17:07:42.552239+0000","last_undegraded":"2024-09-12T17:07:42.552239+0000","last_fullsized":"2024-09-12T17:07:42.552239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":66,"num_write":34,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"74'8","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.547654+0000","last_change":"2024-09-12T17:05:47.521779+0000","last_active":"2024-09-12T17:07:42.547654+0000","last_peered":"2024-09-12T17:07:42.547654+0000","last_clean":"2024-09-12T17:07:42.547654+0000","last_became_active":"2024-09-12T17:05:47.521097+0000","last_became_peered":"2024-09-12T17:05:47.521097+0000","last_unstale":"2024-09-12T17:07:42.547654+0000","last_undegraded":"2024-09-12T17:07:42.547654+0000","last_fullsized":"2024-09-12T17:07:42.547654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:37.072896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":16,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438879+0000","last_change":"2024-09-12T17:05:51.525803+0000","last_active":"2024-09-12T17:07:42.438879+0000","last_peered":"2024-09-12T17:07:42.438879+0000","last_clean":"2024-09-12T17:07:42.438879+0000","last_became_active":"2024-09-12T17:05:51.525457+0000","last_became_peered":"2024-09-12T17:05:51.525457+0000","last_unstale":"2024-09-12T17:07:42.438879+0000","last_undegraded":"2024-09-12T17:07:42.438879+0000","last_fullsized":"2024-09-12T17:07:42.438879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"68'16","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266250+0000","last_change":"2024-09-12T17:06:39.861432+0000","last_active":"2024-09-12T17:07:42.266250+0000","last_peered":"2024-09-12T17:07:42.266250+0000","last_clean":"2024-09-12T17:07:42.266250+0000","last_became_active":"2024-09-12T17:06:39.842347+0000","last_became_peered":"2024-09-12T17:06:39.842347+0000","last_unstale":"2024-09-12T17:07:42.266250+0000","last_undegraded":"2024-09-12T17:07:42.266250+0000","last_fullsized":"2024-09-12T17:07:42.266250+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:59.659342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15411,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":28,"num_read_kb":22,"num_write":18,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265819+0000","last_change":"2024-09-12T17:05:55.563312+0000","last_active":"2024-09-12T17:07:42.265819+0000","last_peered":"2024-09-12T17:07:42.265819+0000","last_clean":"2024-09-12T17:07:42.265819+0000","last_became_active":"2024-09-12T17:05:55.562405+0000","last_became_peered":"2024-09-12T17:05:55.562405+0000","last_unstale":"2024-09-12T17:07:42.265819+0000","last_undegraded":"2024-09-12T17:07:42.265819+0000","last_fullsized":"2024-09-12T17:07:42.265819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548245+0000","last_change":"2024-09-12T17:05:58.121110+0000","last_active":"2024-09-12T17:07:42.548245+0000","last_peered":"2024-09-12T17:07:42.548245+0000","last_clean":"2024-09-12T17:07:42.548245+0000","last_became_active":"2024-09-12T17:05:58.120367+0000","last_became_peered":"2024-09-12T17:05:58.120367+0000","last_unstale":"2024-09-12T17:07:42.548245+0000","last_undegraded":"2024-09-12T17:07:42.548245+0000","last_fullsized":"2024-09-12T17:07:42.548245+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.439033+0000","last_change":"2024-09-12T17:05:49.532377+0000","last_active":"2024-09-12T17:07:42.439033+0000","last_peered":"2024-09-12T17:07:42.439033+0000","last_clean":"2024-09-12T17:07:42.439033+0000","last_became_active":"2024-09-12T17:05:49.531975+0000","last_became_peered":"2024-09-12T17:05:49.531975+0000","last_unstale":"2024-09-12T17:07:42.439033+0000","last_undegraded":"2024-09-12T17:07:42.439033+0000","last_fullsized":"2024-09-12T17:07:42.439033+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"73'9","reported_seq":78,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548086+0000","last_change":"2024-09-12T17:06:39.839448+0000","last_active":"2024-09-12T17:07:42.548086+0000","last_peered":"2024-09-12T17:07:42.548086+0000","last_clean":"2024-09-12T17:07:42.548086+0000","last_became_active":"2024-09-12T17:06:39.839082+0000","last_became_peered":"2024-09-12T17:06:39.839082+0000","last_unstale":"2024-09-12T17:07:42.548086+0000","last_undegraded":"2024-09-12T17:07:42.548086+0000","last_fullsized":"2024-09-12T17:07:42.548086+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:24.708409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":41,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552007+0000","last_change":"2024-09-12T17:05:51.546117+0000","last_active":"2024-09-12T17:07:42.552007+0000","last_peered":"2024-09-12T17:07:42.552007+0000","last_clean":"2024-09-12T17:07:42.552007+0000","last_became_active":"2024-09-12T17:05:51.545154+0000","last_became_peered":"2024-09-12T17:05:51.545154+0000","last_unstale":"2024-09-12T17:07:42.552007+0000","last_undegraded":"2024-09-12T17:07:42.552007+0000","last_fullsized":"2024-09-12T17:07:42.552007+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:49.670591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"68'17","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398107+0000","last_change":"2024-09-12T17:05:53.558834+0000","last_active":"2024-09-12T17:07:42.398107+0000","last_peered":"2024-09-12T17:07:42.398107+0000","last_clean":"2024-09-12T17:07:42.398107+0000","last_became_active":"2024-09-12T17:05:53.558086+0000","last_became_peered":"2024-09-12T17:05:53.558086+0000","last_unstale":"2024-09-12T17:07:42.398107+0000","last_undegraded":"2024-09-12T17:07:42.398107+0000","last_fullsized":"2024-09-12T17:07:42.398107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:43.690058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552019+0000","last_change":"2024-09-12T17:06:08.626154+0000","last_active":"2024-09-12T17:07:42.552019+0000","last_peered":"2024-09-12T17:07:42.552019+0000","last_clean":"2024-09-12T17:07:42.552019+0000","last_became_active":"2024-09-12T17:06:08.625118+0000","last_became_peered":"2024-09-12T17:06:08.625118+0000","last_unstale":"2024-09-12T17:07:42.552019+0000","last_undegraded":"2024-09-12T17:07:42.552019+0000","last_fullsized":"2024-09-12T17:07:42.552019+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:55:11.146823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.12","version":"68'2","reported_seq":100,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549423+0000","last_change":"2024-09-12T17:05:57.597468+0000","last_active":"2024-09-12T17:07:42.549423+0000","last_peered":"2024-09-12T17:07:42.549423+0000","last_clean":"2024-09-12T17:07:42.549423+0000","last_became_active":"2024-09-12T17:05:57.596651+0000","last_became_peered":"2024-09-12T17:05:57.596651+0000","last_unstale":"2024-09-12T17:07:42.549423+0000","last_undegraded":"2024-09-12T17:07:42.549423+0000","last_fullsized":"2024-09-12T17:07:42.549423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.466145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549778+0000","last_change":"2024-09-12T17:06:39.842588+0000","last_active":"2024-09-12T17:07:42.549778+0000","last_peered":"2024-09-12T17:07:42.549778+0000","last_clean":"2024-09-12T17:07:42.549778+0000","last_became_active":"2024-09-12T17:06:39.842241+0000","last_became_peered":"2024-09-12T17:06:39.842241+0000","last_unstale":"2024-09-12T17:07:42.549778+0000","last_undegraded":"2024-09-12T17:07:42.549778+0000","last_fullsized":"2024-09-12T17:07:42.549778+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:38.260106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"73'7","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550878+0000","last_change":"2024-09-12T17:06:39.821271+0000","last_active":"2024-09-12T17:07:42.550878+0000","last_peered":"2024-09-12T17:07:42.550878+0000","last_clean":"2024-09-12T17:07:42.550878+0000","last_became_active":"2024-09-12T17:06:39.820916+0000","last_became_peered":"2024-09-12T17:06:39.820916+0000","last_unstale":"2024-09-12T17:07:42.550878+0000","last_undegraded":"2024-09-12T17:07:42.550878+0000","last_fullsized":"2024-09-12T17:07:42.550878+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:35:18.377128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":15,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551666+0000","last_change":"2024-09-12T17:05:51.539916+0000","last_active":"2024-09-12T17:07:42.551666+0000","last_peered":"2024-09-12T17:07:42.551666+0000","last_clean":"2024-09-12T17:07:42.551666+0000","last_became_active":"2024-09-12T17:05:51.539054+0000","last_became_peered":"2024-09-12T17:05:51.539054+0000","last_unstale":"2024-09-12T17:07:42.551666+0000","last_undegraded":"2024-09-12T17:07:42.551666+0000","last_fullsized":"2024-09-12T17:07:42.551666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:11.640578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"68'12","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550946+0000","last_change":"2024-09-12T17:05:53.557081+0000","last_active":"2024-09-12T17:07:42.550946+0000","last_peered":"2024-09-12T17:07:42.550946+0000","last_clean":"2024-09-12T17:07:42.550946+0000","last_became_active":"2024-09-12T17:05:53.556357+0000","last_became_peered":"2024-09-12T17:05:53.556357+0000","last_unstale":"2024-09-12T17:07:42.550946+0000","last_undegraded":"2024-09-12T17:07:42.550946+0000","last_fullsized":"2024-09-12T17:07:42.550946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:10.984649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550217+0000","last_change":"2024-09-12T17:06:08.622595+0000","last_active":"2024-09-12T17:07:42.550217+0000","last_peered":"2024-09-12T17:07:42.550217+0000","last_clean":"2024-09-12T17:07:42.550217+0000","last_became_active":"2024-09-12T17:06:08.621706+0000","last_became_peered":"2024-09-12T17:06:08.621706+0000","last_unstale":"2024-09-12T17:07:42.550217+0000","last_undegraded":"2024-09-12T17:07:42.550217+0000","last_fullsized":"2024-09-12T17:07:42.550217+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:02:49.649692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264960+0000","last_change":"2024-09-12T17:05:57.596779+0000","last_active":"2024-09-12T17:07:42.264960+0000","last_peered":"2024-09-12T17:07:42.264960+0000","last_clean":"2024-09-12T17:07:42.264960+0000","last_became_active":"2024-09-12T17:05:57.596005+0000","last_became_peered":"2024-09-12T17:05:57.596005+0000","last_unstale":"2024-09-12T17:07:42.264960+0000","last_undegraded":"2024-09-12T17:07:42.264960+0000","last_fullsized":"2024-09-12T17:07:42.264960+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266855+0000","last_change":"2024-09-12T17:06:39.829250+0000","last_active":"2024-09-12T17:07:42.266855+0000","last_peered":"2024-09-12T17:07:42.266855+0000","last_clean":"2024-09-12T17:07:42.266855+0000","last_became_active":"2024-09-12T17:06:39.828475+0000","last_became_peered":"2024-09-12T17:06:39.828475+0000","last_unstale":"2024-09-12T17:07:42.266855+0000","last_undegraded":"2024-09-12T17:07:42.266855+0000","last_fullsized":"2024-09-12T17:07:42.266855+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:00.338345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"74'12","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437059+0000","last_change":"2024-09-12T17:05:47.546051+0000","last_active":"2024-09-12T17:07:42.437059+0000","last_peered":"2024-09-12T17:07:42.437059+0000","last_clean":"2024-09-12T17:07:42.437059+0000","last_became_active":"2024-09-12T17:05:47.545466+0000","last_became_peered":"2024-09-12T17:05:47.545466+0000","last_unstale":"2024-09-12T17:07:42.437059+0000","last_undegraded":"2024-09-12T17:07:42.437059+0000","last_fullsized":"2024-09-12T17:07:42.437059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":5,"num_read_kb":18432,"num_write":28,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":64,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551829+0000","last_change":"2024-09-12T17:06:39.840769+0000","last_active":"2024-09-12T17:07:42.551829+0000","last_peered":"2024-09-12T17:07:42.551829+0000","last_clean":"2024-09-12T17:07:42.551829+0000","last_became_active":"2024-09-12T17:06:39.840073+0000","last_became_peered":"2024-09-12T17:06:39.840073+0000","last_unstale":"2024-09-12T17:07:42.551829+0000","last_undegraded":"2024-09-12T17:07:42.551829+0000","last_fullsized":"2024-09-12T17:07:42.551829+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:47:58.993772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"70'11","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550208+0000","last_change":"2024-09-12T17:05:53.561278+0000","last_active":"2024-09-12T17:07:42.550208+0000","last_peered":"2024-09-12T17:07:42.550208+0000","last_clean":"2024-09-12T17:07:42.550208+0000","last_became_active":"2024-09-12T17:05:53.559688+0000","last_became_peered":"2024-09-12T17:05:53.559688+0000","last_unstale":"2024-09-12T17:07:42.550208+0000","last_undegraded":"2024-09-12T17:07:42.550208+0000","last_fullsized":"2024-09-12T17:07:42.550208+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:37.392549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":19,"num_read_kb":14,"num_write":18,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"68'11","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551688+0000","last_change":"2024-09-12T17:05:55.576227+0000","last_active":"2024-09-12T17:07:42.551688+0000","last_peered":"2024-09-12T17:07:42.551688+0000","last_clean":"2024-09-12T17:07:42.551688+0000","last_became_active":"2024-09-12T17:05:55.571966+0000","last_became_peered":"2024-09-12T17:05:55.571966+0000","last_unstale":"2024-09-12T17:07:42.551688+0000","last_undegraded":"2024-09-12T17:07:42.551688+0000","last_fullsized":"2024-09-12T17:07:42.551688+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:24.680106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.395567+0000","last_change":"2024-09-12T17:05:57.595153+0000","last_active":"2024-09-12T17:07:42.395567+0000","last_peered":"2024-09-12T17:07:42.395567+0000","last_clean":"2024-09-12T17:07:42.395567+0000","last_became_active":"2024-09-12T17:05:57.594396+0000","last_became_peered":"2024-09-12T17:05:57.594396+0000","last_unstale":"2024-09-12T17:07:42.395567+0000","last_undegraded":"2024-09-12T17:07:42.395567+0000","last_fullsized":"2024-09-12T17:07:42.395567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:27.040243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549857+0000","last_change":"2024-09-12T17:05:49.543269+0000","last_active":"2024-09-12T17:07:42.549857+0000","last_peered":"2024-09-12T17:07:42.549857+0000","last_clean":"2024-09-12T17:07:42.549857+0000","last_became_active":"2024-09-12T17:05:49.542414+0000","last_became_peered":"2024-09-12T17:05:49.542414+0000","last_unstale":"2024-09-12T17:07:42.549857+0000","last_undegraded":"2024-09-12T17:07:42.549857+0000","last_fullsized":"2024-09-12T17:07:42.549857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:00.645399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"75'12","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266420+0000","last_change":"2024-09-12T17:06:27.785226+0000","last_active":"2024-09-12T17:07:42.266420+0000","last_peered":"2024-09-12T17:07:42.266420+0000","last_clean":"2024-09-12T17:07:42.266420+0000","last_became_active":"2024-09-12T17:06:27.784897+0000","last_became_peered":"2024-09-12T17:06:27.784897+0000","last_unstale":"2024-09-12T17:07:42.266420+0000","last_undegraded":"2024-09-12T17:07:42.266420+0000","last_fullsized":"2024-09-12T17:07:42.266420+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:25.368283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":28,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396593+0000","last_change":"2024-09-12T17:05:51.528322+0000","last_active":"2024-09-12T17:07:42.396593+0000","last_peered":"2024-09-12T17:07:42.396593+0000","last_clean":"2024-09-12T17:07:42.396593+0000","last_became_active":"2024-09-12T17:05:51.527501+0000","last_became_peered":"2024-09-12T17:05:51.527501+0000","last_unstale":"2024-09-12T17:07:42.396593+0000","last_undegraded":"2024-09-12T17:07:42.396593+0000","last_fullsized":"2024-09-12T17:07:42.396593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"68'16","reported_seq":152,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265194+0000","last_change":"2024-09-12T17:06:39.852541+0000","last_active":"2024-09-12T17:07:42.265194+0000","last_peered":"2024-09-12T17:07:42.265194+0000","last_clean":"2024-09-12T17:07:42.265194+0000","last_became_active":"2024-09-12T17:06:39.830991+0000","last_became_peered":"2024-09-12T17:06:39.830991+0000","last_unstale":"2024-09-12T17:07:42.265194+0000","last_undegraded":"2024-09-12T17:07:42.265194+0000","last_fullsized":"2024-09-12T17:07:42.265194+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:39.574386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.435864+0000","last_change":"2024-09-12T17:05:55.567202+0000","last_active":"2024-09-12T17:07:42.435864+0000","last_peered":"2024-09-12T17:07:42.435864+0000","last_clean":"2024-09-12T17:07:42.435864+0000","last_became_active":"2024-09-12T17:05:55.564710+0000","last_became_peered":"2024-09-12T17:05:55.564710+0000","last_unstale":"2024-09-12T17:07:42.435864+0000","last_undegraded":"2024-09-12T17:07:42.435864+0000","last_fullsized":"2024-09-12T17:07:42.435864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":96,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398624+0000","last_change":"2024-09-12T17:05:57.604052+0000","last_active":"2024-09-12T17:07:42.398624+0000","last_peered":"2024-09-12T17:07:42.398624+0000","last_clean":"2024-09-12T17:07:42.398624+0000","last_became_active":"2024-09-12T17:05:57.603285+0000","last_became_peered":"2024-09-12T17:05:57.603285+0000","last_unstale":"2024-09-12T17:07:42.398624+0000","last_undegraded":"2024-09-12T17:07:42.398624+0000","last_fullsized":"2024-09-12T17:07:42.398624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:31.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'6","reported_seq":122,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550589+0000","last_change":"2024-09-12T17:05:49.548224+0000","last_active":"2024-09-12T17:07:42.550589+0000","last_peered":"2024-09-12T17:07:42.550589+0000","last_clean":"2024-09-12T17:07:42.550589+0000","last_became_active":"2024-09-12T17:05:49.541007+0000","last_became_peered":"2024-09-12T17:05:49.541007+0000","last_unstale":"2024-09-12T17:07:42.550589+0000","last_undegraded":"2024-09-12T17:07:42.550589+0000","last_fullsized":"2024-09-12T17:07:42.550589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:59.768842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"75'4","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266516+0000","last_change":"2024-09-12T17:05:47.543197+0000","last_active":"2024-09-12T17:07:42.266516+0000","last_peered":"2024-09-12T17:07:42.266516+0000","last_clean":"2024-09-12T17:07:42.266516+0000","last_became_active":"2024-09-12T17:05:47.542345+0000","last_became_peered":"2024-09-12T17:05:47.542345+0000","last_unstale":"2024-09-12T17:07:42.266516+0000","last_undegraded":"2024-09-12T17:07:42.266516+0000","last_fullsized":"2024-09-12T17:07:42.266516+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.858635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266040+0000","last_change":"2024-09-12T17:05:51.556256+0000","last_active":"2024-09-12T17:07:42.266040+0000","last_peered":"2024-09-12T17:07:42.266040+0000","last_clean":"2024-09-12T17:07:42.266040+0000","last_became_active":"2024-09-12T17:05:51.554248+0000","last_became_peered":"2024-09-12T17:05:51.554248+0000","last_unstale":"2024-09-12T17:07:42.266040+0000","last_undegraded":"2024-09-12T17:07:42.266040+0000","last_fullsized":"2024-09-12T17:07:42.266040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"68'10","reported_seq":138,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.435967+0000","last_change":"2024-09-12T17:06:39.844736+0000","last_active":"2024-09-12T17:07:42.435967+0000","last_peered":"2024-09-12T17:07:42.435967+0000","last_clean":"2024-09-12T17:07:42.435967+0000","last_became_active":"2024-09-12T17:06:39.831389+0000","last_became_peered":"2024-09-12T17:06:39.831389+0000","last_unstale":"2024-09-12T17:07:42.435967+0000","last_undegraded":"2024-09-12T17:07:42.435967+0000","last_fullsized":"2024-09-12T17:07:42.435967+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:33.010189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549049+0000","last_change":"2024-09-12T17:05:55.567605+0000","last_active":"2024-09-12T17:07:42.549049+0000","last_peered":"2024-09-12T17:07:42.549049+0000","last_clean":"2024-09-12T17:07:42.549049+0000","last_became_active":"2024-09-12T17:05:55.566774+0000","last_became_peered":"2024-09-12T17:05:55.566774+0000","last_unstale":"2024-09-12T17:07:42.549049+0000","last_undegraded":"2024-09-12T17:07:42.549049+0000","last_fullsized":"2024-09-12T17:07:42.549049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:25.935376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550082+0000","last_change":"2024-09-12T17:05:58.121216+0000","last_active":"2024-09-12T17:07:42.550082+0000","last_peered":"2024-09-12T17:07:42.550082+0000","last_clean":"2024-09-12T17:07:42.550082+0000","last_became_active":"2024-09-12T17:05:58.120364+0000","last_became_peered":"2024-09-12T17:05:58.120364+0000","last_unstale":"2024-09-12T17:07:42.550082+0000","last_undegraded":"2024-09-12T17:07:42.550082+0000","last_fullsized":"2024-09-12T17:07:42.550082+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548226+0000","last_change":"2024-09-12T17:05:49.549956+0000","last_active":"2024-09-12T17:07:42.548226+0000","last_peered":"2024-09-12T17:07:42.548226+0000","last_clean":"2024-09-12T17:07:42.548226+0000","last_became_active":"2024-09-12T17:05:49.549481+0000","last_became_peered":"2024-09-12T17:05:49.549481+0000","last_unstale":"2024-09-12T17:07:42.548226+0000","last_undegraded":"2024-09-12T17:07:42.548226+0000","last_fullsized":"2024-09-12T17:07:42.548226+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"74'9","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550475+0000","last_change":"2024-09-12T17:05:47.510898+0000","last_active":"2024-09-12T17:07:42.550475+0000","last_peered":"2024-09-12T17:07:42.550475+0000","last_clean":"2024-09-12T17:07:42.550475+0000","last_became_active":"2024-09-12T17:05:47.510462+0000","last_became_peered":"2024-09-12T17:05:47.510462+0000","last_unstale":"2024-09-12T17:07:42.550475+0000","last_undegraded":"2024-09-12T17:07:42.550475+0000","last_fullsized":"2024-09-12T17:07:42.550475+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":25,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":109,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549176+0000","last_change":"2024-09-12T17:05:51.541454+0000","last_active":"2024-09-12T17:07:42.549176+0000","last_peered":"2024-09-12T17:07:42.549176+0000","last_clean":"2024-09-12T17:07:42.549176+0000","last_became_active":"2024-09-12T17:05:51.539938+0000","last_became_peered":"2024-09-12T17:05:51.539938+0000","last_unstale":"2024-09-12T17:07:42.549176+0000","last_undegraded":"2024-09-12T17:07:42.549176+0000","last_fullsized":"2024-09-12T17:07:42.549176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:18.328350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"68'6","reported_seq":116,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549642+0000","last_change":"2024-09-12T17:05:53.555764+0000","last_active":"2024-09-12T17:07:42.549642+0000","last_peered":"2024-09-12T17:07:42.549642+0000","last_clean":"2024-09-12T17:07:42.549642+0000","last_became_active":"2024-09-12T17:05:53.552095+0000","last_became_peered":"2024-09-12T17:05:53.552095+0000","last_unstale":"2024-09-12T17:07:42.549642+0000","last_undegraded":"2024-09-12T17:07:42.549642+0000","last_fullsized":"2024-09-12T17:07:42.549642+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549717+0000","last_change":"2024-09-12T17:05:55.571520+0000","last_active":"2024-09-12T17:07:42.549717+0000","last_peered":"2024-09-12T17:07:42.549717+0000","last_clean":"2024-09-12T17:07:42.549717+0000","last_became_active":"2024-09-12T17:05:55.570863+0000","last_became_peered":"2024-09-12T17:05:55.570863+0000","last_unstale":"2024-09-12T17:07:42.549717+0000","last_undegraded":"2024-09-12T17:07:42.549717+0000","last_fullsized":"2024-09-12T17:07:42.549717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":102,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.397408+0000","last_change":"2024-09-12T17:06:08.629509+0000","last_active":"2024-09-12T17:07:42.397408+0000","last_peered":"2024-09-12T17:07:42.397408+0000","last_clean":"2024-09-12T17:07:42.397408+0000","last_became_active":"2024-09-12T17:06:08.628015+0000","last_became_peered":"2024-09-12T17:06:08.628015+0000","last_unstale":"2024-09-12T17:07:42.397408+0000","last_undegraded":"2024-09-12T17:07:42.397408+0000","last_fullsized":"2024-09-12T17:07:42.397408+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:12:38.232897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"75'19","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549566+0000","last_change":"2024-09-12T17:05:49.561555+0000","last_active":"2024-09-12T17:07:42.549566+0000","last_peered":"2024-09-12T17:07:42.549566+0000","last_clean":"2024-09-12T17:07:42.549566+0000","last_became_active":"2024-09-12T17:05:49.560875+0000","last_became_peered":"2024-09-12T17:05:49.560875+0000","last_unstale":"2024-09-12T17:07:42.549566+0000","last_undegraded":"2024-09-12T17:07:42.549566+0000","last_fullsized":"2024-09-12T17:07:42.549566+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.493944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":54,"num_write":28,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"75'12","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438951+0000","last_change":"2024-09-12T17:05:47.528128+0000","last_active":"2024-09-12T17:07:42.438951+0000","last_peered":"2024-09-12T17:07:42.438951+0000","last_clean":"2024-09-12T17:07:42.438951+0000","last_became_active":"2024-09-12T17:05:47.527364+0000","last_became_peered":"2024-09-12T17:05:47.527364+0000","last_unstale":"2024-09-12T17:07:42.438951+0000","last_undegraded":"2024-09-12T17:07:42.438951+0000","last_fullsized":"2024-09-12T17:07:42.438951+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":28,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265086+0000","last_change":"2024-09-12T17:06:39.854439+0000","last_active":"2024-09-12T17:07:42.265086+0000","last_peered":"2024-09-12T17:07:42.265086+0000","last_clean":"2024-09-12T17:07:42.265086+0000","last_became_active":"2024-09-12T17:06:39.835053+0000","last_became_peered":"2024-09-12T17:06:39.835053+0000","last_unstale":"2024-09-12T17:07:42.265086+0000","last_undegraded":"2024-09-12T17:07:42.265086+0000","last_fullsized":"2024-09-12T17:07:42.265086+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:49:31.004061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1a","version":"68'11","reported_seq":123,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550029+0000","last_change":"2024-09-12T17:05:53.548391+0000","last_active":"2024-09-12T17:07:42.550029+0000","last_peered":"2024-09-12T17:07:42.550029+0000","last_clean":"2024-09-12T17:07:42.550029+0000","last_became_active":"2024-09-12T17:05:53.547202+0000","last_became_peered":"2024-09-12T17:05:53.547202+0000","last_unstale":"2024-09-12T17:07:42.550029+0000","last_undegraded":"2024-09-12T17:07:42.550029+0000","last_fullsized":"2024-09-12T17:07:42.550029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:00.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9699,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":101,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436882+0000","last_change":"2024-09-12T17:05:55.566243+0000","last_active":"2024-09-12T17:07:42.436882+0000","last_peered":"2024-09-12T17:07:42.436882+0000","last_clean":"2024-09-12T17:07:42.436882+0000","last_became_active":"2024-09-12T17:05:55.565403+0000","last_became_peered":"2024-09-12T17:05:55.565403+0000","last_unstale":"2024-09-12T17:07:42.436882+0000","last_undegraded":"2024-09-12T17:07:42.436882+0000","last_fullsized":"2024-09-12T17:07:42.436882+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":97,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.551765+0000","last_change":"2024-09-12T17:05:57.589526+0000","last_active":"2024-09-12T17:07:42.551765+0000","last_peered":"2024-09-12T17:07:42.551765+0000","last_clean":"2024-09-12T17:07:42.551765+0000","last_became_active":"2024-09-12T17:05:57.588626+0000","last_became_peered":"2024-09-12T17:05:57.588626+0000","last_unstale":"2024-09-12T17:07:42.551765+0000","last_undegraded":"2024-09-12T17:07:42.551765+0000","last_fullsized":"2024-09-12T17:07:42.551765+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.472663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552120+0000","last_change":"2024-09-12T17:06:08.626956+0000","last_active":"2024-09-12T17:07:42.552120+0000","last_peered":"2024-09-12T17:07:42.552120+0000","last_clean":"2024-09-12T17:07:42.552120+0000","last_became_active":"2024-09-12T17:06:08.626120+0000","last_became_peered":"2024-09-12T17:06:08.626120+0000","last_unstale":"2024-09-12T17:07:42.552120+0000","last_undegraded":"2024-09-12T17:07:42.552120+0000","last_fullsized":"2024-09-12T17:07:42.552120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:48:34.074694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.20","version":"73'10","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549161+0000","last_change":"2024-09-12T17:05:47.532523+0000","last_active":"2024-09-12T17:07:42.549161+0000","last_peered":"2024-09-12T17:07:42.549161+0000","last_clean":"2024-09-12T17:07:42.549161+0000","last_became_active":"2024-09-12T17:05:47.531750+0000","last_became_peered":"2024-09-12T17:05:47.531750+0000","last_unstale":"2024-09-12T17:07:42.549161+0000","last_undegraded":"2024-09-12T17:07:42.549161+0000","last_fullsized":"2024-09-12T17:07:42.549161+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:03.075435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":8,"num_read_kb":24577,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":92,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267285+0000","last_change":"2024-09-12T17:06:08.636344+0000","last_active":"2024-09-12T17:07:42.267285+0000","last_peered":"2024-09-12T17:07:42.267285+0000","last_clean":"2024-09-12T17:07:42.267285+0000","last_became_active":"2024-09-12T17:06:08.636028+0000","last_became_peered":"2024-09-12T17:06:08.636028+0000","last_unstale":"2024-09-12T17:07:42.267285+0000","last_undegraded":"2024-09-12T17:07:42.267285+0000","last_fullsized":"2024-09-12T17:07:42.267285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"75'9","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265805+0000","last_change":"2024-09-12T17:05:47.526020+0000","last_active":"2024-09-12T17:07:42.265805+0000","last_peered":"2024-09-12T17:07:42.265805+0000","last_clean":"2024-09-12T17:07:42.265805+0000","last_became_active":"2024-09-12T17:05:47.525481+0000","last_became_peered":"2024-09-12T17:05:47.525481+0000","last_unstale":"2024-09-12T17:07:42.265805+0000","last_undegraded":"2024-09-12T17:07:42.265805+0000","last_fullsized":"2024-09-12T17:07:42.265805+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:05.949135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":17,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"75'23","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266219+0000","last_change":"2024-09-12T17:05:49.546848+0000","last_active":"2024-09-12T17:07:42.266219+0000","last_peered":"2024-09-12T17:07:42.266219+0000","last_clean":"2024-09-12T17:07:42.266219+0000","last_became_active":"2024-09-12T17:05:49.545382+0000","last_became_peered":"2024-09-12T17:05:49.545382+0000","last_unstale":"2024-09-12T17:07:42.266219+0000","last_undegraded":"2024-09-12T17:07:42.266219+0000","last_fullsized":"2024-09-12T17:07:42.266219+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:42.832972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":66,"num_write":34,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"74'8","reported_seq":40,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265882+0000","last_change":"2024-09-12T17:07:28.249892+0000","last_active":"2024-09-12T17:07:42.265882+0000","last_peered":"2024-09-12T17:07:42.265882+0000","last_clean":"2024-09-12T17:07:42.265882+0000","last_became_active":"2024-09-12T17:07:28.191632+0000","last_became_peered":"2024-09-12T17:07:28.191632+0000","last_unstale":"2024-09-12T17:07:42.265882+0000","last_undegraded":"2024-09-12T17:07:42.265882+0000","last_fullsized":"2024-09-12T17:07:42.265882+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.324862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":91,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398572+0000","last_change":"2024-09-12T17:06:08.622437+0000","last_active":"2024-09-12T17:07:42.398572+0000","last_peered":"2024-09-12T17:07:42.398572+0000","last_clean":"2024-09-12T17:07:42.398572+0000","last_became_active":"2024-09-12T17:06:08.620631+0000","last_became_peered":"2024-09-12T17:06:08.620631+0000","last_unstale":"2024-09-12T17:07:42.398572+0000","last_undegraded":"2024-09-12T17:07:42.398572+0000","last_fullsized":"2024-09-12T17:07:42.398572+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:03:03.019920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.23","version":"71'10","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437226+0000","last_change":"2024-09-12T17:05:47.530275+0000","last_active":"2024-09-12T17:07:42.437226+0000","last_peered":"2024-09-12T17:07:42.437226+0000","last_clean":"2024-09-12T17:07:42.437226+0000","last_became_active":"2024-09-12T17:05:47.529857+0000","last_became_peered":"2024-09-12T17:05:47.529857+0000","last_unstale":"2024-09-12T17:07:42.437226+0000","last_undegraded":"2024-09-12T17:07:42.437226+0000","last_fullsized":"2024-09-12T17:07:42.437226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:47.999516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":7,"num_read_kb":26624,"num_write":10,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"74'21","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549194+0000","last_change":"2024-09-12T17:05:49.525070+0000","last_active":"2024-09-12T17:07:42.549194+0000","last_peered":"2024-09-12T17:07:42.549194+0000","last_clean":"2024-09-12T17:07:42.549194+0000","last_became_active":"2024-09-12T17:05:49.524567+0000","last_became_peered":"2024-09-12T17:05:49.524567+0000","last_unstale":"2024-09-12T17:07:42.549194+0000","last_undegraded":"2024-09-12T17:07:42.549194+0000","last_fullsized":"2024-09-12T17:07:42.549194+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:34.320123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":60,"num_write":31,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"72'8","reported_seq":129,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549865+0000","last_change":"2024-09-12T17:05:47.547765+0000","last_active":"2024-09-12T17:07:42.549865+0000","last_peered":"2024-09-12T17:07:42.549865+0000","last_clean":"2024-09-12T17:07:42.549865+0000","last_became_active":"2024-09-12T17:05:47.547393+0000","last_became_peered":"2024-09-12T17:05:47.547393+0000","last_unstale":"2024-09-12T17:07:42.549865+0000","last_undegraded":"2024-09-12T17:07:42.549865+0000","last_fullsized":"2024-09-12T17:07:42.549865+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:46.746261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":6,"num_read_kb":16385,"num_write":32,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550753+0000","last_change":"2024-09-12T17:05:49.561711+0000","last_active":"2024-09-12T17:07:42.550753+0000","last_peered":"2024-09-12T17:07:42.550753+0000","last_clean":"2024-09-12T17:07:42.550753+0000","last_became_active":"2024-09-12T17:05:49.560993+0000","last_became_peered":"2024-09-12T17:05:49.560993+0000","last_unstale":"2024-09-12T17:07:42.550753+0000","last_undegraded":"2024-09-12T17:07:42.550753+0000","last_fullsized":"2024-09-12T17:07:42.550753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:38.400338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"72'9","reported_seq":108,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549903+0000","last_change":"2024-09-12T17:06:08.611289+0000","last_active":"2024-09-12T17:07:42.549903+0000","last_peered":"2024-09-12T17:07:42.549903+0000","last_clean":"2024-09-12T17:07:42.549903+0000","last_became_active":"2024-09-12T17:06:08.610857+0000","last_became_peered":"2024-09-12T17:06:08.610857+0000","last_unstale":"2024-09-12T17:07:42.549903+0000","last_undegraded":"2024-09-12T17:07:42.549903+0000","last_fullsized":"2024-09-12T17:07:42.549903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:29.412900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":11,"num_read_kb":24579,"num_write":17,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.21","version":"68'2","reported_seq":124,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.547868+0000","last_change":"2024-09-12T17:06:08.615771+0000","last_active":"2024-09-12T17:07:42.547868+0000","last_peered":"2024-09-12T17:07:42.547868+0000","last_clean":"2024-09-12T17:07:42.547868+0000","last_became_active":"2024-09-12T17:06:08.615451+0000","last_became_peered":"2024-09-12T17:06:08.615451+0000","last_unstale":"2024-09-12T17:07:42.547868+0000","last_undegraded":"2024-09-12T17:07:42.547868+0000","last_fullsized":"2024-09-12T17:07:42.547868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:11:11.063250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'8","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552139+0000","last_change":"2024-09-12T17:05:47.541213+0000","last_active":"2024-09-12T17:07:42.552139+0000","last_peered":"2024-09-12T17:07:42.552139+0000","last_clean":"2024-09-12T17:07:42.552139+0000","last_became_active":"2024-09-12T17:05:47.540469+0000","last_became_peered":"2024-09-12T17:05:47.540469+0000","last_unstale":"2024-09-12T17:07:42.552139+0000","last_undegraded":"2024-09-12T17:07:42.552139+0000","last_fullsized":"2024-09-12T17:07:42.552139+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:26.620021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"74'21","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548886+0000","last_change":"2024-09-12T17:05:49.541113+0000","last_active":"2024-09-12T17:07:42.548886+0000","last_peered":"2024-09-12T17:07:42.548886+0000","last_clean":"2024-09-12T17:07:42.548886+0000","last_became_active":"2024-09-12T17:05:49.540395+0000","last_became_peered":"2024-09-12T17:05:49.540395+0000","last_unstale":"2024-09-12T17:07:42.548886+0000","last_undegraded":"2024-09-12T17:07:42.548886+0000","last_fullsized":"2024-09-12T17:07:42.548886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:32.506502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":80,"num_read_kb":60,"num_write":31,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"75'17","reported_seq":144,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550949+0000","last_change":"2024-09-12T17:05:47.539986+0000","last_active":"2024-09-12T17:07:42.550949+0000","last_peered":"2024-09-12T17:07:42.550949+0000","last_clean":"2024-09-12T17:07:42.550949+0000","last_became_active":"2024-09-12T17:05:47.539603+0000","last_became_peered":"2024-09-12T17:05:47.539603+0000","last_unstale":"2024-09-12T17:07:42.550949+0000","last_undegraded":"2024-09-12T17:07:42.550949+0000","last_fullsized":"2024-09-12T17:07:42.550949+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":33,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438871+0000","last_change":"2024-09-12T17:05:49.533938+0000","last_active":"2024-09-12T17:07:42.438871+0000","last_peered":"2024-09-12T17:07:42.438871+0000","last_clean":"2024-09-12T17:07:42.438871+0000","last_became_active":"2024-09-12T17:05:49.531769+0000","last_became_peered":"2024-09-12T17:05:49.531769+0000","last_unstale":"2024-09-12T17:07:42.438871+0000","last_undegraded":"2024-09-12T17:07:42.438871+0000","last_fullsized":"2024-09-12T17:07:42.438871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:33.763423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"74'10","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265286+0000","last_change":"2024-09-12T17:05:47.525739+0000","last_active":"2024-09-12T17:07:42.265286+0000","last_peered":"2024-09-12T17:07:42.265286+0000","last_clean":"2024-09-12T17:07:42.265286+0000","last_became_active":"2024-09-12T17:05:47.524922+0000","last_became_peered":"2024-09-12T17:05:47.524922+0000","last_unstale":"2024-09-12T17:07:42.265286+0000","last_undegraded":"2024-09-12T17:07:42.265286+0000","last_fullsized":"2024-09-12T17:07:42.265286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":18,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.550734+0000","last_change":"2024-09-12T17:05:49.555307+0000","last_active":"2024-09-12T17:07:42.550734+0000","last_peered":"2024-09-12T17:07:42.550734+0000","last_clean":"2024-09-12T17:07:42.550734+0000","last_became_active":"2024-09-12T17:05:49.554566+0000","last_became_peered":"2024-09-12T17:05:49.554566+0000","last_unstale":"2024-09-12T17:07:42.550734+0000","last_undegraded":"2024-09-12T17:07:42.550734+0000","last_fullsized":"2024-09-12T17:07:42.550734+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:45.017623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"73'9","reported_seq":131,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.548296+0000","last_change":"2024-09-12T17:05:47.543468+0000","last_active":"2024-09-12T17:07:42.548296+0000","last_peered":"2024-09-12T17:07:42.548296+0000","last_clean":"2024-09-12T17:07:42.548296+0000","last_became_active":"2024-09-12T17:05:47.542753+0000","last_became_peered":"2024-09-12T17:05:47.542753+0000","last_unstale":"2024-09-12T17:07:42.548296+0000","last_undegraded":"2024-09-12T17:07:42.548296+0000","last_fullsized":"2024-09-12T17:07:42.548296+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":33,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"73'17","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267203+0000","last_change":"2024-09-12T17:05:49.536693+0000","last_active":"2024-09-12T17:07:42.267203+0000","last_peered":"2024-09-12T17:07:42.267203+0000","last_clean":"2024-09-12T17:07:42.267203+0000","last_became_active":"2024-09-12T17:05:49.536385+0000","last_became_peered":"2024-09-12T17:05:49.536385+0000","last_unstale":"2024-09-12T17:07:42.267203+0000","last_undegraded":"2024-09-12T17:07:42.267203+0000","last_fullsized":"2024-09-12T17:07:42.267203+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.024498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":64,"num_read_kb":48,"num_write":25,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"69'5","reported_seq":126,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265576+0000","last_change":"2024-09-12T17:05:47.545251+0000","last_active":"2024-09-12T17:07:42.265576+0000","last_peered":"2024-09-12T17:07:42.265576+0000","last_clean":"2024-09-12T17:07:42.265576+0000","last_became_active":"2024-09-12T17:05:47.544406+0000","last_became_peered":"2024-09-12T17:05:47.544406+0000","last_unstale":"2024-09-12T17:07:42.265576+0000","last_undegraded":"2024-09-12T17:07:42.265576+0000","last_fullsized":"2024-09-12T17:07:42.265576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:52.167194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":20481,"num_write":13,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"75'19","reported_seq":132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.553542+0000","last_change":"2024-09-12T17:05:49.564446+0000","last_active":"2024-09-12T17:07:42.553542+0000","last_peered":"2024-09-12T17:07:42.553542+0000","last_clean":"2024-09-12T17:07:42.553542+0000","last_became_active":"2024-09-12T17:05:49.563625+0000","last_became_peered":"2024-09-12T17:05:49.563625+0000","last_unstale":"2024-09-12T17:07:42.553542+0000","last_undegraded":"2024-09-12T17:07:42.553542+0000","last_fullsized":"2024-09-12T17:07:42.553542+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.324265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":72,"num_read_kb":54,"num_write":28,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"72'10","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.437393+0000","last_change":"2024-09-12T17:05:47.558422+0000","last_active":"2024-09-12T17:07:42.437393+0000","last_peered":"2024-09-12T17:07:42.437393+0000","last_clean":"2024-09-12T17:07:42.437393+0000","last_became_active":"2024-09-12T17:05:47.558047+0000","last_became_peered":"2024-09-12T17:05:47.558047+0000","last_unstale":"2024-09-12T17:07:42.437393+0000","last_undegraded":"2024-09-12T17:07:42.437393+0000","last_fullsized":"2024-09-12T17:07:42.437393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:25.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":8,"num_read_kb":32768,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396680+0000","last_change":"2024-09-12T17:05:49.522750+0000","last_active":"2024-09-12T17:07:42.396680+0000","last_peered":"2024-09-12T17:07:42.396680+0000","last_clean":"2024-09-12T17:07:42.396680+0000","last_became_active":"2024-09-12T17:05:49.522097+0000","last_became_peered":"2024-09-12T17:05:49.522097+0000","last_unstale":"2024-09-12T17:07:42.396680+0000","last_undegraded":"2024-09-12T17:07:42.396680+0000","last_fullsized":"2024-09-12T17:07:42.396680+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"73'11","reported_seq":133,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.552023+0000","last_change":"2024-09-12T17:05:47.552865+0000","last_active":"2024-09-12T17:07:42.552023+0000","last_peered":"2024-09-12T17:07:42.552023+0000","last_clean":"2024-09-12T17:07:42.552023+0000","last_became_active":"2024-09-12T17:05:47.552207+0000","last_became_peered":"2024-09-12T17:05:47.552207+0000","last_unstale":"2024-09-12T17:07:42.552023+0000","last_undegraded":"2024-09-12T17:07:42.552023+0000","last_fullsized":"2024-09-12T17:07:42.552023+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:00.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":35,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":119,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.436516+0000","last_change":"2024-09-12T17:06:39.829239+0000","last_active":"2024-09-12T17:07:42.436516+0000","last_peered":"2024-09-12T17:07:42.436516+0000","last_clean":"2024-09-12T17:07:42.436516+0000","last_became_active":"2024-09-12T17:06:39.828894+0000","last_became_peered":"2024-09-12T17:06:39.828894+0000","last_unstale":"2024-09-12T17:07:42.436516+0000","last_undegraded":"2024-09-12T17:07:42.436516+0000","last_fullsized":"2024-09-12T17:07:42.436516+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:56:00.000353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"74'14","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.398678+0000","last_change":"2024-09-12T17:05:47.561338+0000","last_active":"2024-09-12T17:07:42.398678+0000","last_peered":"2024-09-12T17:07:42.398678+0000","last_clean":"2024-09-12T17:07:42.398678+0000","last_became_active":"2024-09-12T17:05:47.560439+0000","last_became_peered":"2024-09-12T17:05:47.560439+0000","last_unstale":"2024-09-12T17:07:42.398678+0000","last_undegraded":"2024-09-12T17:07:42.398678+0000","last_fullsized":"2024-09-12T17:07:42.398678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:58.530869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":14,"num_read_kb":36867,"num_write":22,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":74,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.264694+0000","last_change":"2024-09-12T17:06:27.819106+0000","last_active":"2024-09-12T17:07:42.264694+0000","last_peered":"2024-09-12T17:07:42.264694+0000","last_clean":"2024-09-12T17:07:42.264694+0000","last_became_active":"2024-09-12T17:06:27.818761+0000","last_became_peered":"2024-09-12T17:06:27.818761+0000","last_unstale":"2024-09-12T17:07:42.264694+0000","last_undegraded":"2024-09-12T17:07:42.264694+0000","last_fullsized":"2024-09-12T17:07:42.264694+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:29.107938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"74'8","reported_seq":130,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267384+0000","last_change":"2024-09-12T17:05:47.512066+0000","last_active":"2024-09-12T17:07:42.267384+0000","last_peered":"2024-09-12T17:07:42.267384+0000","last_clean":"2024-09-12T17:07:42.267384+0000","last_became_active":"2024-09-12T17:05:47.511470+0000","last_became_peered":"2024-09-12T17:05:47.511470+0000","last_unstale":"2024-09-12T17:07:42.267384+0000","last_undegraded":"2024-09-12T17:07:42.267384+0000","last_fullsized":"2024-09-12T17:07:42.267384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:38.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.396081+0000","last_change":"2024-09-12T17:05:49.523060+0000","last_active":"2024-09-12T17:07:42.396081+0000","last_peered":"2024-09-12T17:07:42.396081+0000","last_clean":"2024-09-12T17:07:42.396081+0000","last_became_active":"2024-09-12T17:05:49.522157+0000","last_became_peered":"2024-09-12T17:05:49.522157+0000","last_unstale":"2024-09-12T17:07:42.396081+0000","last_undegraded":"2024-09-12T17:07:42.396081+0000","last_fullsized":"2024-09-12T17:07:42.396081+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"71'5","reported_seq":125,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.267144+0000","last_change":"2024-09-12T17:05:47.538305+0000","last_active":"2024-09-12T17:07:42.267144+0000","last_peered":"2024-09-12T17:07:42.267144+0000","last_clean":"2024-09-12T17:07:42.267144+0000","last_became_active":"2024-09-12T17:05:47.535569+0000","last_became_peered":"2024-09-12T17:05:47.535569+0000","last_unstale":"2024-09-12T17:07:42.267144+0000","last_undegraded":"2024-09-12T17:07:42.267144+0000","last_fullsized":"2024-09-12T17:07:42.267144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:24.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'5","reported_seq":121,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.265171+0000","last_change":"2024-09-12T17:05:47.537712+0000","last_active":"2024-09-12T17:07:42.265171+0000","last_peered":"2024-09-12T17:07:42.265171+0000","last_clean":"2024-09-12T17:07:42.265171+0000","last_became_active":"2024-09-12T17:05:47.536958+0000","last_became_peered":"2024-09-12T17:05:47.536958+0000","last_unstale":"2024-09-12T17:07:42.265171+0000","last_undegraded":"2024-09-12T17:07:42.265171+0000","last_fullsized":"2024-09-12T17:07:42.265171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":113,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.438820+0000","last_change":"2024-09-12T17:05:49.544841+0000","last_active":"2024-09-12T17:07:42.438820+0000","last_peered":"2024-09-12T17:07:42.438820+0000","last_clean":"2024-09-12T17:07:42.438820+0000","last_became_active":"2024-09-12T17:05:49.538757+0000","last_became_peered":"2024-09-12T17:05:49.538757+0000","last_unstale":"2024-09-12T17:07:42.438820+0000","last_undegraded":"2024-09-12T17:07:42.438820+0000","last_fullsized":"2024-09-12T17:07:42.438820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.976348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'8","reported_seq":76,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.549842+0000","last_change":"2024-09-12T17:06:39.839407+0000","last_active":"2024-09-12T17:07:42.549842+0000","last_peered":"2024-09-12T17:07:42.549842+0000","last_clean":"2024-09-12T17:07:42.549842+0000","last_became_active":"2024-09-12T17:06:39.838968+0000","last_became_peered":"2024-09-12T17:06:39.838968+0000","last_unstale":"2024-09-12T17:07:42.549842+0000","last_undegraded":"2024-09-12T17:07:42.549842+0000","last_fullsized":"2024-09-12T17:07:42.549842+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:26.351659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":12291,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":112,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-12T17:07:42.266694+0000","last_change":"2024-09-12T17:05:49.552327+0000","last_active":"2024-09-12T17:07:42.266694+0000","last_peered":"2024-09-12T17:07:42.266694+0000","last_clean":"2024-09-12T17:07:42.266694+0000","last_became_active":"2024-09-12T17:05:49.551604+0000","last_became_peered":"2024-09-12T17:05:49.551604+0000","last_unstale":"2024-09-12T17:07:42.266694+0000","last_undegraded":"2024-09-12T17:07:42.266694+0000","last_fullsized":"2024-09-12T17:07:42.266694+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:55.648527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1089,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":21,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":87628,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":719,"num_read_kb":487,"num_write":447,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":46,"num_bytes_recovered":1018,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":434176,"data_stored":119892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":439,"ondisk_log_size":439,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1015,"num_read_kb":775,"num_write":393,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":273,"ondisk_log_size":273,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2055208960,"num_objects":540,"num_object_clones":0,"num_object_copies":1080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":540,"num_whiteouts":0,"num_read":370,"num_read_kb":1159213,"num_write":1440,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4110417920,"data_stored":4110417920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":560,"ondisk_log_size":560,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":57,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542173,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":626744,"kb_used_data":591388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93745096,"statfs":{"total":96636764160,"available":95994978304,"internally_reserved":0,"allocated":605581312,"data_stored":605099569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542174,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":529848,"kb_used_data":494500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93841992,"statfs":{"total":96636764160,"available":96094199808,"internally_reserved":0,"allocated":506368000,"data_stored":505928571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542174,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":658960,"kb_used_data":623608,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93712880,"statfs":{"total":96636764160,"available":95961989120,"internally_reserved":0,"allocated":638574592,"data_stored":638073679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542174,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":701892,"kb_used_data":666540,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93669948,"statfs":{"total":96636764160,"available":95918026752,"internally_reserved":0,"allocated":682536960,"data_stored":682096935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542174,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":667092,"kb_used_data":631744,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93704748,"statfs":{"total":96636764160,"available":95953661952,"internally_reserved":0,"allocated":646905856,"data_stored":646422885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542174,"num_pgs":61,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":495028,"kb_used_data":459672,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93876812,"statfs":{"total":96636764160,"available":96129855488,"internally_reserved":0,"allocated":470704128,"data_stored":470269135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":0,"seq":60129542173,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542174,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":589848,"kb_used_data":554492,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93781992,"statfs":{"total":96636764160,"available":96032759808,"internally_reserved":0,"allocated":567799808,"data_stored":567345372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":566231040,"data_stored":566231040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":469762048,"data_stored":469762048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":645922816,"data_stored":645922816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":681574400,"data_stored":681574400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":637534208,"data_stored":637534208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":505413632,"data_stored":505413632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":603979776,"data_stored":603979776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":17797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":1678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":17248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":40676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":17620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":23993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":21,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:07:46.117 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T17:07:46.117 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T17:07:46.148 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:46.144+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:46.185 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:46.185 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:46.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:46.185 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:46.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.185 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1239 3.16 3:6b2cb9ce:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:46.185 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:46.185 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.579642046000004, 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021398218, 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1239 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:46.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600991+0000", 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9559999999999999e-06 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606170+0000", 2024-09-12T17:07:46.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051789460000000002 2024-09-12T17:07:46.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606222+0000", 2024-09-12T17:07:46.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1422000000000003e-05 2024-09-12T17:07:46.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606249+0000", 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7163000000000001e-05 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606450+0000", 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000201325 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606877+0000", 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042682799999999997 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.607298+0000", 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042127700000000001 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.615845+0000", 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0085471260000000004 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622186+0000", 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063410690000000004 2024-09-12T17:07:46.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622292+0000", 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105305 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622385+0000", 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3801000000000005e-05 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1251 3.1d 3:ba0891d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.437302529999997, 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020778814999999999, 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1251 2024-09-12T17:07:46.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743330+0000", 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7000000000000002e-06 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748572+0000", 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052414710000000002 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748616+0000", 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4369000000000002e-05 2024-09-12T17:07:46.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748636+0000", 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9582999999999999e-05 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748778+0000", 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141867 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749017+0000", 2024-09-12T17:07:46.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000239218 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749233+0000", 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021619799999999999 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.756641+0000", 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074078089999999996 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763784+0000", 2024-09-12T17:07:46.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0071433809999999999 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763958+0000", 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000173862 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.764106+0000", 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014735700000000001 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1259 3.5 3:a1f83edd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.024414663000002, 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024500529, 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1259 2024-09-12T17:07:46.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.199 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:46.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:46.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156217+0000", 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8940000000000002e-06 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160482+0000", 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042645269999999997 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160513+0000", 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1228e-05 2024-09-12T17:07:46.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160526+0000", 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2976000000000001e-05 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160624+0000", 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8048999999999996e-05 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160825+0000", 2024-09-12T17:07:46.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020054799999999999 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160997+0000", 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017260499999999999 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.169300+0000", 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083027050000000005 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180595+0000", 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011294465 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180660+0000", 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5616000000000003e-05 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180715+0000", 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4916000000000001e-05 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.203 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1262 3.5 3:a3a998f2:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.969781951000002, 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020328525, 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.204 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1262 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210850+0000", 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.005e-06 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214862+0000", 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040120640000000001 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214903+0000", 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0831999999999998e-05 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214940+0000", 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7036000000000003e-05 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215059+0000", 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118631 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215237+0000", 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017834900000000001 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215406+0000", 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016896200000000001 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.221184+0000", 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057780130000000002 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231002+0000", 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0098174969999999997 2024-09-12T17:07:46.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231096+0000", 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4204999999999997e-05 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231176+0000", 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9931000000000004e-05 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1264 3.c 3:30907361:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.948858966000003, 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021106314000000001, 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1264 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231772+0000", 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1560000000000002e-06 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235787+0000", 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040149790000000001 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235824+0000", 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6956000000000003e-05 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235843+0000", 2024-09-12T17:07:46.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8315999999999999e-05 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235954+0000", 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111601 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236135+0000", 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000180941 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:46.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236302+0000", 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016626600000000001 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242422+0000", 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061200730000000002 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252655+0000", 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010232978 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252749+0000", 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4481000000000006e-05 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252877+0000", 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012756700000000001 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.216 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1265 3.22 3:44204d7e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:46.216 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:46.216 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.938370781000003, 2024-09-12T17:07:46.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021506441000000001, 2024-09-12T17:07:46.216 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.216 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.216 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.216 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.216 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.216 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.216 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1265 2024-09-12T17:07:46.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242262+0000", 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7299999999999999e-06 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246237+0000", 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039746989999999999 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246272+0000", 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5589000000000001e-05 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246290+0000", 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7107000000000001e-05 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246410+0000", 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119984 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246589+0000", 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000179853 2024-09-12T17:07:46.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246748+0000", 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158536 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252569+0000", 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058212810000000002 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263464+0000", 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010894406000000001 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263627+0000", 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000163833 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263765+0000", 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013742299999999999 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.221 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1269 3.c 3:3287b6aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.889743609, 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019007443999999998, 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.222 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1269 2024-09-12T17:07:46.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.223 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:46.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:46.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290890+0000", 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2529999999999998e-06 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294907+0000", 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004017189 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294952+0000", 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5252e-05 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294971+0000", 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8606000000000001e-05 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295107+0000", 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000135654 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295466+0000", 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000359448 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295948+0000", 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000482079 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.308012+0000", 2024-09-12T17:07:46.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012064210000000001 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309570+0000", 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015580839999999999 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309758+0000", 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000187522 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.227 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309893+0000", 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013514700000000001 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1275 3.16 3:68cda83e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 32.827046467000002, 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019055547999999999, 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.228 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.229 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.229 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.229 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.229 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1275 2024-09-12T17:07:46.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.229 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:46.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353586+0000", 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0769999999999999e-06 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359376+0000", 2024-09-12T17:07:46.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057904100000000002 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359400+0000", 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3805999999999999e-05 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359412+0000", 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2404e-05 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359522+0000", 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109685 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359767+0000", 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024471399999999999 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.360035+0000", 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026762699999999999 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372243+0000", 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012208169 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372526+0000", 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028289599999999998 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372581+0000", 2024-09-12T17:07:46.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5747e-05 2024-09-12T17:07:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372638+0000", 2024-09-12T17:07:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7012999999999998e-05 2024-09-12T17:07:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1390 3.2f 3:f51d0419:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:46.234 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.803853741000001, 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019302698, 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1390 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.235 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:46.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:46.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376779+0000", 2024-09-12T17:07:46.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8700000000000002e-06 2024-09-12T17:07:46.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381020+0000", 2024-09-12T17:07:46.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042401660000000001 2024-09-12T17:07:46.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381069+0000", 2024-09-12T17:07:46.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9279e-05 2024-09-12T17:07:46.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381098+0000", 2024-09-12T17:07:46.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9110000000000001e-05 2024-09-12T17:07:46.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381276+0000", 2024-09-12T17:07:46.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017790199999999999 2024-09-12T17:07:46.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381577+0000", 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030131400000000001 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381798+0000", 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022053200000000001 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.391131+0000", 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093337400000000001 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395755+0000", 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004624034 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395932+0000", 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000176317 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.396078+0000", 2024-09-12T17:07:46.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000146434 2024-09-12T17:07:46.241 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.241 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.241 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1408 3.2a 3:56341a86:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.376764615999999, 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.030673474999999999, 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1408 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.242 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:46.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:46.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803868+0000", 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1130000000000001e-06 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808291+0000", 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044233120000000004 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808331+0000", 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9869000000000001e-05 2024-09-12T17:07:46.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808351+0000", 2024-09-12T17:07:46.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9673e-05 2024-09-12T17:07:46.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808511+0000", 2024-09-12T17:07:46.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015999699999999999 2024-09-12T17:07:46.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808843+0000", 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033221900000000003 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.809106+0000", 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026355900000000002 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.827691+0000", 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018584471000000002 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834339+0000", 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066477790000000004 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834448+0000", 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109578 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834538+0000", 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9905000000000001e-05 2024-09-12T17:07:46.247 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1884 3.16 3:6a49863c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.25:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.022506791000001, 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02557398, 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.248 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1884 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158125+0000", 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1399999999999998e-06 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163204+0000", 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050792720000000001 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163244+0000", 2024-09-12T17:07:46.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0522000000000003e-05 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163262+0000", 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7872000000000001e-05 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163395+0000", 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013291799999999999 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163698+0000", 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030317700000000001 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.164523+0000", 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082438900000000002 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.181881+0000", 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017357991999999999 2024-09-12T17:07:46.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183465+0000", 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015843509999999999 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183583+0000", 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118025 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183696+0000", 2024-09-12T17:07:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113322 2024-09-12T17:07:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1923 3.1d 3:bbfa0a4b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.RvdbUUXkO22SF-kwzRd4VKnEQTGoFzf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.155534936, 2024-09-12T17:07:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.029952679999999999, 2024-09-12T17:07:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.254 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1923 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.255 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025097+0000", 2024-09-12T17:07:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6599999999999999e-06 2024-09-12T17:07:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033262+0000", 2024-09-12T17:07:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0081647409999999997 2024-09-12T17:07:46.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033304+0000", 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2138000000000002e-05 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033322+0000", 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8059000000000001e-05 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033512+0000", 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019057199999999999 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033775+0000", 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026250299999999998 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034023+0000", 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024751999999999999 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.047403+0000", 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013380845000000001 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054890+0000", 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074861529999999997 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054976+0000", 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6644999999999995e-05 2024-09-12T17:07:46.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.055047+0000", 2024-09-12T17:07:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0844000000000001e-05 2024-09-12T17:07:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1990 3.28 3:17f1f290:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.41:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:46.260 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.862837917, 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019908233000000001, 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1990 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317794+0000", 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.993e-06 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323013+0000", 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052182490000000003 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323051+0000", 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8343000000000002e-05 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323069+0000", 2024-09-12T17:07:46.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8082000000000001e-05 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323264+0000", 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019453499999999999 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323530+0000", 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026603999999999999 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:46.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.324371+0000", 2024-09-12T17:07:46.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00084152599999999999 2024-09-12T17:07:46.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.336666+0000", 2024-09-12T17:07:46.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012295276000000001 2024-09-12T17:07:46.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337488+0000", 2024-09-12T17:07:46.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082180399999999998 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337622+0000", 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000133864 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337700+0000", 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7521000000000005e-05 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.267 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2125 3.4 e73/51 3:235ee04f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.q5_4TTRRhSFZvQfgJaK5ATByAODjVXJ_1:head v 73'6, mlcod=71'4)", 2024-09-12T17:07:46.267 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:46.267 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.913432332999999, 2024-09-12T17:07:46.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024265888999999999, 2024-09-12T17:07:46.267 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.267 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.267 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.267 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0299999999999999e-07 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274450+0000", 2024-09-12T17:07:46.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0072528879999999999 2024-09-12T17:07:46.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274475+0000", 2024-09-12T17:07:46.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5185e-05 2024-09-12T17:07:46.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.269 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274491+0000", 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5305999999999999e-05 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274624+0000", 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000132915 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274681+0000", 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7340999999999999e-05 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.291377+0000", 2024-09-12T17:07:46.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016695451 2024-09-12T17:07:46.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.291463+0000", 2024-09-12T17:07:46.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6299999999999997e-05 2024-09-12T17:07:46.271 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.271 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.271 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2128 3.5 3:a25f4989:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.64:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.885205752999999, 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019706656999999999, 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.272 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2128 2024-09-12T17:07:46.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.273 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:46.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:46.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295427+0000", 2024-09-12T17:07:46.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4060000000000001e-06 2024-09-12T17:07:46.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299816+0000", 2024-09-12T17:07:46.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043890029999999998 2024-09-12T17:07:46.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299855+0000", 2024-09-12T17:07:46.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8955000000000002e-05 2024-09-12T17:07:46.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299873+0000", 2024-09-12T17:07:46.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8359000000000002e-05 2024-09-12T17:07:46.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.300038+0000", 2024-09-12T17:07:46.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016448100000000001 2024-09-12T17:07:46.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.300335+0000", 2024-09-12T17:07:46.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029776899999999997 2024-09-12T17:07:46.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:46.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.301250+0000", 2024-09-12T17:07:46.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00091437699999999996 2024-09-12T17:07:46.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.313996+0000", 2024-09-12T17:07:46.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012745975 2024-09-12T17:07:46.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.314902+0000", 2024-09-12T17:07:46.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00090575699999999998 2024-09-12T17:07:46.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.315023+0000", 2024-09-12T17:07:46.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012113899999999999 2024-09-12T17:07:46.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.315130+0000", 2024-09-12T17:07:46.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010743600000000001 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2158 3.3a 3:5f23622e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.69:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.192442233, 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025287745, 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.279 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.280 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.280 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2158 2024-09-12T17:07:46.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.280 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:46.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988190+0000", 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.897e-06 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992248+0000", 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040576420000000002 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992288+0000", 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9959000000000001e-05 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992305+0000", 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7813999999999999e-05 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992495+0000", 2024-09-12T17:07:46.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018977800000000001 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992759+0000", 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026367399999999998 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.993586+0000", 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082746299999999996 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.002363+0000", 2024-09-12T17:07:46.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087768069999999993 2024-09-12T17:07:46.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013296+0000", 2024-09-12T17:07:46.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010932871 2024-09-12T17:07:46.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013408+0000", 2024-09-12T17:07:46.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111709 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013475+0000", 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7131000000000005e-05 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2161 3.5 3:a0815047:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.1213Daer3gr3KDhM5kgqYBB_xC83lvZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:46.285 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.054046529000001, 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020142651000000001, 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2161 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126586+0000", 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9830000000000001e-06 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130385+0000", 2024-09-12T17:07:46.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037997009999999999 2024-09-12T17:07:46.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130415+0000", 2024-09-12T17:07:46.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9529000000000001e-05 2024-09-12T17:07:46.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130427+0000", 2024-09-12T17:07:46.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2351000000000001e-05 2024-09-12T17:07:46.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130516+0000", 2024-09-12T17:07:46.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8214999999999995e-05 2024-09-12T17:07:46.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130663+0000", 2024-09-12T17:07:46.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147145 2024-09-12T17:07:46.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:46.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130793+0000", 2024-09-12T17:07:46.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012986700000000001 2024-09-12T17:07:46.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.138966+0000", 2024-09-12T17:07:46.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0081739810000000003 2024-09-12T17:07:46.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146483+0000", 2024-09-12T17:07:46.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.007516928 2024-09-12T17:07:46.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146599+0000", 2024-09-12T17:07:46.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115932 2024-09-12T17:07:46.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146725+0000", 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000126019 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2195 3.c 3:337f05fc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.DSvxz4vaxxy0dMg8hp4VJxR3sCjbrFE_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.773024+0000", 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 9.4076056819999998, 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023923855000000001, 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.292 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.293 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.293 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.293 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.293 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.293 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2195 2024-09-12T17:07:46.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.293 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.293 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.293 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.773024+0000", 2024-09-12T17:07:46.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.773024+0000", 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.773027+0000", 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.574e-06 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777123+0000", 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040961000000000001 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777166+0000", 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2972000000000001e-05 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777185+0000", 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9269000000000001e-05 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777284+0000", 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8240999999999997e-05 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777444+0000", 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016014999999999999 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777586+0000", 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000142428 2024-09-12T17:07:46.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.784298+0000", 2024-09-12T17:07:46.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067112430000000004 2024-09-12T17:07:46.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.796855+0000", 2024-09-12T17:07:46.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012557474000000001 2024-09-12T17:07:46.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.796906+0000", 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0518e-05 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.796947+0000", 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1885999999999998e-05 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.298 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2330 3.c 3:312d3416:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.96:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:39.563180+0000", 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.6174494089999998, 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021299865000000001, 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2330 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.563180+0000", 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.563180+0000", 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.563182+0000", 2024-09-12T17:07:46.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6259999999999999e-06 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567288+0000", 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041051120000000002 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567319+0000", 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1788999999999997e-05 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567344+0000", 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4213e-05 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567493+0000", 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014904799999999999 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567854+0000", 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036099500000000002 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.568778+0000", 2024-09-12T17:07:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00092410500000000004 2024-09-12T17:07:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.583477+0000", 2024-09-12T17:07:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014699031 2024-09-12T17:07:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.584281+0000", 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080444299999999995 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.584387+0000", 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105753 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.584480+0000", 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2750000000000005e-05 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.304 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.305 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.305 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2351 3.1d 3:b93c23bf:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.-9Whj7OyWidDksiwzT19FTZdXgAbEF9_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:46.305 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:39.995677+0000", 2024-09-12T17:07:46.305 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 6.1849525219999997, 2024-09-12T17:07:46.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020208282000000001, 2024-09-12T17:07:46.305 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:46.305 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:46.305 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:46.305 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:46.305 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2351 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.995677+0000", 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.995677+0000", 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.995679+0000", 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6390000000000001e-06 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999600+0000", 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003920219 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999638+0000", 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8590999999999997e-05 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999662+0000", 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3366e-05 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999859+0000", 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000197617 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.000117+0000", 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025815099999999998 2024-09-12T17:07:46.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.000396+0000", 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027906099999999999 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.010299+0000", 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0099028009999999993 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.015705+0000", 2024-09-12T17:07:46.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054053230000000001 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.015810+0000", 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105287 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.015885+0000", 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5227000000000003e-05 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:46.310 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:46.311 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:46.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T17:07:46.313 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:46.313 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:46.308+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:46.317 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:07:46.413 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:46.408+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:46.491 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:46.492 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:46.492 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:46.492 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:46.498 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:46.498 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:46.506 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:46.530 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:46.531 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:46.549 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:46.544+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:46.549 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:46.549 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:46.567 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:46.568 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:46.588 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:46.588 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:46.607 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:46.607 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:46.613 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:46.608+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:46.626 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:46.626 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:46.648 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:46.648 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:46.681 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:46.681 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:46.695 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:46.743 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:46.740+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:46.816 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:46.812+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:46.825 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:46.825 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:46.841 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:46.917 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:46.912+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:47.014 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:47.014 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:47.018 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:47.012+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:47.029 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:47.118 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:47.112+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:47.201 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:47.201 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:47.216 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:47.219 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:47.212+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:47.313 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is set 2024-09-12T17:07:47.319 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:47.316+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:47.349 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:47.349 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:47.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:07:47.424 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:47.420+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:47.519 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:47.519 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:47.522 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:47.520+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:47.539 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:07:47.624 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:47.620+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:47.714 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:47.714 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:47.725 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:47.720+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:47.728 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:07:47.826 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:47.820+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:47.893 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:47.893 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:47.906 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:07:47.927 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:47.924+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:48.028 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:48.024+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:48.071 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:48.071 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:48.088 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:07:48.131 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:48.128+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:48.205 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:48.205 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:48.220 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:07:48.264 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:48.260+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:48.329 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:48.324+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:48.395 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:48.396 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:48.411 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:07:48.456 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:48.452+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:48.531 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:48.528+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:48.583 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:48.583 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:48.597 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:07:48.632 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:48.628+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:48.669 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:07:48.721 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:48.721 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:48.733 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:48.728+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:48.735 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:07:48.834 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:48.828+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:48.853 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:48.854 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:48.854 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:48.854 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:48.868 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:07:48.871 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:48.871 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:48.890 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:48.890 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:48.909 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:48.909 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:48.930 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:48.930 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:48.935 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:48.932+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:48.952 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:48.952 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:48.985 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:48.985 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:48.985 INFO:teuthology.orchestra.run.smithi017.stdout: "num_ops": 0 2024-09-12T17:07:48.985 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:48.988 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:48.989 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:48.998 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:07:49.024 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:49.024 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:49.035 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:49.032+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:49.136 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:49.132+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:49.140 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:49.140 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:49.140 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:49.154 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:07:49.237 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:49.232+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:49.316 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:49.317 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:49.317 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:49.317 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:49.317 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.317 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1201 3.8 3:114be366:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:49.317 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:49.318 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.49814851, 2024-09-12T17:07:49.318 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021172410999999999, 2024-09-12T17:07:49.318 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.318 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.318 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.318 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.319 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.319 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1201 2024-09-12T17:07:49.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.319 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.319 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:49.319 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.319 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.319 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.319 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:49.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812956+0000", 2024-09-12T17:07:49.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3050000000000001e-06 2024-09-12T17:07:49.320 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.320 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.320 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.320 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816133+0000", 2024-09-12T17:07:49.320 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031766699999999999 2024-09-12T17:07:49.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816165+0000", 2024-09-12T17:07:49.321 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2197999999999999e-05 2024-09-12T17:07:49.321 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.321 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.321 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.321 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816177+0000", 2024-09-12T17:07:49.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1973999999999999e-05 2024-09-12T17:07:49.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816249+0000", 2024-09-12T17:07:49.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1898999999999997e-05 2024-09-12T17:07:49.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.322 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.322 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.322 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816385+0000", 2024-09-12T17:07:49.322 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013646400000000001 2024-09-12T17:07:49.322 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:49.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816513+0000", 2024-09-12T17:07:49.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128097 2024-09-12T17:07:49.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.323 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.821736+0000", 2024-09-12T17:07:49.323 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052224869999999996 2024-09-12T17:07:49.323 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.323 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.323 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834015+0000", 2024-09-12T17:07:49.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012279784 2024-09-12T17:07:49.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834087+0000", 2024-09-12T17:07:49.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1935999999999997e-05 2024-09-12T17:07:49.324 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.324 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.324 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.324 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834125+0000", 2024-09-12T17:07:49.324 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7596999999999999e-05 2024-09-12T17:07:49.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.325 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.325 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.325 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.325 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.325 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1202 3.2 3:421b0e45:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:49.325 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:49.325 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.488364722999997, 2024-09-12T17:07:49.325 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018086743999999998, 2024-09-12T17:07:49.326 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.326 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.326 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.326 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.326 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1202 2024-09-12T17:07:49.326 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.326 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.326 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.327 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:49.327 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.327 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.327 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.327 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:49.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.328 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.328 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.328 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822739+0000", 2024-09-12T17:07:49.328 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2589999999999999e-06 2024-09-12T17:07:49.328 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824478+0000", 2024-09-12T17:07:49.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001739256 2024-09-12T17:07:49.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.329 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824502+0000", 2024-09-12T17:07:49.329 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3952999999999999e-05 2024-09-12T17:07:49.329 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.329 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.329 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.330 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824514+0000", 2024-09-12T17:07:49.330 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2031999999999999e-05 2024-09-12T17:07:49.330 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.330 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.330 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824577+0000", 2024-09-12T17:07:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2793999999999995e-05 2024-09-12T17:07:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.331 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824714+0000", 2024-09-12T17:07:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013785199999999999 2024-09-12T17:07:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824862+0000", 2024-09-12T17:07:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147751 2024-09-12T17:07:49.332 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.830267+0000", 2024-09-12T17:07:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054052670000000001 2024-09-12T17:07:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840734+0000", 2024-09-12T17:07:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010466938 2024-09-12T17:07:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.333 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840780+0000", 2024-09-12T17:07:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5831999999999998e-05 2024-09-12T17:07:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840823+0000", 2024-09-12T17:07:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2809999999999998e-05 2024-09-12T17:07:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.334 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1210 3.29 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.367620461999998, 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021481673, 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1210 2024-09-12T17:07:49.335 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.336 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943483+0000", 2024-09-12T17:07:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6520000000000002e-06 2024-09-12T17:07:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945771+0000", 2024-09-12T17:07:49.337 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022874829999999999 2024-09-12T17:07:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945806+0000", 2024-09-12T17:07:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4836999999999999e-05 2024-09-12T17:07:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945820+0000", 2024-09-12T17:07:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939e-05 2024-09-12T17:07:49.338 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945888+0000", 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7702999999999999e-05 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946027+0000", 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000139135 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946146+0000", 2024-09-12T17:07:49.339 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118742 2024-09-12T17:07:49.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.950285+0000", 2024-09-12T17:07:49.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041384880000000001 2024-09-12T17:07:49.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.340 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.340 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964885+0000", 2024-09-12T17:07:49.340 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014600594 2024-09-12T17:07:49.340 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.340 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964928+0000", 2024-09-12T17:07:49.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2536000000000001e-05 2024-09-12T17:07:49.341 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.341 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.341 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.341 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964962+0000", 2024-09-12T17:07:49.341 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4564000000000003e-05 2024-09-12T17:07:49.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.341 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.341 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.342 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.342 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.342 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1216 3.33 3:cf30ff9d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:49.342 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:49.342 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.303135687000001, 2024-09-12T17:07:49.342 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023290796999999999, 2024-09-12T17:07:49.342 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.342 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.342 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.342 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1216 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:49.343 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007968+0000", 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0580000000000002e-06 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009686+0000", 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017173920000000001 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.344 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009718+0000", 2024-09-12T17:07:49.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2632999999999997e-05 2024-09-12T17:07:49.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009734+0000", 2024-09-12T17:07:49.345 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6011999999999998e-05 2024-09-12T17:07:49.345 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.345 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.345 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.345 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009834+0000", 2024-09-12T17:07:49.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9947999999999999e-05 2024-09-12T17:07:49.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010000+0000", 2024-09-12T17:07:49.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016520599999999999 2024-09-12T17:07:49.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.346 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.346 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:49.346 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010133+0000", 2024-09-12T17:07:49.346 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133676 2024-09-12T17:07:49.346 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.015744+0000", 2024-09-12T17:07:49.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056104570000000001 2024-09-12T17:07:49.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.347 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031150+0000", 2024-09-12T17:07:49.347 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015405894999999999 2024-09-12T17:07:49.347 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.347 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.347 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031209+0000", 2024-09-12T17:07:49.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9247999999999999e-05 2024-09-12T17:07:49.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.348 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.348 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031256+0000", 2024-09-12T17:07:49.348 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7271999999999997e-05 2024-09-12T17:07:49.348 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.348 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.348 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.348 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.348 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1230 3.24 3:257b3201:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 36.827866636000003, 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018874753000000001, 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1230 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.349 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:49.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.350 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.350 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.350 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.350 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:49.350 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483238+0000", 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2880000000000001e-06 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485868+0000", 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026303490000000001 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.351 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485904+0000", 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5513999999999999e-05 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485920+0000", 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6201999999999998e-05 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486092+0000", 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017220700000000001 2024-09-12T17:07:49.352 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486500+0000", 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040771200000000002 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486750+0000", 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025026699999999998 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.353 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.500598+0000", 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013848226 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.501939+0000", 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013409839999999999 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502016+0000", 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6908000000000003e-05 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.354 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.355 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.355 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502109+0000", 2024-09-12T17:07:49.355 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3096000000000004e-05 2024-09-12T17:07:49.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.355 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.355 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.355 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.355 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.355 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1387 3.8 3:122cdcfa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:49.356 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:49.356 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 32.972812296000001, 2024-09-12T17:07:49.356 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018409291000000001, 2024-09-12T17:07:49.356 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.356 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.356 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.356 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.357 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.357 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1387 2024-09-12T17:07:49.357 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.357 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.358 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:49.358 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.358 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.358 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.358 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:49.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.359 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.359 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.359 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338292+0000", 2024-09-12T17:07:49.359 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.631e-06 2024-09-12T17:07:49.359 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340227+0000", 2024-09-12T17:07:49.360 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001934217 2024-09-12T17:07:49.360 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.360 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.360 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.360 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340262+0000", 2024-09-12T17:07:49.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5893999999999999e-05 2024-09-12T17:07:49.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.361 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.361 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340278+0000", 2024-09-12T17:07:49.361 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5325e-05 2024-09-12T17:07:49.361 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.361 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.362 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340387+0000", 2024-09-12T17:07:49.362 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010876 2024-09-12T17:07:49.362 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.362 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.362 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340570+0000", 2024-09-12T17:07:49.363 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018296299999999999 2024-09-12T17:07:49.363 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.363 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.363 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:49.363 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340735+0000", 2024-09-12T17:07:49.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568400000000001 2024-09-12T17:07:49.364 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.364 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.364 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.364 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.345914+0000", 2024-09-12T17:07:49.364 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051783319999999999 2024-09-12T17:07:49.365 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.365 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.365 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.365 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356536+0000", 2024-09-12T17:07:49.365 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010622529 2024-09-12T17:07:49.366 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.366 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.366 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.366 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356632+0000", 2024-09-12T17:07:49.366 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5927000000000005e-05 2024-09-12T17:07:49.367 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.367 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.367 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.367 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356698+0000", 2024-09-12T17:07:49.367 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6029000000000001e-05 2024-09-12T17:07:49.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.367 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.367 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.368 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.368 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.368 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1733 3.33 3:cd3b7926:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.M8SFsRZfEjvXnxNc1Ny07cg_vtwVJ9y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T17:07:49.368 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:49.368 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.243502704000001, 2024-09-12T17:07:49.368 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024112788, 2024-09-12T17:07:49.368 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.368 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.369 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.369 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.369 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1733 2024-09-12T17:07:49.369 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.370 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:49.370 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.370 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.370 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.370 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.370 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:49.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.371 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.371 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067603+0000", 2024-09-12T17:07:49.371 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.707e-06 2024-09-12T17:07:49.371 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.371 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072541+0000", 2024-09-12T17:07:49.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049382710000000002 2024-09-12T17:07:49.372 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.372 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.372 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.372 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072582+0000", 2024-09-12T17:07:49.372 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0392999999999998e-05 2024-09-12T17:07:49.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.373 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.373 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.373 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072606+0000", 2024-09-12T17:07:49.373 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4303000000000001e-05 2024-09-12T17:07:49.373 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072745+0000", 2024-09-12T17:07:49.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013889300000000001 2024-09-12T17:07:49.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.374 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.374 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.374 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072967+0000", 2024-09-12T17:07:49.374 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022192800000000001 2024-09-12T17:07:49.374 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:49.375 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.073233+0000", 2024-09-12T17:07:49.375 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026631499999999999 2024-09-12T17:07:49.375 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.375 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.375 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.086312+0000", 2024-09-12T17:07:49.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013078579 2024-09-12T17:07:49.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.376 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.376 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091563+0000", 2024-09-12T17:07:49.376 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052509369999999998 2024-09-12T17:07:49.376 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.376 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091648+0000", 2024-09-12T17:07:49.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5051999999999998e-05 2024-09-12T17:07:49.377 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.377 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.377 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.377 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091711+0000", 2024-09-12T17:07:49.377 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3410000000000004e-05 2024-09-12T17:07:49.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.377 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.377 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1887 3.33 3:cf01266b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.yI34Oa84OEb7C49UYPF9HCMJS_d1s3T_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 19.048015347, 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018315027000000001, 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.378 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1887 2024-09-12T17:07:49.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.379 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:49.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.379 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.379 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.379 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.379 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:49.379 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.380 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.380 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.380 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.380 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263090+0000", 2024-09-12T17:07:49.380 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0239999999999999e-06 2024-09-12T17:07:49.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.381 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.381 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265411+0000", 2024-09-12T17:07:49.381 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00232132 2024-09-12T17:07:49.381 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.381 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265443+0000", 2024-09-12T17:07:49.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1718999999999999e-05 2024-09-12T17:07:49.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.382 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.382 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.382 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265455+0000", 2024-09-12T17:07:49.382 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2143999999999999e-05 2024-09-12T17:07:49.382 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265535+0000", 2024-09-12T17:07:49.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9659000000000004e-05 2024-09-12T17:07:49.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.383 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.383 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265655+0000", 2024-09-12T17:07:49.383 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120902 2024-09-12T17:07:49.383 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.383 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:49.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265755+0000", 2024-09-12T17:07:49.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9761999999999998e-05 2024-09-12T17:07:49.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.384 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.272399+0000", 2024-09-12T17:07:49.384 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066442510000000003 2024-09-12T17:07:49.384 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.384 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.384 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281321+0000", 2024-09-12T17:07:49.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089219669999999994 2024-09-12T17:07:49.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.385 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.385 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281358+0000", 2024-09-12T17:07:49.385 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6355e-05 2024-09-12T17:07:49.385 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.385 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.386 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.386 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281401+0000", 2024-09-12T17:07:49.386 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2923999999999998e-05 2024-09-12T17:07:49.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.386 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.386 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.386 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.386 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.386 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1920 3.8 3:11cda29a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.31:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:49.386 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:49.386 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.397246748000001, 2024-09-12T17:07:49.387 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022252124000000002, 2024-09-12T17:07:49.387 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.387 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.387 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.387 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.387 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1920 2024-09-12T17:07:49.387 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.387 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.387 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:49.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.388 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:49.388 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.388 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.388 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.388 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913858+0000", 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0770000000000001e-06 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917854+0000", 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039960600000000001 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917898+0000", 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3689999999999997e-05 2024-09-12T17:07:49.389 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917917+0000", 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9233e-05 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.918051+0000", 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133969 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.918315+0000", 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000263355 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.919198+0000", 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00088375200000000002 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.928506+0000", 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0093070960000000008 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936025+0000", 2024-09-12T17:07:49.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075193400000000002 2024-09-12T17:07:49.392 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.392 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.392 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.392 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936073+0000", 2024-09-12T17:07:49.392 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8012e-05 2024-09-12T17:07:49.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.393 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.393 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936106+0000", 2024-09-12T17:07:49.393 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3540000000000001e-05 2024-09-12T17:07:49.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.393 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.393 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.393 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.393 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.393 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1938 3.19 3:9addcbec:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.34:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.978106253, 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020463775, 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1938 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.394 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332997+0000", 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5100000000000001e-06 2024-09-12T17:07:49.395 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337007+0000", 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040099979999999999 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337054+0000", 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6826000000000002e-05 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.396 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337073+0000", 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8743e-05 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337189+0000", 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116507 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337415+0000", 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022530099999999999 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.397 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.338022+0000", 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00060701600000000004 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.347566+0000", 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0095447150000000005 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353379+0000", 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058124170000000003 2024-09-12T17:07:49.398 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353425+0000", 2024-09-12T17:07:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5824e-05 2024-09-12T17:07:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353459+0000", 2024-09-12T17:07:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3918000000000003e-05 2024-09-12T17:07:49.399 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2101 3.24 3:25ca6521:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.4pZZCgy-wBJXiNQ0J0vFl8TPz4X_i3J_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.500316593999999, 2024-09-12T17:07:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018837217999999999, 2024-09-12T17:07:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.400 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2101 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.401 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810788+0000", 2024-09-12T17:07:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0069999999999999e-06 2024-09-12T17:07:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.402 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812434+0000", 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016459020000000001 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812468+0000", 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3173999999999998e-05 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812482+0000", 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3985000000000001e-05 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.403 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812582+0000", 2024-09-12T17:07:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100801 2024-09-12T17:07:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812780+0000", 2024-09-12T17:07:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000197219 2024-09-12T17:07:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:49.404 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812965+0000", 2024-09-12T17:07:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018523500000000001 2024-09-12T17:07:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.818504+0000", 2024-09-12T17:07:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055390429999999996 2024-09-12T17:07:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.405 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829488+0000", 2024-09-12T17:07:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010984551 2024-09-12T17:07:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829565+0000", 2024-09-12T17:07:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7106000000000003e-05 2024-09-12T17:07:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829622+0000", 2024-09-12T17:07:49.406 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6195e-05 2024-09-12T17:07:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2107 3.27 3:e6a067b7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.Yyze1zZ5yDQsQYVWfVwDqF36m9lCinJ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.399348310000001, 2024-09-12T17:07:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020701105000000001, 2024-09-12T17:07:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.407 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2107 2024-09-12T17:07:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911756+0000", 2024-09-12T17:07:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.557e-06 2024-09-12T17:07:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.409 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913489+0000", 2024-09-12T17:07:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001732623 2024-09-12T17:07:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913518+0000", 2024-09-12T17:07:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8949e-05 2024-09-12T17:07:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.410 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913530+0000", 2024-09-12T17:07:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1691999999999999e-05 2024-09-12T17:07:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.412 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913612+0000", 2024-09-12T17:07:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2706000000000004e-05 2024-09-12T17:07:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913803+0000", 2024-09-12T17:07:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000190695 2024-09-12T17:07:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913972+0000", 2024-09-12T17:07:49.413 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000169536 2024-09-12T17:07:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.919843+0000", 2024-09-12T17:07:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058703280000000002 2024-09-12T17:07:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932289+0000", 2024-09-12T17:07:49.414 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0124463 2024-09-12T17:07:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932386+0000", 2024-09-12T17:07:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7108999999999995e-05 2024-09-12T17:07:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932454+0000", 2024-09-12T17:07:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7609999999999998e-05 2024-09-12T17:07:49.415 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2134 3.19 3:9a3dd654:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.65:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.881460482, 2024-09-12T17:07:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021094020000000002, 2024-09-12T17:07:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.416 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2134 2024-09-12T17:07:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.417 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429643+0000", 2024-09-12T17:07:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.588e-06 2024-09-12T17:07:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.418 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431844+0000", 2024-09-12T17:07:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022009040000000001 2024-09-12T17:07:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431875+0000", 2024-09-12T17:07:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1217999999999998e-05 2024-09-12T17:07:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431889+0000", 2024-09-12T17:07:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-12T17:07:49.419 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.432039+0000", 2024-09-12T17:07:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015003799999999999 2024-09-12T17:07:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.432481+0000", 2024-09-12T17:07:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00044164399999999999 2024-09-12T17:07:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.420 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.433634+0000", 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011532059999999999 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.449117+0000", 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015483241999999999 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450419+0000", 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001301466 2024-09-12T17:07:49.421 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450606+0000", 2024-09-12T17:07:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000187009 2024-09-12T17:07:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450735+0000", 2024-09-12T17:07:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012906199999999999 2024-09-12T17:07:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.422 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2143 3.7 3:e0f27ed8:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.WqbBAH1T3u9gjF2P42eNw2YQ0hm2xWo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.655215+0000", 2024-09-12T17:07:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 13.655886198999999, 2024-09-12T17:07:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019844753999999999, 2024-09-12T17:07:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.423 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.424 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2143 2024-09-12T17:07:49.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.424 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.655215+0000", 2024-09-12T17:07:49.424 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.424 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.424 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.424 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.424 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.655215+0000", 2024-09-12T17:07:49.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.655219+0000", 2024-09-12T17:07:49.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8600000000000003e-06 2024-09-12T17:07:49.425 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.425 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.425 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.425 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657519+0000", 2024-09-12T17:07:49.425 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023000149999999999 2024-09-12T17:07:49.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657547+0000", 2024-09-12T17:07:49.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8489000000000001e-05 2024-09-12T17:07:49.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.426 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.426 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657559+0000", 2024-09-12T17:07:49.426 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058999999999999e-05 2024-09-12T17:07:49.426 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.426 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657657+0000", 2024-09-12T17:07:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7965000000000001e-05 2024-09-12T17:07:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657816+0000", 2024-09-12T17:07:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001584 2024-09-12T17:07:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:49.427 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657946+0000", 2024-09-12T17:07:49.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000130667 2024-09-12T17:07:49.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.662762+0000", 2024-09-12T17:07:49.428 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048154859999999999 2024-09-12T17:07:49.428 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.428 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.428 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.428 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.674927+0000", 2024-09-12T17:07:49.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012165364 2024-09-12T17:07:49.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.674997+0000", 2024-09-12T17:07:49.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0173999999999996e-05 2024-09-12T17:07:49.429 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.429 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.429 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.429 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.675060+0000", 2024-09-12T17:07:49.429 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2274999999999996e-05 2024-09-12T17:07:49.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.430 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.430 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.430 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.430 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.430 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2179 3.33 3:cc4cab85:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.BhsaRTISTLDImeesX85vqIql3rkxI1u_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:49.430 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.575783+0000", 2024-09-12T17:07:49.430 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.735318424999999, 2024-09-12T17:07:49.430 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.065094399999999997, 2024-09-12T17:07:49.430 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.430 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.431 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.431 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.431 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2179 2024-09-12T17:07:49.431 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.431 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.431 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.431 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.431 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.575783+0000", 2024-09-12T17:07:49.431 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.575783+0000", 2024-09-12T17:07:49.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.432 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.432 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.432 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.432 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.575787+0000", 2024-09-12T17:07:49.432 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9530000000000001e-06 2024-09-12T17:07:49.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579440+0000", 2024-09-12T17:07:49.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036530640000000001 2024-09-12T17:07:49.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.433 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.433 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.433 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579477+0000", 2024-09-12T17:07:49.433 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7845000000000001e-05 2024-09-12T17:07:49.433 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579492+0000", 2024-09-12T17:07:49.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4275e-05 2024-09-12T17:07:49.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.434 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.434 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579676+0000", 2024-09-12T17:07:49.434 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000184031 2024-09-12T17:07:49.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579895+0000", 2024-09-12T17:07:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219302 2024-09-12T17:07:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.580106+0000", 2024-09-12T17:07:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000210922 2024-09-12T17:07:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.435 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639924+0000", 2024-09-12T17:07:49.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.059817951000000001 2024-09-12T17:07:49.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.640589+0000", 2024-09-12T17:07:49.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066520200000000005 2024-09-12T17:07:49.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.436 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.436 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.640754+0000", 2024-09-12T17:07:49.436 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016527600000000001 2024-09-12T17:07:49.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.437 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.437 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.640877+0000", 2024-09-12T17:07:49.437 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012257899999999999 2024-09-12T17:07:49.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.437 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.437 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2180 3.8 3:123ed638:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.BhsaRTISTLDImeesX85vqIql3rkxI1u_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:49.438 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.586208+0000", 2024-09-12T17:07:49.438 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.724893322, 2024-09-12T17:07:49.438 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052320799000000001, 2024-09-12T17:07:49.438 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.438 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.438 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.438 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.438 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.438 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.438 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2180 2024-09-12T17:07:49.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.438 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.586208+0000", 2024-09-12T17:07:49.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.439 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.586208+0000", 2024-09-12T17:07:49.439 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.439 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.586210+0000", 2024-09-12T17:07:49.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.661e-06 2024-09-12T17:07:49.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.440 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587685+0000", 2024-09-12T17:07:49.440 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014748249999999999 2024-09-12T17:07:49.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.440 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587706+0000", 2024-09-12T17:07:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0996e-05 2024-09-12T17:07:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587718+0000", 2024-09-12T17:07:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2001000000000001e-05 2024-09-12T17:07:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.441 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587815+0000", 2024-09-12T17:07:49.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6900999999999999e-05 2024-09-12T17:07:49.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587993+0000", 2024-09-12T17:07:49.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017817899999999999 2024-09-12T17:07:49.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.442 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:49.442 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.588130+0000", 2024-09-12T17:07:49.442 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013711600000000001 2024-09-12T17:07:49.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636926+0000", 2024-09-12T17:07:49.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048795660999999997 2024-09-12T17:07:49.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.443 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.443 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.638267+0000", 2024-09-12T17:07:49.443 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013408770000000001 2024-09-12T17:07:49.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.638393+0000", 2024-09-12T17:07:49.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012611 2024-09-12T17:07:49.444 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.444 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.444 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.444 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.638529+0000", 2024-09-12T17:07:49.444 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013547200000000001 2024-09-12T17:07:49.444 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.444 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.445 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.445 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.445 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop_reply(client.4434.0:2179 3.33 e73/24 ondisk, result = 0)", 2024-09-12T17:07:49.445 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.591277+0000", 2024-09-12T17:07:49.445 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.719823856, 2024-09-12T17:07:49.445 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048673934000000002, 2024-09-12T17:07:49.445 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.445 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.445 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T17:07:49.445 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.445 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591277+0000", 2024-09-12T17:07:49.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591277+0000", 2024-09-12T17:07:49.446 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.446 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.446 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.446 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.446 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591279+0000", 2024-09-12T17:07:49.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.717e-06 2024-09-12T17:07:49.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591288+0000", 2024-09-12T17:07:49.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8799999999999997e-06 2024-09-12T17:07:49.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.447 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.447 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.631851+0000", 2024-09-12T17:07:49.447 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040563601999999997 2024-09-12T17:07:49.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.631880+0000", 2024-09-12T17:07:49.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8779999999999999e-05 2024-09-12T17:07:49.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.448 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.448 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639863+0000", 2024-09-12T17:07:49.448 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079828290000000003 2024-09-12T17:07:49.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639887+0000", 2024-09-12T17:07:49.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4156999999999999e-05 2024-09-12T17:07:49.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.449 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.449 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639951+0000", 2024-09-12T17:07:49.449 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T17:07:49.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.449 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.450 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop_reply(client.4434.0:2180 3.8 e73/51 ondisk, result = 0)", 2024-09-12T17:07:49.450 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.594180+0000", 2024-09-12T17:07:49.450 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.716921339000001, 2024-09-12T17:07:49.450 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04275955, 2024-09-12T17:07:49.450 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.450 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.450 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T17:07:49.450 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594180+0000", 2024-09-12T17:07:49.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.451 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.451 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594180+0000", 2024-09-12T17:07:49.451 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594181+0000", 2024-09-12T17:07:49.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.683e-06 2024-09-12T17:07:49.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.452 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.452 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594190+0000", 2024-09-12T17:07:49.452 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6079999999999996e-06 2024-09-12T17:07:49.452 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.452 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.632075+0000", 2024-09-12T17:07:49.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037884843000000001 2024-09-12T17:07:49.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.453 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.632268+0000", 2024-09-12T17:07:49.453 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019365300000000001 2024-09-12T17:07:49.453 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.453 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.453 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636902+0000", 2024-09-12T17:07:49.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004633936 2024-09-12T17:07:49.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636917+0000", 2024-09-12T17:07:49.454 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4324e-05 2024-09-12T17:07:49.454 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.454 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.454 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.454 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636939+0000", 2024-09-12T17:07:49.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2503000000000001e-05 2024-09-12T17:07:49.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.455 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.455 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.455 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.455 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.455 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:2195 3.c e73/24 3:337f05fc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.DSvxz4vaxxy0dMg8hp4VJxR3sCjbrFE_1:head v 73'10, mlcod=72'8)", 2024-09-12T17:07:49.455 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.777412+0000", 2024-09-12T17:07:49.455 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 12.533688953, 2024-09-12T17:07:49.455 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018679920999999999, 2024-09-12T17:07:49.455 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.456 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.456 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.456 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.777412+0000", 2024-09-12T17:07:49.456 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.456 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.456 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.456 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.456 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.777412+0000", 2024-09-12T17:07:49.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.777416+0000", 2024-09-12T17:07:49.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0029999999999996e-06 2024-09-12T17:07:49.457 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.457 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.457 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.457 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783541+0000", 2024-09-12T17:07:49.457 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061247070000000001 2024-09-12T17:07:49.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783584+0000", 2024-09-12T17:07:49.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3498999999999998e-05 2024-09-12T17:07:49.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.458 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.458 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.458 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783610+0000", 2024-09-12T17:07:49.458 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5406999999999999e-05 2024-09-12T17:07:49.458 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783809+0000", 2024-09-12T17:07:49.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019944900000000001 2024-09-12T17:07:49.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.459 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.459 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783882+0000", 2024-09-12T17:07:49.459 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3308999999999999e-05 2024-09-12T17:07:49.459 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.459 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.796030+0000", 2024-09-12T17:07:49.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012147217 2024-09-12T17:07:49.460 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.460 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.460 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.460 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.796092+0000", 2024-09-12T17:07:49.460 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2329999999999994e-05 2024-09-12T17:07:49.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.460 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.460 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.461 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.461 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.461 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2327 3.33 3:ce967cb5:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.MVmoorSq8SMskXgSj5cJmk32Q3--ssn_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:49.461 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:39.530634+0000", 2024-09-12T17:07:49.461 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 9.7804669260000008, 2024-09-12T17:07:49.461 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026980457999999999, 2024-09-12T17:07:49.461 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:49.461 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:49.461 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:49.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:49.461 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.462 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2327 2024-09-12T17:07:49.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.462 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:49.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:49.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.530634+0000", 2024-09-12T17:07:49.462 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.462 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.462 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.462 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:49.462 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.530634+0000", 2024-09-12T17:07:49.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:49.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:49.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.530636+0000", 2024-09-12T17:07:49.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-06 2024-09-12T17:07:49.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.463 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.463 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:49.463 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532507+0000", 2024-09-12T17:07:49.463 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001870802 2024-09-12T17:07:49.463 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:49.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532533+0000", 2024-09-12T17:07:49.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6098e-05 2024-09-12T17:07:49.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.464 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.464 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532547+0000", 2024-09-12T17:07:49.464 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3944000000000001e-05 2024-09-12T17:07:49.464 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.464 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:49.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532632+0000", 2024-09-12T17:07:49.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4894000000000004e-05 2024-09-12T17:07:49.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:49.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532791+0000", 2024-09-12T17:07:49.465 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015956799999999999 2024-09-12T17:07:49.465 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.465 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.465 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:49.465 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532920+0000", 2024-09-12T17:07:49.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012916699999999999 2024-09-12T17:07:49.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:49.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.538587+0000", 2024-09-12T17:07:49.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056661130000000004 2024-09-12T17:07:49.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.466 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.466 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.466 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.557478+0000", 2024-09-12T17:07:49.466 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018891181999999999 2024-09-12T17:07:49.466 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.557556+0000", 2024-09-12T17:07:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7875999999999998e-05 2024-09-12T17:07:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.557615+0000", 2024-09-12T17:07:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8941999999999999e-05 2024-09-12T17:07:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.467 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.468 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:49.468 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:49.468 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:49.468 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T17:07:49.470 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:49.468+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:49.470 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:07:49.570 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:49.564+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:49.611 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:49.612 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:49.612 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:49.626 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:07:49.671 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:49.668+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:49.772 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:49.768+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:49.802 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:49.802 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:49.802 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:49.802 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:49.802 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:49.818 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:07:49.873 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:49.868+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:49.973 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:49.968+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:49.988 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:49.989 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:49.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:49.989 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:49.989 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.989 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1188 3.31 3:8d857c15:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:49.989 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:49.989 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 38.490430828999997, 2024-09-12T17:07:49.989 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019168672000000001, 2024-09-12T17:07:49.989 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:49.989 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:49.989 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1188 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:49.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493824+0000", 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.553e-06 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497820+0000", 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039958659999999998 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:49.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497855+0000", 2024-09-12T17:07:49.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4956000000000002e-05 2024-09-12T17:07:49.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497872+0000", 2024-09-12T17:07:49.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6863000000000001e-05 2024-09-12T17:07:49.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:49.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497996+0000", 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124306 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498229+0000", 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023307699999999999 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498994+0000", 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076469699999999995 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.507996+0000", 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090021540000000001 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512687+0000", 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046905360000000004 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512861+0000", 2024-09-12T17:07:49.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017420399999999999 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512990+0000", 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012946 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1232 3.14 3:2967aafe:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.463977921000001, 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019509183999999999, 2024-09-12T17:07:49.995 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:49.996 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:49.996 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:49.996 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:49.996 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:49.996 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:49.996 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1232 2024-09-12T17:07:49.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.996 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:49.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:49.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:49.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:49.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:49.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:49.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:49.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:49.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520278+0000", 2024-09-12T17:07:49.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9539999999999998e-06 2024-09-12T17:07:49.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525478+0000", 2024-09-12T17:07:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005199665 2024-09-12T17:07:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525520+0000", 2024-09-12T17:07:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2391999999999997e-05 2024-09-12T17:07:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525542+0000", 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1613000000000001e-05 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525676+0000", 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013434300000000001 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525933+0000", 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025640400000000001 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:49.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:50.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.526162+0000", 2024-09-12T17:07:50.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228722 2024-09-12T17:07:50.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.000 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.534431+0000", 2024-09-12T17:07:50.000 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082696019999999992 2024-09-12T17:07:50.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.000 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.000 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539449+0000", 2024-09-12T17:07:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050177099999999999 2024-09-12T17:07:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539640+0000", 2024-09-12T17:07:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190812 2024-09-12T17:07:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539784+0000", 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143967 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1234 3.3 3:c0bf349d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.438806976000002, 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019413466000000001, 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.002 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1234 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545450+0000", 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.313e-06 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549431+0000", 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039813139999999997 2024-09-12T17:07:50.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549472+0000", 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0828999999999998e-05 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549491+0000", 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9055999999999998e-05 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549627+0000", 2024-09-12T17:07:50.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013646700000000001 2024-09-12T17:07:50.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549859+0000", 2024-09-12T17:07:50.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023186100000000001 2024-09-12T17:07:50.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.006 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:50.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.550208+0000", 2024-09-12T17:07:50.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000348372 2024-09-12T17:07:50.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.559516+0000", 2024-09-12T17:07:50.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093083260000000004 2024-09-12T17:07:50.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564688+0000", 2024-09-12T17:07:50.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051717849999999999 2024-09-12T17:07:50.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564783+0000", 2024-09-12T17:07:50.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4821000000000006e-05 2024-09-12T17:07:50.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564859+0000", 2024-09-12T17:07:50.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6322000000000006e-05 2024-09-12T17:07:50.009 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.009 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.009 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.010 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1235 3.1c e63/45 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:50.010 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:50.010 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.421740839999998, 2024-09-12T17:07:50.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023527869, 2024-09-12T17:07:50.010 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.010 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.010 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.010 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.010 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562514+0000", 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:50.011 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570603+0000", 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080886359999999997 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570630+0000", 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7276000000000001e-05 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.012 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570642+0000", 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2153e-05 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570805+0000", 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016319899999999999 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570900+0000", 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4988000000000006e-05 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.585884+0000", 2024-09-12T17:07:50.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014984046000000001 2024-09-12T17:07:50.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.586039+0000", 2024-09-12T17:07:50.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155184 2024-09-12T17:07:50.015 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.015 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.015 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.015 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1247 3.1a 3:58056b43:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:50.015 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:50.016 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.283214798000003, 2024-09-12T17:07:50.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021958978000000001, 2024-09-12T17:07:50.016 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.016 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.016 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.016 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.016 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.016 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.017 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1247 2024-09-12T17:07:50.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.017 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:50.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:50.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701041+0000", 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9399999999999998e-06 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705529+0000", 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044889789999999997 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705569+0000", 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9606e-05 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705588+0000", 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9375999999999999e-05 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705756+0000", 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016734200000000001 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706045+0000", 2024-09-12T17:07:50.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028885400000000001 2024-09-12T17:07:50.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:50.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706343+0000", 2024-09-12T17:07:50.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029790300000000002 2024-09-12T17:07:50.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720973+0000", 2024-09-12T17:07:50.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014630684 2024-09-12T17:07:50.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722653+0000", 2024-09-12T17:07:50.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016799790000000001 2024-09-12T17:07:50.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722878+0000", 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022488799999999999 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722997+0000", 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118427 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1376 3.3 3:c01937d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.765025891000001, 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020435229999999999, 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1376 2024-09-12T17:07:50.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219230+0000", 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.23e-06 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223391+0000", 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041610629999999996 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223425+0000", 2024-09-12T17:07:50.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4167e-05 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223443+0000", 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8105999999999999e-05 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223562+0000", 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118861 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223840+0000", 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027762099999999998 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.224077+0000", 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023720100000000001 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.232976+0000", 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0088992900000000007 2024-09-12T17:07:50.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239478+0000", 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065023609999999999 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239574+0000", 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5527999999999997e-05 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.032 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239662+0000", 2024-09-12T17:07:50.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7801999999999997e-05 2024-09-12T17:07:50.033 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.033 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.033 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.033 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.033 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1382 3.1a 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:50.033 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:50.033 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.698358939000002, 2024-09-12T17:07:50.033 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020895593, 2024-09-12T17:07:50.033 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.033 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.034 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.034 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.034 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.034 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.034 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1382 2024-09-12T17:07:50.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.034 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:50.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:50.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285897+0000", 2024-09-12T17:07:50.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6669999999999998e-06 2024-09-12T17:07:50.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290617+0000", 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047198689999999998 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290657+0000", 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0201999999999999e-05 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290676+0000", 2024-09-12T17:07:50.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9293e-05 2024-09-12T17:07:50.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290860+0000", 2024-09-12T17:07:50.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000183353 2024-09-12T17:07:50.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291264+0000", 2024-09-12T17:07:50.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040463800000000002 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291676+0000", 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041151499999999999 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301391+0000", 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0097147350000000004 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306412+0000", 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050210790000000003 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306636+0000", 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000224589 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306789+0000", 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015265299999999999 2024-09-12T17:07:50.039 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.040 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.040 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.040 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1385 3.34 3:2f3cb087:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:50.040 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:50.040 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.666333833000003, 2024-09-12T17:07:50.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024744103999999999, 2024-09-12T17:07:50.041 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.041 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.041 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.041 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1385 2024-09-12T17:07:50.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.041 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.041 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.041 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:50.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:50.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317922+0000", 2024-09-12T17:07:50.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.157e-06 2024-09-12T17:07:50.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322800+0000", 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048785879999999997 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322846+0000", 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5732999999999997e-05 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322866+0000", 2024-09-12T17:07:50.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0415999999999999e-05 2024-09-12T17:07:50.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323048+0000", 2024-09-12T17:07:50.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018128 2024-09-12T17:07:50.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323496+0000", 2024-09-12T17:07:50.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044786400000000002 2024-09-12T17:07:50.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:50.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323919+0000", 2024-09-12T17:07:50.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042374399999999999 2024-09-12T17:07:50.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.340076+0000", 2024-09-12T17:07:50.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016156925999999999 2024-09-12T17:07:50.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342379+0000", 2024-09-12T17:07:50.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023025189999999998 2024-09-12T17:07:50.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342546+0000", 2024-09-12T17:07:50.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016719599999999999 2024-09-12T17:07:50.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342663+0000", 2024-09-12T17:07:50.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116681 2024-09-12T17:07:50.047 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.047 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.047 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.047 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1409 3.a e64/24 3:53d4fdcd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_3:head v 64'6, mlcod=64'4)", 2024-09-12T17:07:50.047 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:50.047 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.162854291000002, 2024-09-12T17:07:50.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021472076, 2024-09-12T17:07:50.047 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.047 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.048 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.048 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:50.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:50.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821402+0000", 2024-09-12T17:07:50.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4699999999999998e-06 2024-09-12T17:07:50.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828337+0000", 2024-09-12T17:07:50.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069354229999999996 2024-09-12T17:07:50.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828387+0000", 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9908999999999999e-05 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828412+0000", 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5389999999999999e-05 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828587+0000", 2024-09-12T17:07:50.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017425599999999999 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828654+0000", 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7708999999999998e-05 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842774+0000", 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014119860999999999 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.051 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842870+0000", 2024-09-12T17:07:50.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6057999999999994e-05 2024-09-12T17:07:50.052 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.052 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.052 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.052 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1417 3.14 3:29a29b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.061525885999998, 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.034043223999999997, 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1417 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922731+0000", 2024-09-12T17:07:50.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1099999999999996e-06 2024-09-12T17:07:50.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930785+0000", 2024-09-12T17:07:50.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080541020000000005 2024-09-12T17:07:50.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930841+0000", 2024-09-12T17:07:50.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6005999999999999e-05 2024-09-12T17:07:50.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930869+0000", 2024-09-12T17:07:50.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8602000000000002e-05 2024-09-12T17:07:50.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931049+0000", 2024-09-12T17:07:50.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017998299999999999 2024-09-12T17:07:50.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931287+0000", 2024-09-12T17:07:50.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000237712 2024-09-12T17:07:50.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:50.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931510+0000", 2024-09-12T17:07:50.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022283200000000001 2024-09-12T17:07:50.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941891+0000", 2024-09-12T17:07:50.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010380785 2024-09-12T17:07:50.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.955891+0000", 2024-09-12T17:07:50.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014000207000000001 2024-09-12T17:07:50.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956636+0000", 2024-09-12T17:07:50.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00074503099999999995 2024-09-12T17:07:50.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956770+0000", 2024-09-12T17:07:50.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013385400000000001 2024-09-12T17:07:50.059 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.059 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.059 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1420 3.3 3:c118c659:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.032232069999999, 2024-09-12T17:07:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022394282000000001, 2024-09-12T17:07:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.060 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1420 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.061 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952024+0000", 2024-09-12T17:07:50.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1760000000000003e-06 2024-09-12T17:07:50.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958458+0000", 2024-09-12T17:07:50.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064335770000000002 2024-09-12T17:07:50.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958492+0000", 2024-09-12T17:07:50.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4309e-05 2024-09-12T17:07:50.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958508+0000", 2024-09-12T17:07:50.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5699999999999999e-05 2024-09-12T17:07:50.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958717+0000", 2024-09-12T17:07:50.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020871900000000001 2024-09-12T17:07:50.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959163+0000", 2024-09-12T17:07:50.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000446007 2024-09-12T17:07:50.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:50.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959583+0000", 2024-09-12T17:07:50.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042026800000000001 2024-09-12T17:07:50.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.970389+0000", 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010806375999999999 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974044+0000", 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003654352 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974232+0000", 2024-09-12T17:07:50.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018811899999999999 2024-09-12T17:07:50.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974415+0000", 2024-09-12T17:07:50.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018267899999999999 2024-09-12T17:07:50.066 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.066 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.066 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.067 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1896 3.2c e71/24 3:3773d78b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.27:head v 71'8, mlcod=71'6)", 2024-09-12T17:07:50.067 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:50.067 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.580195863, 2024-09-12T17:07:50.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021824796, 2024-09-12T17:07:50.067 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.067 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.067 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.067 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:50.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.068 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.068 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:50.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.068 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404059+0000", 2024-09-12T17:07:50.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.537e-06 2024-09-12T17:07:50.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408616+0000", 2024-09-12T17:07:50.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045564799999999999 2024-09-12T17:07:50.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408657+0000", 2024-09-12T17:07:50.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1968000000000002e-05 2024-09-12T17:07:50.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408676+0000", 2024-09-12T17:07:50.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8445999999999999e-05 2024-09-12T17:07:50.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408880+0000", 2024-09-12T17:07:50.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020370100000000001 2024-09-12T17:07:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408952+0000", 2024-09-12T17:07:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2226999999999998e-05 2024-09-12T17:07:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.425787+0000", 2024-09-12T17:07:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016835383999999998 2024-09-12T17:07:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.425881+0000", 2024-09-12T17:07:50.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4053000000000002e-05 2024-09-12T17:07:50.072 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.072 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.072 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.072 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1917 3.1a 3:5b4c0dd7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.P_wej9y73GH8iAzyXzEiqKNwtELtJTp_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:50.072 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:50.072 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.100283471000001, 2024-09-12T17:07:50.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026569157999999999, 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1917 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:50.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883971+0000", 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4030000000000001e-06 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890727+0000", 2024-09-12T17:07:50.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067561080000000003 2024-09-12T17:07:50.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890770+0000", 2024-09-12T17:07:50.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2614999999999998e-05 2024-09-12T17:07:50.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890794+0000", 2024-09-12T17:07:50.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3808999999999999e-05 2024-09-12T17:07:50.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890964+0000", 2024-09-12T17:07:50.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000169956 2024-09-12T17:07:50.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.891223+0000", 2024-09-12T17:07:50.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025883600000000003 2024-09-12T17:07:50.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.891466+0000", 2024-09-12T17:07:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000242883 2024-09-12T17:07:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.909542+0000", 2024-09-12T17:07:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018076262999999999 2024-09-12T17:07:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910349+0000", 2024-09-12T17:07:50.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080699299999999999 2024-09-12T17:07:50.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910447+0000", 2024-09-12T17:07:50.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8301999999999995e-05 2024-09-12T17:07:50.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910538+0000", 2024-09-12T17:07:50.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0989999999999994e-05 2024-09-12T17:07:50.078 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1923 3.1d e71/24 3:bbfa0a4b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.RvdbUUXkO22SF-kwzRd4VKnEQTGoFzf_1:head v 71'2, mlcod=0'0)", 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.949940518999998, 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020143629, 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034315+0000", 2024-09-12T17:07:50.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.123e-06 2024-09-12T17:07:50.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038477+0000", 2024-09-12T17:07:50.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041615999999999997 2024-09-12T17:07:50.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038520+0000", 2024-09-12T17:07:50.081 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3705000000000003e-05 2024-09-12T17:07:50.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038539+0000", 2024-09-12T17:07:50.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8825999999999999e-05 2024-09-12T17:07:50.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038679+0000", 2024-09-12T17:07:50.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000140051 2024-09-12T17:07:50.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038729+0000", 2024-09-12T17:07:50.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9455e-05 2024-09-12T17:07:50.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054300+0000", 2024-09-12T17:07:50.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015571000999999999 2024-09-12T17:07:50.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054455+0000", 2024-09-12T17:07:50.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015586800000000001 2024-09-12T17:07:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1926 3.9 3:92ed9a0c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.32:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.924707084000001, 2024-09-12T17:07:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019336487999999999, 2024-09-12T17:07:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.084 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.085 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.085 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.085 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.085 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1926 2024-09-12T17:07:50.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.085 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:50.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:50.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059548+0000", 2024-09-12T17:07:50.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T17:07:50.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063544+0000", 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039964340000000001 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063587+0000", 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2701000000000003e-05 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063605+0000", 2024-09-12T17:07:50.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8065999999999999e-05 2024-09-12T17:07:50.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063745+0000", 2024-09-12T17:07:50.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014033000000000001 2024-09-12T17:07:50.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.088 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.088 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.064004+0000", 2024-09-12T17:07:50.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025869899999999998 2024-09-12T17:07:50.088 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.064666+0000", 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00066141599999999996 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.074813+0000", 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010147168 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078769+0000", 2024-09-12T17:07:50.089 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039561680000000004 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078837+0000", 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8089000000000005e-05 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078882+0000", 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4827000000000003e-05 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1975 3.1c e71/45 3:3805ec2a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.jnyWlqSvXNPIAN3dK-0eL-Xl-MeMoAE_1:head v 71'6, mlcod=64'4)", 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.963014133000001, 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019266097999999999, 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:50.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021241+0000", 2024-09-12T17:07:50.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0369999999999999e-06 2024-09-12T17:07:50.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027374+0000", 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061327090000000001 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027417+0000", 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2966000000000002e-05 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027435+0000", 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7796e-05 2024-09-12T17:07:50.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027586+0000", 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015143000000000001 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027623+0000", 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6535000000000002e-05 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.040387+0000", 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012764463 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.040504+0000", 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117162 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2131 3.34 3:2ed641cc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.zMHhD2lKVde2GeFxbpVTls1jtnLcDP5_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:50.095 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.589307246000001, 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025713333000000001, 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2131 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:50.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:50.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394949+0000", 2024-09-12T17:07:50.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6799999999999999e-06 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399541+0000", 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004591955 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399595+0000", 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4694000000000002e-05 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399622+0000", 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6466e-05 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399826+0000", 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020443600000000001 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.400245+0000", 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041897400000000002 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.400666+0000", 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042066199999999998 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420138+0000", 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019472382 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420297+0000", 2024-09-12T17:07:50.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158214 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420498+0000", 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020172899999999999 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420658+0000", 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016014100000000001 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.101 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2146 3.2c e73/24 3:35eb2578:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.67:head v 73'11, mlcod=71'9)", 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.297378556, 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018962961, 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:50.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686876+0000", 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6740000000000001e-06 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691317+0000", 2024-09-12T17:07:50.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044404900000000001 2024-09-12T17:07:50.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691352+0000", 2024-09-12T17:07:50.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5355999999999998e-05 2024-09-12T17:07:50.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.104 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691370+0000", 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7584999999999999e-05 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691503+0000", 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013263199999999999 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691545+0000", 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2886000000000002e-05 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.705738+0000", 2024-09-12T17:07:50.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014192885000000001 2024-09-12T17:07:50.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.705837+0000", 2024-09-12T17:07:50.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8453000000000001e-05 2024-09-12T17:07:50.106 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.106 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.106 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2198 3.1 e73/24 3:829b5d0c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.74:head v 73'6, mlcod=72'4)", 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.805329+0000", 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.178923245, 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019490977999999999, 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.805329+0000", 2024-09-12T17:07:50.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.805329+0000", 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.805331+0000", 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.672e-06 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810780+0000", 2024-09-12T17:07:50.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054493110000000001 2024-09-12T17:07:50.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810807+0000", 2024-09-12T17:07:50.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7126000000000001e-05 2024-09-12T17:07:50.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810825+0000", 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7747000000000001e-05 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810971+0000", 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014580600000000001 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.811038+0000", 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7477999999999993e-05 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.824762+0000", 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013723384 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.824820+0000", 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8454e-05 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.112 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2204 3.31 3:8c16fd85:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.75:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:50.112 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.953186+0000", 2024-09-12T17:07:50.112 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.031066156, 2024-09-12T17:07:50.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022095528, 2024-09-12T17:07:50.112 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.112 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.112 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.112 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.112 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.112 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.112 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2204 2024-09-12T17:07:50.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.953186+0000", 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.953186+0000", 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.953189+0000", 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2030000000000001e-06 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957694+0000", 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045044159999999998 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957733+0000", 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8899000000000001e-05 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957749+0000", 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6402999999999999e-05 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957890+0000", 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014088100000000001 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.958158+0000", 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026755799999999999 2024-09-12T17:07:50.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.959046+0000", 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00088877100000000001 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.974849+0000", 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015802248000000001 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.975083+0000", 2024-09-12T17:07:50.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023468600000000001 2024-09-12T17:07:50.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.975203+0000", 2024-09-12T17:07:50.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119919 2024-09-12T17:07:50.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.975282+0000", 2024-09-12T17:07:50.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8543999999999999e-05 2024-09-12T17:07:50.117 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.117 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.118 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.118 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.118 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.118 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:50.119 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:07:50.120 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:50.116+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:50.220 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:50.216+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:50.290 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:50.290 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:50.290 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:50.290 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:50.304 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:07:50.333 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T17:07:50.351 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:50.348+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:50.422 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:50.416+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:50.431 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:50.431 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:50.431 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:50.431 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:50.431 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:50.446 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:07:50.535 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:50.532+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:50.618 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:50.618 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:50.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1239 3.16 3:6b2cb9ce:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 38.012710355999999, 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021398218, 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1239 2024-09-12T17:07:50.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600991+0000", 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9559999999999999e-06 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606170+0000", 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051789460000000002 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606222+0000", 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1422000000000003e-05 2024-09-12T17:07:50.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606249+0000", 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7163000000000001e-05 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606450+0000", 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000201325 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.622 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606877+0000", 2024-09-12T17:07:50.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042682799999999997 2024-09-12T17:07:50.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:50.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.607298+0000", 2024-09-12T17:07:50.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042127700000000001 2024-09-12T17:07:50.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.615845+0000", 2024-09-12T17:07:50.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0085471260000000004 2024-09-12T17:07:50.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622186+0000", 2024-09-12T17:07:50.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063410690000000004 2024-09-12T17:07:50.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622292+0000", 2024-09-12T17:07:50.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105305 2024-09-12T17:07:50.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622385+0000", 2024-09-12T17:07:50.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3801000000000005e-05 2024-09-12T17:07:50.625 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.625 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.625 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.625 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1251 3.1d 3:ba0891d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:50.625 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:50.625 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.87037084, 2024-09-12T17:07:50.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020778814999999999, 2024-09-12T17:07:50.626 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.626 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.626 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.626 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.626 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.626 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.626 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1251 2024-09-12T17:07:50.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.626 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743330+0000", 2024-09-12T17:07:50.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7000000000000002e-06 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748572+0000", 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052414710000000002 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748616+0000", 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4369000000000002e-05 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.628 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748636+0000", 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9582999999999999e-05 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748778+0000", 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141867 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749017+0000", 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000239218 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749233+0000", 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021619799999999999 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.756641+0000", 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074078089999999996 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763784+0000", 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0071433809999999999 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763958+0000", 2024-09-12T17:07:50.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000173862 2024-09-12T17:07:50.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.764106+0000", 2024-09-12T17:07:50.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014735700000000001 2024-09-12T17:07:50.631 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.631 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.631 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.632 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1259 3.5 3:a1f83edd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:50.632 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:50.632 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.457482972999998, 2024-09-12T17:07:50.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024500529, 2024-09-12T17:07:50.632 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.632 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.632 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.632 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.632 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.632 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.632 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1259 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156217+0000", 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8940000000000002e-06 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160482+0000", 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042645269999999997 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160513+0000", 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1228e-05 2024-09-12T17:07:50.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160526+0000", 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2976000000000001e-05 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160624+0000", 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8048999999999996e-05 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.635 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160825+0000", 2024-09-12T17:07:50.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020054799999999999 2024-09-12T17:07:50.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:50.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160997+0000", 2024-09-12T17:07:50.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017260499999999999 2024-09-12T17:07:50.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.169300+0000", 2024-09-12T17:07:50.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083027050000000005 2024-09-12T17:07:50.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180595+0000", 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011294465 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180660+0000", 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5616000000000003e-05 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180715+0000", 2024-09-12T17:07:50.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4916000000000001e-05 2024-09-12T17:07:50.638 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.638 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.638 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1262 3.5 3:a3a998f2:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.402850260999998, 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020328525, 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1262 2024-09-12T17:07:50.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.641 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:50.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.641 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.641 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:50.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210850+0000", 2024-09-12T17:07:50.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.005e-06 2024-09-12T17:07:50.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214862+0000", 2024-09-12T17:07:50.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040120640000000001 2024-09-12T17:07:50.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214903+0000", 2024-09-12T17:07:50.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0831999999999998e-05 2024-09-12T17:07:50.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214940+0000", 2024-09-12T17:07:50.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7036000000000003e-05 2024-09-12T17:07:50.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215059+0000", 2024-09-12T17:07:50.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118631 2024-09-12T17:07:50.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215237+0000", 2024-09-12T17:07:50.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017834900000000001 2024-09-12T17:07:50.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:50.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215406+0000", 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016896200000000001 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.221184+0000", 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057780130000000002 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231002+0000", 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0098174969999999997 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231096+0000", 2024-09-12T17:07:50.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4204999999999997e-05 2024-09-12T17:07:50.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231176+0000", 2024-09-12T17:07:50.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9931000000000004e-05 2024-09-12T17:07:50.647 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.647 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.647 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.648 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1264 3.c 3:30907361:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:50.648 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:50.648 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.381927275999999, 2024-09-12T17:07:50.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021106314000000001, 2024-09-12T17:07:50.648 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.648 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.648 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.648 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.648 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.648 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.648 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1264 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231772+0000", 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1560000000000002e-06 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235787+0000", 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040149790000000001 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235824+0000", 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6956000000000003e-05 2024-09-12T17:07:50.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235843+0000", 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8315999999999999e-05 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235954+0000", 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111601 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236135+0000", 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000180941 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236302+0000", 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016626600000000001 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242422+0000", 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061200730000000002 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252655+0000", 2024-09-12T17:07:50.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010232978 2024-09-12T17:07:50.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252749+0000", 2024-09-12T17:07:50.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4481000000000006e-05 2024-09-12T17:07:50.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.653 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.653 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252877+0000", 2024-09-12T17:07:50.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012756700000000001 2024-09-12T17:07:50.654 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.654 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.654 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.654 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1265 3.22 3:44204d7e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:50.654 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:50.654 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.371439090999999, 2024-09-12T17:07:50.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021506441000000001, 2024-09-12T17:07:50.654 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.654 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.654 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1265 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242262+0000", 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7299999999999999e-06 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246237+0000", 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039746989999999999 2024-09-12T17:07:50.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246272+0000", 2024-09-12T17:07:50.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5589000000000001e-05 2024-09-12T17:07:50.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246290+0000", 2024-09-12T17:07:50.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7107000000000001e-05 2024-09-12T17:07:50.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246410+0000", 2024-09-12T17:07:50.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119984 2024-09-12T17:07:50.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246589+0000", 2024-09-12T17:07:50.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000179853 2024-09-12T17:07:50.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:50.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246748+0000", 2024-09-12T17:07:50.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158536 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252569+0000", 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058212810000000002 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263464+0000", 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010894406000000001 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.659 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263627+0000", 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000163833 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263765+0000", 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013742299999999999 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1269 3.c 3:3287b6aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:50.660 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.322811919000003, 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019007443999999998, 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1269 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:50.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:50.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290890+0000", 2024-09-12T17:07:50.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2529999999999998e-06 2024-09-12T17:07:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294907+0000", 2024-09-12T17:07:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004017189 2024-09-12T17:07:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294952+0000", 2024-09-12T17:07:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5252e-05 2024-09-12T17:07:50.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294971+0000", 2024-09-12T17:07:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8606000000000001e-05 2024-09-12T17:07:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295107+0000", 2024-09-12T17:07:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000135654 2024-09-12T17:07:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295466+0000", 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000359448 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295948+0000", 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000482079 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.308012+0000", 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012064210000000001 2024-09-12T17:07:50.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309570+0000", 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015580839999999999 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309758+0000", 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000187522 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309893+0000", 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013514700000000001 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1275 3.16 3:68cda83e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.260114776999998, 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019055547999999999, 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.667 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.668 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.668 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.668 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.668 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1275 2024-09-12T17:07:50.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.668 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:50.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353586+0000", 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0769999999999999e-06 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359376+0000", 2024-09-12T17:07:50.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057904100000000002 2024-09-12T17:07:50.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359400+0000", 2024-09-12T17:07:50.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3805999999999999e-05 2024-09-12T17:07:50.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359412+0000", 2024-09-12T17:07:50.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2404e-05 2024-09-12T17:07:50.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359522+0000", 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109685 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359767+0000", 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024471399999999999 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.360035+0000", 2024-09-12T17:07:50.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026762699999999999 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372243+0000", 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012208169 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372526+0000", 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028289599999999998 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372581+0000", 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5747e-05 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372638+0000", 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7012999999999998e-05 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.673 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1390 3.2f 3:f51d0419:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.236922051000001, 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019302698, 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1390 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376779+0000", 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8700000000000002e-06 2024-09-12T17:07:50.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381020+0000", 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042401660000000001 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381069+0000", 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9279e-05 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381098+0000", 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9110000000000001e-05 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381276+0000", 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017790199999999999 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381577+0000", 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030131400000000001 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381798+0000", 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022053200000000001 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.391131+0000", 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093337400000000001 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395755+0000", 2024-09-12T17:07:50.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004624034 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395932+0000", 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000176317 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.396078+0000", 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000146434 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.679 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1408 3.2a 3:56341a86:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 33.809832925999999, 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.030673474999999999, 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.680 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1408 2024-09-12T17:07:50.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.681 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:50.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:50.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803868+0000", 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1130000000000001e-06 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808291+0000", 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044233120000000004 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.682 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808331+0000", 2024-09-12T17:07:50.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9869000000000001e-05 2024-09-12T17:07:50.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808351+0000", 2024-09-12T17:07:50.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9673e-05 2024-09-12T17:07:50.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808511+0000", 2024-09-12T17:07:50.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015999699999999999 2024-09-12T17:07:50.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808843+0000", 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033221900000000003 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.809106+0000", 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026355900000000002 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.827691+0000", 2024-09-12T17:07:50.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018584471000000002 2024-09-12T17:07:50.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834339+0000", 2024-09-12T17:07:50.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066477790000000004 2024-09-12T17:07:50.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834448+0000", 2024-09-12T17:07:50.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109578 2024-09-12T17:07:50.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834538+0000", 2024-09-12T17:07:50.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9905000000000001e-05 2024-09-12T17:07:50.686 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.686 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.686 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.686 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1884 3.16 3:6a49863c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.25:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:50.687 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:50.687 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.455575101000001, 2024-09-12T17:07:50.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02557398, 2024-09-12T17:07:50.687 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.687 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.687 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.687 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.687 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.687 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.687 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1884 2024-09-12T17:07:50.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.688 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:50.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158125+0000", 2024-09-12T17:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1399999999999998e-06 2024-09-12T17:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163204+0000", 2024-09-12T17:07:50.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050792720000000001 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163244+0000", 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0522000000000003e-05 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163262+0000", 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7872000000000001e-05 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163395+0000", 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013291799999999999 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163698+0000", 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030317700000000001 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.164523+0000", 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082438900000000002 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.181881+0000", 2024-09-12T17:07:50.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017357991999999999 2024-09-12T17:07:50.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183465+0000", 2024-09-12T17:07:50.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015843509999999999 2024-09-12T17:07:50.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.692 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.692 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183583+0000", 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118025 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183696+0000", 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113322 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1923 3.1d 3:bbfa0a4b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.RvdbUUXkO22SF-kwzRd4VKnEQTGoFzf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:50.693 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.588603246000002, 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.029952679999999999, 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1923 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025097+0000", 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6599999999999999e-06 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033262+0000", 2024-09-12T17:07:50.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0081647409999999997 2024-09-12T17:07:50.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033304+0000", 2024-09-12T17:07:50.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2138000000000002e-05 2024-09-12T17:07:50.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033322+0000", 2024-09-12T17:07:50.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8059000000000001e-05 2024-09-12T17:07:50.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033512+0000", 2024-09-12T17:07:50.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019057199999999999 2024-09-12T17:07:50.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033775+0000", 2024-09-12T17:07:50.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026250299999999998 2024-09-12T17:07:50.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034023+0000", 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024751999999999999 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.047403+0000", 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013380845000000001 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054890+0000", 2024-09-12T17:07:50.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074861529999999997 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054976+0000", 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6644999999999995e-05 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.055047+0000", 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0844000000000001e-05 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.699 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1990 3.28 3:17f1f290:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.41:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.295906227, 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019908233000000001, 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1990 2024-09-12T17:07:50.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.701 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:50.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:50.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317794+0000", 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.993e-06 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323013+0000", 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052182490000000003 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323051+0000", 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8343000000000002e-05 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323069+0000", 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8082000000000001e-05 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323264+0000", 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019453499999999999 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323530+0000", 2024-09-12T17:07:50.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026603999999999999 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.324371+0000", 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00084152599999999999 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.336666+0000", 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012295276000000001 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337488+0000", 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082180399999999998 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337622+0000", 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000133864 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337700+0000", 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7521000000000005e-05 2024-09-12T17:07:50.705 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2125 3.4 e73/51 3:235ee04f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.q5_4TTRRhSFZvQfgJaK5ATByAODjVXJ_1:head v 73'6, mlcod=71'4)", 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.346500643000001, 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024265888999999999, 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:50.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0299999999999999e-07 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274450+0000", 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0072528879999999999 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274475+0000", 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5185e-05 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.708 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274491+0000", 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5305999999999999e-05 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274624+0000", 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000132915 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274681+0000", 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7340999999999999e-05 2024-09-12T17:07:50.709 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.291377+0000", 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016695451 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.291463+0000", 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6299999999999997e-05 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.710 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.711 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2128 3.5 3:a25f4989:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.64:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:50.711 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:50.711 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.318274063, 2024-09-12T17:07:50.711 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019706656999999999, 2024-09-12T17:07:50.711 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.711 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.711 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.711 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.711 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2128 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:50.712 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295427+0000", 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4060000000000001e-06 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299816+0000", 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043890029999999998 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.713 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299855+0000", 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8955000000000002e-05 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299873+0000", 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8359000000000002e-05 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.300038+0000", 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016448100000000001 2024-09-12T17:07:50.714 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.300335+0000", 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029776899999999997 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.301250+0000", 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00091437699999999996 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.715 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.313996+0000", 2024-09-12T17:07:50.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012745975 2024-09-12T17:07:50.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.314902+0000", 2024-09-12T17:07:50.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00090575699999999998 2024-09-12T17:07:50.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.716 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.716 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.716 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.315023+0000", 2024-09-12T17:07:50.716 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012113899999999999 2024-09-12T17:07:50.716 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.717 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.717 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.315130+0000", 2024-09-12T17:07:50.717 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010743600000000001 2024-09-12T17:07:50.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.717 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.717 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.717 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.717 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.717 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2158 3.3a 3:5f23622e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.69:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:50.717 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:50.717 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.625510543000001, 2024-09-12T17:07:50.718 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025287745, 2024-09-12T17:07:50.718 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.718 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.718 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.718 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.718 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.718 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.718 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2158 2024-09-12T17:07:50.718 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.719 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988190+0000", 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.897e-06 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992248+0000", 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040576420000000002 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992288+0000", 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9959000000000001e-05 2024-09-12T17:07:50.720 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992305+0000", 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7813999999999999e-05 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992495+0000", 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018977800000000001 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.721 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992759+0000", 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026367399999999998 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.993586+0000", 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082746299999999996 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.002363+0000", 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087768069999999993 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.722 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013296+0000", 2024-09-12T17:07:50.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010932871 2024-09-12T17:07:50.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013408+0000", 2024-09-12T17:07:50.723 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111709 2024-09-12T17:07:50.723 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.723 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.723 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.723 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013475+0000", 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7131000000000005e-05 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2161 3.5 3:a0815047:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.1213Daer3gr3KDhM5kgqYBB_xC83lvZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.487114839, 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020142651000000001, 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.724 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2161 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.725 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:50.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126586+0000", 2024-09-12T17:07:50.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9830000000000001e-06 2024-09-12T17:07:50.726 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.726 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.726 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.726 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130385+0000", 2024-09-12T17:07:50.726 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037997009999999999 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130415+0000", 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9529000000000001e-05 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130427+0000", 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2351000000000001e-05 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.727 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130516+0000", 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8214999999999995e-05 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130663+0000", 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147145 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130793+0000", 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012986700000000001 2024-09-12T17:07:50.728 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.138966+0000", 2024-09-12T17:07:50.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0081739810000000003 2024-09-12T17:07:50.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.729 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.729 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146483+0000", 2024-09-12T17:07:50.729 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.007516928 2024-09-12T17:07:50.729 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.729 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146599+0000", 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115932 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146725+0000", 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000126019 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.730 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2195 3.c 3:337f05fc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.DSvxz4vaxxy0dMg8hp4VJxR3sCjbrFE_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.773024+0000", 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 13.840673991999999, 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023923855000000001, 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2195 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.731 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.773024+0000", 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.773024+0000", 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.773027+0000", 2024-09-12T17:07:50.732 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.574e-06 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777123+0000", 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040961000000000001 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777166+0000", 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2972000000000001e-05 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.733 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777185+0000", 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9269000000000001e-05 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777284+0000", 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8240999999999997e-05 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777444+0000", 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016014999999999999 2024-09-12T17:07:50.734 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777586+0000", 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000142428 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.784298+0000", 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067112430000000004 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.735 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.796855+0000", 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012557474000000001 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.796906+0000", 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0518e-05 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.796947+0000", 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1885999999999998e-05 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.736 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2330 3.c 3:312d3416:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.96:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:39.563180+0000", 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 11.050517719, 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021299865000000001, 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.737 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2330 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.563180+0000", 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.563180+0000", 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.738 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.563182+0000", 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6259999999999999e-06 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567288+0000", 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041051120000000002 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567319+0000", 2024-09-12T17:07:50.739 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1788999999999997e-05 2024-09-12T17:07:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567344+0000", 2024-09-12T17:07:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4213e-05 2024-09-12T17:07:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567493+0000", 2024-09-12T17:07:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014904799999999999 2024-09-12T17:07:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.740 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567854+0000", 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036099500000000002 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.568778+0000", 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00092410500000000004 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.583477+0000", 2024-09-12T17:07:50.741 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014699031 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.584281+0000", 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080444299999999995 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.584387+0000", 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105753 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.742 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.584480+0000", 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2750000000000005e-05 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2351 3.1d 3:b93c23bf:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.-9Whj7OyWidDksiwzT19FTZdXgAbEF9_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:39.995677+0000", 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 10.618020831999999, 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020208282000000001, 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:50.743 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2351 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.995677+0000", 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.744 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.995677+0000", 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.995679+0000", 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6390000000000001e-06 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999600+0000", 2024-09-12T17:07:50.745 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003920219 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999638+0000", 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8590999999999997e-05 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999662+0000", 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3366e-05 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:50.746 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999859+0000", 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000197617 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.000117+0000", 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025815099999999998 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.000396+0000", 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027906099999999999 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.747 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.010299+0000", 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0099028009999999993 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.015705+0000", 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054053230000000001 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.015810+0000", 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105287 2024-09-12T17:07:50.748 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:50.749 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:50.749 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:50.749 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.015885+0000", 2024-09-12T17:07:50.749 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5227000000000003e-05 2024-09-12T17:07:50.749 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.749 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.749 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.749 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:50.749 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:50.749 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:50.752 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:50.753 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:50.748+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:50.852 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:50.848+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:50.927 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:50.927 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:50.927 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:50.927 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:50.941 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:50.953 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:50.948+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:51.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T17:07:51.054 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:51.048+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:51.069 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:51.069 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:51.069 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:51.069 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:51.069 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:51.084 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:51.155 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:51.148+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:51.182 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:51.182 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:51.199 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:51.199 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:51.215 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:51.215 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:51.231 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:51.232 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:51.252 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:51.253 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:51.256 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:51.252+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:51.260 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:51.260 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:51.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:51.260 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:51.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.260 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:07:51.260 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:07:51.260 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 115.716811846, 2024-09-12T17:07:51.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.040278856000000002, 2024-09-12T17:07:51.261 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.261 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.261 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.261 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.261 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 46 2024-09-12T17:07:51.261 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.261 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.261 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.261 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.261 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:07:51.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:07:51.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.262 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.262 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.262 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537089+0000", 2024-09-12T17:07:51.262 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3000000000000002e-06 2024-09-12T17:07:51.262 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537103+0000", 2024-09-12T17:07:51.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4097000000000001e-05 2024-09-12T17:07:51.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.263 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.263 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537137+0000", 2024-09-12T17:07:51.263 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4079999999999999e-05 2024-09-12T17:07:51.263 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.263 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537162+0000", 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4579999999999998e-05 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537327+0000", 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000165081 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537344+0000", 2024-09-12T17:07:51.264 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7447000000000001e-05 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.552576+0000", 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015231339 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.552597+0000", 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0934e-05 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.265 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.572608+0000", 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020010917 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.572902+0000", 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029482400000000001 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.573205+0000", 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030300900000000003 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.266 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.576854+0000", 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003648966 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577088+0000", 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023368099999999999 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577216+0000", 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012821600000000001 2024-09-12T17:07:51.267 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.268 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.268 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577365+0000", 2024-09-12T17:07:51.268 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014838500000000001 2024-09-12T17:07:51.268 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.268 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.268 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.268 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.268 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.268 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1181 3.a 3:52e4a2c7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:51.268 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.426419+0000", 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.827478853999999, 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022424422999999999, 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1181 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.269 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.426419+0000", 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.426419+0000", 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.426422+0000", 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.14e-06 2024-09-12T17:07:51.270 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.430282+0000", 2024-09-12T17:07:51.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003860156 2024-09-12T17:07:51.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.271 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.430335+0000", 2024-09-12T17:07:51.271 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2951999999999997e-05 2024-09-12T17:07:51.271 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.271 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.271 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.430356+0000", 2024-09-12T17:07:51.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0795999999999999e-05 2024-09-12T17:07:51.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.272 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.430554+0000", 2024-09-12T17:07:51.272 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019868199999999999 2024-09-12T17:07:51.272 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.272 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.272 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.430908+0000", 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035311799999999998 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.431315+0000", 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040779400000000001 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.439801+0000", 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0084859189999999998 2024-09-12T17:07:51.273 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.448632+0000", 2024-09-12T17:07:51.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0088308459999999998 2024-09-12T17:07:51.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.274 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.274 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.448747+0000", 2024-09-12T17:07:51.274 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115219 2024-09-12T17:07:51.274 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.274 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.448843+0000", 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5801e-05 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1183 3.20 3:06cd57f7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.445964+0000", 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.807933144000003, 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025875618999999999, 2024-09-12T17:07:51.275 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.276 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.276 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.276 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.276 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.276 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.276 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1183 2024-09-12T17:07:51.276 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.276 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.276 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.276 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.276 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.445964+0000", 2024-09-12T17:07:51.276 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.445964+0000", 2024-09-12T17:07:51.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.277 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.277 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.277 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.445968+0000", 2024-09-12T17:07:51.277 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9269999999999998e-06 2024-09-12T17:07:51.277 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.449417+0000", 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003448282 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.449441+0000", 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4215000000000001e-05 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.449453+0000", 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.217e-05 2024-09-12T17:07:51.278 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.449562+0000", 2024-09-12T17:07:51.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109211 2024-09-12T17:07:51.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.279 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.449828+0000", 2024-09-12T17:07:51.279 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026588300000000002 2024-09-12T17:07:51.279 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.279 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.279 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.450091+0000", 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026239999999999998 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.468053+0000", 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017962367999999999 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.471537+0000", 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003483894 2024-09-12T17:07:51.280 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.471713+0000", 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017569600000000001 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.471840+0000", 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012757299999999999 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.281 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.282 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.282 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1209 3.a 3:531ac038:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:51.282 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.934993+0000", 2024-09-12T17:07:51.282 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.318904732, 2024-09-12T17:07:51.282 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024821032, 2024-09-12T17:07:51.282 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.282 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.282 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.282 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.282 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.282 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.282 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1209 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.934993+0000", 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.934993+0000", 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.283 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.934998+0000", 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6360000000000002e-06 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.941377+0000", 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063798759999999996 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.941425+0000", 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7871999999999998e-05 2024-09-12T17:07:51.284 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.941447+0000", 2024-09-12T17:07:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2172999999999999e-05 2024-09-12T17:07:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.941597+0000", 2024-09-12T17:07:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014970000000000001 2024-09-12T17:07:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.285 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.941847+0000", 2024-09-12T17:07:51.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024967099999999997 2024-09-12T17:07:51.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:51.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942089+0000", 2024-09-12T17:07:51.286 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024169400000000001 2024-09-12T17:07:51.286 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.286 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.286 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.286 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.950597+0000", 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0085083480000000006 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959638+0000", 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090407360000000006 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959738+0000", 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100364 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.287 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959814+0000", 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5962000000000002e-05 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1216 3.33 e63/24 3:cf30ff9d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_16:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.011551+0000", 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.242346482000002, 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020340845, 2024-09-12T17:07:51.288 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.011551+0000", 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.011551+0000", 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.289 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.011552+0000", 2024-09-12T17:07:51.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.333e-06 2024-09-12T17:07:51.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.290 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.016038+0000", 2024-09-12T17:07:51.290 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044851020000000004 2024-09-12T17:07:51.290 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.290 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.290 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.016087+0000", 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9876000000000002e-05 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.016118+0000", 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0605000000000003e-05 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.016265+0000", 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000146957 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.291 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.016304+0000", 2024-09-12T17:07:51.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8649000000000002e-05 2024-09-12T17:07:51.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.031744+0000", 2024-09-12T17:07:51.292 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015439903 2024-09-12T17:07:51.292 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.292 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.292 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.292 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.031892+0000", 2024-09-12T17:07:51.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014841999999999999 2024-09-12T17:07:51.293 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.293 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.293 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.293 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.293 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.293 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1249 3.a 3:5189db44:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:51.293 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.721729+0000", 2024-09-12T17:07:51.293 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 38.532168767999998, 2024-09-12T17:07:51.293 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021046339000000001, 2024-09-12T17:07:51.293 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.293 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.294 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.294 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.294 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.294 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.294 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1249 2024-09-12T17:07:51.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.294 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.294 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.294 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.294 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.721729+0000", 2024-09-12T17:07:51.294 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.294 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.721729+0000", 2024-09-12T17:07:51.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.295 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.295 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.721733+0000", 2024-09-12T17:07:51.295 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8099999999999999e-06 2024-09-12T17:07:51.295 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.295 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.726566+0000", 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048333639999999997 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.726618+0000", 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1856e-05 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.726644+0000", 2024-09-12T17:07:51.296 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5979e-05 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.726846+0000", 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020230899999999999 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.727279+0000", 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000432803 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.297 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.727543+0000", 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026372100000000002 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.742545+0000", 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015002161999999999 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.742615+0000", 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0061999999999994e-05 2024-09-12T17:07:51.298 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.742703+0000", 2024-09-12T17:07:51.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7958e-05 2024-09-12T17:07:51.299 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.299 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.299 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.299 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.742775+0000", 2024-09-12T17:07:51.299 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2315000000000001e-05 2024-09-12T17:07:51.299 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.299 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.299 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.300 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.300 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.300 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1274 3.36 3:6e24700e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:51.300 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.343282+0000", 2024-09-12T17:07:51.300 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.910615397999997, 2024-09-12T17:07:51.300 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025462483000000001, 2024-09-12T17:07:51.300 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.300 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.300 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.300 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.300 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.301 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.301 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1274 2024-09-12T17:07:51.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.301 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.301 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.343282+0000", 2024-09-12T17:07:51.301 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.301 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.301 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.301 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.343282+0000", 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.343285+0000", 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1439999999999999e-06 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.351152+0000", 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0078670440000000001 2024-09-12T17:07:51.302 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.351197+0000", 2024-09-12T17:07:51.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4629000000000002e-05 2024-09-12T17:07:51.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.303 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.303 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.351216+0000", 2024-09-12T17:07:51.303 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8851999999999998e-05 2024-09-12T17:07:51.303 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.303 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.351311+0000", 2024-09-12T17:07:51.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5247999999999993e-05 2024-09-12T17:07:51.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.304 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.304 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.351430+0000", 2024-09-12T17:07:51.304 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119157 2024-09-12T17:07:51.304 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.304 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:51.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.351605+0000", 2024-09-12T17:07:51.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017512300000000001 2024-09-12T17:07:51.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.362834+0000", 2024-09-12T17:07:51.305 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011228152999999999 2024-09-12T17:07:51.305 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.305 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.305 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.305 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.368591+0000", 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057577160000000004 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.368675+0000", 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4027e-05 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.368745+0000", 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9389999999999998e-05 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.306 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.307 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.307 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.307 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.307 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1371 3.35 3:ad03dbae:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:51.307 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.165331+0000", 2024-09-12T17:07:51.307 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 35.088567021000003, 2024-09-12T17:07:51.307 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024708127999999999, 2024-09-12T17:07:51.307 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.307 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.307 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.307 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.307 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1371 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.165331+0000", 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.165331+0000", 2024-09-12T17:07:51.308 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.165334+0000", 2024-09-12T17:07:51.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.976e-06 2024-09-12T17:07:51.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.309 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.309 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.309 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.169457+0000", 2024-09-12T17:07:51.309 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004123481 2024-09-12T17:07:51.309 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.169498+0000", 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1276000000000003e-05 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.169519+0000", 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0392999999999999e-05 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.310 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.169665+0000", 2024-09-12T17:07:51.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014592000000000001 2024-09-12T17:07:51.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.170047+0000", 2024-09-12T17:07:51.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038206900000000002 2024-09-12T17:07:51.311 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.311 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.311 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:51.311 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.170309+0000", 2024-09-12T17:07:51.311 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026202799999999998 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.183143+0000", 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012833804000000001 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.189715+0000", 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065727540000000001 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.312 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.189893+0000", 2024-09-12T17:07:51.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017783999999999999 2024-09-12T17:07:51.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.313 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.313 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.190039+0000", 2024-09-12T17:07:51.313 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145587 2024-09-12T17:07:51.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.313 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.313 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.313 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.313 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.314 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1391 3.35 3:ae9f95b7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:51.314 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.390619+0000", 2024-09-12T17:07:51.314 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.863278395000002, 2024-09-12T17:07:51.314 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024091837000000001, 2024-09-12T17:07:51.314 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.314 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.314 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.314 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.314 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1391 2024-09-12T17:07:51.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.315 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.390619+0000", 2024-09-12T17:07:51.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.315 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.315 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.315 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.390619+0000", 2024-09-12T17:07:51.315 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.315 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.391998+0000", 2024-09-12T17:07:51.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001378871 2024-09-12T17:07:51.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.316 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.316 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.398937+0000", 2024-09-12T17:07:51.316 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069387590000000001 2024-09-12T17:07:51.316 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.316 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.398979+0000", 2024-09-12T17:07:51.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2599999999999999e-05 2024-09-12T17:07:51.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.398998+0000", 2024-09-12T17:07:51.317 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8726e-05 2024-09-12T17:07:51.317 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.317 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.317 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.317 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.399178+0000", 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017938900000000001 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.399613+0000", 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00043582499999999998 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.400042+0000", 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042816799999999998 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.318 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.412198+0000", 2024-09-12T17:07:51.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012156108000000001 2024-09-12T17:07:51.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.414284+0000", 2024-09-12T17:07:51.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020866499999999998 2024-09-12T17:07:51.319 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.319 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.319 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.319 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.414553+0000", 2024-09-12T17:07:51.319 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026912099999999999 2024-09-12T17:07:51.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.320 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.320 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.320 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.414711+0000", 2024-09-12T17:07:51.320 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015762 2024-09-12T17:07:51.320 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.320 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.320 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.320 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1409 3.a 3:53d4fdcd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.815815+0000", 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.438082825000002, 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027748752000000002, 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1409 2024-09-12T17:07:51.321 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.322 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.815815+0000", 2024-09-12T17:07:51.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.322 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.322 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.322 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.815815+0000", 2024-09-12T17:07:51.322 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.322 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.815819+0000", 2024-09-12T17:07:51.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1500000000000001e-06 2024-09-12T17:07:51.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.323 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.820384+0000", 2024-09-12T17:07:51.323 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045648750000000004 2024-09-12T17:07:51.323 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.323 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.323 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.820441+0000", 2024-09-12T17:07:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6855999999999999e-05 2024-09-12T17:07:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.820471+0000", 2024-09-12T17:07:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0252000000000001e-05 2024-09-12T17:07:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.820654+0000", 2024-09-12T17:07:51.324 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000182914 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.820911+0000", 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025744400000000001 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821143+0000", 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000231339 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.325 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.831865+0000", 2024-09-12T17:07:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010722261 2024-09-12T17:07:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.843252+0000", 2024-09-12T17:07:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011387237 2024-09-12T17:07:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.326 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.843438+0000", 2024-09-12T17:07:51.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018579999999999999 2024-09-12T17:07:51.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.327 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.327 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.843564+0000", 2024-09-12T17:07:51.327 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012562399999999999 2024-09-12T17:07:51.327 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.327 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.327 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.327 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.327 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.328 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1411 3.35 3:ad037334:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:51.328 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.849073+0000", 2024-09-12T17:07:51.328 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.404824920999999, 2024-09-12T17:07:51.328 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020544357999999999, 2024-09-12T17:07:51.328 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.328 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.328 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.328 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.328 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.328 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.328 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1411 2024-09-12T17:07:51.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.329 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.849073+0000", 2024-09-12T17:07:51.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.329 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.329 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.329 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.849073+0000", 2024-09-12T17:07:51.329 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.329 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.849076+0000", 2024-09-12T17:07:51.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0199999999999999e-06 2024-09-12T17:07:51.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.330 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.330 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.853620+0000", 2024-09-12T17:07:51.330 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045439599999999997 2024-09-12T17:07:51.330 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.330 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.853675+0000", 2024-09-12T17:07:51.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5389000000000001e-05 2024-09-12T17:07:51.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.331 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.853693+0000", 2024-09-12T17:07:51.331 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7595e-05 2024-09-12T17:07:51.331 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.331 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.331 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.853846+0000", 2024-09-12T17:07:51.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015381699999999999 2024-09-12T17:07:51.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.332 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.332 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.854103+0000", 2024-09-12T17:07:51.332 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025632900000000002 2024-09-12T17:07:51.332 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.332 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:51.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.854372+0000", 2024-09-12T17:07:51.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026870699999999997 2024-09-12T17:07:51.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.333 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.862095+0000", 2024-09-12T17:07:51.333 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0077231330000000001 2024-09-12T17:07:51.333 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.333 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.333 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.869404+0000", 2024-09-12T17:07:51.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0073091789999999998 2024-09-12T17:07:51.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.869507+0000", 2024-09-12T17:07:51.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103118 2024-09-12T17:07:51.334 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.334 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.334 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.334 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.869617+0000", 2024-09-12T17:07:51.334 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000110111 2024-09-12T17:07:51.335 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.335 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.335 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.335 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.335 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.335 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1416 3.0 e64/51 3:03f8363f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_10:head v 64'5, mlcod=64'3)", 2024-09-12T17:07:51.335 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.914186+0000", 2024-09-12T17:07:51.335 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.339711635999997, 2024-09-12T17:07:51.335 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020854184000000001, 2024-09-12T17:07:51.335 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.335 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.336 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.336 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.336 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.914186+0000", 2024-09-12T17:07:51.336 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.336 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.336 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.336 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.914186+0000", 2024-09-12T17:07:51.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.914188+0000", 2024-09-12T17:07:51.337 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1560000000000002e-06 2024-09-12T17:07:51.337 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.337 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.337 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.337 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.919920+0000", 2024-09-12T17:07:51.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057317990000000001 2024-09-12T17:07:51.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.919956+0000", 2024-09-12T17:07:51.338 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5682000000000002e-05 2024-09-12T17:07:51.338 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.338 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.338 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.338 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.919987+0000", 2024-09-12T17:07:51.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1333e-05 2024-09-12T17:07:51.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.920129+0000", 2024-09-12T17:07:51.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141853 2024-09-12T17:07:51.339 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.339 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.339 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.339 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.920173+0000", 2024-09-12T17:07:51.339 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4053e-05 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.934875+0000", 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014702455 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.935040+0000", 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016485299999999999 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.340 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.341 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.341 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.341 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1419 3.26 3:643d8bfc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:51.341 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.941647+0000", 2024-09-12T17:07:51.341 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 34.312250401999997, 2024-09-12T17:07:51.341 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025072576999999999, 2024-09-12T17:07:51.341 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.341 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.341 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.341 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.341 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.341 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.342 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1419 2024-09-12T17:07:51.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.342 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941647+0000", 2024-09-12T17:07:51.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.342 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.342 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.342 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.342 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941647+0000", 2024-09-12T17:07:51.342 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941681+0000", 2024-09-12T17:07:51.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3949000000000003e-05 2024-09-12T17:07:51.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.343 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.343 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.343 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.947632+0000", 2024-09-12T17:07:51.343 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059505440000000003 2024-09-12T17:07:51.343 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.947673+0000", 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1025000000000001e-05 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.947692+0000", 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9573e-05 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.344 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.947865+0000", 2024-09-12T17:07:51.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017221700000000001 2024-09-12T17:07:51.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.948284+0000", 2024-09-12T17:07:51.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000419851 2024-09-12T17:07:51.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.345 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.345 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:51.345 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.948711+0000", 2024-09-12T17:07:51.345 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000426854 2024-09-12T17:07:51.345 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959639+0000", 2024-09-12T17:07:51.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010927971 2024-09-12T17:07:51.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.346 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.966311+0000", 2024-09-12T17:07:51.346 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066715280000000004 2024-09-12T17:07:51.346 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.346 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.346 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.966551+0000", 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023980900000000001 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.966720+0000", 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016925600000000001 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.347 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1741 3.2c 3:357f56e5:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.UIKEegG2Kg-xSRVVeGW_lR93QbWiwOo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:27.225978+0000", 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.027920042000002, 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025542815, 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1741 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.348 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.225978+0000", 2024-09-12T17:07:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.225978+0000", 2024-09-12T17:07:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.349 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.225982+0000", 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2200000000000003e-06 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.231967+0000", 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059849400000000002 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.232010+0000", 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3631000000000003e-05 2024-09-12T17:07:51.350 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.232030+0000", 2024-09-12T17:07:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9213000000000001e-05 2024-09-12T17:07:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.232217+0000", 2024-09-12T17:07:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000187651 2024-09-12T17:07:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.351 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.232639+0000", 2024-09-12T17:07:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042198399999999998 2024-09-12T17:07:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.233064+0000", 2024-09-12T17:07:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000425277 2024-09-12T17:07:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.250583+0000", 2024-09-12T17:07:51.352 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017518995999999998 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.251368+0000", 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00078491399999999995 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.251458+0000", 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9646000000000002e-05 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.353 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.251520+0000", 2024-09-12T17:07:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2342999999999996e-05 2024-09-12T17:07:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1744 3.35 3:af4cf40d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.2:head [create,setxattr user.rgw.idtag (60) in=14b,setxattr user.rgw.tail_tag (60) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T17:07:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:27.255467+0000", 2024-09-12T17:07:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.998430933000002, 2024-09-12T17:07:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022711011, 2024-09-12T17:07:51.354 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.355 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.355 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.355 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.355 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.355 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.355 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1744 2024-09-12T17:07:51.355 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.355 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.355 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.355 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.355 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.255467+0000", 2024-09-12T17:07:51.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.255467+0000", 2024-09-12T17:07:51.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.356 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.356 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.356 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.255470+0000", 2024-09-12T17:07:51.356 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9000000000000002e-06 2024-09-12T17:07:51.356 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.259747+0000", 2024-09-12T17:07:51.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042769770000000004 2024-09-12T17:07:51.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.357 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.259784+0000", 2024-09-12T17:07:51.357 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7539000000000001e-05 2024-09-12T17:07:51.357 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.357 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.357 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.259801+0000", 2024-09-12T17:07:51.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7212000000000001e-05 2024-09-12T17:07:51.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.259897+0000", 2024-09-12T17:07:51.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5400000000000001e-05 2024-09-12T17:07:51.358 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.358 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.358 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.358 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.260101+0000", 2024-09-12T17:07:51.358 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000204052 2024-09-12T17:07:51.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:51.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.260706+0000", 2024-09-12T17:07:51.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00060523599999999999 2024-09-12T17:07:51.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.359 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.359 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.359 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.267330+0000", 2024-09-12T17:07:51.359 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066240810000000004 2024-09-12T17:07:51.359 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.277857+0000", 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010526659000000001 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.278058+0000", 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020135699999999999 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.360 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.278178+0000", 2024-09-12T17:07:51.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119598 2024-09-12T17:07:51.361 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.361 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.361 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.361 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.361 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.361 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1893 3.2c 3:376edb74:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.HFEx8NLO4qNEqI9Hm5LhOzDLwPG7G5M_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:51.361 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.374447+0000", 2024-09-12T17:07:51.361 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.879450498000001, 2024-09-12T17:07:51.361 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020252932000000001, 2024-09-12T17:07:51.361 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.362 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.362 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.362 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.362 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.362 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.362 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1893 2024-09-12T17:07:51.362 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.362 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.362 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.362 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.362 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.374447+0000", 2024-09-12T17:07:51.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.374447+0000", 2024-09-12T17:07:51.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.363 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.363 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.363 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.374450+0000", 2024-09-12T17:07:51.363 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8499999999999998e-06 2024-09-12T17:07:51.363 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.378468+0000", 2024-09-12T17:07:51.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040185120000000001 2024-09-12T17:07:51.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.364 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.364 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.378504+0000", 2024-09-12T17:07:51.364 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5292e-05 2024-09-12T17:07:51.364 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.364 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.378521+0000", 2024-09-12T17:07:51.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7275999999999999e-05 2024-09-12T17:07:51.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.378650+0000", 2024-09-12T17:07:51.365 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000128904 2024-09-12T17:07:51.365 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.365 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.365 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.365 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.378910+0000", 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025975999999999999 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.379140+0000", 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000230084 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.393152+0000", 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014012039 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.366 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.394352+0000", 2024-09-12T17:07:51.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012002200000000001 2024-09-12T17:07:51.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.394545+0000", 2024-09-12T17:07:51.367 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000192795 2024-09-12T17:07:51.367 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.367 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.367 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.367 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.394700+0000", 2024-09-12T17:07:51.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0001552 2024-09-12T17:07:51.368 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.368 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.368 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.368 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.368 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.368 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1896 3.2c 3:3773d78b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.27:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:51.368 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.398387+0000", 2024-09-12T17:07:51.368 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.855510816999999, 2024-09-12T17:07:51.368 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028353700999999999, 2024-09-12T17:07:51.368 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.368 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1896 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.398387+0000", 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.369 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.398387+0000", 2024-09-12T17:07:51.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.398390+0000", 2024-09-12T17:07:51.370 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4070000000000002e-06 2024-09-12T17:07:51.370 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.370 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.370 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.370 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.402373+0000", 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039830839999999996 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.402409+0000", 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5465e-05 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.402425+0000", 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5909e-05 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.371 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.402557+0000", 2024-09-12T17:07:51.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000132805 2024-09-12T17:07:51.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.402844+0000", 2024-09-12T17:07:51.372 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028694799999999998 2024-09-12T17:07:51.372 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.372 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.372 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:51.372 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.403794+0000", 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00094998700000000001 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.426361+0000", 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022566928 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.426401+0000", 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9665000000000001e-05 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.373 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.426588+0000", 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000186539 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.426741+0000", 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015296400000000001 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.374 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2119 3.20 3:0529b5d9:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.ex47I2wBo4YNPUzefmcVhDBd0ZGN1Yz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:51.375 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.146292+0000", 2024-09-12T17:07:51.375 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.107605622000001, 2024-09-12T17:07:51.375 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021203072, 2024-09-12T17:07:51.375 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.375 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.375 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.375 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.375 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.375 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.375 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2119 2024-09-12T17:07:51.375 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.375 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.146292+0000", 2024-09-12T17:07:51.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.376 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.146292+0000", 2024-09-12T17:07:51.376 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.376 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.376 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.376 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.146294+0000", 2024-09-12T17:07:51.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3630000000000001e-06 2024-09-12T17:07:51.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.154205+0000", 2024-09-12T17:07:51.377 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0079102400000000007 2024-09-12T17:07:51.377 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.377 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.377 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.377 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.154252+0000", 2024-09-12T17:07:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6915000000000001e-05 2024-09-12T17:07:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.154271+0000", 2024-09-12T17:07:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9582e-05 2024-09-12T17:07:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.154436+0000", 2024-09-12T17:07:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016445699999999999 2024-09-12T17:07:51.378 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.154685+0000", 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024904799999999998 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.154927+0000", 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024269100000000001 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.379 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.164206+0000", 2024-09-12T17:07:51.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0092787760000000007 2024-09-12T17:07:51.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.167245+0000", 2024-09-12T17:07:51.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030385249999999998 2024-09-12T17:07:51.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.380 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.380 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.380 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.167345+0000", 2024-09-12T17:07:51.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100203 2024-09-12T17:07:51.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.167495+0000", 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015027199999999999 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2146 3.2c 3:35eb2578:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.67:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.680030+0000", 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.573867651, 2024-09-12T17:07:51.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026494238, 2024-09-12T17:07:51.382 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.382 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.382 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.382 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.382 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.382 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.382 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2146 2024-09-12T17:07:51.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.382 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.680030+0000", 2024-09-12T17:07:51.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.680030+0000", 2024-09-12T17:07:51.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.680032+0000", 2024-09-12T17:07:51.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2069999999999998e-06 2024-09-12T17:07:51.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.685207+0000", 2024-09-12T17:07:51.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051749459999999997 2024-09-12T17:07:51.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.685240+0000", 2024-09-12T17:07:51.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2499000000000002e-05 2024-09-12T17:07:51.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.685256+0000", 2024-09-12T17:07:51.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6069000000000001e-05 2024-09-12T17:07:51.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.685447+0000", 2024-09-12T17:07:51.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019092999999999999 2024-09-12T17:07:51.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.685713+0000", 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026668699999999999 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686636+0000", 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00092234999999999995 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.706112+0000", 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019476078000000001 2024-09-12T17:07:51.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.706279+0000", 2024-09-12T17:07:51.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016724700000000001 2024-09-12T17:07:51.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.706410+0000", 2024-09-12T17:07:51.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000130865 2024-09-12T17:07:51.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.706524+0000", 2024-09-12T17:07:51.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011436 2024-09-12T17:07:51.388 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.388 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.388 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.388 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2210 3.35 3:afb4900b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.76:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:51.388 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:37.092926+0000", 2024-09-12T17:07:51.388 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.160971521, 2024-09-12T17:07:51.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025007710999999998, 2024-09-12T17:07:51.388 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2210 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.092926+0000", 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.092926+0000", 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.092929+0000", 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.27e-06 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:51.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.097130+0000", 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042002230000000003 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.097170+0000", 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0865999999999998e-05 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.097189+0000", 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8685000000000002e-05 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:51.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.097332+0000", 2024-09-12T17:07:51.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014263899999999999 2024-09-12T17:07:51.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:51.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.097603+0000", 2024-09-12T17:07:51.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000271267 2024-09-12T17:07:51.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.392 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:51.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.098492+0000", 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00088944200000000005 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.113482+0000", 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014989105000000001 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.117696+0000", 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004214789 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.117803+0000", 2024-09-12T17:07:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010621899999999999 2024-09-12T17:07:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.117934+0000", 2024-09-12T17:07:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000131206 2024-09-12T17:07:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.394 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:51.395 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:51.395 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:51.396 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:51.396 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:51.397 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:51.397 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:51.398 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:51.398 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:51.399 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:51.399 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:51.392+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:51.497 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:51.492+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:51.534 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:51.534 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:51.550 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:51.597 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:51.592+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:51.699 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:51.696+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:51.718 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:51.718 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:51.734 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:51.800 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:51.796+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:51.901 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:51.896+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:51.908 INFO:teuthology.orchestra.run.smithi047.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:51.909 INFO:teuthology.orchestra.run.smithi047.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:51.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T17:07:52.002 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-09-12T17:07:51.996+0000 7fbd8e97c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26327) UID: 0 2024-09-12T17:07:52.048 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:52.048 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:52.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T17:07:52.104 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:52.100+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:52.205 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:52.200+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:52.232 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:52.232 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:52.245 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T17:07:52.306 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:52.300+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:52.355 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T17:07:52.407 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:52.404+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:52.412 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:52.412 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:52.426 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T17:07:52.508 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:52.504+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:52.544 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:52.544 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:52.557 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T17:07:52.609 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:52.604+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:52.695 INFO:tasks.workunit.client.0.smithi017.stdout:adding file to bucket buck_2024_08_12_17_07_26: 10Mb.100 2024-09-12T17:07:52.695 INFO:tasks.workunit.client.0.smithi017.stdout:upload file successful 2024-09-12T17:07:52.695 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.1 from bucket to /tmp/downloadfile.1 2024-09-12T17:07:52.695 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.2 from bucket to /tmp/downloadfile.2 2024-09-12T17:07:52.695 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.3 from bucket to /tmp/downloadfile.3 2024-09-12T17:07:52.695 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.4 from bucket to /tmp/downloadfile.4 2024-09-12T17:07:52.695 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.5 from bucket to /tmp/downloadfile.5 2024-09-12T17:07:52.695 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.6 from bucket to /tmp/downloadfile.6 2024-09-12T17:07:52.695 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.7 from bucket to /tmp/downloadfile.7 2024-09-12T17:07:52.695 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.8 from bucket to /tmp/downloadfile.8 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.9 from bucket to /tmp/downloadfile.9 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.10 from bucket to /tmp/downloadfile.10 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.11 from bucket to /tmp/downloadfile.11 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.12 from bucket to /tmp/downloadfile.12 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.13 from bucket to /tmp/downloadfile.13 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.14 from bucket to /tmp/downloadfile.14 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.15 from bucket to /tmp/downloadfile.15 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.16 from bucket to /tmp/downloadfile.16 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.17 from bucket to /tmp/downloadfile.17 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.18 from bucket to /tmp/downloadfile.18 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.19 from bucket to /tmp/downloadfile.19 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.20 from bucket to /tmp/downloadfile.20 2024-09-12T17:07:52.696 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.21 from bucket to /tmp/downloadfile.21 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.22 from bucket to /tmp/downloadfile.22 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.23 from bucket to /tmp/downloadfile.23 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.24 from bucket to /tmp/downloadfile.24 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.25 from bucket to /tmp/downloadfile.25 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.26 from bucket to /tmp/downloadfile.26 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.27 from bucket to /tmp/downloadfile.27 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.28 from bucket to /tmp/downloadfile.28 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.29 from bucket to /tmp/downloadfile.29 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.30 from bucket to /tmp/downloadfile.30 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.31 from bucket to /tmp/downloadfile.31 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.32 from bucket to /tmp/downloadfile.32 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.33 from bucket to /tmp/downloadfile.33 2024-09-12T17:07:52.697 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.34 from bucket to /tmp/downloadfile.34 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.35 from bucket to /tmp/downloadfile.35 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.36 from bucket to /tmp/downloadfile.36 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.37 from bucket to /tmp/downloadfile.37 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.38 from bucket to /tmp/downloadfile.38 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.39 from bucket to /tmp/downloadfile.39 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.40 from bucket to /tmp/downloadfile.40 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.41 from bucket to /tmp/downloadfile.41 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.42 from bucket to /tmp/downloadfile.42 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.43 from bucket to /tmp/downloadfile.43 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.44 from bucket to /tmp/downloadfile.44 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.45 from bucket to /tmp/downloadfile.45 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.46 from bucket to /tmp/downloadfile.46 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.47 from bucket to /tmp/downloadfile.47 2024-09-12T17:07:52.698 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.48 from bucket to /tmp/downloadfile.48 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.49 from bucket to /tmp/downloadfile.49 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.50 from bucket to /tmp/downloadfile.50 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.51 from bucket to /tmp/downloadfile.51 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.52 from bucket to /tmp/downloadfile.52 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.53 from bucket to /tmp/downloadfile.53 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.54 from bucket to /tmp/downloadfile.54 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.55 from bucket to /tmp/downloadfile.55 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.56 from bucket to /tmp/downloadfile.56 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.57 from bucket to /tmp/downloadfile.57 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.58 from bucket to /tmp/downloadfile.58 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.59 from bucket to /tmp/downloadfile.59 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.60 from bucket to /tmp/downloadfile.60 2024-09-12T17:07:52.699 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.61 from bucket to /tmp/downloadfile.61 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.62 from bucket to /tmp/downloadfile.62 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.63 from bucket to /tmp/downloadfile.63 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.64 from bucket to /tmp/downloadfile.64 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.65 from bucket to /tmp/downloadfile.65 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.66 from bucket to /tmp/downloadfile.66 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.67 from bucket to /tmp/downloadfile.67 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.68 from bucket to /tmp/downloadfile.68 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.69 from bucket to /tmp/downloadfile.69 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.70 from bucket to /tmp/downloadfile.70 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.71 from bucket to /tmp/downloadfile.71 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.72 from bucket to /tmp/downloadfile.72 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.73 from bucket to /tmp/downloadfile.73 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.74 from bucket to /tmp/downloadfile.74 2024-09-12T17:07:52.700 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.75 from bucket to /tmp/downloadfile.75 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.76 from bucket to /tmp/downloadfile.76 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.77 from bucket to /tmp/downloadfile.77 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.78 from bucket to /tmp/downloadfile.78 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.79 from bucket to /tmp/downloadfile.79 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.80 from bucket to /tmp/downloadfile.80 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.81 from bucket to /tmp/downloadfile.81 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.82 from bucket to /tmp/downloadfile.82 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.83 from bucket to /tmp/downloadfile.83 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.84 from bucket to /tmp/downloadfile.84 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.85 from bucket to /tmp/downloadfile.85 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.86 from bucket to /tmp/downloadfile.86 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.87 from bucket to /tmp/downloadfile.87 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.88 from bucket to /tmp/downloadfile.88 2024-09-12T17:07:52.701 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.89 from bucket to /tmp/downloadfile.89 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.90 from bucket to /tmp/downloadfile.90 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.91 from bucket to /tmp/downloadfile.91 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.92 from bucket to /tmp/downloadfile.92 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.93 from bucket to /tmp/downloadfile.93 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.94 from bucket to /tmp/downloadfile.94 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.95 from bucket to /tmp/downloadfile.95 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.96 from bucket to /tmp/downloadfile.96 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.97 from bucket to /tmp/downloadfile.97 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.98 from bucket to /tmp/downloadfile.98 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.99 from bucket to /tmp/downloadfile.99 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:Downloading 10Mb.100 from bucket to /tmp/downloadfile.100 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:Test case: PASSED - checksum verification for multipart upload passed 2024-09-12T17:07:52.702 INFO:tasks.workunit.client.0.smithi017.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T17:07:52.710 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:52.704+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:52.711 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:52.711 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:52.724 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T17:07:52.811 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:52.808+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:52.842 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:52.842 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:52.855 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T17:07:52.912 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:52.908+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:52.978 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:52.979 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:52.992 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T17:07:53.035 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:53.032+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:53.114 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:53.108+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:53.115 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:53.115 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:53.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T17:07:53.219 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:53.216+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:53.293 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:53.293 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:53.307 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T17:07:53.316 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:53.312+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:53.343 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T17:07:53.400 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T17:07:53.447 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:53.444+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:53.471 INFO:teuthology.orchestra.run.smithi017.stdout:ERROR: (22) Invalid argument 2024-09-12T17:07:53.471 INFO:teuthology.orchestra.run.smithi017.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T17:07:53.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T17:07:53.517 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:53.512+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:53.542 INFO:teuthology.orchestra.run.smithi017.stdout:osd.0: {} 2024-09-12T17:07:53.542 INFO:teuthology.orchestra.run.smithi017.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T17:07:53.560 INFO:teuthology.orchestra.run.smithi017.stdout:osd.1: {} 2024-09-12T17:07:53.560 INFO:teuthology.orchestra.run.smithi017.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T17:07:53.577 INFO:teuthology.orchestra.run.smithi017.stdout:osd.2: {} 2024-09-12T17:07:53.577 INFO:teuthology.orchestra.run.smithi017.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T17:07:53.594 INFO:teuthology.orchestra.run.smithi017.stdout:osd.3: {} 2024-09-12T17:07:53.594 INFO:teuthology.orchestra.run.smithi017.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T17:07:53.618 INFO:teuthology.orchestra.run.smithi017.stdout:osd.4: {} 2024-09-12T17:07:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T17:07:53.619 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:53.616+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:53.647 INFO:teuthology.orchestra.run.smithi017.stdout:osd.5: {} 2024-09-12T17:07:53.647 INFO:teuthology.orchestra.run.smithi017.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T17:07:53.653 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [], 2024-09-12T17:07:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: "complaint_time": 30, 2024-09-12T17:07:53.653 INFO:teuthology.orchestra.run.smithi017.stdout: "num_blocked_ops": 0 2024-09-12T17:07:53.653 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:53.666 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T17:07:53.669 INFO:teuthology.orchestra.run.smithi017.stdout:osd.6: {} 2024-09-12T17:07:53.669 INFO:teuthology.orchestra.run.smithi017.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T17:07:53.693 INFO:teuthology.orchestra.run.smithi017.stdout:osd.7: {} 2024-09-12T17:07:53.693 INFO:teuthology.orchestra.run.smithi017.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T17:07:53.751 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-09-12T17:07:53.748+0000 7f5d48b74640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26324) UID: 0 2024-09-12T17:07:53.784 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:07:53.784 INFO:teuthology.orchestra.run.smithi017.stdout: "size": 20, 2024-09-12T17:07:53.784 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 600, 2024-09-12T17:07:53.785 INFO:teuthology.orchestra.run.smithi017.stdout: "ops": [ 2024-09-12T17:07:53.785 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.785 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1201 3.8 3:114be366:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:53.785 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:53.785 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.968814225999999, 2024-09-12T17:07:53.785 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021172410999999999, 2024-09-12T17:07:53.785 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.785 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.785 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.785 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.785 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.785 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1201 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812953+0000", 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.786 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.812956+0000", 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3050000000000001e-06 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816133+0000", 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0031766699999999999 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.787 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816165+0000", 2024-09-12T17:07:53.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2197999999999999e-05 2024-09-12T17:07:53.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816177+0000", 2024-09-12T17:07:53.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1973999999999999e-05 2024-09-12T17:07:53.788 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.788 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.788 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.788 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816249+0000", 2024-09-12T17:07:53.788 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1898999999999997e-05 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816385+0000", 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013646400000000001 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.816513+0000", 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000128097 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.789 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.821736+0000", 2024-09-12T17:07:53.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052224869999999996 2024-09-12T17:07:53.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.790 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.790 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834015+0000", 2024-09-12T17:07:53.790 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012279784 2024-09-12T17:07:53.790 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.790 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834087+0000", 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.1935999999999997e-05 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.834125+0000", 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7596999999999999e-05 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.791 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1202 3.2 3:421b0e45:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.959030439000003, 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018086743999999998, 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1202 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.792 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822736+0000", 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.793 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.822739+0000", 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2589999999999999e-06 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824478+0000", 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001739256 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824502+0000", 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.3952999999999999e-05 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.794 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824514+0000", 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2031999999999999e-05 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824577+0000", 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2793999999999995e-05 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824714+0000", 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013785199999999999 2024-09-12T17:07:53.795 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.824862+0000", 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000147751 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.830267+0000", 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0054052670000000001 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840734+0000", 2024-09-12T17:07:53.796 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010466938 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840780+0000", 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5831999999999998e-05 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.840823+0000", 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2809999999999998e-05 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.797 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1210 3.29 3:97884890:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.838286177999997, 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021481673, 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1210 2024-09-12T17:07:53.798 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943481+0000", 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.799 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.943483+0000", 2024-09-12T17:07:53.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6520000000000002e-06 2024-09-12T17:07:53.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.800 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.800 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945771+0000", 2024-09-12T17:07:53.800 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022874829999999999 2024-09-12T17:07:53.800 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.800 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945806+0000", 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4836999999999999e-05 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945820+0000", 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4939e-05 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.945888+0000", 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7702999999999999e-05 2024-09-12T17:07:53.801 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946027+0000", 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000139135 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.946146+0000", 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000118742 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.802 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.950285+0000", 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0041384880000000001 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964885+0000", 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.014600594 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964928+0000", 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2536000000000001e-05 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.803 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:11.964962+0000", 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.4564000000000003e-05 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1216 3.33 3:cf30ff9d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.773801403, 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.023290796999999999, 2024-09-12T17:07:53.804 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1216 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.805 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007965+0000", 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.007968+0000", 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.0580000000000002e-06 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009686+0000", 2024-09-12T17:07:53.806 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0017173920000000001 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009718+0000", 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2632999999999997e-05 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009734+0000", 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6011999999999998e-05 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.807 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.009834+0000", 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9947999999999999e-05 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010000+0000", 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016520599999999999 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.010133+0000", 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133676 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.808 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.015744+0000", 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056104570000000001 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031150+0000", 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015405894999999999 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031209+0000", 2024-09-12T17:07:53.809 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.9247999999999999e-05 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.031256+0000", 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.7271999999999997e-05 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1230 3.24 3:257b3201:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 41.298532352000002, 2024-09-12T17:07:53.810 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018874753000000001, 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1230 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:53.811 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483234+0000", 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.483238+0000", 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.2880000000000001e-06 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.812 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485868+0000", 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0026303490000000001 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485904+0000", 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5513999999999999e-05 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.485920+0000", 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.6201999999999998e-05 2024-09-12T17:07:53.813 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486092+0000", 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017220700000000001 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486500+0000", 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00040771200000000002 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.486750+0000", 2024-09-12T17:07:53.814 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00025026699999999998 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.500598+0000", 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013848226 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.501939+0000", 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013409839999999999 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.815 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502016+0000", 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.6908000000000003e-05 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:12.502109+0000", 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.3096000000000004e-05 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.816 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1387 3.8 3:122cdcfa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 37.443478012, 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018409291000000001, 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1387 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.817 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338289+0000", 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.338292+0000", 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.631e-06 2024-09-12T17:07:53.818 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340227+0000", 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001934217 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340262+0000", 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.5893999999999999e-05 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.819 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340278+0000", 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.5325e-05 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340387+0000", 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00010876 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340570+0000", 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018296299999999999 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.820 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.340735+0000", 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016568400000000001 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.345914+0000", 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0051783319999999999 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356536+0000", 2024-09-12T17:07:53.821 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010622529 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356632+0000", 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.5927000000000005e-05 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:16.356698+0000", 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.6029000000000001e-05 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.822 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1733 3.33 3:cd3b7926:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.M8SFsRZfEjvXnxNc1Ny07cg_vtwVJ9y_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 26.71416842, 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.024112788, 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1733 2024-09-12T17:07:53.823 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067598+0000", 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.824 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.067603+0000", 2024-09-12T17:07:53.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.707e-06 2024-09-12T17:07:53.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.825 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072541+0000", 2024-09-12T17:07:53.825 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0049382710000000002 2024-09-12T17:07:53.825 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.825 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.825 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072582+0000", 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0392999999999998e-05 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072606+0000", 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4303000000000001e-05 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072745+0000", 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013889300000000001 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.826 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.072967+0000", 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022192800000000001 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.073233+0000", 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00026631499999999999 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.086312+0000", 2024-09-12T17:07:53.827 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.013078579 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091563+0000", 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0052509369999999998 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091648+0000", 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.5051999999999998e-05 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.828 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:27.091711+0000", 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3410000000000004e-05 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1887 3.33 3:cf01266b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.yI34Oa84OEb7C49UYPF9HCMJS_d1s3T_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 23.518681062999999, 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018315027000000001, 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.829 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1887 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.830 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263086+0000", 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.263090+0000", 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0239999999999999e-06 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265411+0000", 2024-09-12T17:07:53.831 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00232132 2024-09-12T17:07:53.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265443+0000", 2024-09-12T17:07:53.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1718999999999999e-05 2024-09-12T17:07:53.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.832 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.832 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265455+0000", 2024-09-12T17:07:53.832 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2143999999999999e-05 2024-09-12T17:07:53.832 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.832 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265535+0000", 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.9659000000000004e-05 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265655+0000", 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000120902 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.265755+0000", 2024-09-12T17:07:53.833 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.9761999999999998e-05 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.272399+0000", 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0066442510000000003 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281321+0000", 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0089219669999999994 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.834 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281358+0000", 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.6355e-05 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.281401+0000", 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.2923999999999998e-05 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.835 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1920 3.8 3:11cda29a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.31:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.867912464, 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.022252124000000002, 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1920 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.836 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913854+0000", 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.913858+0000", 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0770000000000001e-06 2024-09-12T17:07:53.837 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917854+0000", 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0039960600000000001 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917898+0000", 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3689999999999997e-05 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.838 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.917917+0000", 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.9233e-05 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.918051+0000", 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000133969 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.918315+0000", 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000263355 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.839 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.919198+0000", 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00088375200000000002 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.928506+0000", 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0093070960000000008 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936025+0000", 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0075193400000000002 2024-09-12T17:07:53.840 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936073+0000", 2024-09-12T17:07:53.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.8012e-05 2024-09-12T17:07:53.841 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.841 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.841 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.841 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:30.936106+0000", 2024-09-12T17:07:53.841 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3540000000000001e-05 2024-09-12T17:07:53.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.841 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.841 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:1938 3.19 3:9addcbec:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.34:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 22.448771968999999, 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020463775, 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.842 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 1938 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332995+0000", 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.843 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.332997+0000", 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5100000000000001e-06 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337007+0000", 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0040099979999999999 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337054+0000", 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.6826000000000002e-05 2024-09-12T17:07:53.844 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337073+0000", 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.8743e-05 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337189+0000", 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000116507 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.845 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.337415+0000", 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00022530099999999999 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.338022+0000", 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00060701600000000004 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.347566+0000", 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0095447150000000005 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.846 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353379+0000", 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058124170000000003 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353425+0000", 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.5824e-05 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:31.353459+0000", 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3918000000000003e-05 2024-09-12T17:07:53.847 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2101 3.24 3:25ca6521:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.4pZZCgy-wBJXiNQ0J0vFl8TPz4X_i3J_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.97098231, 2024-09-12T17:07:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018837217999999999, 2024-09-12T17:07:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.848 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2101 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.849 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810784+0000", 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.810788+0000", 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0069999999999999e-06 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812434+0000", 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0016459020000000001 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.850 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812468+0000", 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.3173999999999998e-05 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812482+0000", 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3985000000000001e-05 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812582+0000", 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000100801 2024-09-12T17:07:53.851 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812780+0000", 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000197219 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.812965+0000", 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00018523500000000001 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.818504+0000", 2024-09-12T17:07:53.852 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0055390429999999996 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829488+0000", 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.010984551 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829565+0000", 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7106000000000003e-05 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.853 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.829622+0000", 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.6195e-05 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2107 3.27 3:e6a067b7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.Yyze1zZ5yDQsQYVWfVwDqF36m9lCinJ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.870014026, 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.020701105000000001, 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.854 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2107 2024-09-12T17:07:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.855 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911753+0000", 2024-09-12T17:07:53.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.856 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.856 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.911756+0000", 2024-09-12T17:07:53.856 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.557e-06 2024-09-12T17:07:53.856 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.856 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913489+0000", 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001732623 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913518+0000", 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8949e-05 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913530+0000", 2024-09-12T17:07:53.857 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.1691999999999999e-05 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913612+0000", 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.2706000000000004e-05 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913803+0000", 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000190695 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:53.858 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.913972+0000", 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000169536 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.919843+0000", 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0058703280000000002 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932289+0000", 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0124463 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.859 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932386+0000", 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7108999999999995e-05 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:34.932454+0000", 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.7609999999999998e-05 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.860 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2134 3.19 3:9a3dd654:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.65:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.352126198000001, 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.021094020000000002, 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2134 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.861 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429641+0000", 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.862 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.429643+0000", 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.588e-06 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431844+0000", 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0022009040000000001 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431875+0000", 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.1217999999999998e-05 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.863 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.431889+0000", 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3643e-05 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.432039+0000", 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015003799999999999 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.432481+0000", 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00044164399999999999 2024-09-12T17:07:53.864 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.433634+0000", 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0011532059999999999 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.449117+0000", 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.015483241999999999 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.865 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450419+0000", 2024-09-12T17:07:53.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001301466 2024-09-12T17:07:53.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450606+0000", 2024-09-12T17:07:53.866 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000187009 2024-09-12T17:07:53.866 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.866 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.866 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.866 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.450735+0000", 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012906199999999999 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2143 3.7 3:e0f27ed8:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.WqbBAH1T3u9gjF2P42eNw2YQ0hm2xWo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:35.655215+0000", 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 18.126551915, 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.019844753999999999, 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.867 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.868 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.868 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.868 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2143 2024-09-12T17:07:53.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.868 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.868 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.868 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.868 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.655215+0000", 2024-09-12T17:07:53.868 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.868 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.655215+0000", 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.655219+0000", 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.8600000000000003e-06 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.869 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657519+0000", 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0023000149999999999 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657547+0000", 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8489000000000001e-05 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657559+0000", 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2058999999999999e-05 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.870 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657657+0000", 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.7965000000000001e-05 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657816+0000", 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0001584 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.657946+0000", 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000130667 2024-09-12T17:07:53.871 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.662762+0000", 2024-09-12T17:07:53.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0048154859999999999 2024-09-12T17:07:53.872 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.872 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.872 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.872 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.674927+0000", 2024-09-12T17:07:53.872 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012165364 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.674997+0000", 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.0173999999999996e-05 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:35.675060+0000", 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2274999999999996e-05 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.873 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2179 3.33 3:cc4cab85:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.BhsaRTISTLDImeesX85vqIql3rkxI1u_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.575783+0000", 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.205984140999998, 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.065094399999999997, 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.874 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2179 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.575783+0000", 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.575783+0000", 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.875 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.575787+0000", 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.9530000000000001e-06 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579440+0000", 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0036530640000000001 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579477+0000", 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 3.7845000000000001e-05 2024-09-12T17:07:53.876 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579492+0000", 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4275e-05 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579676+0000", 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000184031 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.579895+0000", 2024-09-12T17:07:53.877 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000219302 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.580106+0000", 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.000210922 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639924+0000", 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.059817951000000001 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.878 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.640589+0000", 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00066520200000000005 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.640754+0000", 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00016527600000000001 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.640877+0000", 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012257899999999999 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.879 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2180 3.8 3:123ed638:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.BhsaRTISTLDImeesX85vqIql3rkxI1u_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.586208+0000", 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.195559037999999, 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.052320799000000001, 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.880 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2180 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.586208+0000", 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.586208+0000", 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.881 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.586210+0000", 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.661e-06 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587685+0000", 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0014748249999999999 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587706+0000", 2024-09-12T17:07:53.882 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.0996e-05 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587718+0000", 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.2001000000000001e-05 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587815+0000", 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 9.6900999999999999e-05 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.883 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.587993+0000", 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00017817899999999999 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.588130+0000", 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013711600000000001 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636926+0000", 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048795660999999997 2024-09-12T17:07:53.884 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.638267+0000", 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0013408770000000001 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.638393+0000", 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012611 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.885 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.638529+0000", 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00013547200000000001 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop_reply(client.4434.0:2179 3.33 e73/24 ondisk, result = 0)", 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.591277+0000", 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.190489572000001, 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.048673934000000002, 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.886 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591277+0000", 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591277+0000", 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.887 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591279+0000", 2024-09-12T17:07:53.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.717e-06 2024-09-12T17:07:53.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.591288+0000", 2024-09-12T17:07:53.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.8799999999999997e-06 2024-09-12T17:07:53.888 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.888 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.888 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.888 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.631851+0000", 2024-09-12T17:07:53.888 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.040563601999999997 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.631880+0000", 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.8779999999999999e-05 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639863+0000", 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0079828290000000003 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.889 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639887+0000", 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.4156999999999999e-05 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.639951+0000", 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.3968999999999997e-05 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop_reply(client.4434.0:2180 3.8 e73/51 ondisk, result = 0)", 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.594180+0000", 2024-09-12T17:07:53.890 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.187587055000002, 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.04275955, 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "started", 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594180+0000", 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.891 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594180+0000", 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594181+0000", 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.683e-06 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.594190+0000", 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.6079999999999996e-06 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.892 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.632075+0000", 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.037884843000000001 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.632268+0000", 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019365300000000001 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636902+0000", 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.004633936 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.893 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636917+0000", 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.4324e-05 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.636939+0000", 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.2503000000000001e-05 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.894 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_repop(client.4434.0:2195 3.c e73/24 3:337f05fc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.DSvxz4vaxxy0dMg8hp4VJxR3sCjbrFE_1:head v 73'10, mlcod=72'8)", 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:36.777412+0000", 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 17.004354669000001, 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018679920999999999, 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.777412+0000", 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.895 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.777412+0000", 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.777416+0000", 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.0029999999999996e-06 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783541+0000", 2024-09-12T17:07:53.896 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0061247070000000001 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783584+0000", 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 4.3498999999999998e-05 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783610+0000", 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.5406999999999999e-05 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.897 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783809+0000", 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00019944900000000001 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.783882+0000", 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.3308999999999999e-05 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.796030+0000", 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.012147217 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.898 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:36.796092+0000", 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 6.2329999999999994e-05 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "description": "osd_op(client.4434.0:2327 3.33 3:ce967cb5:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.MVmoorSq8SMskXgSj5cJmk32Q3--ssn_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "initiated_at": "2024-09-12T17:07:39.530634+0000", 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "age": 14.251132642, 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.026980457999999999, 2024-09-12T17:07:53.899 INFO:teuthology.orchestra.run.smithi017.stdout: "continuous": false, 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "type_data": { 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client_info": { 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client": "client.4434", 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "tid": 2327 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "events": [ 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "initiated", 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.530634+0000", 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.900 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "header_read", 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.530634+0000", 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "throttled", 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.530636+0000", 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.872e-06 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "all_read", 2024-09-12T17:07:53.901 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532507+0000", 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.001870802 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "dispatched", 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532533+0000", 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 2.6098e-05 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "queued_for_pg", 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532547+0000", 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 1.3944000000000001e-05 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.902 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "reached_pg", 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532632+0000", 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 8.4894000000000004e-05 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "started", 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532791+0000", 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00015956799999999999 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.532920+0000", 2024-09-12T17:07:53.903 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.00012916699999999999 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "op_commit", 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.538587+0000", 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.0056661130000000004 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.557478+0000", 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 0.018891181999999999 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.904 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "commit_sent", 2024-09-12T17:07:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.557556+0000", 2024-09-12T17:07:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 7.7875999999999998e-05 2024-09-12T17:07:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-09-12T17:07:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-09-12T17:07:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: "event": "done", 2024-09-12T17:07:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: "time": "2024-09-12T17:07:39.557615+0000", 2024-09-12T17:07:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: "duration": 5.8941999999999999e-05 2024-09-12T17:07:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-09-12T17:07:53.905 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-09-12T17:07:53.906 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:07:53.907 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T17:07:53.908 INFO:tasks.ceph.osd.4.smithi047.stderr:2024-09-12T17:07:53.904+0000 7f6b617f5640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26473) UID: 0 2024-09-12T17:07:54.008 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:54.004+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:54.051 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:54.051 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:54.051 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:54.066 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T17:07:54.072 INFO:tasks.workunit.client.0.smithi017.stdout:user 0.330683562529401 deleted 2024-09-12T17:07:54.076 INFO:tasks.workunit.client.0.smithi017.stdout:OK 2024-09-12T17:07:54.077 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T17:07:54.077 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T17:07:54.116 INFO:tasks.ceph.osd.7.smithi047.stderr:2024-09-12T17:07:54.112+0000 7fc348acf640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26480) UID: 0 2024-09-12T17:07:54.129 INFO:tasks.workunit:Stopping ['rgw/s3_multipart_upload.pl'] on client.0... 2024-09-12T17:07:54.130 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T17:07:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:54.190 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:54.190 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:54.190 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:54.190 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:54.205 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T17:07:54.247 INFO:tasks.ceph.osd.5.smithi047.stderr:2024-09-12T17:07:54.244+0000 7f9bab493640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26476) UID: 0 2024-09-12T17:07:54.311 INFO:tasks.ceph.osd.6.smithi047.stderr:2024-09-12T17:07:54.308+0000 7fc958add640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26478) UID: 0 2024-09-12T17:07:54.379 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:54.379 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:54.379 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:54.379 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:54.379 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1188 3.31 3:8d857c15:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1_100Mb.2:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.881070039000001, 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019168672000000001, 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1188 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.380 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493822+0000", 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.381 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.493824+0000", 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.553e-06 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497820+0000", 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039958659999999998 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497855+0000", 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4956000000000002e-05 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.382 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497872+0000", 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6863000000000001e-05 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.497996+0000", 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124306 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498229+0000", 2024-09-12T17:07:54.383 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023307699999999999 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.498994+0000", 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00076469699999999995 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.507996+0000", 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090021540000000001 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.384 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512687+0000", 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0046905360000000004 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512861+0000", 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017420399999999999 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.512990+0000", 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012946 2024-09-12T17:07:54.385 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1232 3.14 3:2967aafe:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.854617130999998, 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019509183999999999, 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.386 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1232 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520274+0000", 2024-09-12T17:07:54.387 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.520278+0000", 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9539999999999998e-06 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525478+0000", 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005199665 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.388 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525520+0000", 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2391999999999997e-05 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525542+0000", 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1613000000000001e-05 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525676+0000", 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013434300000000001 2024-09-12T17:07:54.389 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.525933+0000", 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025640400000000001 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.526162+0000", 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000228722 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.390 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.534431+0000", 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0082696019999999992 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539449+0000", 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050177099999999999 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539640+0000", 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000190812 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.391 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.539784+0000", 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000143967 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1234 3.3 3:c0bf349d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.829446185999998, 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019413466000000001, 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.392 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1234 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.393 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545445+0000", 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.545450+0000", 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.313e-06 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549431+0000", 2024-09-12T17:07:54.394 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039813139999999997 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549472+0000", 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0828999999999998e-05 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549491+0000", 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9055999999999998e-05 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.395 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549627+0000", 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013646700000000001 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.549859+0000", 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023186100000000001 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.550208+0000", 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000348372 2024-09-12T17:07:54.396 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.559516+0000", 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093083260000000004 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564688+0000", 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051717849999999999 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564783+0000", 2024-09-12T17:07:54.397 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4821000000000006e-05 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.564859+0000", 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.6322000000000006e-05 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1235 3.1c e63/45 3:3a130a9b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_7:head v 63'2, mlcod=0'0)", 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:54.398 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.812380050000002, 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023527869, 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.399 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562512+0000", 2024-09-12T17:07:54.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.400 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.562514+0000", 2024-09-12T17:07:54.400 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3870000000000002e-06 2024-09-12T17:07:54.400 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.400 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.400 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570603+0000", 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080886359999999997 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570630+0000", 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7276000000000001e-05 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570642+0000", 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2153e-05 2024-09-12T17:07:54.401 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570805+0000", 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016319899999999999 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.570900+0000", 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4988000000000006e-05 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.585884+0000", 2024-09-12T17:07:54.402 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014984046000000001 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.586039+0000", 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000155184 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1247 3.1a 3:58056b43:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:54.403 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.673854007999999, 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021958978000000001, 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1247 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:54.404 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701038+0000", 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.701041+0000", 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9399999999999998e-06 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.405 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705529+0000", 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044889789999999997 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705569+0000", 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9606e-05 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705588+0000", 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9375999999999999e-05 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.406 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.705756+0000", 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016734200000000001 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706045+0000", 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028885400000000001 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.706343+0000", 2024-09-12T17:07:54.407 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029790300000000002 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720973+0000", 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014630684 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722653+0000", 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016799790000000001 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.408 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722878+0000", 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022488799999999999 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.722997+0000", 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118427 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1376 3.3 3:c01937d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:54.409 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 38.155665100999997, 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020435229999999999, 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1376 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.410 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219226+0000", 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.219230+0000", 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.23e-06 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.411 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223391+0000", 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041610629999999996 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223425+0000", 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4167e-05 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223443+0000", 2024-09-12T17:07:54.412 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8105999999999999e-05 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223562+0000", 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118861 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.223840+0000", 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027762099999999998 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.413 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.224077+0000", 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023720100000000001 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.232976+0000", 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0088992900000000007 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239478+0000", 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065023609999999999 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.414 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239574+0000", 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5527999999999997e-05 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.239662+0000", 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7801999999999997e-05 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.415 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1382 3.1a 3:5ab5b3ac:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 38.088998148999998, 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020895593, 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1382 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.416 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285893+0000", 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.285897+0000", 2024-09-12T17:07:54.417 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6669999999999998e-06 2024-09-12T17:07:54.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.418 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.418 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.418 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290617+0000", 2024-09-12T17:07:54.418 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0047198689999999998 2024-09-12T17:07:54.418 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290657+0000", 2024-09-12T17:07:54.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0201999999999999e-05 2024-09-12T17:07:54.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.419 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.419 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290676+0000", 2024-09-12T17:07:54.419 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9293e-05 2024-09-12T17:07:54.419 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.419 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.290860+0000", 2024-09-12T17:07:54.420 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000183353 2024-09-12T17:07:54.420 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.420 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.420 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.420 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291264+0000", 2024-09-12T17:07:54.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040463800000000002 2024-09-12T17:07:54.421 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.421 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.421 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:54.421 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.291676+0000", 2024-09-12T17:07:54.421 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041151499999999999 2024-09-12T17:07:54.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.422 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.422 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.422 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.301391+0000", 2024-09-12T17:07:54.422 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0097147350000000004 2024-09-12T17:07:54.422 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306412+0000", 2024-09-12T17:07:54.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050210790000000003 2024-09-12T17:07:54.423 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.423 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.423 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.423 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306636+0000", 2024-09-12T17:07:54.423 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000224589 2024-09-12T17:07:54.424 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.424 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.424 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.424 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.306789+0000", 2024-09-12T17:07:54.424 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015265299999999999 2024-09-12T17:07:54.424 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.425 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.425 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.425 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.425 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.425 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1385 3.34 3:2f3cb087:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:54.426 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:54.426 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 38.056973042999999, 2024-09-12T17:07:54.426 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024744103999999999, 2024-09-12T17:07:54.426 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.426 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.426 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.426 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.426 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1385 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317919+0000", 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.427 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.317922+0000", 2024-09-12T17:07:54.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.157e-06 2024-09-12T17:07:54.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322800+0000", 2024-09-12T17:07:54.428 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048785879999999997 2024-09-12T17:07:54.428 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.428 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.428 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.428 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322846+0000", 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5732999999999997e-05 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.322866+0000", 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0415999999999999e-05 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323048+0000", 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018128 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.429 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323496+0000", 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044786400000000002 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.323919+0000", 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042374399999999999 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.340076+0000", 2024-09-12T17:07:54.430 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016156925999999999 2024-09-12T17:07:54.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342379+0000", 2024-09-12T17:07:54.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0023025189999999998 2024-09-12T17:07:54.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.431 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.431 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.431 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342546+0000", 2024-09-12T17:07:54.431 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016719599999999999 2024-09-12T17:07:54.431 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.432 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.432 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.342663+0000", 2024-09-12T17:07:54.432 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116681 2024-09-12T17:07:54.432 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.432 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.432 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.432 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.432 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.433 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1409 3.a e64/24 3:53d4fdcd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_3:head v 64'6, mlcod=64'4)", 2024-09-12T17:07:54.433 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:54.433 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.553493500999998, 2024-09-12T17:07:54.433 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021472076, 2024-09-12T17:07:54.433 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.433 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.433 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.433 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.434 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.434 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:54.434 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.434 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.434 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.435 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.435 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821398+0000", 2024-09-12T17:07:54.435 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.435 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.435 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821402+0000", 2024-09-12T17:07:54.436 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4699999999999998e-06 2024-09-12T17:07:54.436 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.436 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.436 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.436 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828337+0000", 2024-09-12T17:07:54.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069354229999999996 2024-09-12T17:07:54.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828387+0000", 2024-09-12T17:07:54.437 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9908999999999999e-05 2024-09-12T17:07:54.437 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.437 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.437 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.437 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828412+0000", 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5389999999999999e-05 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828587+0000", 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017425599999999999 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.828654+0000", 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7708999999999998e-05 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.438 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842774+0000", 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014119860999999999 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.842870+0000", 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6057999999999994e-05 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.439 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.440 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1417 3.14 3:29a29b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:54.440 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:54.440 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.452165096000002, 2024-09-12T17:07:54.440 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.034043223999999997, 2024-09-12T17:07:54.440 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.440 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.440 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.440 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.440 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.440 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.440 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1417 2024-09-12T17:07:54.440 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922726+0000", 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.441 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.922731+0000", 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1099999999999996e-06 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930785+0000", 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0080541020000000005 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930841+0000", 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6005999999999999e-05 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.442 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.930869+0000", 2024-09-12T17:07:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8602000000000002e-05 2024-09-12T17:07:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931049+0000", 2024-09-12T17:07:54.443 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017998299999999999 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931287+0000", 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000237712 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931510+0000", 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022283200000000001 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.444 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941891+0000", 2024-09-12T17:07:54.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010380785 2024-09-12T17:07:54.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.445 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.445 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.955891+0000", 2024-09-12T17:07:54.445 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014000207000000001 2024-09-12T17:07:54.445 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.445 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956636+0000", 2024-09-12T17:07:54.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00074503099999999995 2024-09-12T17:07:54.446 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.446 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.446 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.446 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.956770+0000", 2024-09-12T17:07:54.446 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013385400000000001 2024-09-12T17:07:54.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.446 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.446 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1420 3.3 3:c118c659:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 37.422871280000003, 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022394282000000001, 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.447 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1420 2024-09-12T17:07:54.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.448 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:54.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.448 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.448 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.448 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952020+0000", 2024-09-12T17:07:54.448 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.448 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952024+0000", 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1760000000000003e-06 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958458+0000", 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0064335770000000002 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.449 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958492+0000", 2024-09-12T17:07:54.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4309e-05 2024-09-12T17:07:54.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958508+0000", 2024-09-12T17:07:54.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5699999999999999e-05 2024-09-12T17:07:54.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.450 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.450 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.450 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.958717+0000", 2024-09-12T17:07:54.450 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020871900000000001 2024-09-12T17:07:54.450 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959163+0000", 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000446007 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959583+0000", 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042026800000000001 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.451 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.970389+0000", 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010806375999999999 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974044+0000", 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003654352 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974232+0000", 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018811899999999999 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.452 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.974415+0000", 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018267899999999999 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1896 3.2c e71/24 3:3773d78b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.27:head v 71'8, mlcod=71'6)", 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.970835073, 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021824796, 2024-09-12T17:07:54.453 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404056+0000", 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.454 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.404059+0000", 2024-09-12T17:07:54.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.537e-06 2024-09-12T17:07:54.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.455 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408616+0000", 2024-09-12T17:07:54.455 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045564799999999999 2024-09-12T17:07:54.455 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.455 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.455 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408657+0000", 2024-09-12T17:07:54.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1968000000000002e-05 2024-09-12T17:07:54.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408676+0000", 2024-09-12T17:07:54.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8445999999999999e-05 2024-09-12T17:07:54.456 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.456 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.456 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.456 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408880+0000", 2024-09-12T17:07:54.456 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020370100000000001 2024-09-12T17:07:54.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.408952+0000", 2024-09-12T17:07:54.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2226999999999998e-05 2024-09-12T17:07:54.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.457 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.457 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.425787+0000", 2024-09-12T17:07:54.457 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016835383999999998 2024-09-12T17:07:54.457 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.457 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.458 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.458 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.425881+0000", 2024-09-12T17:07:54.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4053000000000002e-05 2024-09-12T17:07:54.458 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.458 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.458 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.458 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.458 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.458 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1917 3.1a 3:5b4c0dd7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.P_wej9y73GH8iAzyXzEiqKNwtELtJTp_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:54.458 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:54.458 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.490922681000001, 2024-09-12T17:07:54.458 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026569157999999999, 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1917 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:54.459 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883969+0000", 2024-09-12T17:07:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.883971+0000", 2024-09-12T17:07:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4030000000000001e-06 2024-09-12T17:07:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.460 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890727+0000", 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067561080000000003 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890770+0000", 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2614999999999998e-05 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890794+0000", 2024-09-12T17:07:54.461 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3808999999999999e-05 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.890964+0000", 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000169956 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.891223+0000", 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025883600000000003 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.462 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.891466+0000", 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000242883 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.909542+0000", 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018076262999999999 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910349+0000", 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080699299999999999 2024-09-12T17:07:54.463 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910447+0000", 2024-09-12T17:07:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8301999999999995e-05 2024-09-12T17:07:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.910538+0000", 2024-09-12T17:07:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.0989999999999994e-05 2024-09-12T17:07:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.464 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1923 3.1d e71/24 3:bbfa0a4b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.RvdbUUXkO22SF-kwzRd4VKnEQTGoFzf_1:head v 71'2, mlcod=0'0)", 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.340579729000002, 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020143629, 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.465 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034312+0000", 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034315+0000", 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.123e-06 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.466 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038477+0000", 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041615999999999997 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038520+0000", 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3705000000000003e-05 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038539+0000", 2024-09-12T17:07:54.467 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8825999999999999e-05 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038679+0000", 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000140051 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.038729+0000", 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9455e-05 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.468 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054300+0000", 2024-09-12T17:07:54.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015571000999999999 2024-09-12T17:07:54.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.469 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.469 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.469 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054455+0000", 2024-09-12T17:07:54.469 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015586800000000001 2024-09-12T17:07:54.469 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.469 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.469 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.469 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1926 3.9 3:92ed9a0c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.32:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.315346294000001, 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019336487999999999, 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1926 2024-09-12T17:07:54.470 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059545+0000", 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.471 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.059548+0000", 2024-09-12T17:07:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5900000000000002e-06 2024-09-12T17:07:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063544+0000", 2024-09-12T17:07:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039964340000000001 2024-09-12T17:07:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063587+0000", 2024-09-12T17:07:54.472 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2701000000000003e-05 2024-09-12T17:07:54.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063605+0000", 2024-09-12T17:07:54.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8065999999999999e-05 2024-09-12T17:07:54.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.473 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.473 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.063745+0000", 2024-09-12T17:07:54.473 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014033000000000001 2024-09-12T17:07:54.473 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.473 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.064004+0000", 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025869899999999998 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.064666+0000", 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00066141599999999996 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.074813+0000", 2024-09-12T17:07:54.474 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010147168 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078769+0000", 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039561680000000004 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078837+0000", 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8089000000000005e-05 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.475 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.476 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.078882+0000", 2024-09-12T17:07:54.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4827000000000003e-05 2024-09-12T17:07:54.476 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.476 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.476 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.476 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.476 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.476 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1975 3.1c e71/45 3:3805ec2a:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.jnyWlqSvXNPIAN3dK-0eL-Xl-MeMoAE_1:head v 71'6, mlcod=64'4)", 2024-09-12T17:07:54.476 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:54.476 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.353653343000001, 2024-09-12T17:07:54.476 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019266097999999999, 2024-09-12T17:07:54.476 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021238+0000", 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.477 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.021241+0000", 2024-09-12T17:07:54.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0369999999999999e-06 2024-09-12T17:07:54.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.478 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027374+0000", 2024-09-12T17:07:54.478 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061327090000000001 2024-09-12T17:07:54.478 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.478 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.478 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027417+0000", 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2966000000000002e-05 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027435+0000", 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7796e-05 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027586+0000", 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015143000000000001 2024-09-12T17:07:54.479 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.027623+0000", 2024-09-12T17:07:54.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6535000000000002e-05 2024-09-12T17:07:54.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.480 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.040387+0000", 2024-09-12T17:07:54.480 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012764463 2024-09-12T17:07:54.480 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.480 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.480 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.040504+0000", 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000117162 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2131 3.34 3:2ed641cc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.zMHhD2lKVde2GeFxbpVTls1jtnLcDP5_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.979946456, 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025713333000000001, 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.481 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.482 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.482 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.482 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2131 2024-09-12T17:07:54.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.482 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.482 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.482 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.482 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:54.482 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.482 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394945+0000", 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.394949+0000", 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6799999999999999e-06 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.483 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399541+0000", 2024-09-12T17:07:54.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004591955 2024-09-12T17:07:54.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399595+0000", 2024-09-12T17:07:54.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4694000000000002e-05 2024-09-12T17:07:54.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.484 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.484 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.484 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399622+0000", 2024-09-12T17:07:54.484 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6466e-05 2024-09-12T17:07:54.484 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399826+0000", 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020443600000000001 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.400245+0000", 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041897400000000002 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:54.485 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.400666+0000", 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042066199999999998 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420138+0000", 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019472382 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420297+0000", 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158214 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.486 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420498+0000", 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020172899999999999 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.420658+0000", 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016014100000000001 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.487 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2146 3.2c e73/24 3:35eb2578:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.67:head v 73'11, mlcod=71'9)", 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.688017766000002, 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018962961, 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.488 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686874+0000", 2024-09-12T17:07:54.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.489 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686876+0000", 2024-09-12T17:07:54.489 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6740000000000001e-06 2024-09-12T17:07:54.489 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.489 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.489 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691317+0000", 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044404900000000001 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691352+0000", 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5355999999999998e-05 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691370+0000", 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7584999999999999e-05 2024-09-12T17:07:54.490 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691503+0000", 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013263199999999999 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.691545+0000", 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2886000000000002e-05 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.491 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.705738+0000", 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014192885000000001 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.705837+0000", 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8453000000000001e-05 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2198 3.1 e73/24 3:829b5d0c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.74:head v 73'6, mlcod=72'4)", 2024-09-12T17:07:54.492 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.805329+0000", 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.569562455, 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019490977999999999, 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.805329+0000", 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.493 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.805329+0000", 2024-09-12T17:07:54.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.805331+0000", 2024-09-12T17:07:54.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.672e-06 2024-09-12T17:07:54.494 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.494 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.494 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.494 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810780+0000", 2024-09-12T17:07:54.494 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054493110000000001 2024-09-12T17:07:54.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810807+0000", 2024-09-12T17:07:54.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7126000000000001e-05 2024-09-12T17:07:54.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.495 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.495 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810825+0000", 2024-09-12T17:07:54.495 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7747000000000001e-05 2024-09-12T17:07:54.495 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.495 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.810971+0000", 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014580600000000001 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.811038+0000", 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7477999999999993e-05 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.824762+0000", 2024-09-12T17:07:54.496 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013723384 2024-09-12T17:07:54.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.497 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.497 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.824820+0000", 2024-09-12T17:07:54.497 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.8454e-05 2024-09-12T17:07:54.497 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.497 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.497 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.497 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.497 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.497 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2204 3.31 3:8c16fd85:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.75:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:54.497 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.953186+0000", 2024-09-12T17:07:54.498 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 17.421705366000001, 2024-09-12T17:07:54.498 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022095528, 2024-09-12T17:07:54.498 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.498 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.498 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.498 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.498 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.498 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.498 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2204 2024-09-12T17:07:54.498 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.498 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.498 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.953186+0000", 2024-09-12T17:07:54.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.953186+0000", 2024-09-12T17:07:54.499 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.499 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.499 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.499 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.499 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.953189+0000", 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2030000000000001e-06 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957694+0000", 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045044159999999998 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957733+0000", 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8899000000000001e-05 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.500 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957749+0000", 2024-09-12T17:07:54.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6402999999999999e-05 2024-09-12T17:07:54.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.957890+0000", 2024-09-12T17:07:54.501 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014088100000000001 2024-09-12T17:07:54.501 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.501 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.501 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.501 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.958158+0000", 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026755799999999999 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.959046+0000", 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00088877100000000001 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.974849+0000", 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015802248000000001 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.502 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.975083+0000", 2024-09-12T17:07:54.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023468600000000001 2024-09-12T17:07:54.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.975203+0000", 2024-09-12T17:07:54.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119919 2024-09-12T17:07:54.503 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.503 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.503 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.503 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.975282+0000", 2024-09-12T17:07:54.503 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.8543999999999999e-05 2024-09-12T17:07:54.504 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.504 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.504 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.504 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.504 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.504 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:54.506 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-09-12T17:07:54.500+0000 7f9e3c45d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26329) UID: 0 2024-09-12T17:07:54.506 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T17:07:54.507 DEBUG:teuthology.parallel:result is None 2024-09-12T17:07:54.507 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:07:54.560 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:07:54.560 DEBUG:teuthology.orchestra.run.smithi017:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T17:07:54.606 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-09-12T17:07:54.600+0000 7f0d48de8640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26331) UID: 0 2024-09-12T17:07:54.625 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T17:07:54.625 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T17:07:54.635 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T17:07:54.678 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:54.678 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:54.678 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:54.679 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:54.693 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T17:07:54.813 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:54.813 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:54.814 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:54.814 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:54.814 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:54.828 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T17:07:54.959 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:54.959 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:54.959 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:54.959 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:54.959 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.960 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1239 3.16 3:6b2cb9ce:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:54.960 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:54.960 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.355292962, 2024-09-12T17:07:54.960 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021398218, 2024-09-12T17:07:54.960 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.960 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.960 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.960 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.960 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.960 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.960 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1239 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600987+0000", 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.961 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.600991+0000", 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9559999999999999e-06 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606170+0000", 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051789460000000002 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606222+0000", 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1422000000000003e-05 2024-09-12T17:07:54.962 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606249+0000", 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7163000000000001e-05 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606450+0000", 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000201325 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.606877+0000", 2024-09-12T17:07:54.963 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042682799999999997 2024-09-12T17:07:54.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:54.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.607298+0000", 2024-09-12T17:07:54.964 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042127700000000001 2024-09-12T17:07:54.964 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.964 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.964 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.964 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.615845+0000", 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0085471260000000004 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622186+0000", 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063410690000000004 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622292+0000", 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105305 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.965 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.622385+0000", 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3801000000000005e-05 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1251 3.1d 3:ba0891d6:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.212953446, 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020778814999999999, 2024-09-12T17:07:54.966 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1251 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.967 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743327+0000", 2024-09-12T17:07:54.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.743330+0000", 2024-09-12T17:07:54.968 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7000000000000002e-06 2024-09-12T17:07:54.968 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.968 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.968 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.968 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748572+0000", 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052414710000000002 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748616+0000", 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4369000000000002e-05 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748636+0000", 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9582999999999999e-05 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.969 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.748778+0000", 2024-09-12T17:07:54.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141867 2024-09-12T17:07:54.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749017+0000", 2024-09-12T17:07:54.970 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000239218 2024-09-12T17:07:54.970 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.970 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.970 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:54.970 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.749233+0000", 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00021619799999999999 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.756641+0000", 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074078089999999996 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763784+0000", 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0071433809999999999 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.971 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.763958+0000", 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000173862 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.764106+0000", 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014735700000000001 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.972 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1259 3.5 3:a1f83edd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:54.973 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:54.973 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.800065578999998, 2024-09-12T17:07:54.973 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024500529, 2024-09-12T17:07:54.973 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.973 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.973 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.973 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.973 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.973 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.973 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1259 2024-09-12T17:07:54.973 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.973 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:54.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.974 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156215+0000", 2024-09-12T17:07:54.974 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.974 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.974 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.974 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.156217+0000", 2024-09-12T17:07:54.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8940000000000002e-06 2024-09-12T17:07:54.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160482+0000", 2024-09-12T17:07:54.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042645269999999997 2024-09-12T17:07:54.975 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.975 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.975 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.975 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160513+0000", 2024-09-12T17:07:54.975 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1228e-05 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160526+0000", 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2976000000000001e-05 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160624+0000", 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8048999999999996e-05 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.976 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160825+0000", 2024-09-12T17:07:54.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020054799999999999 2024-09-12T17:07:54.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:54.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.160997+0000", 2024-09-12T17:07:54.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017260499999999999 2024-09-12T17:07:54.977 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.977 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.977 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.977 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.169300+0000", 2024-09-12T17:07:54.977 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083027050000000005 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180595+0000", 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011294465 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180660+0000", 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.5616000000000003e-05 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.978 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.180715+0000", 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.4916000000000001e-05 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1262 3.5 3:a3a998f2:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.745432866999998, 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020328525, 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.979 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1262 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.980 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210847+0000", 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.210850+0000", 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.005e-06 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214862+0000", 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040120640000000001 2024-09-12T17:07:54.981 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214903+0000", 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0831999999999998e-05 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.214940+0000", 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7036000000000003e-05 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.982 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215059+0000", 2024-09-12T17:07:54.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118631 2024-09-12T17:07:54.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215237+0000", 2024-09-12T17:07:54.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017834900000000001 2024-09-12T17:07:54.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.983 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.983 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:54.983 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.215406+0000", 2024-09-12T17:07:54.983 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016896200000000001 2024-09-12T17:07:54.983 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.221184+0000", 2024-09-12T17:07:54.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057780130000000002 2024-09-12T17:07:54.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.984 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.984 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231002+0000", 2024-09-12T17:07:54.984 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0098174969999999997 2024-09-12T17:07:54.984 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.984 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.986 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.986 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231096+0000", 2024-09-12T17:07:54.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4204999999999997e-05 2024-09-12T17:07:54.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.987 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.987 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.987 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231176+0000", 2024-09-12T17:07:54.987 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9931000000000004e-05 2024-09-12T17:07:54.987 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.987 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.987 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.987 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.988 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.988 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1264 3.c 3:30907361:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:54.988 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:54.988 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.724509882, 2024-09-12T17:07:54.988 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021106314000000001, 2024-09-12T17:07:54.989 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.989 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:54.989 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:54.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:54.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:54.989 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:54.990 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1264 2024-09-12T17:07:54.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.990 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:54.990 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.990 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:54.990 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:54.990 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.990 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:54.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231770+0000", 2024-09-12T17:07:54.991 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:54.991 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.991 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.991 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:54.991 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.231772+0000", 2024-09-12T17:07:54.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1560000000000002e-06 2024-09-12T17:07:54.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:54.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235787+0000", 2024-09-12T17:07:54.992 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040149790000000001 2024-09-12T17:07:54.992 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.992 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.992 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:54.992 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235824+0000", 2024-09-12T17:07:54.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.6956000000000003e-05 2024-09-12T17:07:54.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:54.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235843+0000", 2024-09-12T17:07:54.993 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8315999999999999e-05 2024-09-12T17:07:54.993 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.993 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.993 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:54.993 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.235954+0000", 2024-09-12T17:07:54.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111601 2024-09-12T17:07:54.994 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.994 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.994 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:54.994 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236135+0000", 2024-09-12T17:07:54.994 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000180941 2024-09-12T17:07:54.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.995 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.995 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:54.995 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.236302+0000", 2024-09-12T17:07:54.995 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016626600000000001 2024-09-12T17:07:54.995 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:54.996 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242422+0000", 2024-09-12T17:07:54.996 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0061200730000000002 2024-09-12T17:07:54.996 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.996 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.996 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:54.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252655+0000", 2024-09-12T17:07:54.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010232978 2024-09-12T17:07:54.997 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.997 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.997 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:54.997 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252749+0000", 2024-09-12T17:07:54.997 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.4481000000000006e-05 2024-09-12T17:07:54.998 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.998 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.998 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:54.998 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252877+0000", 2024-09-12T17:07:54.998 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012756700000000001 2024-09-12T17:07:54.998 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.999 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:54.999 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:54.999 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:54.999 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:54.999 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1265 3.22 3:44204d7e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:54.999 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:54.999 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.714021697, 2024-09-12T17:07:54.999 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021506441000000001, 2024-09-12T17:07:54.999 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:54.999 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.000 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.000 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.000 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.000 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.000 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1265 2024-09-12T17:07:55.000 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.001 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.001 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.001 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:55.001 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.001 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.001 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242258+0000", 2024-09-12T17:07:55.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.002 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.002 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.002 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.002 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.242262+0000", 2024-09-12T17:07:55.002 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7299999999999999e-06 2024-09-12T17:07:55.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.003 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246237+0000", 2024-09-12T17:07:55.003 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039746989999999999 2024-09-12T17:07:55.003 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.003 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.003 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246272+0000", 2024-09-12T17:07:55.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5589000000000001e-05 2024-09-12T17:07:55.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.004 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246290+0000", 2024-09-12T17:07:55.004 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7107000000000001e-05 2024-09-12T17:07:55.004 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.004 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.004 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.005 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246410+0000", 2024-09-12T17:07:55.005 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119984 2024-09-12T17:07:55.005 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.005 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.005 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.006 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246589+0000", 2024-09-12T17:07:55.006 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000179853 2024-09-12T17:07:55.006 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.006 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:55.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.246748+0000", 2024-09-12T17:07:55.007 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000158536 2024-09-12T17:07:55.007 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.007 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.007 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.007 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.252569+0000", 2024-09-12T17:07:55.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0058212810000000002 2024-09-12T17:07:55.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.008 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.008 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.008 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263464+0000", 2024-09-12T17:07:55.008 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010894406000000001 2024-09-12T17:07:55.008 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263627+0000", 2024-09-12T17:07:55.009 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000163833 2024-09-12T17:07:55.009 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.009 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.009 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.009 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.263765+0000", 2024-09-12T17:07:55.010 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013742299999999999 2024-09-12T17:07:55.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.010 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.010 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.010 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.010 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.010 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1269 3.c 3:3287b6aa:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:55.011 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:55.011 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.665394524999996, 2024-09-12T17:07:55.011 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019007443999999998, 2024-09-12T17:07:55.011 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.011 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.011 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.012 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.012 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.012 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.012 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1269 2024-09-12T17:07:55.012 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.012 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:55.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.013 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.013 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290886+0000", 2024-09-12T17:07:55.013 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.013 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.013 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.290890+0000", 2024-09-12T17:07:55.014 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2529999999999998e-06 2024-09-12T17:07:55.014 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.014 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.014 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.014 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294907+0000", 2024-09-12T17:07:55.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004017189 2024-09-12T17:07:55.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.015 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.015 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.015 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294952+0000", 2024-09-12T17:07:55.015 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.5252e-05 2024-09-12T17:07:55.015 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.016 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.016 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.294971+0000", 2024-09-12T17:07:55.016 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8606000000000001e-05 2024-09-12T17:07:55.016 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.016 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295107+0000", 2024-09-12T17:07:55.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000135654 2024-09-12T17:07:55.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.017 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.017 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.017 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295466+0000", 2024-09-12T17:07:55.017 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000359448 2024-09-12T17:07:55.017 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:55.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.295948+0000", 2024-09-12T17:07:55.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000482079 2024-09-12T17:07:55.018 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.018 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.018 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.018 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.308012+0000", 2024-09-12T17:07:55.018 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012064210000000001 2024-09-12T17:07:55.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309570+0000", 2024-09-12T17:07:55.019 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015580839999999999 2024-09-12T17:07:55.019 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.019 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.019 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.019 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309758+0000", 2024-09-12T17:07:55.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000187522 2024-09-12T17:07:55.020 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.020 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.020 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.020 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.309893+0000", 2024-09-12T17:07:55.020 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013514700000000001 2024-09-12T17:07:55.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.020 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.020 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.021 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.021 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.021 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1275 3.16 3:68cda83e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:55.021 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:55.021 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 41.602697382999999, 2024-09-12T17:07:55.021 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019055547999999999, 2024-09-12T17:07:55.022 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.022 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.022 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.022 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.022 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.022 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.022 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1275 2024-09-12T17:07:55.022 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.023 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.023 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.023 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.023 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:55.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353583+0000", 2024-09-12T17:07:55.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.024 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.024 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.024 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.024 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.353586+0000", 2024-09-12T17:07:55.024 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0769999999999999e-06 2024-09-12T17:07:55.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.025 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.025 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359376+0000", 2024-09-12T17:07:55.025 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057904100000000002 2024-09-12T17:07:55.025 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.025 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359400+0000", 2024-09-12T17:07:55.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3805999999999999e-05 2024-09-12T17:07:55.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.026 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359412+0000", 2024-09-12T17:07:55.026 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2404e-05 2024-09-12T17:07:55.026 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.026 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.026 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.027 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359522+0000", 2024-09-12T17:07:55.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109685 2024-09-12T17:07:55.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.027 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.027 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.027 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.359767+0000", 2024-09-12T17:07:55.027 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024471399999999999 2024-09-12T17:07:55.027 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.028 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.028 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:55.028 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.360035+0000", 2024-09-12T17:07:55.028 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026762699999999999 2024-09-12T17:07:55.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.029 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.029 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372243+0000", 2024-09-12T17:07:55.029 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012208169 2024-09-12T17:07:55.029 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.029 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372526+0000", 2024-09-12T17:07:55.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028289599999999998 2024-09-12T17:07:55.030 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.030 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.030 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.030 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372581+0000", 2024-09-12T17:07:55.030 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5747e-05 2024-09-12T17:07:55.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.031 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.031 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.031 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.372638+0000", 2024-09-12T17:07:55.031 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7012999999999998e-05 2024-09-12T17:07:55.031 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.031 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.031 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.031 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.032 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.032 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1390 3.2f 3:f51d0419:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:55.032 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:55.032 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 38.579504657000001, 2024-09-12T17:07:55.032 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019302698, 2024-09-12T17:07:55.032 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.033 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.033 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.033 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.033 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.033 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.033 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1390 2024-09-12T17:07:55.033 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.034 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.034 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.034 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.034 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:55.034 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.034 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376776+0000", 2024-09-12T17:07:55.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.035 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.376779+0000", 2024-09-12T17:07:55.035 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8700000000000002e-06 2024-09-12T17:07:55.035 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.035 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.035 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381020+0000", 2024-09-12T17:07:55.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042401660000000001 2024-09-12T17:07:55.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.036 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.036 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381069+0000", 2024-09-12T17:07:55.036 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9279e-05 2024-09-12T17:07:55.036 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.036 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381098+0000", 2024-09-12T17:07:55.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9110000000000001e-05 2024-09-12T17:07:55.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.037 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381276+0000", 2024-09-12T17:07:55.037 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017790199999999999 2024-09-12T17:07:55.037 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.037 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.037 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381577+0000", 2024-09-12T17:07:55.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030131400000000001 2024-09-12T17:07:55.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.038 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:55.038 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.381798+0000", 2024-09-12T17:07:55.038 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022053200000000001 2024-09-12T17:07:55.038 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.038 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.391131+0000", 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0093337400000000001 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395755+0000", 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004624034 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.395932+0000", 2024-09-12T17:07:55.039 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000176317 2024-09-12T17:07:55.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.040 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.040 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.396078+0000", 2024-09-12T17:07:55.040 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000146434 2024-09-12T17:07:55.040 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.040 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.040 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.040 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.040 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.040 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1408 3.2a 3:56341a86:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 38.152415531999999, 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.030673474999999999, 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1408 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.041 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:55.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.042 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.042 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.042 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.042 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803865+0000", 2024-09-12T17:07:55.042 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.043 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.043 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.803868+0000", 2024-09-12T17:07:55.043 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1130000000000001e-06 2024-09-12T17:07:55.043 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.043 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808291+0000", 2024-09-12T17:07:55.044 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044233120000000004 2024-09-12T17:07:55.044 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.044 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.044 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.044 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808331+0000", 2024-09-12T17:07:55.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9869000000000001e-05 2024-09-12T17:07:55.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.045 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808351+0000", 2024-09-12T17:07:55.045 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9673e-05 2024-09-12T17:07:55.045 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.045 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.045 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808511+0000", 2024-09-12T17:07:55.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015999699999999999 2024-09-12T17:07:55.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.046 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.046 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.808843+0000", 2024-09-12T17:07:55.046 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00033221900000000003 2024-09-12T17:07:55.046 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.046 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:55.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.809106+0000", 2024-09-12T17:07:55.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026355900000000002 2024-09-12T17:07:55.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.047 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.047 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.047 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.827691+0000", 2024-09-12T17:07:55.047 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.018584471000000002 2024-09-12T17:07:55.047 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.048 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834339+0000", 2024-09-12T17:07:55.048 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066477790000000004 2024-09-12T17:07:55.048 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.048 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.048 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834448+0000", 2024-09-12T17:07:55.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109578 2024-09-12T17:07:55.049 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.049 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.049 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.049 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.834538+0000", 2024-09-12T17:07:55.049 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9905000000000001e-05 2024-09-12T17:07:55.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.050 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.050 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.050 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.050 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.050 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1884 3.16 3:6a49863c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.25:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:55.050 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:55.050 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.798157707000001, 2024-09-12T17:07:55.050 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.02557398, 2024-09-12T17:07:55.050 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.051 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.051 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.051 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.051 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1884 2024-09-12T17:07:55.051 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.052 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.052 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.052 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:55.052 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.052 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.052 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.053 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158122+0000", 2024-09-12T17:07:55.053 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.053 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.053 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.053 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.158125+0000", 2024-09-12T17:07:55.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1399999999999998e-06 2024-09-12T17:07:55.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163204+0000", 2024-09-12T17:07:55.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050792720000000001 2024-09-12T17:07:55.054 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.054 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.054 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.054 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163244+0000", 2024-09-12T17:07:55.054 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0522000000000003e-05 2024-09-12T17:07:55.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.055 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163262+0000", 2024-09-12T17:07:55.055 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7872000000000001e-05 2024-09-12T17:07:55.055 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.055 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.055 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163395+0000", 2024-09-12T17:07:55.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013291799999999999 2024-09-12T17:07:55.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.056 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.056 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.163698+0000", 2024-09-12T17:07:55.056 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030317700000000001 2024-09-12T17:07:55.056 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.056 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:55.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.164523+0000", 2024-09-12T17:07:55.057 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082438900000000002 2024-09-12T17:07:55.057 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.057 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.057 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.057 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.181881+0000", 2024-09-12T17:07:55.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017357991999999999 2024-09-12T17:07:55.058 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.058 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.058 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.058 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183465+0000", 2024-09-12T17:07:55.058 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0015843509999999999 2024-09-12T17:07:55.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.059 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.059 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.059 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183583+0000", 2024-09-12T17:07:55.059 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000118025 2024-09-12T17:07:55.059 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.060 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.060 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.060 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.183696+0000", 2024-09-12T17:07:55.060 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000113322 2024-09-12T17:07:55.060 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.060 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.060 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.060 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.061 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.061 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1923 3.1d 3:bbfa0a4b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.RvdbUUXkO22SF-kwzRd4VKnEQTGoFzf_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:55.061 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:55.061 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 23.931185851999999, 2024-09-12T17:07:55.061 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.029952679999999999, 2024-09-12T17:07:55.061 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.061 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.061 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.061 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.062 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1923 2024-09-12T17:07:55.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.062 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:55.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.062 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.062 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.062 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.062 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025094+0000", 2024-09-12T17:07:55.062 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.025097+0000", 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6599999999999999e-06 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033262+0000", 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0081647409999999997 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.063 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033304+0000", 2024-09-12T17:07:55.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2138000000000002e-05 2024-09-12T17:07:55.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.064 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.064 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033322+0000", 2024-09-12T17:07:55.064 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8059000000000001e-05 2024-09-12T17:07:55.064 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.064 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033512+0000", 2024-09-12T17:07:55.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019057199999999999 2024-09-12T17:07:55.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.033775+0000", 2024-09-12T17:07:55.065 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026250299999999998 2024-09-12T17:07:55.065 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.065 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.065 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:55.065 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.034023+0000", 2024-09-12T17:07:55.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024751999999999999 2024-09-12T17:07:55.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.047403+0000", 2024-09-12T17:07:55.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013380845000000001 2024-09-12T17:07:55.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.066 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.066 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.066 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054890+0000", 2024-09-12T17:07:55.066 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074861529999999997 2024-09-12T17:07:55.066 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.054976+0000", 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6644999999999995e-05 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.055047+0000", 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0844000000000001e-05 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.067 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.068 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.068 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1990 3.28 3:17f1f290:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.41:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:55.068 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:55.068 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 22.638488833, 2024-09-12T17:07:55.068 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019908233000000001, 2024-09-12T17:07:55.068 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.068 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.068 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.068 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.068 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.068 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.068 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1990 2024-09-12T17:07:55.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.069 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.069 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:55.069 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.069 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.069 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.069 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317791+0000", 2024-09-12T17:07:55.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.070 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.070 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.317794+0000", 2024-09-12T17:07:55.070 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.993e-06 2024-09-12T17:07:55.070 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.070 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323013+0000", 2024-09-12T17:07:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0052182490000000003 2024-09-12T17:07:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323051+0000", 2024-09-12T17:07:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8343000000000002e-05 2024-09-12T17:07:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.071 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323069+0000", 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8082000000000001e-05 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323264+0000", 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019453499999999999 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.323530+0000", 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026603999999999999 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.072 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:55.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.324371+0000", 2024-09-12T17:07:55.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00084152599999999999 2024-09-12T17:07:55.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.073 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.336666+0000", 2024-09-12T17:07:55.073 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012295276000000001 2024-09-12T17:07:55.073 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.073 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.073 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337488+0000", 2024-09-12T17:07:55.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082180399999999998 2024-09-12T17:07:55.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.074 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.074 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337622+0000", 2024-09-12T17:07:55.074 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000133864 2024-09-12T17:07:55.074 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.074 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.075 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.075 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:32.337700+0000", 2024-09-12T17:07:55.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.7521000000000005e-05 2024-09-12T17:07:55.075 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.075 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.075 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.075 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.075 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.075 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:2125 3.4 e73/51 3:235ee04f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.q5_4TTRRhSFZvQfgJaK5ATByAODjVXJ_1:head v 73'6, mlcod=71'4)", 2024-09-12T17:07:55.075 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:55.075 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.689083248999999, 2024-09-12T17:07:55.075 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024265888999999999, 2024-09-12T17:07:55.076 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.076 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.076 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.076 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:55.076 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.076 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.076 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.076 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.076 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.267197+0000", 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0299999999999999e-07 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274450+0000", 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0072528879999999999 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.077 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274475+0000", 2024-09-12T17:07:55.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5185e-05 2024-09-12T17:07:55.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274491+0000", 2024-09-12T17:07:55.078 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5305999999999999e-05 2024-09-12T17:07:55.078 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.078 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.078 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.078 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274624+0000", 2024-09-12T17:07:55.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000132915 2024-09-12T17:07:55.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.274681+0000", 2024-09-12T17:07:55.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7340999999999999e-05 2024-09-12T17:07:55.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.079 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.079 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.079 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.291377+0000", 2024-09-12T17:07:55.079 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016695451 2024-09-12T17:07:55.079 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.291463+0000", 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6299999999999997e-05 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2128 3.5 3:a25f4989:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.64:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.660856669000001, 2024-09-12T17:07:55.080 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019706656999999999, 2024-09-12T17:07:55.081 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.081 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.081 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.081 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.081 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.081 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.081 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2128 2024-09-12T17:07:55.081 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.081 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.081 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.081 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.081 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:55.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295424+0000", 2024-09-12T17:07:55.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.082 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.082 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.082 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.295427+0000", 2024-09-12T17:07:55.082 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4060000000000001e-06 2024-09-12T17:07:55.082 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299816+0000", 2024-09-12T17:07:55.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0043890029999999998 2024-09-12T17:07:55.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.083 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299855+0000", 2024-09-12T17:07:55.083 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8955000000000002e-05 2024-09-12T17:07:55.083 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.083 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.083 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.299873+0000", 2024-09-12T17:07:55.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8359000000000002e-05 2024-09-12T17:07:55.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.300038+0000", 2024-09-12T17:07:55.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016448100000000001 2024-09-12T17:07:55.084 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.084 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.084 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.084 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.300335+0000", 2024-09-12T17:07:55.084 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029776899999999997 2024-09-12T17:07:55.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:55.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.301250+0000", 2024-09-12T17:07:55.085 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00091437699999999996 2024-09-12T17:07:55.085 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.085 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.085 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.085 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.313996+0000", 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012745975 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.314902+0000", 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00090575699999999998 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.315023+0000", 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012113899999999999 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.086 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.087 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.087 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.315130+0000", 2024-09-12T17:07:55.087 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010743600000000001 2024-09-12T17:07:55.087 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.087 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.087 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.087 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.088 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.088 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2158 3.3a 3:5f23622e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.69:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:55.088 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:55.088 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.968093149000001, 2024-09-12T17:07:55.088 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025287745, 2024-09-12T17:07:55.088 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.088 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.089 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.089 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.089 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.089 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.089 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2158 2024-09-12T17:07:55.089 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.089 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.089 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.089 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:55.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.090 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.090 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.090 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.090 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988187+0000", 2024-09-12T17:07:55.090 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.091 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.091 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.091 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.988190+0000", 2024-09-12T17:07:55.091 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.897e-06 2024-09-12T17:07:55.091 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.092 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992248+0000", 2024-09-12T17:07:55.092 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040576420000000002 2024-09-12T17:07:55.092 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.092 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.092 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992288+0000", 2024-09-12T17:07:55.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9959000000000001e-05 2024-09-12T17:07:55.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.093 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.093 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.093 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992305+0000", 2024-09-12T17:07:55.093 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7813999999999999e-05 2024-09-12T17:07:55.093 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992495+0000", 2024-09-12T17:07:55.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018977800000000001 2024-09-12T17:07:55.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.094 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.992759+0000", 2024-09-12T17:07:55.094 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026367399999999998 2024-09-12T17:07:55.094 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.094 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.094 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:55.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.993586+0000", 2024-09-12T17:07:55.095 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00082746299999999996 2024-09-12T17:07:55.095 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.095 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.095 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.095 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.002363+0000", 2024-09-12T17:07:55.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087768069999999993 2024-09-12T17:07:55.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013296+0000", 2024-09-12T17:07:55.096 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010932871 2024-09-12T17:07:55.096 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.096 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.096 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.096 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013408+0000", 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000111709 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.013475+0000", 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.7131000000000005e-05 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2161 3.5 3:a0815047:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.1213Daer3gr3KDhM5kgqYBB_xC83lvZ_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:55.097 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.829697445000001, 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020142651000000001, 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2161 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.098 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:55.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126583+0000", 2024-09-12T17:07:55.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.099 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.099 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.099 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.099 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.126586+0000", 2024-09-12T17:07:55.099 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9830000000000001e-06 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130385+0000", 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037997009999999999 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130415+0000", 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9529000000000001e-05 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.100 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130427+0000", 2024-09-12T17:07:55.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2351000000000001e-05 2024-09-12T17:07:55.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130516+0000", 2024-09-12T17:07:55.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8214999999999995e-05 2024-09-12T17:07:55.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.101 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.101 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.101 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130663+0000", 2024-09-12T17:07:55.101 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000147145 2024-09-12T17:07:55.101 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:55.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.130793+0000", 2024-09-12T17:07:55.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012986700000000001 2024-09-12T17:07:55.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.102 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.138966+0000", 2024-09-12T17:07:55.102 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0081739810000000003 2024-09-12T17:07:55.102 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.102 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.102 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146483+0000", 2024-09-12T17:07:55.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.007516928 2024-09-12T17:07:55.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.103 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146599+0000", 2024-09-12T17:07:55.103 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115932 2024-09-12T17:07:55.103 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.103 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.103 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.146725+0000", 2024-09-12T17:07:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000126019 2024-09-12T17:07:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2195 3.c 3:337f05fc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.DSvxz4vaxxy0dMg8hp4VJxR3sCjbrFE_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.773024+0000", 2024-09-12T17:07:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.183256598, 2024-09-12T17:07:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023923855000000001, 2024-09-12T17:07:55.104 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2195 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.773024+0000", 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.105 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.773024+0000", 2024-09-12T17:07:55.106 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.106 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.106 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.106 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.106 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.773027+0000", 2024-09-12T17:07:55.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.574e-06 2024-09-12T17:07:55.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777123+0000", 2024-09-12T17:07:55.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040961000000000001 2024-09-12T17:07:55.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.107 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.107 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.107 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777166+0000", 2024-09-12T17:07:55.107 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2972000000000001e-05 2024-09-12T17:07:55.107 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777185+0000", 2024-09-12T17:07:55.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9269000000000001e-05 2024-09-12T17:07:55.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.108 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.108 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.108 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777284+0000", 2024-09-12T17:07:55.108 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8240999999999997e-05 2024-09-12T17:07:55.108 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777444+0000", 2024-09-12T17:07:55.109 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016014999999999999 2024-09-12T17:07:55.109 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.109 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.109 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:55.109 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.777586+0000", 2024-09-12T17:07:55.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000142428 2024-09-12T17:07:55.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.784298+0000", 2024-09-12T17:07:55.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067112430000000004 2024-09-12T17:07:55.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.110 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.110 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.110 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.796855+0000", 2024-09-12T17:07:55.110 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012557474000000001 2024-09-12T17:07:55.110 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.796906+0000", 2024-09-12T17:07:55.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0518e-05 2024-09-12T17:07:55.111 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.111 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.111 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.111 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.796947+0000", 2024-09-12T17:07:55.111 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1885999999999998e-05 2024-09-12T17:07:55.111 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.111 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.112 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.112 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.112 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.112 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2330 3.c 3:312d3416:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.96:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:55.112 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:39.563180+0000", 2024-09-12T17:07:55.112 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 15.393100325000001, 2024-09-12T17:07:55.112 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021299865000000001, 2024-09-12T17:07:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2330 2024-09-12T17:07:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.113 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.563180+0000", 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.563180+0000", 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.563182+0000", 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6259999999999999e-06 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.114 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567288+0000", 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041051120000000002 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567319+0000", 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1788999999999997e-05 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567344+0000", 2024-09-12T17:07:55.115 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4213e-05 2024-09-12T17:07:55.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.116 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.116 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567493+0000", 2024-09-12T17:07:55.116 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014904799999999999 2024-09-12T17:07:55.116 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.116 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.567854+0000", 2024-09-12T17:07:55.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00036099500000000002 2024-09-12T17:07:55.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:55.117 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.568778+0000", 2024-09-12T17:07:55.117 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00092410500000000004 2024-09-12T17:07:55.117 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.117 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.117 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.583477+0000", 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014699031 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.584281+0000", 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00080444299999999995 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.584387+0000", 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105753 2024-09-12T17:07:55.118 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.119 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.119 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.584480+0000", 2024-09-12T17:07:55.119 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.2750000000000005e-05 2024-09-12T17:07:55.119 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.119 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.119 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.119 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.119 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.119 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2351 3.1d 3:b93c23bf:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.-9Whj7OyWidDksiwzT19FTZdXgAbEF9_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:55.119 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:39.995677+0000", 2024-09-12T17:07:55.119 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 14.960603438, 2024-09-12T17:07:55.120 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020208282000000001, 2024-09-12T17:07:55.120 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.120 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.120 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.120 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.120 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.120 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.120 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2351 2024-09-12T17:07:55.120 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.120 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.995677+0000", 2024-09-12T17:07:55.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.121 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.995677+0000", 2024-09-12T17:07:55.121 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.121 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.121 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.121 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.995679+0000", 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6390000000000001e-06 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999600+0000", 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003920219 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999638+0000", 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8590999999999997e-05 2024-09-12T17:07:55.122 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999662+0000", 2024-09-12T17:07:55.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3366e-05 2024-09-12T17:07:55.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.123 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.123 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.123 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.999859+0000", 2024-09-12T17:07:55.123 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000197617 2024-09-12T17:07:55.123 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.000117+0000", 2024-09-12T17:07:55.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025815099999999998 2024-09-12T17:07:55.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:55.124 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.000396+0000", 2024-09-12T17:07:55.124 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027906099999999999 2024-09-12T17:07:55.124 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.124 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.124 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.010299+0000", 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0099028009999999993 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.015705+0000", 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054053230000000001 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.015810+0000", 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000105287 2024-09-12T17:07:55.125 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.126 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.126 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.126 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.015885+0000", 2024-09-12T17:07:55.126 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5227000000000003e-05 2024-09-12T17:07:55.126 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.126 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.126 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.126 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.126 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.126 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:55.128 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T17:07:55.260 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:55.261 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:55.261 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:55.261 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:55.275 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T17:07:55.362 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T17:07:55.406 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:55.406 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:55.407 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:55.407 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:55.421 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T17:07:55.556 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:55.556 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:55.556 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:55.556 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:55.556 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.556 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T17:07:55.557 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:07:55.557 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 120.014272308, 2024-09-12T17:07:55.557 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.040278856000000002, 2024-09-12T17:07:55.557 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.557 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.557 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.557 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.557 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.557 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.557 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 46 2024-09-12T17:07:55.557 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537086+0000", 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.558 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537089+0000", 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3000000000000002e-06 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537103+0000", 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4097000000000001e-05 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537137+0000", 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4079999999999999e-05 2024-09-12T17:07:55.559 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537162+0000", 2024-09-12T17:07:55.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4579999999999998e-05 2024-09-12T17:07:55.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.560 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537327+0000", 2024-09-12T17:07:55.560 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000165081 2024-09-12T17:07:55.560 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.560 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.560 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T17:07:55.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.537344+0000", 2024-09-12T17:07:55.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7447000000000001e-05 2024-09-12T17:07:55.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.552576+0000", 2024-09-12T17:07:55.561 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015231339 2024-09-12T17:07:55.561 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.561 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.561 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T17:07:55.561 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.552597+0000", 2024-09-12T17:07:55.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0934e-05 2024-09-12T17:07:55.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.572608+0000", 2024-09-12T17:07:55.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020010917 2024-09-12T17:07:55.562 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.562 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.562 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.562 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.572902+0000", 2024-09-12T17:07:55.562 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00029482400000000001 2024-09-12T17:07:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.573205+0000", 2024-09-12T17:07:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030300900000000003 2024-09-12T17:07:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.576854+0000", 2024-09-12T17:07:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003648966 2024-09-12T17:07:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.563 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577088+0000", 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023368099999999999 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577216+0000", 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012821600000000001 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:55.577365+0000", 2024-09-12T17:07:55.564 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014838500000000001 2024-09-12T17:07:55.565 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.565 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.565 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.565 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.565 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.565 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1181 3.a 3:52e4a2c7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:55.565 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.426419+0000", 2024-09-12T17:07:55.565 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.124939316000003, 2024-09-12T17:07:55.565 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022424422999999999, 2024-09-12T17:07:55.565 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.565 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.565 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1181 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.426419+0000", 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.566 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.426419+0000", 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.426422+0000", 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.14e-06 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.430282+0000", 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003860156 2024-09-12T17:07:55.567 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.430335+0000", 2024-09-12T17:07:55.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.2951999999999997e-05 2024-09-12T17:07:55.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.568 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.430356+0000", 2024-09-12T17:07:55.568 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0795999999999999e-05 2024-09-12T17:07:55.568 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.568 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.568 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.430554+0000", 2024-09-12T17:07:55.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019868199999999999 2024-09-12T17:07:55.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.569 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.430908+0000", 2024-09-12T17:07:55.569 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00035311799999999998 2024-09-12T17:07:55.569 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.569 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.569 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:55.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.431315+0000", 2024-09-12T17:07:55.570 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00040779400000000001 2024-09-12T17:07:55.570 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.570 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.570 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.570 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.439801+0000", 2024-09-12T17:07:55.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0084859189999999998 2024-09-12T17:07:55.571 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.571 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.571 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.571 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.448632+0000", 2024-09-12T17:07:55.571 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0088308459999999998 2024-09-12T17:07:55.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.572 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.572 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.572 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.448747+0000", 2024-09-12T17:07:55.572 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115219 2024-09-12T17:07:55.572 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.573 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.573 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.573 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.448843+0000", 2024-09-12T17:07:55.573 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5801e-05 2024-09-12T17:07:55.573 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.573 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.574 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.574 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.574 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.574 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1183 3.20 3:06cd57f7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.CmloM-glbR9kSeCBpmtaJkNHWYHLNxM_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:55.574 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.445964+0000", 2024-09-12T17:07:55.575 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 44.105393606, 2024-09-12T17:07:55.575 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025875618999999999, 2024-09-12T17:07:55.575 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.575 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.575 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.575 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.576 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.576 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1183 2024-09-12T17:07:55.576 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.576 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.577 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.577 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.445964+0000", 2024-09-12T17:07:55.577 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.577 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.577 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.578 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.578 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.445964+0000", 2024-09-12T17:07:55.578 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.578 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.578 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.579 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.445968+0000", 2024-09-12T17:07:55.579 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9269999999999998e-06 2024-09-12T17:07:55.579 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.579 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.579 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.580 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.449417+0000", 2024-09-12T17:07:55.580 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003448282 2024-09-12T17:07:55.580 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.580 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.580 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.449441+0000", 2024-09-12T17:07:55.581 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.4215000000000001e-05 2024-09-12T17:07:55.581 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.581 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.581 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.581 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.449453+0000", 2024-09-12T17:07:55.582 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.217e-05 2024-09-12T17:07:55.582 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.582 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.582 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.582 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.449562+0000", 2024-09-12T17:07:55.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000109211 2024-09-12T17:07:55.583 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.583 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.583 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.583 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.449828+0000", 2024-09-12T17:07:55.583 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026588300000000002 2024-09-12T17:07:55.584 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.584 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.584 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:55.584 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.450091+0000", 2024-09-12T17:07:55.584 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026239999999999998 2024-09-12T17:07:55.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.585 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.585 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.585 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.468053+0000", 2024-09-12T17:07:55.585 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017962367999999999 2024-09-12T17:07:55.585 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.586 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.586 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.471537+0000", 2024-09-12T17:07:55.586 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.003483894 2024-09-12T17:07:55.586 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.586 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.587 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.471713+0000", 2024-09-12T17:07:55.587 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017569600000000001 2024-09-12T17:07:55.587 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.587 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.587 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.588 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.471840+0000", 2024-09-12T17:07:55.588 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012757299999999999 2024-09-12T17:07:55.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.588 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.588 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.588 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.588 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.588 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1209 3.a 3:531ac038:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:55.588 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:11.934993+0000", 2024-09-12T17:07:55.589 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.616365193999997, 2024-09-12T17:07:55.589 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024821032, 2024-09-12T17:07:55.589 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.589 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.589 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.589 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.589 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1209 2024-09-12T17:07:55.589 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.589 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.589 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.934993+0000", 2024-09-12T17:07:55.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.934993+0000", 2024-09-12T17:07:55.590 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.590 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.590 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.590 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.590 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.934998+0000", 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6360000000000002e-06 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.941377+0000", 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0063798759999999996 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.941425+0000", 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7871999999999998e-05 2024-09-12T17:07:55.591 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.941447+0000", 2024-09-12T17:07:55.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2172999999999999e-05 2024-09-12T17:07:55.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.592 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.941597+0000", 2024-09-12T17:07:55.592 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014970000000000001 2024-09-12T17:07:55.592 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.592 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.592 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.941847+0000", 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024967099999999997 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.942089+0000", 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024169400000000001 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.950597+0000", 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0085083480000000006 2024-09-12T17:07:55.593 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959638+0000", 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0090407360000000006 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959738+0000", 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100364 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.594 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:11.959814+0000", 2024-09-12T17:07:55.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5962000000000002e-05 2024-09-12T17:07:55.595 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.595 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.595 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.595 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.595 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.595 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1216 3.33 e63/24 3:cf30ff9d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.ACxXprFQ5ldS8kbJPWbYBR9qLfBC5rh_16:head v 63'1, mlcod=0'0)", 2024-09-12T17:07:55.595 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.011551+0000", 2024-09-12T17:07:55.595 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.539806943999999, 2024-09-12T17:07:55.595 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020340845, 2024-09-12T17:07:55.595 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.596 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.596 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.596 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.011551+0000", 2024-09-12T17:07:55.596 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.596 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.596 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.596 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.596 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.011551+0000", 2024-09-12T17:07:55.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.011552+0000", 2024-09-12T17:07:55.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.333e-06 2024-09-12T17:07:55.597 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.597 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.597 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.597 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.016038+0000", 2024-09-12T17:07:55.597 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044851020000000004 2024-09-12T17:07:55.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.016087+0000", 2024-09-12T17:07:55.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.9876000000000002e-05 2024-09-12T17:07:55.598 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.598 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.598 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.598 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.016118+0000", 2024-09-12T17:07:55.598 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0605000000000003e-05 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.016265+0000", 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000146957 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.016304+0000", 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8649000000000002e-05 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.599 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.031744+0000", 2024-09-12T17:07:55.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015439903 2024-09-12T17:07:55.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.600 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.600 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.031892+0000", 2024-09-12T17:07:55.600 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014841999999999999 2024-09-12T17:07:55.600 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.600 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.600 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.600 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.600 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.601 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1249 3.a 3:5189db44:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:55.601 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.721729+0000", 2024-09-12T17:07:55.601 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.829629230000002, 2024-09-12T17:07:55.601 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021046339000000001, 2024-09-12T17:07:55.601 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.601 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.601 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.601 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.601 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.601 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.601 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1249 2024-09-12T17:07:55.601 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.602 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.602 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.721729+0000", 2024-09-12T17:07:55.602 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.602 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.602 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.602 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.721729+0000", 2024-09-12T17:07:55.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.603 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.603 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.603 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.721733+0000", 2024-09-12T17:07:55.603 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8099999999999999e-06 2024-09-12T17:07:55.603 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.604 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.726566+0000", 2024-09-12T17:07:55.604 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0048333639999999997 2024-09-12T17:07:55.604 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.604 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.604 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.726618+0000", 2024-09-12T17:07:55.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.1856e-05 2024-09-12T17:07:55.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.605 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.605 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.605 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.726644+0000", 2024-09-12T17:07:55.605 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5979e-05 2024-09-12T17:07:55.605 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.726846+0000", 2024-09-12T17:07:55.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020230899999999999 2024-09-12T17:07:55.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.606 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.606 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.727279+0000", 2024-09-12T17:07:55.606 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000432803 2024-09-12T17:07:55.606 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.606 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.727543+0000", 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026372100000000002 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.742545+0000", 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015002161999999999 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.742615+0000", 2024-09-12T17:07:55.607 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.0061999999999994e-05 2024-09-12T17:07:55.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.742703+0000", 2024-09-12T17:07:55.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.7958e-05 2024-09-12T17:07:55.608 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.608 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.608 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.608 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.742775+0000", 2024-09-12T17:07:55.608 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2315000000000001e-05 2024-09-12T17:07:55.608 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.608 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1274 3.36 3:6e24700e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.343282+0000", 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.208075860000001, 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025462483000000001, 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.609 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1274 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.343282+0000", 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.343282+0000", 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.610 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.343285+0000", 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1439999999999999e-06 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.351152+0000", 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0078670440000000001 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.611 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.351197+0000", 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4629000000000002e-05 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.351216+0000", 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8851999999999998e-05 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.351311+0000", 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5247999999999993e-05 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.612 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.351430+0000", 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119157 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.351605+0000", 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017512300000000001 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.362834+0000", 2024-09-12T17:07:55.613 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011228152999999999 2024-09-12T17:07:55.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.368591+0000", 2024-09-12T17:07:55.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057577160000000004 2024-09-12T17:07:55.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.614 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.614 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.368675+0000", 2024-09-12T17:07:55.614 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.4027e-05 2024-09-12T17:07:55.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.614 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.368745+0000", 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9389999999999998e-05 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1371 3.35 3:ad03dbae:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.165331+0000", 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.386027482999999, 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024708127999999999, 2024-09-12T17:07:55.615 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.616 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.616 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.616 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.616 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.616 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.616 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1371 2024-09-12T17:07:55.616 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.616 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.616 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.616 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.616 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.165331+0000", 2024-09-12T17:07:55.616 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.165331+0000", 2024-09-12T17:07:55.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.617 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.617 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.165334+0000", 2024-09-12T17:07:55.617 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.976e-06 2024-09-12T17:07:55.617 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.617 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.169457+0000", 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004123481 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.169498+0000", 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1276000000000003e-05 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.169519+0000", 2024-09-12T17:07:55.618 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0392999999999999e-05 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.169665+0000", 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014592000000000001 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.170047+0000", 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00038206900000000002 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.619 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.170309+0000", 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026202799999999998 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.183143+0000", 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012833804000000001 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.189715+0000", 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065727540000000001 2024-09-12T17:07:55.620 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.189893+0000", 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017783999999999999 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.190039+0000", 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000145587 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.621 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.622 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.622 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1391 3.35 3:ae9f95b7:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:55.622 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.390619+0000", 2024-09-12T17:07:55.622 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.160738856999998, 2024-09-12T17:07:55.622 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.024091837000000001, 2024-09-12T17:07:55.622 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.622 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.622 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.622 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.622 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.622 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.622 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1391 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.390619+0000", 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.390619+0000", 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.623 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.391998+0000", 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.001378871 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.398937+0000", 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0069387590000000001 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.398979+0000", 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2599999999999999e-05 2024-09-12T17:07:55.624 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.398998+0000", 2024-09-12T17:07:55.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8726e-05 2024-09-12T17:07:55.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.625 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.399178+0000", 2024-09-12T17:07:55.625 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017938900000000001 2024-09-12T17:07:55.625 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.625 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.625 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.399613+0000", 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00043582499999999998 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.400042+0000", 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042816799999999998 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.412198+0000", 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.012156108000000001 2024-09-12T17:07:55.626 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.414284+0000", 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0020866499999999998 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.414553+0000", 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026912099999999999 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.627 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.414711+0000", 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015762 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1409 3.a 3:53d4fdcd:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.815815+0000", 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 38.735543286999999, 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027748752000000002, 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.628 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1409 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.815815+0000", 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.629 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.815815+0000", 2024-09-12T17:07:55.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.815819+0000", 2024-09-12T17:07:55.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1500000000000001e-06 2024-09-12T17:07:55.630 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.630 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.630 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.630 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.820384+0000", 2024-09-12T17:07:55.630 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045648750000000004 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.820441+0000", 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6855999999999999e-05 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.820471+0000", 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0252000000000001e-05 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.631 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.820654+0000", 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000182914 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.820911+0000", 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025744400000000001 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.821143+0000", 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000231339 2024-09-12T17:07:55.632 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.831865+0000", 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010722261 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.843252+0000", 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011387237 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.633 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.843438+0000", 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018579999999999999 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.843564+0000", 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012562399999999999 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1411 3.35 3:ad037334:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:55.634 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.849073+0000", 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 38.702285383000003, 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020544357999999999, 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1411 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.635 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.849073+0000", 2024-09-12T17:07:55.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.849073+0000", 2024-09-12T17:07:55.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.636 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.636 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.636 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.636 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.849076+0000", 2024-09-12T17:07:55.636 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0199999999999999e-06 2024-09-12T17:07:55.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.853620+0000", 2024-09-12T17:07:55.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0045439599999999997 2024-09-12T17:07:55.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.637 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.637 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.853675+0000", 2024-09-12T17:07:55.637 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.5389000000000001e-05 2024-09-12T17:07:55.637 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.637 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.853693+0000", 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7595e-05 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.853846+0000", 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015381699999999999 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.854103+0000", 2024-09-12T17:07:55.638 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025632900000000002 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.854372+0000", 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026870699999999997 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.862095+0000", 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0077231330000000001 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.639 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.869404+0000", 2024-09-12T17:07:55.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0073091789999999998 2024-09-12T17:07:55.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.869507+0000", 2024-09-12T17:07:55.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000103118 2024-09-12T17:07:55.640 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.640 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.640 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.640 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.869617+0000", 2024-09-12T17:07:55.640 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000110111 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1416 3.0 e64/51 3:03f8363f:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_10:head v 64'5, mlcod=64'3)", 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.914186+0000", 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 38.637172098000001, 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020854184000000001, 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.641 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.914186+0000", 2024-09-12T17:07:55.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.642 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.914186+0000", 2024-09-12T17:07:55.642 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.642 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.642 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.642 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.914188+0000", 2024-09-12T17:07:55.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.1560000000000002e-06 2024-09-12T17:07:55.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.919920+0000", 2024-09-12T17:07:55.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0057317990000000001 2024-09-12T17:07:55.643 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.643 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.643 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.643 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.919956+0000", 2024-09-12T17:07:55.643 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5682000000000002e-05 2024-09-12T17:07:55.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.919987+0000", 2024-09-12T17:07:55.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1333e-05 2024-09-12T17:07:55.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.644 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.644 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.920129+0000", 2024-09-12T17:07:55.644 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141853 2024-09-12T17:07:55.644 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.644 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.920173+0000", 2024-09-12T17:07:55.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4053e-05 2024-09-12T17:07:55.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.645 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.645 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.934875+0000", 2024-09-12T17:07:55.645 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014702455 2024-09-12T17:07:55.645 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.645 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.646 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.646 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.935040+0000", 2024-09-12T17:07:55.646 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016485299999999999 2024-09-12T17:07:55.646 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.646 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.646 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.646 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.646 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.646 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1419 3.26 3:643d8bfc:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:55.646 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.941647+0000", 2024-09-12T17:07:55.646 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 38.609710864, 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025072576999999999, 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1419 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.647 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941647+0000", 2024-09-12T17:07:55.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941647+0000", 2024-09-12T17:07:55.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.648 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.648 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.648 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.941681+0000", 2024-09-12T17:07:55.648 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3949000000000003e-05 2024-09-12T17:07:55.648 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.947632+0000", 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059505440000000003 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.947673+0000", 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1025000000000001e-05 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.649 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.947692+0000", 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9573e-05 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.947865+0000", 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017221700000000001 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.948284+0000", 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000419851 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.650 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 7", 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.948711+0000", 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000426854 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.959639+0000", 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010927971 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.966311+0000", 2024-09-12T17:07:55.651 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066715280000000004 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.966551+0000", 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023980900000000001 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.966720+0000", 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016925600000000001 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.652 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1741 3.2c 3:357f56e5:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.UIKEegG2Kg-xSRVVeGW_lR93QbWiwOo_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T17:07:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:27.225978+0000", 2024-09-12T17:07:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.325380504000002, 2024-09-12T17:07:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025542815, 2024-09-12T17:07:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.653 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1741 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.225978+0000", 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.225978+0000", 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.654 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.225982+0000", 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.2200000000000003e-06 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.231967+0000", 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0059849400000000002 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.232010+0000", 2024-09-12T17:07:55.655 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.3631000000000003e-05 2024-09-12T17:07:55.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.232030+0000", 2024-09-12T17:07:55.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9213000000000001e-05 2024-09-12T17:07:55.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.656 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.656 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.232217+0000", 2024-09-12T17:07:55.656 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000187651 2024-09-12T17:07:55.656 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.656 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.232639+0000", 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042198399999999998 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.233064+0000", 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000425277 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.250583+0000", 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017518995999999998 2024-09-12T17:07:55.657 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.251368+0000", 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00078491399999999995 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.251458+0000", 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.9646000000000002e-05 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.658 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.251520+0000", 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2342999999999996e-05 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1744 3.35 3:af4cf40d:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.2:head [create,setxattr user.rgw.idtag (60) in=14b,setxattr user.rgw.tail_tag (60) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:27.255467+0000", 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.295891395000002, 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022711011, 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.659 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1744 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.255467+0000", 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.660 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.255467+0000", 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.255470+0000", 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9000000000000002e-06 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.259747+0000", 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042769770000000004 2024-09-12T17:07:55.661 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.259784+0000", 2024-09-12T17:07:55.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7539000000000001e-05 2024-09-12T17:07:55.662 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.662 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.662 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.662 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.259801+0000", 2024-09-12T17:07:55.662 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7212000000000001e-05 2024-09-12T17:07:55.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.259897+0000", 2024-09-12T17:07:55.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.5400000000000001e-05 2024-09-12T17:07:55.663 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.663 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.663 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.663 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.260101+0000", 2024-09-12T17:07:55.663 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000204052 2024-09-12T17:07:55.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:55.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.260706+0000", 2024-09-12T17:07:55.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00060523599999999999 2024-09-12T17:07:55.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.664 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.664 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.664 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.267330+0000", 2024-09-12T17:07:55.664 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066240810000000004 2024-09-12T17:07:55.664 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.277857+0000", 2024-09-12T17:07:55.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010526659000000001 2024-09-12T17:07:55.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.665 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.665 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.665 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.278058+0000", 2024-09-12T17:07:55.665 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020135699999999999 2024-09-12T17:07:55.665 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.666 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.666 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.278178+0000", 2024-09-12T17:07:55.666 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119598 2024-09-12T17:07:55.666 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.666 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.666 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.666 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.666 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.666 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1893 3.2c 3:376edb74:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.HFEx8NLO4qNEqI9Hm5LhOzDLwPG7G5M_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:55.667 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.374447+0000", 2024-09-12T17:07:55.667 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.176910960000001, 2024-09-12T17:07:55.667 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020252932000000001, 2024-09-12T17:07:55.667 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.667 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.667 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.667 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.667 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.667 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.667 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1893 2024-09-12T17:07:55.667 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.668 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.374447+0000", 2024-09-12T17:07:55.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.668 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.668 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.668 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.374447+0000", 2024-09-12T17:07:55.668 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.668 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.374450+0000", 2024-09-12T17:07:55.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.8499999999999998e-06 2024-09-12T17:07:55.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.669 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.669 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.378468+0000", 2024-09-12T17:07:55.669 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040185120000000001 2024-09-12T17:07:55.669 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.669 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.378504+0000", 2024-09-12T17:07:55.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5292e-05 2024-09-12T17:07:55.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.378521+0000", 2024-09-12T17:07:55.670 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7275999999999999e-05 2024-09-12T17:07:55.670 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.670 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.670 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.670 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.378650+0000", 2024-09-12T17:07:55.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000128904 2024-09-12T17:07:55.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.378910+0000", 2024-09-12T17:07:55.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025975999999999999 2024-09-12T17:07:55.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.671 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.671 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:55.671 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.379140+0000", 2024-09-12T17:07:55.671 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000230084 2024-09-12T17:07:55.671 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.393152+0000", 2024-09-12T17:07:55.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014012039 2024-09-12T17:07:55.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.672 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.394352+0000", 2024-09-12T17:07:55.672 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0012002200000000001 2024-09-12T17:07:55.672 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.672 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.672 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.394545+0000", 2024-09-12T17:07:55.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000192795 2024-09-12T17:07:55.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.673 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.673 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.673 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.394700+0000", 2024-09-12T17:07:55.673 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0001552 2024-09-12T17:07:55.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.673 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.673 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.673 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.674 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.674 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1896 3.2c 3:3773d78b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.27:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:55.674 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.398387+0000", 2024-09-12T17:07:55.674 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.152971278999999, 2024-09-12T17:07:55.674 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.028353700999999999, 2024-09-12T17:07:55.674 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.674 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.674 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.674 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.674 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.674 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.675 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1896 2024-09-12T17:07:55.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.675 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.675 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.398387+0000", 2024-09-12T17:07:55.675 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.675 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.675 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.675 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.398387+0000", 2024-09-12T17:07:55.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.398390+0000", 2024-09-12T17:07:55.676 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.4070000000000002e-06 2024-09-12T17:07:55.676 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.676 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.676 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.676 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.402373+0000", 2024-09-12T17:07:55.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039830839999999996 2024-09-12T17:07:55.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.402409+0000", 2024-09-12T17:07:55.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5465e-05 2024-09-12T17:07:55.677 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.677 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.677 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.677 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.402425+0000", 2024-09-12T17:07:55.677 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5909e-05 2024-09-12T17:07:55.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.402557+0000", 2024-09-12T17:07:55.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000132805 2024-09-12T17:07:55.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.678 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.678 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.402844+0000", 2024-09-12T17:07:55.678 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028694799999999998 2024-09-12T17:07:55.678 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.678 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:55.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.403794+0000", 2024-09-12T17:07:55.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00094998700000000001 2024-09-12T17:07:55.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.679 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.679 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.679 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.426361+0000", 2024-09-12T17:07:55.679 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022566928 2024-09-12T17:07:55.679 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.426401+0000", 2024-09-12T17:07:55.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9665000000000001e-05 2024-09-12T17:07:55.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.680 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.680 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.426588+0000", 2024-09-12T17:07:55.680 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000186539 2024-09-12T17:07:55.680 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.680 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.681 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.681 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.426741+0000", 2024-09-12T17:07:55.681 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015296400000000001 2024-09-12T17:07:55.681 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.681 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.681 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.681 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.681 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.681 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2119 3.20 3:0529b5d9:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.ex47I2wBo4YNPUzefmcVhDBd0ZGN1Yz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:55.681 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.146292+0000", 2024-09-12T17:07:55.681 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.405066084000001, 2024-09-12T17:07:55.682 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021203072, 2024-09-12T17:07:55.682 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.682 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.682 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.682 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.682 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2119 2024-09-12T17:07:55.682 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.682 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.682 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.146292+0000", 2024-09-12T17:07:55.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.683 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.683 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.146292+0000", 2024-09-12T17:07:55.683 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.683 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.683 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.684 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.684 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.146294+0000", 2024-09-12T17:07:55.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3630000000000001e-06 2024-09-12T17:07:55.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.685 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.685 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.685 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.154205+0000", 2024-09-12T17:07:55.685 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0079102400000000007 2024-09-12T17:07:55.685 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.154252+0000", 2024-09-12T17:07:55.686 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6915000000000001e-05 2024-09-12T17:07:55.686 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.686 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.686 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.686 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.154271+0000", 2024-09-12T17:07:55.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9582e-05 2024-09-12T17:07:55.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.687 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.687 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.687 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.154436+0000", 2024-09-12T17:07:55.687 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016445699999999999 2024-09-12T17:07:55.687 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.154685+0000", 2024-09-12T17:07:55.688 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024904799999999998 2024-09-12T17:07:55.688 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.688 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.688 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:55.688 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.154927+0000", 2024-09-12T17:07:55.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00024269100000000001 2024-09-12T17:07:55.689 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.689 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.689 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.689 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.164206+0000", 2024-09-12T17:07:55.689 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0092787760000000007 2024-09-12T17:07:55.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.690 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.690 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.690 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.167245+0000", 2024-09-12T17:07:55.690 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0030385249999999998 2024-09-12T17:07:55.690 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.167345+0000", 2024-09-12T17:07:55.691 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000100203 2024-09-12T17:07:55.691 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.691 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.691 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.691 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.167495+0000", 2024-09-12T17:07:55.692 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015027199999999999 2024-09-12T17:07:55.692 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.692 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.692 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.692 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.692 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.692 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2146 3.2c 3:35eb2578:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.67:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:55.692 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.680030+0000", 2024-09-12T17:07:55.693 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.871328113000001, 2024-09-12T17:07:55.693 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026494238, 2024-09-12T17:07:55.693 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.693 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.693 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.693 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.693 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.693 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.693 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2146 2024-09-12T17:07:55.693 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.693 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.680030+0000", 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.680030+0000", 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.694 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.680032+0000", 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2069999999999998e-06 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.685207+0000", 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051749459999999997 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.685240+0000", 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.2499000000000002e-05 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.695 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.685256+0000", 2024-09-12T17:07:55.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.6069000000000001e-05 2024-09-12T17:07:55.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.685447+0000", 2024-09-12T17:07:55.696 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019092999999999999 2024-09-12T17:07:55.696 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.696 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.696 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.696 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.685713+0000", 2024-09-12T17:07:55.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026668699999999999 2024-09-12T17:07:55.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:55.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.686636+0000", 2024-09-12T17:07:55.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00092234999999999995 2024-09-12T17:07:55.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.697 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.697 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.697 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.706112+0000", 2024-09-12T17:07:55.697 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019476078000000001 2024-09-12T17:07:55.697 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.706279+0000", 2024-09-12T17:07:55.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016724700000000001 2024-09-12T17:07:55.698 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.698 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.698 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.698 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.706410+0000", 2024-09-12T17:07:55.698 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000130865 2024-09-12T17:07:55.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.699 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.699 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.706524+0000", 2024-09-12T17:07:55.699 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011436 2024-09-12T17:07:55.699 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.699 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.699 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.699 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.699 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.699 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2210 3.35 3:afb4900b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.76:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:55.700 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:37.092926+0000", 2024-09-12T17:07:55.700 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 18.458431983000001, 2024-09-12T17:07:55.700 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025007710999999998, 2024-09-12T17:07:55.700 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:55.700 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:55.700 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:55.700 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:55.700 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:55.700 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:55.700 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2210 2024-09-12T17:07:55.700 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.700 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:55.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:55.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.092926+0000", 2024-09-12T17:07:55.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.701 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:55.701 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.092926+0000", 2024-09-12T17:07:55.701 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:55.701 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.701 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.702 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:55.702 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.092929+0000", 2024-09-12T17:07:55.702 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.27e-06 2024-09-12T17:07:55.702 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.702 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.097130+0000", 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0042002230000000003 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.097170+0000", 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0865999999999998e-05 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.097189+0000", 2024-09-12T17:07:55.703 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8685000000000002e-05 2024-09-12T17:07:55.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.704 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.704 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:55.704 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.097332+0000", 2024-09-12T17:07:55.704 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014263899999999999 2024-09-12T17:07:55.704 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.705 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:55.705 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.097603+0000", 2024-09-12T17:07:55.705 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000271267 2024-09-12T17:07:55.705 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.705 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.098492+0000", 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00088944200000000005 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.113482+0000", 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014989105000000001 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.117696+0000", 2024-09-12T17:07:55.706 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.004214789 2024-09-12T17:07:55.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:55.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.117803+0000", 2024-09-12T17:07:55.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00010621899999999999 2024-09-12T17:07:55.707 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:55.707 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:55.707 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:55.707 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:37.117934+0000", 2024-09-12T17:07:55.707 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000131206 2024-09-12T17:07:55.707 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.707 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.708 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.708 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:55.708 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:55.708 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:55.709 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T17:07:55.842 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:55.842 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:55.843 INFO:teuthology.orchestra.run.smithi047.stdout: "num_ops": 0 2024-09-12T17:07:55.843 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:55.859 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T17:07:55.988 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:55.988 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [], 2024-09-12T17:07:55.988 INFO:teuthology.orchestra.run.smithi047.stdout: "complaint_time": 30, 2024-09-12T17:07:55.988 INFO:teuthology.orchestra.run.smithi047.stdout: "num_blocked_ops": 0 2024-09-12T17:07:55.988 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:56.003 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T17:07:56.127 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-09-12T17:07:56.127 INFO:teuthology.orchestra.run.smithi047.stdout: "size": 20, 2024-09-12T17:07:56.127 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 600, 2024-09-12T17:07:56.127 INFO:teuthology.orchestra.run.smithi047.stdout: "ops": [ 2024-09-12T17:07:56.127 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.127 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4216.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17)", 2024-09-12T17:07:56.127 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:07:56.127 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 140.94368046899999, 2024-09-12T17:07:56.128 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.51115267600000003, 2024-09-12T17:07:56.128 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.128 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.128 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.128 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.128 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4216", 2024-09-12T17:07:56.128 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.47:0/2927311836", 2024-09-12T17:07:56.128 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1 2024-09-12T17:07:56.128 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.128 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.128 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:07:56.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178729+0000", 2024-09-12T17:07:56.129 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.129 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.129 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.129 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.129 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178732+0000", 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.3329999999999999e-06 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178746+0000", 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.4273e-05 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178768+0000", 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.2246e-05 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.130 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.178786+0000", 2024-09-12T17:07:56.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7354e-05 2024-09-12T17:07:56.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.131 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.179126+0000", 2024-09-12T17:07:56.131 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00034083699999999998 2024-09-12T17:07:56.131 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.131 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.131 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for peered", 2024-09-12T17:07:56.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.179140+0000", 2024-09-12T17:07:56.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3879999999999999e-05 2024-09-12T17:07:56.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.132 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.686346+0000", 2024-09-12T17:07:56.132 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.50720528799999998 2024-09-12T17:07:56.132 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.132 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.132 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.686808+0000", 2024-09-12T17:07:56.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00046207300000000002 2024-09-12T17:07:56.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:56.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.687360+0000", 2024-09-12T17:07:56.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00055267599999999999 2024-09-12T17:07:56.133 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.133 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.133 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.133 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689052+0000", 2024-09-12T17:07:56.133 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0016913329999999999 2024-09-12T17:07:56.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689665+0000", 2024-09-12T17:07:56.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00061308200000000004 2024-09-12T17:07:56.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.134 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.134 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.134 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689763+0000", 2024-09-12T17:07:56.134 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.8048999999999996e-05 2024-09-12T17:07:56.134 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.135 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.135 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:05:35.689882+0000", 2024-09-12T17:07:56.135 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119252 2024-09-12T17:07:56.135 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.135 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.135 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.135 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.135 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.135 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1229 3.3f 3:ff2c3f48:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:56.135 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.463419+0000", 2024-09-12T17:07:56.136 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.658990627000001, 2024-09-12T17:07:56.136 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023214266000000001, 2024-09-12T17:07:56.136 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.136 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.136 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.136 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.136 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.136 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.136 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1229 2024-09-12T17:07:56.136 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.136 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.463419+0000", 2024-09-12T17:07:56.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.137 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.137 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.137 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.463419+0000", 2024-09-12T17:07:56.137 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.137 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.463422+0000", 2024-09-12T17:07:56.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5859999999999999e-06 2024-09-12T17:07:56.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.138 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.467402+0000", 2024-09-12T17:07:56.138 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039800230000000001 2024-09-12T17:07:56.138 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.138 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.138 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.467438+0000", 2024-09-12T17:07:56.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5892999999999997e-05 2024-09-12T17:07:56.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.467453+0000", 2024-09-12T17:07:56.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5685999999999999e-05 2024-09-12T17:07:56.139 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.139 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.139 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.139 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.467651+0000", 2024-09-12T17:07:56.139 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019786200000000001 2024-09-12T17:07:56.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.467888+0000", 2024-09-12T17:07:56.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023626800000000001 2024-09-12T17:07:56.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.140 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:56.140 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.468126+0000", 2024-09-12T17:07:56.140 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000237941 2024-09-12T17:07:56.140 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.140 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.478659+0000", 2024-09-12T17:07:56.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.010533391 2024-09-12T17:07:56.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.486461+0000", 2024-09-12T17:07:56.141 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0078016700000000001 2024-09-12T17:07:56.141 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.141 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.141 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.141 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.486558+0000", 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7717e-05 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.486634+0000", 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.5228999999999994e-05 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1248 3.f 3:f313a312:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.C7c6KkanxMmxnDTwidAh77PC4xR7u1d_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:56.142 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:12.712301+0000", 2024-09-12T17:07:56.143 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 43.410108715, 2024-09-12T17:07:56.143 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022956944999999999, 2024-09-12T17:07:56.143 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.143 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.143 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.143 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.143 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.143 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.143 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1248 2024-09-12T17:07:56.143 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.143 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.143 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.712301+0000", 2024-09-12T17:07:56.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.712301+0000", 2024-09-12T17:07:56.144 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.144 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.144 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.144 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.144 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.712313+0000", 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.1426e-05 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.719351+0000", 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0070381530000000001 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.719408+0000", 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.7012999999999998e-05 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.145 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.719435+0000", 2024-09-12T17:07:56.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.7636000000000001e-05 2024-09-12T17:07:56.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.719611+0000", 2024-09-12T17:07:56.146 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017562900000000001 2024-09-12T17:07:56.146 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.146 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.146 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.146 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720004+0000", 2024-09-12T17:07:56.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00039291400000000001 2024-09-12T17:07:56.147 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.147 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.147 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:56.147 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.720230+0000", 2024-09-12T17:07:56.147 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022651799999999999 2024-09-12T17:07:56.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.731236+0000", 2024-09-12T17:07:56.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011005044 2024-09-12T17:07:56.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.148 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.148 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.734954+0000", 2024-09-12T17:07:56.148 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0037183720000000002 2024-09-12T17:07:56.148 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.148 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.735129+0000", 2024-09-12T17:07:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017522999999999999 2024-09-12T17:07:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:12.735258+0000", 2024-09-12T17:07:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012901000000000001 2024-09-12T17:07:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.149 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1268 3.d 3:b32ccbbb:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.4D5j-m2psb02UoP-LBy3fyIvYk6FWjM_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:13.281315+0000", 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 42.841094724999998, 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022082814999999999, 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1268 2024-09-12T17:07:56.150 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.281315+0000", 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.281315+0000", 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.151 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.281319+0000", 2024-09-12T17:07:56.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.726e-06 2024-09-12T17:07:56.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.152 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.288734+0000", 2024-09-12T17:07:56.152 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0074151019999999998 2024-09-12T17:07:56.152 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.152 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.152 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.288773+0000", 2024-09-12T17:07:56.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9162000000000002e-05 2024-09-12T17:07:56.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.288792+0000", 2024-09-12T17:07:56.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8865999999999999e-05 2024-09-12T17:07:56.153 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.153 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.153 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.153 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.288926+0000", 2024-09-12T17:07:56.153 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013373700000000001 2024-09-12T17:07:56.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.289200+0000", 2024-09-12T17:07:56.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000273894 2024-09-12T17:07:56.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.154 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:56.154 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.289420+0000", 2024-09-12T17:07:56.154 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000220681 2024-09-12T17:07:56.154 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.154 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.302762+0000", 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013341916000000001 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.303301+0000", 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00053860799999999999 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.303352+0000", 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0930999999999997e-05 2024-09-12T17:07:56.155 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:13.303398+0000", 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6192000000000001e-05 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1372 3.15 3:a8d86e21:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.176279+0000", 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.946130840000002, 2024-09-12T17:07:56.156 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025118363000000001, 2024-09-12T17:07:56.157 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.157 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.157 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.157 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.157 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.157 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.157 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1372 2024-09-12T17:07:56.157 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.157 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.157 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.157 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.157 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176279+0000", 2024-09-12T17:07:56.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176279+0000", 2024-09-12T17:07:56.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.158 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.158 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.158 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.176284+0000", 2024-09-12T17:07:56.158 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.0760000000000002e-06 2024-09-12T17:07:56.158 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.182875+0000", 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00659108 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.182932+0000", 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.6486000000000001e-05 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.159 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.182952+0000", 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0146e-05 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.183137+0000", 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000185386 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.183563+0000", 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042571500000000001 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.160 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.183980+0000", 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041686099999999998 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.200703+0000", 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.016722893999999999 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.201083+0000", 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000379992 2024-09-12T17:07:56.161 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.201230+0000", 2024-09-12T17:07:56.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014721999999999999 2024-09-12T17:07:56.162 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.162 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.162 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.162 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.201397+0000", 2024-09-12T17:07:56.162 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016750700000000001 2024-09-12T17:07:56.162 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.162 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.162 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.163 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.163 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1373 3.2d 3:b512a50c:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:56.163 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.186074+0000", 2024-09-12T17:07:56.163 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.936335540000002, 2024-09-12T17:07:56.163 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.027037162999999999, 2024-09-12T17:07:56.163 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.163 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.163 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.163 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.163 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.163 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1373 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.186074+0000", 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.186074+0000", 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.164 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.186078+0000", 2024-09-12T17:07:56.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7869999999999999e-06 2024-09-12T17:07:56.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.165 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.192627+0000", 2024-09-12T17:07:56.165 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0065486370000000004 2024-09-12T17:07:56.165 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.165 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.165 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.192666+0000", 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9233000000000002e-05 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.192684+0000", 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8406e-05 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.192841+0000", 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015609700000000001 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.166 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.193143+0000", 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00030227100000000001 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.193403+0000", 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026007100000000001 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.202677+0000", 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0092737610000000002 2024-09-12T17:07:56.167 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.212802+0000", 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01012564 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.212965+0000", 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00016284000000000001 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.168 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.213112+0000", 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014642 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1378 3.3f 3:fcf90740:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.uIc2Ry7Y1wSiqLmMppCt0CgLWz4zp_p_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.244185+0000", 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.878224549999999, 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.020809912, 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.169 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1378 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.244185+0000", 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.170 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.244185+0000", 2024-09-12T17:07:56.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.244189+0000", 2024-09-12T17:07:56.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1999999999999999e-06 2024-09-12T17:07:56.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.171 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.171 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.171 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.249536+0000", 2024-09-12T17:07:56.171 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.005347419 2024-09-12T17:07:56.171 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.249576+0000", 2024-09-12T17:07:56.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9813e-05 2024-09-12T17:07:56.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.172 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.249596+0000", 2024-09-12T17:07:56.172 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9902e-05 2024-09-12T17:07:56.172 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.172 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.172 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.249752+0000", 2024-09-12T17:07:56.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00015593700000000001 2024-09-12T17:07:56.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.250006+0000", 2024-09-12T17:07:56.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025447799999999999 2024-09-12T17:07:56.173 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.173 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.173 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:56.173 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.250239+0000", 2024-09-12T17:07:56.173 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023313500000000001 2024-09-12T17:07:56.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.259502+0000", 2024-09-12T17:07:56.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0092624850000000009 2024-09-12T17:07:56.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.174 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.174 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.264670+0000", 2024-09-12T17:07:56.174 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00516871 2024-09-12T17:07:56.174 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.174 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.264854+0000", 2024-09-12T17:07:56.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018312600000000001 2024-09-12T17:07:56.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.175 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.175 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.175 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.264995+0000", 2024-09-12T17:07:56.175 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000141707 2024-09-12T17:07:56.175 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.175 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.175 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.175 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.176 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.176 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_repop(client.4434.0:1417 3.14 e64/24 3:29a29b4e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_11:head v 64'4, mlcod=63'2)", 2024-09-12T17:07:56.176 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:16.931750+0000", 2024-09-12T17:07:56.176 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.190660391999998, 2024-09-12T17:07:56.176 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021227023000000001, 2024-09-12T17:07:56.176 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.176 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.176 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.176 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931750+0000", 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931750+0000", 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.177 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.931753+0000", 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1300000000000001e-06 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.937425+0000", 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056726149999999998 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.937472+0000", 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.7111999999999999e-05 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.178 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.937493+0000", 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.0676999999999999e-05 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.937664+0000", 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00017092600000000001 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.937733+0000", 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9152000000000005e-05 2024-09-12T17:07:56.179 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952852+0000", 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015118614000000001 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:16.952977+0000", 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000124797 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.180 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.181 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.181 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1429 3.39 3:9c4af548:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.1__shadow_.sPBiBxWqVBfsX_xHesFvuQ12v58qxHW_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T17:07:56.181 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:17.046799+0000", 2024-09-12T17:07:56.181 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 39.07561054, 2024-09-12T17:07:56.181 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022223333000000001, 2024-09-12T17:07:56.181 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.181 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.181 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.181 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.181 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.181 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1429 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.046799+0000", 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.046799+0000", 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.182 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.046802+0000", 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.9900000000000002e-06 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.052461+0000", 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056589819999999999 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.052498+0000", 2024-09-12T17:07:56.183 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.7098000000000003e-05 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.052517+0000", 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8385000000000001e-05 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.052645+0000", 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012804900000000001 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.184 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.052900+0000", 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000255195 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 0", 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.053136+0000", 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00023572600000000001 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.060661+0000", 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0075248470000000003 2024-09-12T17:07:56.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.068853+0000", 2024-09-12T17:07:56.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0081926940000000004 2024-09-12T17:07:56.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.186 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.068950+0000", 2024-09-12T17:07:56.186 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.6503999999999996e-05 2024-09-12T17:07:56.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.186 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.186 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:17.069023+0000", 2024-09-12T17:07:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.2862999999999997e-05 2024-09-12T17:07:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1738 3.3f 3:fd0cc8cb:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.1:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T17:07:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:27.096542+0000", 2024-09-12T17:07:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 29.025867553000001, 2024-09-12T17:07:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021400209, 2024-09-12T17:07:56.187 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1738 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.096542+0000", 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.188 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.096542+0000", 2024-09-12T17:07:56.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.189 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.189 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.189 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.189 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.096546+0000", 2024-09-12T17:07:56.189 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.32e-06 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.104914+0000", 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0083684510000000007 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.104961+0000", 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.6851000000000003e-05 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.190 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.191 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.104980+0000", 2024-09-12T17:07:56.191 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9332000000000001e-05 2024-09-12T17:07:56.191 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.191 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.191 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.105087+0000", 2024-09-12T17:07:56.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000106495 2024-09-12T17:07:56.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.105296+0000", 2024-09-12T17:07:56.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000208789 2024-09-12T17:07:56.192 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.192 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.192 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:56.192 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.105814+0000", 2024-09-12T17:07:56.192 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00051882899999999995 2024-09-12T17:07:56.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.117435+0000", 2024-09-12T17:07:56.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011620292000000001 2024-09-12T17:07:56.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.193 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.193 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.117567+0000", 2024-09-12T17:07:56.193 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013263700000000001 2024-09-12T17:07:56.193 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.193 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.117803+0000", 2024-09-12T17:07:56.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000235469 2024-09-12T17:07:56.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.194 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.194 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.194 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.117943+0000", 2024-09-12T17:07:56.194 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000139744 2024-09-12T17:07:56.194 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.194 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.194 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.194 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.195 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.195 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1747 3.2d 3:b65ccb38:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.1WIPq_cHo5kI8P6J6YoSpzHQu4w7UKi_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e69)", 2024-09-12T17:07:56.195 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:27.379548+0000", 2024-09-12T17:07:56.195 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 28.742861519000002, 2024-09-12T17:07:56.195 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023003183, 2024-09-12T17:07:56.195 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.195 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.195 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.195 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.195 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.195 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.195 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1747 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.379548+0000", 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.379548+0000", 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.196 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.379552+0000", 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1609999999999999e-06 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.383624+0000", 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040721000000000004 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.383655+0000", 2024-09-12T17:07:56.197 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.1244000000000001e-05 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.383669+0000", 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3764000000000001e-05 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.383782+0000", 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011362999999999999 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.198 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.384007+0000", 2024-09-12T17:07:56.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00022500999999999999 2024-09-12T17:07:56.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.199 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.199 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:56.199 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.384221+0000", 2024-09-12T17:07:56.199 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000214205 2024-09-12T17:07:56.199 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.393656+0000", 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0094344939999999999 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.402447+0000", 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0087913550000000007 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.200 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.402507+0000", 2024-09-12T17:07:56.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 5.9539e-05 2024-09-12T17:07:56.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.201 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.201 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:27.402552+0000", 2024-09-12T17:07:56.201 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4681000000000001e-05 2024-09-12T17:07:56.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.201 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.201 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.201 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.201 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.201 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1905 3.f 3:f36f3c54:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.7nk1u89_arKyo2WAm6dLSCN4ABFfUep_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:30.623256+0000", 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 25.499153397000001, 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023289942000000001, 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1905 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.202 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.623256+0000", 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.623256+0000", 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.623260+0000", 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.433e-06 2024-09-12T17:07:56.203 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.627696+0000", 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0044357019999999997 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.627735+0000", 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9149000000000001e-05 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.204 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.627753+0000", 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8451999999999999e-05 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.627939+0000", 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018546200000000001 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.628351+0000", 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00041259000000000001 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.205 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.628785+0000", 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00043396500000000002 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.641179+0000", 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.01239402 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.646211+0000", 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050321660000000002 2024-09-12T17:07:56.206 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.646414+0000", 2024-09-12T17:07:56.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00020287500000000001 2024-09-12T17:07:56.207 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.207 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.207 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.207 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:30.646546+0000", 2024-09-12T17:07:56.207 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013212799999999999 2024-09-12T17:07:56.207 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.207 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:1969 3.2d 3:b6146979:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.Z5cptCHTKeM4GHx6NXYUfrogv-Oetmi_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:31.858871+0000", 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 24.263539248000001, 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021201133, 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.208 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.209 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 1969 2024-09-12T17:07:56.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.209 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.858871+0000", 2024-09-12T17:07:56.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.209 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.209 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.209 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.209 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.858871+0000", 2024-09-12T17:07:56.209 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.858874+0000", 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5200000000000002e-06 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.864481+0000", 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0056065780000000001 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.210 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.864514+0000", 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3071999999999998e-05 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.864533+0000", 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.9369999999999999e-05 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.864674+0000", 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014101399999999999 2024-09-12T17:07:56.211 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.864940+0000", 2024-09-12T17:07:56.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026604500000000002 2024-09-12T17:07:56.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:56.212 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.865190+0000", 2024-09-12T17:07:56.212 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00025025399999999999 2024-09-12T17:07:56.212 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.212 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.212 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.879013+0000", 2024-09-12T17:07:56.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.013822298 2024-09-12T17:07:56.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.879789+0000", 2024-09-12T17:07:56.213 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00077623700000000004 2024-09-12T17:07:56.213 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.213 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.213 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.213 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.879905+0000", 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000115872 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:31.880072+0000", 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000166873 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2113 3.3f 3:fe63f524:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.VtYZzSFm8Nik5F6ZWV2Yjrk9Xs3h70G_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:56.214 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.012480+0000", 2024-09-12T17:07:56.215 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.109930324, 2024-09-12T17:07:56.215 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026661711000000001, 2024-09-12T17:07:56.215 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.215 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.215 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.215 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.215 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2113 2024-09-12T17:07:56.215 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.215 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.215 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.012480+0000", 2024-09-12T17:07:56.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.012480+0000", 2024-09-12T17:07:56.216 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.216 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.216 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.216 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.216 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.012482+0000", 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.6740000000000001e-06 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.017655+0000", 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051724300000000004 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.017695+0000", 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0664999999999998e-05 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.217 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.017713+0000", 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7473e-05 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.017883+0000", 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000170223 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.018307+0000", 2024-09-12T17:07:56.218 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00042441100000000003 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.018749+0000", 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00044192400000000001 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.038330+0000", 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.019580341000000001 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.219 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.038974+0000", 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00064444600000000002 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.039071+0000", 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7330000000000005e-05 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.039141+0000", 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.9794000000000003e-05 2024-09-12T17:07:56.220 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2116 3.3f 3:fce43777:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.62:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e72)", 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.043451+0000", 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 21.078959081000001, 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.021176442, 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.221 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2116 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.043451+0000", 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.043451+0000", 2024-09-12T17:07:56.222 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.043454+0000", 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.914e-06 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.048504+0000", 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0050503400000000004 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.223 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.048544+0000", 2024-09-12T17:07:56.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9505999999999997e-05 2024-09-12T17:07:56.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.048569+0000", 2024-09-12T17:07:56.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 2.5678999999999999e-05 2024-09-12T17:07:56.224 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.224 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.224 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.224 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.048758+0000", 2024-09-12T17:07:56.224 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00018887999999999999 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.049023+0000", 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00026519599999999999 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 6", 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.049927+0000", 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00090320099999999996 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.225 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.064381+0000", 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.014454335 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.064422+0000", 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.1331999999999997e-05 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.064538+0000", 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000116229 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.226 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.064627+0000", 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.8830000000000002e-05 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2132 3.37 3:ecbaeb04:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.zMHhD2lKVde2GeFxbpVTls1jtnLcDP5_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:35.399044+0000", 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 20.723365459, 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.026245003999999999, 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.227 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2132 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399044+0000", 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.228 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399044+0000", 2024-09-12T17:07:56.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.399048+0000", 2024-09-12T17:07:56.229 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9369999999999997e-06 2024-09-12T17:07:56.229 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.229 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.229 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.229 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.403116+0000", 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0040672740000000001 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.403190+0000", 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.3918000000000006e-05 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.403223+0000", 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.3742000000000003e-05 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.230 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.403424+0000", 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000200943 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op must wait for map", 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.403437+0000", 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.2259000000000001e-05 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.415308+0000", 2024-09-12T17:07:56.231 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011871250999999999 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.415521+0000", 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000213229 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 5", 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.415733+0000", 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000211652 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.232 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.422359+0000", 2024-09-12T17:07:56.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0066266729999999996 2024-09-12T17:07:56.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.425127+0000", 2024-09-12T17:07:56.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0027680949999999999 2024-09-12T17:07:56.233 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.233 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.233 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.233 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.425221+0000", 2024-09-12T17:07:56.233 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.3820000000000006e-05 2024-09-12T17:07:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:35.425289+0000", 2024-09-12T17:07:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.8211000000000001e-05 2024-09-12T17:07:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2170 3.11 3:88f74337:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.71:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:56.234 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.298982+0000", 2024-09-12T17:07:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.823428029999999, 2024-09-12T17:07:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022322314999999999, 2024-09-12T17:07:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2170 2024-09-12T17:07:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.235 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.298982+0000", 2024-09-12T17:07:56.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.298982+0000", 2024-09-12T17:07:56.236 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.236 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.236 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.236 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.236 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.298985+0000", 2024-09-12T17:07:56.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.0000000000000001e-06 2024-09-12T17:07:56.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.303107+0000", 2024-09-12T17:07:56.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041219660000000003 2024-09-12T17:07:56.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.237 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.237 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.237 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.303142+0000", 2024-09-12T17:07:56.237 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.5457999999999998e-05 2024-09-12T17:07:56.237 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.303158+0000", 2024-09-12T17:07:56.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.5787e-05 2024-09-12T17:07:56.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.238 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.303288+0000", 2024-09-12T17:07:56.238 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000129782 2024-09-12T17:07:56.238 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.238 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.238 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.303558+0000", 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00027055999999999998 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.304370+0000", 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00081127800000000002 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.320346+0000", 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.015975999000000001 2024-09-12T17:07:56.239 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.321051+0000", 2024-09-12T17:07:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00070550400000000003 2024-09-12T17:07:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.321162+0000", 2024-09-12T17:07:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011120600000000001 2024-09-12T17:07:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.240 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.321304+0000", 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00014177499999999999 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2173 3.2d 3:b4393a9e:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2__shadow_.Wj90S10sGnKqRbk_9HpntodOyKiVSPB_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e73)", 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:36.425178+0000", 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 19.697232027999998, 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.023124005999999999, 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.241 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.242 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.242 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2173 2024-09-12T17:07:56.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.242 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.242 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.242 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.425178+0000", 2024-09-12T17:07:56.242 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.242 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.242 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.425178+0000", 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.425182+0000", 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0330000000000002e-06 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.429357+0000", 2024-09-12T17:07:56.243 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0041749389999999999 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.429395+0000", 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.8413e-05 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.429409+0000", 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.3447e-05 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.244 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.429506+0000", 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7019000000000001e-05 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.429659+0000", 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000152841 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 2", 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.429786+0000", 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00012769499999999999 2024-09-12T17:07:56.245 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.436558+0000", 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0067716599999999997 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.448160+0000", 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011602232000000001 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.448239+0000", 2024-09-12T17:07:56.246 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 7.9172999999999996e-05 2024-09-12T17:07:56.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.247 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.247 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:36.448302+0000", 2024-09-12T17:07:56.247 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 6.2553999999999998e-05 2024-09-12T17:07:56.247 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.247 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.247 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.247 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.247 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.247 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2342 3.11 3:89db9a3b:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.98:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:56.248 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:39.785696+0000", 2024-09-12T17:07:56.248 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.336714266000001, 2024-09-12T17:07:56.248 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.022270939, 2024-09-12T17:07:56.248 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.248 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.248 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.248 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.248 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.248 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2342 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.785696+0000", 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.785696+0000", 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.249 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.785700+0000", 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.0899999999999998e-06 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.789673+0000", 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0039733959999999997 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.250 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.789712+0000", 2024-09-12T17:07:56.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.9335999999999997e-05 2024-09-12T17:07:56.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.789730+0000", 2024-09-12T17:07:56.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.7679000000000001e-05 2024-09-12T17:07:56.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.251 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.251 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.251 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.789862+0000", 2024-09-12T17:07:56.251 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00013225199999999999 2024-09-12T17:07:56.251 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.790150+0000", 2024-09-12T17:07:56.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028793699999999999 2024-09-12T17:07:56.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 4", 2024-09-12T17:07:56.252 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.791080+0000", 2024-09-12T17:07:56.252 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00093015199999999995 2024-09-12T17:07:56.252 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.252 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.252 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.802299+0000", 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.011218422 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.807766+0000", 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0054673719999999999 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.807880+0000", 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00011359899999999999 2024-09-12T17:07:56.253 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.254 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.254 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:39.807967+0000", 2024-09-12T17:07:56.254 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 8.6704000000000002e-05 2024-09-12T17:07:56.254 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.254 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.254 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.254 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.254 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.254 INFO:teuthology.orchestra.run.smithi047.stdout: "description": "osd_op(client.4434.0:2354 3.15 3:aaf30e37:::b3a4e2ba-8587-46e1-847c-b6ab3db563ee.4434.2_10Mb.100:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75)", 2024-09-12T17:07:56.254 INFO:teuthology.orchestra.run.smithi047.stdout: "initiated_at": "2024-09-12T17:07:40.020176+0000", 2024-09-12T17:07:56.254 INFO:teuthology.orchestra.run.smithi047.stdout: "age": 16.102234064000001, 2024-09-12T17:07:56.255 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.025158504000000002, 2024-09-12T17:07:56.255 INFO:teuthology.orchestra.run.smithi047.stdout: "continuous": false, 2024-09-12T17:07:56.255 INFO:teuthology.orchestra.run.smithi047.stdout: "type_data": { 2024-09-12T17:07:56.255 INFO:teuthology.orchestra.run.smithi047.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T17:07:56.255 INFO:teuthology.orchestra.run.smithi047.stdout: "client_info": { 2024-09-12T17:07:56.255 INFO:teuthology.orchestra.run.smithi047.stdout: "client": "client.4434", 2024-09-12T17:07:56.255 INFO:teuthology.orchestra.run.smithi047.stdout: "client_addr": "172.21.15.17:0/2525162340", 2024-09-12T17:07:56.255 INFO:teuthology.orchestra.run.smithi047.stdout: "tid": 2354 2024-09-12T17:07:56.255 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.255 INFO:teuthology.orchestra.run.smithi047.stdout: "events": [ 2024-09-12T17:07:56.255 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.255 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "initiated", 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.020176+0000", 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "header_read", 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.020176+0000", 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "throttled", 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.020180+0000", 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 3.873e-06 2024-09-12T17:07:56.256 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "all_read", 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.025312+0000", 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.0051321759999999996 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "dispatched", 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.025356+0000", 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 4.4515000000000003e-05 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "queued_for_pg", 2024-09-12T17:07:56.257 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.025375+0000", 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 1.8332999999999999e-05 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "reached_pg", 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.025573+0000", 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00019826300000000001 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "started", 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.025856+0000", 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00028271699999999998 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.258 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "waiting for subops from 3", 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.026708+0000", 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00085196299999999996 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "sub_op_commit_rec", 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.044202+0000", 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.017494247000000001 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "op_commit", 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.045118+0000", 2024-09-12T17:07:56.259 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.00091612699999999998 2024-09-12T17:07:56.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "commit_sent", 2024-09-12T17:07:56.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.045237+0000", 2024-09-12T17:07:56.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 0.000119159 2024-09-12T17:07:56.260 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-09-12T17:07:56.260 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-09-12T17:07:56.260 INFO:teuthology.orchestra.run.smithi047.stdout: "event": "done", 2024-09-12T17:07:56.260 INFO:teuthology.orchestra.run.smithi047.stdout: "time": "2024-09-12T17:07:40.045334+0000", 2024-09-12T17:07:56.260 INFO:teuthology.orchestra.run.smithi047.stdout: "duration": 9.7131000000000002e-05 2024-09-12T17:07:56.260 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.260 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.261 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.261 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-09-12T17:07:56.261 INFO:teuthology.orchestra.run.smithi047.stdout: ] 2024-09-12T17:07:56.261 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-09-12T17:07:56.357 INFO:teuthology.orchestra.run.smithi017.stderr:noscrub is unset 2024-09-12T17:07:56.382 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T17:07:57.358 INFO:teuthology.orchestra.run.smithi017.stderr:nodeep-scrub is unset 2024-09-12T17:08:16.118 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-12T17:08:16.119 INFO:tasks.thrashosds.thrasher:Adding osd 1 2024-09-12T17:08:16.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 1 2024-09-12T17:08:16.453 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-09-12T17:08:16.447+0000 7fd39ca3b640 -1 mon.a@0(leader).osd e86 definitely_dead 0 2024-09-12T17:08:17.423 INFO:teuthology.orchestra.run.smithi017.stderr:marked in osd.1. 2024-09-12T17:08:17.464 INFO:tasks.thrashosds.thrasher:Added osd 1 2024-09-12T17:08:17.464 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T17:08:17.604 INFO:teuthology.orchestra.run.smithi017.stdout:mon.a: {} 2024-09-12T17:08:17.604 INFO:teuthology.orchestra.run.smithi017.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T17:08:17.617 INFO:teuthology.orchestra.run.smithi017.stdout:mon.b: {} 2024-09-12T17:08:17.618 INFO:teuthology.orchestra.run.smithi017.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T17:08:17.628 INFO:teuthology.orchestra.run.smithi017.stdout:mon.c: {} 2024-09-12T17:08:17.628 INFO:teuthology.orchestra.run.smithi017.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T17:08:17.646 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T17:08:18.422 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T17:08:18.482 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T17:08:19.431 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T17:08:19.466 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T17:08:20.451 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T17:08:20.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T17:08:21.437 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T17:08:21.480 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T17:08:22.469 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T17:08:22.496 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T17:08:23.478 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T17:08:23.506 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-12T17:08:24.484 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.3 to 1 (10000) 2024-09-12T17:08:24.513 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-12T17:08:25.497 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-12T17:08:25.528 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-12T17:08:26.520 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.4 to 1 (10000) 2024-09-12T17:08:26.546 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-12T17:08:27.522 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-12T17:08:27.555 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-12T17:08:28.542 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.5 to 1 (10000) 2024-09-12T17:08:28.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-12T17:08:29.544 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-12T17:08:29.574 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-12T17:08:30.559 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.6 to 1 (10000) 2024-09-12T17:08:30.589 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-12T17:08:31.589 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-12T17:08:31.616 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-12T17:08:32.590 INFO:teuthology.orchestra.run.smithi017.stderr:reweighted osd.7 to 1 (10000) 2024-09-12T17:08:32.615 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-12T17:08:33.604 INFO:teuthology.orchestra.run.smithi017.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-12T17:08:33.631 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T17:08:33.632 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T17:08:33.632 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T17:08:33.632 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T17:08:33.632 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T17:08:33.632 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:08:33.943 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:08:33.944 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":103,"fsid":"505f0ddb-af61-4cad-802f-747b5bdb41a8","created":"2024-09-12T17:05:20.776084+0000","modified":"2024-09-12T17:08:33.592782+0000","last_up_change":"2024-09-12T17:05:32.139689+0000","last_in_change":"2024-09-12T17:08:17.404564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:05:33.945154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:05:39.084260+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:05:45.863238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:05:47.870247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:05:49.759077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:05:51.664893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:05:53.564403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:05:55.697439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf0f0496-2732-4649-9792-6f2117afe076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6817","nonce":2182669987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6819","nonce":2182669987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6823","nonce":2182669987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6821","nonce":2182669987}]},"public_addr":"172.21.15.17:6817/2182669987","cluster_addr":"172.21.15.17:6819/2182669987","heartbeat_back_addr":"172.21.15.17:6823/2182669987","heartbeat_front_addr":"172.21.15.17:6821/2182669987","state":["exists","up"]},{"osd":1,"uuid":"931ecda0-1894-411b-a2f8-843472ad493c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6825","nonce":3677250778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6827","nonce":3677250778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6831","nonce":3677250778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6829","nonce":3677250778}]},"public_addr":"172.21.15.17:6825/3677250778","cluster_addr":"172.21.15.17:6827/3677250778","heartbeat_back_addr":"172.21.15.17:6831/3677250778","heartbeat_front_addr":"172.21.15.17:6829/3677250778","state":["exists","up"]},{"osd":2,"uuid":"e1cc4a34-80dd-42e2-afb1-babce54de8cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6801","nonce":2449755532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6803","nonce":2449755532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6807","nonce":2449755532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6805","nonce":2449755532}]},"public_addr":"172.21.15.17:6801/2449755532","cluster_addr":"172.21.15.17:6803/2449755532","heartbeat_back_addr":"172.21.15.17:6807/2449755532","heartbeat_front_addr":"172.21.15.17:6805/2449755532","state":["exists","up"]},{"osd":3,"uuid":"48424313-1b8e-41ba-b322-d37b813552da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6809","nonce":1410973648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6811","nonce":1410973648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6815","nonce":1410973648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6813","nonce":1410973648}]},"public_addr":"172.21.15.17:6809/1410973648","cluster_addr":"172.21.15.17:6811/1410973648","heartbeat_back_addr":"172.21.15.17:6815/1410973648","heartbeat_front_addr":"172.21.15.17:6813/1410973648","state":["exists","up"]},{"osd":4,"uuid":"ba035b82-db0e-4e9a-a45e-fd111aebaea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6825","nonce":3279960414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6827","nonce":3279960414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6831","nonce":3279960414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6829","nonce":3279960414}]},"public_addr":"172.21.15.47:6825/3279960414","cluster_addr":"172.21.15.47:6827/3279960414","heartbeat_back_addr":"172.21.15.47:6831/3279960414","heartbeat_front_addr":"172.21.15.47:6829/3279960414","state":["exists","up"]},{"osd":5,"uuid":"3bad8071-4d77-4ec3-a85f-9648cb1d9c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6801","nonce":2093714552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6803","nonce":2093714552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6807","nonce":2093714552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6805","nonce":2093714552}]},"public_addr":"172.21.15.47:6801/2093714552","cluster_addr":"172.21.15.47:6803/2093714552","heartbeat_back_addr":"172.21.15.47:6807/2093714552","heartbeat_front_addr":"172.21.15.47:6805/2093714552","state":["exists","up"]},{"osd":6,"uuid":"cef01590-aa71-4356-bd81-0629172de3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6817","nonce":2759913072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6819","nonce":2759913072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6823","nonce":2759913072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6821","nonce":2759913072}]},"public_addr":"172.21.15.47:6817/2759913072","cluster_addr":"172.21.15.47:6819/2759913072","heartbeat_back_addr":"172.21.15.47:6823/2759913072","heartbeat_front_addr":"172.21.15.47:6821/2759913072","state":["exists","up"]},{"osd":7,"uuid":"39b07acd-56a6-47ad-86ec-cb330c7647b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6809","nonce":1836347584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6811","nonce":1836347584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6815","nonce":1836347584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6813","nonce":1836347584}]},"public_addr":"172.21.15.47:6809/1836347584","cluster_addr":"172.21.15.47:6811/1836347584","heartbeat_back_addr":"172.21.15.47:6815/1836347584","heartbeat_front_addr":"172.21.15.47:6813/1836347584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.587047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:30.238668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.152914+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.921710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:30.271565+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.589211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.997198+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.558519+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":5}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:08:33.963 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T17:08:33.963 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:08:34.270 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:08:34.270 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":103,"fsid":"505f0ddb-af61-4cad-802f-747b5bdb41a8","created":"2024-09-12T17:05:20.776084+0000","modified":"2024-09-12T17:08:33.592782+0000","last_up_change":"2024-09-12T17:05:32.139689+0000","last_in_change":"2024-09-12T17:08:17.404564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:05:33.945154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:05:39.084260+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:05:45.863238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:05:47.870247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:05:49.759077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:05:51.664893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:05:53.564403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:05:55.697439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf0f0496-2732-4649-9792-6f2117afe076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6817","nonce":2182669987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6819","nonce":2182669987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6823","nonce":2182669987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6821","nonce":2182669987}]},"public_addr":"172.21.15.17:6817/2182669987","cluster_addr":"172.21.15.17:6819/2182669987","heartbeat_back_addr":"172.21.15.17:6823/2182669987","heartbeat_front_addr":"172.21.15.17:6821/2182669987","state":["exists","up"]},{"osd":1,"uuid":"931ecda0-1894-411b-a2f8-843472ad493c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6825","nonce":3677250778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6827","nonce":3677250778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6831","nonce":3677250778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6829","nonce":3677250778}]},"public_addr":"172.21.15.17:6825/3677250778","cluster_addr":"172.21.15.17:6827/3677250778","heartbeat_back_addr":"172.21.15.17:6831/3677250778","heartbeat_front_addr":"172.21.15.17:6829/3677250778","state":["exists","up"]},{"osd":2,"uuid":"e1cc4a34-80dd-42e2-afb1-babce54de8cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6801","nonce":2449755532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6803","nonce":2449755532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6807","nonce":2449755532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6805","nonce":2449755532}]},"public_addr":"172.21.15.17:6801/2449755532","cluster_addr":"172.21.15.17:6803/2449755532","heartbeat_back_addr":"172.21.15.17:6807/2449755532","heartbeat_front_addr":"172.21.15.17:6805/2449755532","state":["exists","up"]},{"osd":3,"uuid":"48424313-1b8e-41ba-b322-d37b813552da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6809","nonce":1410973648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6811","nonce":1410973648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6815","nonce":1410973648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6813","nonce":1410973648}]},"public_addr":"172.21.15.17:6809/1410973648","cluster_addr":"172.21.15.17:6811/1410973648","heartbeat_back_addr":"172.21.15.17:6815/1410973648","heartbeat_front_addr":"172.21.15.17:6813/1410973648","state":["exists","up"]},{"osd":4,"uuid":"ba035b82-db0e-4e9a-a45e-fd111aebaea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6825","nonce":3279960414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6827","nonce":3279960414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6831","nonce":3279960414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6829","nonce":3279960414}]},"public_addr":"172.21.15.47:6825/3279960414","cluster_addr":"172.21.15.47:6827/3279960414","heartbeat_back_addr":"172.21.15.47:6831/3279960414","heartbeat_front_addr":"172.21.15.47:6829/3279960414","state":["exists","up"]},{"osd":5,"uuid":"3bad8071-4d77-4ec3-a85f-9648cb1d9c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6801","nonce":2093714552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6803","nonce":2093714552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6807","nonce":2093714552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6805","nonce":2093714552}]},"public_addr":"172.21.15.47:6801/2093714552","cluster_addr":"172.21.15.47:6803/2093714552","heartbeat_back_addr":"172.21.15.47:6807/2093714552","heartbeat_front_addr":"172.21.15.47:6805/2093714552","state":["exists","up"]},{"osd":6,"uuid":"cef01590-aa71-4356-bd81-0629172de3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6817","nonce":2759913072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6819","nonce":2759913072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6823","nonce":2759913072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6821","nonce":2759913072}]},"public_addr":"172.21.15.47:6817/2759913072","cluster_addr":"172.21.15.47:6819/2759913072","heartbeat_back_addr":"172.21.15.47:6823/2759913072","heartbeat_front_addr":"172.21.15.47:6821/2759913072","state":["exists","up"]},{"osd":7,"uuid":"39b07acd-56a6-47ad-86ec-cb330c7647b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6809","nonce":1836347584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6811","nonce":1836347584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6815","nonce":1836347584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6813","nonce":1836347584}]},"public_addr":"172.21.15.47:6809/1836347584","cluster_addr":"172.21.15.47:6811/1836347584","heartbeat_back_addr":"172.21.15.47:6815/1836347584","heartbeat_front_addr":"172.21.15.47:6813/1836347584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.587047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:30.238668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.152914+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.921710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:30.271565+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.589211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.997198+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.558519+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":5}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:08:34.291 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T17:08:34.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T17:08:34.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T17:08:34.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T17:08:34.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T17:08:34.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T17:08:34.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T17:08:34.294 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T17:08:34.562 INFO:teuthology.orchestra.run.smithi017.stdout:60129542185 2024-09-12T17:08:34.562 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:08:34.571 INFO:teuthology.orchestra.run.smithi017.stdout:60129542185 2024-09-12T17:08:34.572 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:08:34.573 INFO:teuthology.orchestra.run.smithi017.stdout:60129542185 2024-09-12T17:08:34.573 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:08:34.575 INFO:teuthology.orchestra.run.smithi017.stdout:60129542185 2024-09-12T17:08:34.575 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:08:34.577 INFO:teuthology.orchestra.run.smithi017.stdout:60129542184 2024-09-12T17:08:34.578 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:08:34.579 INFO:teuthology.orchestra.run.smithi017.stdout:60129542185 2024-09-12T17:08:34.579 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:08:34.585 INFO:teuthology.orchestra.run.smithi017.stdout:60129542184 2024-09-12T17:08:34.585 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:08:34.587 INFO:teuthology.orchestra.run.smithi017.stdout:60129542185 2024-09-12T17:08:34.587 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:08:35.091 INFO:teuthology.orchestra.run.smithi017.stdout:60129542184 2024-09-12T17:08:35.094 INFO:teuthology.orchestra.run.smithi017.stdout:60129542184 2024-09-12T17:08:35.102 INFO:teuthology.orchestra.run.smithi017.stdout:60129542184 2024-09-12T17:08:35.121 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542184 for osd.4 2024-09-12T17:08:35.135 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542184 for osd.3 2024-09-12T17:08:35.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542184 for osd.2 2024-09-12T17:08:35.143 INFO:teuthology.orchestra.run.smithi017.stdout:60129542184 2024-09-12T17:08:35.159 INFO:teuthology.orchestra.run.smithi017.stdout:60129542183 2024-09-12T17:08:35.161 INFO:teuthology.orchestra.run.smithi017.stdout:60129542183 2024-09-12T17:08:35.167 INFO:teuthology.orchestra.run.smithi017.stdout:60129542184 2024-09-12T17:08:35.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542184 for osd.0 2024-09-12T17:08:35.178 INFO:teuthology.orchestra.run.smithi017.stdout:60129542184 2024-09-12T17:08:35.183 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542183 for osd.1 2024-09-12T17:08:35.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542183 for osd.7 2024-09-12T17:08:35.190 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542184 for osd.6 2024-09-12T17:08:35.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542184 for osd.5 2024-09-12T17:08:36.122 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T17:08:36.136 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T17:08:36.140 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T17:08:36.171 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T17:08:36.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T17:08:36.187 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T17:08:36.191 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T17:08:36.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T17:08:36.667 INFO:teuthology.orchestra.run.smithi017.stdout:60129542185 2024-09-12T17:08:36.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542185 for osd.4 2024-09-12T17:08:36.691 DEBUG:teuthology.parallel:result is None 2024-09-12T17:08:36.716 INFO:teuthology.orchestra.run.smithi017.stdout:60129542185 2024-09-12T17:08:36.722 INFO:teuthology.orchestra.run.smithi017.stdout:60129542185 2024-09-12T17:08:36.724 INFO:teuthology.orchestra.run.smithi017.stdout:60129542184 2024-09-12T17:08:36.748 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542184 for osd.1 2024-09-12T17:08:36.748 DEBUG:teuthology.parallel:result is None 2024-09-12T17:08:36.749 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542185 for osd.2 2024-09-12T17:08:36.749 DEBUG:teuthology.parallel:result is None 2024-09-12T17:08:36.751 INFO:teuthology.orchestra.run.smithi017.stdout:60129542185 2024-09-12T17:08:36.755 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542185 for osd.3 2024-09-12T17:08:36.755 DEBUG:teuthology.parallel:result is None 2024-09-12T17:08:36.757 INFO:teuthology.orchestra.run.smithi017.stdout:60129542185 2024-09-12T17:08:36.770 INFO:teuthology.orchestra.run.smithi017.stdout:60129542185 2024-09-12T17:08:36.779 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542185 for osd.5 2024-09-12T17:08:36.779 DEBUG:teuthology.parallel:result is None 2024-09-12T17:08:36.781 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542185 for osd.0 2024-09-12T17:08:36.781 DEBUG:teuthology.parallel:result is None 2024-09-12T17:08:36.789 INFO:teuthology.orchestra.run.smithi017.stdout:60129542184 2024-09-12T17:08:36.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542185 got 60129542185 for osd.6 2024-09-12T17:08:36.790 DEBUG:teuthology.parallel:result is None 2024-09-12T17:08:36.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542184 got 60129542184 for osd.7 2024-09-12T17:08:36.807 DEBUG:teuthology.parallel:result is None 2024-09-12T17:08:36.807 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T17:08:36.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:08:37.176 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:08:37.182 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:08:37.193 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-09-12T17:08:35.976637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636609489,"num_objects":638,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":638,"num_whiteouts":0,"num_read":4036,"num_read_kb":2034452,"num_write":3052,"num_write_kb":2050296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":241214307,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3489000,"kb_used_data":3206192,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":751485720,"statfs":{"total":773094113280,"available":769521377280,"internally_reserved":0,"allocated":3283140608,"data_stored":3278556364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-5,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.416225"},"pg_stats":[{"pgid":"3.3f","version":"84'19","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607887+0000","last_change":"2024-09-12T17:05:47.561581+0000","last_active":"2024-09-12T17:08:33.607887+0000","last_peered":"2024-09-12T17:08:33.607887+0000","last_clean":"2024-09-12T17:08:33.607887+0000","last_became_active":"2024-09-12T17:05:47.560791+0000","last_became_peered":"2024-09-12T17:05:47.560791+0000","last_unstale":"2024-09-12T17:08:33.607887+0000","last_undegraded":"2024-09-12T17:08:33.607887+0000","last_fullsized":"2024-09-12T17:08:33.607887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:23.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":35,"num_read_kb":57356,"num_write":51,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"84'44","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602148+0000","last_change":"2024-09-12T17:05:49.558060+0000","last_active":"2024-09-12T17:08:33.602148+0000","last_peered":"2024-09-12T17:08:33.602148+0000","last_clean":"2024-09-12T17:08:33.602148+0000","last_became_active":"2024-09-12T17:05:49.557287+0000","last_became_peered":"2024-09-12T17:05:49.557287+0000","last_unstale":"2024-09-12T17:08:33.602148+0000","last_undegraded":"2024-09-12T17:08:33.602148+0000","last_fullsized":"2024-09-12T17:08:33.602148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":132,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"71'3","reported_seq":40,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.945479+0000","last_change":"2024-09-12T17:08:21.529824+0000","last_active":"2024-09-12T17:08:32.945479+0000","last_peered":"2024-09-12T17:08:32.945479+0000","last_clean":"2024-09-12T17:08:32.945479+0000","last_became_active":"2024-09-12T17:08:21.462766+0000","last_became_peered":"2024-09-12T17:08:21.462766+0000","last_unstale":"2024-09-12T17:08:32.945479+0000","last_undegraded":"2024-09-12T17:08:32.945479+0000","last_fullsized":"2024-09-12T17:08:32.945479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:47.442324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605094+0000","last_change":"2024-09-12T17:08:18.454422+0000","last_active":"2024-09-12T17:08:33.605094+0000","last_peered":"2024-09-12T17:08:33.605094+0000","last_clean":"2024-09-12T17:08:33.605094+0000","last_became_active":"2024-09-12T17:08:18.442986+0000","last_became_peered":"2024-09-12T17:08:18.442986+0000","last_unstale":"2024-09-12T17:08:33.605094+0000","last_undegraded":"2024-09-12T17:08:33.605094+0000","last_fullsized":"2024-09-12T17:08:33.605094+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:26.720649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"84'15","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603748+0000","last_change":"2024-09-12T17:05:47.523052+0000","last_active":"2024-09-12T17:08:33.603748+0000","last_peered":"2024-09-12T17:08:33.603748+0000","last_clean":"2024-09-12T17:08:33.603748+0000","last_became_active":"2024-09-12T17:05:47.522544+0000","last_became_peered":"2024-09-12T17:05:47.522544+0000","last_unstale":"2024-09-12T17:08:33.603748+0000","last_undegraded":"2024-09-12T17:08:33.603748+0000","last_fullsized":"2024-09-12T17:08:33.603748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":38921,"num_write":39,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"84'34","reported_seq":199,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589439+0000","last_change":"2024-09-12T17:05:49.549990+0000","last_active":"2024-09-12T17:08:32.589439+0000","last_peered":"2024-09-12T17:08:32.589439+0000","last_clean":"2024-09-12T17:08:32.589439+0000","last_became_active":"2024-09-12T17:05:49.549241+0000","last_became_peered":"2024-09-12T17:05:49.549241+0000","last_unstale":"2024-09-12T17:08:32.589439+0000","last_undegraded":"2024-09-12T17:08:32.589439+0000","last_fullsized":"2024-09-12T17:08:32.589439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.601256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"84'12","reported_seq":148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938452+0000","last_change":"2024-09-12T17:06:27.748679+0000","last_active":"2024-09-12T17:08:32.938452+0000","last_peered":"2024-09-12T17:08:32.938452+0000","last_clean":"2024-09-12T17:08:32.938452+0000","last_became_active":"2024-09-12T17:06:27.748390+0000","last_became_peered":"2024-09-12T17:06:27.748390+0000","last_unstale":"2024-09-12T17:08:32.938452+0000","last_undegraded":"2024-09-12T17:08:32.938452+0000","last_fullsized":"2024-09-12T17:08:32.938452+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:58.547350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":30732,"num_write":44,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602063+0000","last_change":"2024-09-12T17:05:49.542142+0000","last_active":"2024-09-12T17:08:33.602063+0000","last_peered":"2024-09-12T17:08:33.602063+0000","last_clean":"2024-09-12T17:08:33.602063+0000","last_became_active":"2024-09-12T17:05:49.541354+0000","last_became_peered":"2024-09-12T17:05:49.541354+0000","last_unstale":"2024-09-12T17:08:33.602063+0000","last_undegraded":"2024-09-12T17:08:33.602063+0000","last_fullsized":"2024-09-12T17:08:33.602063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.147865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"84'8","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606019+0000","last_change":"2024-09-12T17:05:47.556154+0000","last_active":"2024-09-12T17:08:33.606019+0000","last_peered":"2024-09-12T17:08:33.606019+0000","last_clean":"2024-09-12T17:08:33.606019+0000","last_became_active":"2024-09-12T17:05:47.555396+0000","last_became_peered":"2024-09-12T17:05:47.555396+0000","last_unstale":"2024-09-12T17:08:33.606019+0000","last_undegraded":"2024-09-12T17:08:33.606019+0000","last_fullsized":"2024-09-12T17:08:33.606019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:27.784208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941104+0000","last_change":"2024-09-12T17:05:49.529344+0000","last_active":"2024-09-12T17:08:32.941104+0000","last_peered":"2024-09-12T17:08:32.941104+0000","last_clean":"2024-09-12T17:08:32.941104+0000","last_became_active":"2024-09-12T17:05:49.528184+0000","last_became_peered":"2024-09-12T17:05:49.528184+0000","last_unstale":"2024-09-12T17:08:32.941104+0000","last_undegraded":"2024-09-12T17:08:32.941104+0000","last_fullsized":"2024-09-12T17:08:32.941104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:18.357328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"84'11","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603007+0000","last_change":"2024-09-12T17:05:47.532931+0000","last_active":"2024-09-12T17:08:33.603007+0000","last_peered":"2024-09-12T17:08:33.603007+0000","last_clean":"2024-09-12T17:08:33.603007+0000","last_became_active":"2024-09-12T17:05:47.531427+0000","last_became_peered":"2024-09-12T17:05:47.531427+0000","last_unstale":"2024-09-12T17:08:33.603007+0000","last_undegraded":"2024-09-12T17:08:33.603007+0000","last_fullsized":"2024-09-12T17:08:33.603007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588848+0000","last_change":"2024-09-12T17:05:49.550694+0000","last_active":"2024-09-12T17:08:32.588848+0000","last_peered":"2024-09-12T17:08:32.588848+0000","last_clean":"2024-09-12T17:08:32.588848+0000","last_became_active":"2024-09-12T17:05:49.549066+0000","last_became_peered":"2024-09-12T17:05:49.549066+0000","last_unstale":"2024-09-12T17:08:32.588848+0000","last_undegraded":"2024-09-12T17:08:32.588848+0000","last_fullsized":"2024-09-12T17:08:32.588848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:24.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"84'7","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605517+0000","last_change":"2024-09-12T17:05:47.560085+0000","last_active":"2024-09-12T17:08:33.605517+0000","last_peered":"2024-09-12T17:08:33.605517+0000","last_clean":"2024-09-12T17:08:33.605517+0000","last_became_active":"2024-09-12T17:05:47.559160+0000","last_became_peered":"2024-09-12T17:05:47.559160+0000","last_unstale":"2024-09-12T17:08:33.605517+0000","last_undegraded":"2024-09-12T17:08:33.605517+0000","last_fullsized":"2024-09-12T17:08:33.605517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:06.664677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'2","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604685+0000","last_change":"2024-09-12T17:08:18.490456+0000","last_active":"2024-09-12T17:08:33.604685+0000","last_peered":"2024-09-12T17:08:33.604685+0000","last_clean":"2024-09-12T17:08:33.604685+0000","last_became_active":"2024-09-12T17:08:18.471124+0000","last_became_peered":"2024-09-12T17:08:18.471124+0000","last_unstale":"2024-09-12T17:08:33.604685+0000","last_undegraded":"2024-09-12T17:08:33.604685+0000","last_fullsized":"2024-09-12T17:08:33.604685+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.772819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"84'10","reported_seq":143,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936168+0000","last_change":"2024-09-12T17:06:27.748750+0000","last_active":"2024-09-12T17:08:32.936168+0000","last_peered":"2024-09-12T17:08:32.936168+0000","last_clean":"2024-09-12T17:08:32.936168+0000","last_became_active":"2024-09-12T17:06:27.748329+0000","last_became_peered":"2024-09-12T17:06:27.748329+0000","last_unstale":"2024-09-12T17:08:32.936168+0000","last_undegraded":"2024-09-12T17:08:32.936168+0000","last_fullsized":"2024-09-12T17:08:32.936168+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:26.773943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26633,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938254+0000","last_change":"2024-09-12T17:07:28.190678+0000","last_active":"2024-09-12T17:08:32.938254+0000","last_peered":"2024-09-12T17:08:32.938254+0000","last_clean":"2024-09-12T17:08:32.938254+0000","last_became_active":"2024-09-12T17:07:28.190245+0000","last_became_peered":"2024-09-12T17:07:28.190245+0000","last_unstale":"2024-09-12T17:08:32.938254+0000","last_undegraded":"2024-09-12T17:08:32.938254+0000","last_fullsized":"2024-09-12T17:08:32.938254+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:04.220150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586445+0000","last_change":"2024-09-12T17:05:49.549575+0000","last_active":"2024-09-12T17:08:32.586445+0000","last_peered":"2024-09-12T17:08:32.586445+0000","last_clean":"2024-09-12T17:08:32.586445+0000","last_became_active":"2024-09-12T17:05:49.548292+0000","last_became_peered":"2024-09-12T17:05:49.548292+0000","last_unstale":"2024-09-12T17:08:32.586445+0000","last_undegraded":"2024-09-12T17:08:32.586445+0000","last_fullsized":"2024-09-12T17:08:32.586445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"84'6","reported_seq":30,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940291+0000","last_change":"2024-09-12T17:08:28.649055+0000","last_active":"2024-09-12T17:08:32.940291+0000","last_peered":"2024-09-12T17:08:32.940291+0000","last_clean":"2024-09-12T17:08:32.940291+0000","last_became_active":"2024-09-12T17:08:28.568157+0000","last_became_peered":"2024-09-12T17:08:28.568157+0000","last_unstale":"2024-09-12T17:08:32.940291+0000","last_undegraded":"2024-09-12T17:08:32.940291+0000","last_fullsized":"2024-09-12T17:08:32.940291+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:11.023137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":18434,"num_write":14,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605305+0000","last_change":"2024-09-12T17:08:18.455416+0000","last_active":"2024-09-12T17:08:33.605305+0000","last_peered":"2024-09-12T17:08:33.605305+0000","last_clean":"2024-09-12T17:08:33.605305+0000","last_became_active":"2024-09-12T17:08:18.454062+0000","last_became_peered":"2024-09-12T17:08:18.454062+0000","last_unstale":"2024-09-12T17:08:33.605305+0000","last_undegraded":"2024-09-12T17:08:33.605305+0000","last_fullsized":"2024-09-12T17:08:33.605305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:38.260106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'13","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942226+0000","last_change":"2024-09-12T17:05:47.528338+0000","last_active":"2024-09-12T17:08:32.942226+0000","last_peered":"2024-09-12T17:08:32.942226+0000","last_clean":"2024-09-12T17:08:32.942226+0000","last_became_active":"2024-09-12T17:05:47.527533+0000","last_became_peered":"2024-09-12T17:05:47.527533+0000","last_unstale":"2024-09-12T17:08:32.942226+0000","last_undegraded":"2024-09-12T17:08:32.942226+0000","last_fullsized":"2024-09-12T17:08:32.942226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.693731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":34828,"num_write":45,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"84'30","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603444+0000","last_change":"2024-09-12T17:05:49.543097+0000","last_active":"2024-09-12T17:08:33.603444+0000","last_peered":"2024-09-12T17:08:33.603444+0000","last_clean":"2024-09-12T17:08:33.603444+0000","last_became_active":"2024-09-12T17:05:49.542113+0000","last_became_peered":"2024-09-12T17:05:49.542113+0000","last_unstale":"2024-09-12T17:08:33.603444+0000","last_undegraded":"2024-09-12T17:08:33.603444+0000","last_fullsized":"2024-09-12T17:08:33.603444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":90,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"83'13","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942024+0000","last_change":"2024-09-12T17:05:47.529868+0000","last_active":"2024-09-12T17:08:32.942024+0000","last_peered":"2024-09-12T17:08:32.942024+0000","last_clean":"2024-09-12T17:08:32.942024+0000","last_became_active":"2024-09-12T17:05:47.529083+0000","last_became_peered":"2024-09-12T17:05:47.529083+0000","last_unstale":"2024-09-12T17:08:32.942024+0000","last_undegraded":"2024-09-12T17:08:32.942024+0000","last_fullsized":"2024-09-12T17:08:32.942024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:16.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":40969,"num_write":37,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938860+0000","last_change":"2024-09-12T17:05:49.548084+0000","last_active":"2024-09-12T17:08:32.938860+0000","last_peered":"2024-09-12T17:08:32.938860+0000","last_clean":"2024-09-12T17:08:32.938860+0000","last_became_active":"2024-09-12T17:05:49.539930+0000","last_became_peered":"2024-09-12T17:05:49.539930+0000","last_unstale":"2024-09-12T17:08:32.938860+0000","last_undegraded":"2024-09-12T17:08:32.938860+0000","last_fullsized":"2024-09-12T17:08:32.938860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:11.453390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587178+0000","last_change":"2024-09-12T17:05:47.548316+0000","last_active":"2024-09-12T17:08:32.587178+0000","last_peered":"2024-09-12T17:08:32.587178+0000","last_clean":"2024-09-12T17:08:32.587178+0000","last_became_active":"2024-09-12T17:05:47.547430+0000","last_became_peered":"2024-09-12T17:05:47.547430+0000","last_unstale":"2024-09-12T17:08:32.587178+0000","last_undegraded":"2024-09-12T17:08:32.587178+0000","last_fullsized":"2024-09-12T17:08:32.587178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:21.143073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938230+0000","last_change":"2024-09-12T17:05:49.556144+0000","last_active":"2024-09-12T17:08:32.938230+0000","last_peered":"2024-09-12T17:08:32.938230+0000","last_clean":"2024-09-12T17:08:32.938230+0000","last_became_active":"2024-09-12T17:05:49.555033+0000","last_became_peered":"2024-09-12T17:05:49.555033+0000","last_unstale":"2024-09-12T17:08:32.938230+0000","last_undegraded":"2024-09-12T17:08:32.938230+0000","last_fullsized":"2024-09-12T17:08:32.938230+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:08.056726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":186,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587374+0000","last_change":"2024-09-12T17:05:47.511375+0000","last_active":"2024-09-12T17:08:32.587374+0000","last_peered":"2024-09-12T17:08:32.587374+0000","last_clean":"2024-09-12T17:08:32.587374+0000","last_became_active":"2024-09-12T17:05:47.510364+0000","last_became_peered":"2024-09-12T17:05:47.510364+0000","last_unstale":"2024-09-12T17:08:32.587374+0000","last_undegraded":"2024-09-12T17:08:32.587374+0000","last_fullsized":"2024-09-12T17:08:32.587374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":38912,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588969+0000","last_change":"2024-09-12T17:08:18.448181+0000","last_active":"2024-09-12T17:08:32.588969+0000","last_peered":"2024-09-12T17:08:32.588969+0000","last_clean":"2024-09-12T17:08:32.588969+0000","last_became_active":"2024-09-12T17:08:18.447353+0000","last_became_peered":"2024-09-12T17:08:18.447353+0000","last_unstale":"2024-09-12T17:08:32.588969+0000","last_undegraded":"2024-09-12T17:08:32.588969+0000","last_fullsized":"2024-09-12T17:08:32.588969+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:07.836287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"83'5","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601601+0000","last_change":"2024-09-12T17:08:18.831302+0000","last_active":"2024-09-12T17:08:33.601601+0000","last_peered":"2024-09-12T17:08:33.601601+0000","last_clean":"2024-09-12T17:08:33.601601+0000","last_became_active":"2024-09-12T17:08:18.467826+0000","last_became_peered":"2024-09-12T17:08:18.467826+0000","last_unstale":"2024-09-12T17:08:33.601601+0000","last_undegraded":"2024-09-12T17:08:33.601601+0000","last_fullsized":"2024-09-12T17:08:33.601601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:24.964574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14339,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10485760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"84'2","reported_seq":148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585952+0000","last_change":"2024-09-12T17:05:57.588515+0000","last_active":"2024-09-12T17:08:32.585952+0000","last_peered":"2024-09-12T17:08:32.585952+0000","last_clean":"2024-09-12T17:08:32.585952+0000","last_became_active":"2024-09-12T17:05:57.587891+0000","last_became_peered":"2024-09-12T17:05:57.587891+0000","last_unstale":"2024-09-12T17:08:32.585952+0000","last_undegraded":"2024-09-12T17:08:32.585952+0000","last_fullsized":"2024-09-12T17:08:32.585952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:24.257847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588921+0000","last_change":"2024-09-12T17:08:21.457874+0000","last_active":"2024-09-12T17:08:32.588921+0000","last_peered":"2024-09-12T17:08:32.588921+0000","last_clean":"2024-09-12T17:08:32.588921+0000","last_became_active":"2024-09-12T17:08:21.457526+0000","last_became_peered":"2024-09-12T17:08:21.457526+0000","last_unstale":"2024-09-12T17:08:32.588921+0000","last_undegraded":"2024-09-12T17:08:32.588921+0000","last_fullsized":"2024-09-12T17:08:32.588921+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:37.646866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"84'13","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604660+0000","last_change":"2024-09-12T17:05:47.557687+0000","last_active":"2024-09-12T17:08:33.604660+0000","last_peered":"2024-09-12T17:08:33.604660+0000","last_clean":"2024-09-12T17:08:33.604660+0000","last_became_active":"2024-09-12T17:05:47.556980+0000","last_became_peered":"2024-09-12T17:05:47.556980+0000","last_unstale":"2024-09-12T17:08:33.604660+0000","last_undegraded":"2024-09-12T17:08:33.604660+0000","last_fullsized":"2024-09-12T17:08:33.604660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.891909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38921,"num_write":37,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606120+0000","last_change":"2024-09-12T17:08:18.472276+0000","last_active":"2024-09-12T17:08:33.606120+0000","last_peered":"2024-09-12T17:08:33.606120+0000","last_clean":"2024-09-12T17:08:33.606120+0000","last_became_active":"2024-09-12T17:08:18.471264+0000","last_became_peered":"2024-09-12T17:08:18.471264+0000","last_unstale":"2024-09-12T17:08:33.606120+0000","last_undegraded":"2024-09-12T17:08:33.606120+0000","last_fullsized":"2024-09-12T17:08:33.606120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:10.434396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"84'14","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602673+0000","last_change":"2024-09-12T17:05:53.537592+0000","last_active":"2024-09-12T17:08:33.602673+0000","last_peered":"2024-09-12T17:08:33.602673+0000","last_clean":"2024-09-12T17:08:33.602673+0000","last_became_active":"2024-09-12T17:05:53.536921+0000","last_became_peered":"2024-09-12T17:05:53.536921+0000","last_unstale":"2024-09-12T17:08:33.602673+0000","last_undegraded":"2024-09-12T17:08:33.602673+0000","last_fullsized":"2024-09-12T17:08:33.602673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:25.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607496+0000","last_change":"2024-09-12T17:05:55.559431+0000","last_active":"2024-09-12T17:08:33.607496+0000","last_peered":"2024-09-12T17:08:33.607496+0000","last_clean":"2024-09-12T17:08:33.607496+0000","last_became_active":"2024-09-12T17:05:55.558297+0000","last_became_peered":"2024-09-12T17:05:55.558297+0000","last_unstale":"2024-09-12T17:08:33.607496+0000","last_undegraded":"2024-09-12T17:08:33.607496+0000","last_fullsized":"2024-09-12T17:08:33.607496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"84'4","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601882+0000","last_change":"2024-09-12T17:05:57.592599+0000","last_active":"2024-09-12T17:08:33.601882+0000","last_peered":"2024-09-12T17:08:33.601882+0000","last_clean":"2024-09-12T17:08:33.601882+0000","last_became_active":"2024-09-12T17:05:57.591877+0000","last_became_peered":"2024-09-12T17:05:57.591877+0000","last_unstale":"2024-09-12T17:08:33.601882+0000","last_undegraded":"2024-09-12T17:08:33.601882+0000","last_fullsized":"2024-09-12T17:08:33.601882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:57.557525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"68'6","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605335+0000","last_change":"2024-09-12T17:05:49.546093+0000","last_active":"2024-09-12T17:08:33.605335+0000","last_peered":"2024-09-12T17:08:33.605335+0000","last_clean":"2024-09-12T17:08:33.605335+0000","last_became_active":"2024-09-12T17:05:49.544425+0000","last_became_peered":"2024-09-12T17:05:49.544425+0000","last_unstale":"2024-09-12T17:08:33.605335+0000","last_undegraded":"2024-09-12T17:08:33.605335+0000","last_fullsized":"2024-09-12T17:08:33.605335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.495950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"72'6","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601748+0000","last_change":"2024-09-12T17:05:47.535295+0000","last_active":"2024-09-12T17:08:33.601748+0000","last_peered":"2024-09-12T17:08:33.601748+0000","last_clean":"2024-09-12T17:08:33.601748+0000","last_became_active":"2024-09-12T17:05:47.534833+0000","last_became_peered":"2024-09-12T17:05:47.534833+0000","last_unstale":"2024-09-12T17:08:33.601748+0000","last_undegraded":"2024-09-12T17:08:33.601748+0000","last_fullsized":"2024-09-12T17:08:33.601748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589416+0000","last_change":"2024-09-12T17:05:51.533888+0000","last_active":"2024-09-12T17:08:32.589416+0000","last_peered":"2024-09-12T17:08:32.589416+0000","last_clean":"2024-09-12T17:08:32.589416+0000","last_became_active":"2024-09-12T17:05:51.533164+0000","last_became_peered":"2024-09-12T17:05:51.533164+0000","last_unstale":"2024-09-12T17:08:32.589416+0000","last_undegraded":"2024-09-12T17:08:32.589416+0000","last_fullsized":"2024-09-12T17:08:32.589416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:33.007858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.590259+0000","last_change":"2024-09-12T17:05:53.549534+0000","last_active":"2024-09-12T17:08:32.590259+0000","last_peered":"2024-09-12T17:08:32.590259+0000","last_clean":"2024-09-12T17:08:32.590259+0000","last_became_active":"2024-09-12T17:05:53.548824+0000","last_became_peered":"2024-09-12T17:05:53.548824+0000","last_unstale":"2024-09-12T17:08:32.590259+0000","last_undegraded":"2024-09-12T17:08:32.590259+0000","last_fullsized":"2024-09-12T17:08:32.590259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.765832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589324+0000","last_change":"2024-09-12T17:05:55.557468+0000","last_active":"2024-09-12T17:08:32.589324+0000","last_peered":"2024-09-12T17:08:32.589324+0000","last_clean":"2024-09-12T17:08:32.589324+0000","last_became_active":"2024-09-12T17:05:55.556689+0000","last_became_peered":"2024-09-12T17:05:55.556689+0000","last_unstale":"2024-09-12T17:08:32.589324+0000","last_undegraded":"2024-09-12T17:08:32.589324+0000","last_fullsized":"2024-09-12T17:08:32.589324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:56.879576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601144+0000","last_change":"2024-09-12T17:05:57.589569+0000","last_active":"2024-09-12T17:08:33.601144+0000","last_peered":"2024-09-12T17:08:33.601144+0000","last_clean":"2024-09-12T17:08:33.601144+0000","last_became_active":"2024-09-12T17:05:57.588649+0000","last_became_peered":"2024-09-12T17:05:57.588649+0000","last_unstale":"2024-09-12T17:08:33.601144+0000","last_undegraded":"2024-09-12T17:08:33.601144+0000","last_fullsized":"2024-09-12T17:08:33.601144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"68'10","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604412+0000","last_change":"2024-09-12T17:05:49.531436+0000","last_active":"2024-09-12T17:08:33.604412+0000","last_peered":"2024-09-12T17:08:33.604412+0000","last_clean":"2024-09-12T17:08:33.604412+0000","last_became_active":"2024-09-12T17:05:49.530687+0000","last_became_peered":"2024-09-12T17:05:49.530687+0000","last_unstale":"2024-09-12T17:08:33.604412+0000","last_undegraded":"2024-09-12T17:08:33.604412+0000","last_fullsized":"2024-09-12T17:08:33.604412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"83'12","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605777+0000","last_change":"2024-09-12T17:05:47.564709+0000","last_active":"2024-09-12T17:08:33.605777+0000","last_peered":"2024-09-12T17:08:33.605777+0000","last_clean":"2024-09-12T17:08:33.605777+0000","last_became_active":"2024-09-12T17:05:47.564189+0000","last_became_peered":"2024-09-12T17:05:47.564189+0000","last_unstale":"2024-09-12T17:08:33.605777+0000","last_undegraded":"2024-09-12T17:08:33.605777+0000","last_fullsized":"2024-09-12T17:08:33.605777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":34825,"num_write":36,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":170,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.592479+0000","last_change":"2024-09-12T17:08:18.465074+0000","last_active":"2024-09-12T17:08:32.592479+0000","last_peered":"2024-09-12T17:08:32.592479+0000","last_clean":"2024-09-12T17:08:32.592479+0000","last_became_active":"2024-09-12T17:08:18.464648+0000","last_became_peered":"2024-09-12T17:08:18.464648+0000","last_unstale":"2024-09-12T17:08:32.592479+0000","last_undegraded":"2024-09-12T17:08:32.592479+0000","last_fullsized":"2024-09-12T17:08:32.592479+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:04.122655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.937705+0000","last_change":"2024-09-12T17:05:53.549328+0000","last_active":"2024-09-12T17:08:32.937705+0000","last_peered":"2024-09-12T17:08:32.937705+0000","last_clean":"2024-09-12T17:08:32.937705+0000","last_became_active":"2024-09-12T17:05:53.548968+0000","last_became_peered":"2024-09-12T17:05:53.548968+0000","last_unstale":"2024-09-12T17:08:32.937705+0000","last_undegraded":"2024-09-12T17:08:32.937705+0000","last_fullsized":"2024-09-12T17:08:32.937705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:36.974950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"91'16","reported_seq":229,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606823+0000","last_change":"2024-09-12T17:08:21.488239+0000","last_active":"2024-09-12T17:08:33.606823+0000","last_peered":"2024-09-12T17:08:33.606823+0000","last_clean":"2024-09-12T17:08:33.606823+0000","last_became_active":"2024-09-12T17:08:21.464957+0000","last_became_peered":"2024-09-12T17:08:21.464957+0000","last_unstale":"2024-09-12T17:08:33.606823+0000","last_undegraded":"2024-09-12T17:08:33.606823+0000","last_fullsized":"2024-09-12T17:08:33.606823+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.266320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586739+0000","last_change":"2024-09-12T17:05:58.122522+0000","last_active":"2024-09-12T17:08:32.586739+0000","last_peered":"2024-09-12T17:08:32.586739+0000","last_clean":"2024-09-12T17:08:32.586739+0000","last_became_active":"2024-09-12T17:05:58.121871+0000","last_became_peered":"2024-09-12T17:05:58.121871+0000","last_unstale":"2024-09-12T17:08:32.586739+0000","last_undegraded":"2024-09-12T17:08:32.586739+0000","last_fullsized":"2024-09-12T17:08:32.586739+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:22.625236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.592100+0000","last_change":"2024-09-12T17:05:49.528766+0000","last_active":"2024-09-12T17:08:32.592100+0000","last_peered":"2024-09-12T17:08:32.592100+0000","last_clean":"2024-09-12T17:08:32.592100+0000","last_became_active":"2024-09-12T17:05:49.527758+0000","last_became_peered":"2024-09-12T17:05:49.527758+0000","last_unstale":"2024-09-12T17:08:32.592100+0000","last_undegraded":"2024-09-12T17:08:32.592100+0000","last_fullsized":"2024-09-12T17:08:32.592100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:06.399711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"84'15","reported_seq":196,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939316+0000","last_change":"2024-09-12T17:05:47.521727+0000","last_active":"2024-09-12T17:08:32.939316+0000","last_peered":"2024-09-12T17:08:32.939316+0000","last_clean":"2024-09-12T17:08:32.939316+0000","last_became_active":"2024-09-12T17:05:47.520943+0000","last_became_peered":"2024-09-12T17:05:47.520943+0000","last_unstale":"2024-09-12T17:08:32.939316+0000","last_undegraded":"2024-09-12T17:08:32.939316+0000","last_fullsized":"2024-09-12T17:08:32.939316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:24.772296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":19,"num_read_kb":51203,"num_write":23,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"29'1","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604412+0000","last_change":"2024-09-12T17:05:51.556202+0000","last_active":"2024-09-12T17:08:33.604412+0000","last_peered":"2024-09-12T17:08:33.604412+0000","last_clean":"2024-09-12T17:08:33.604412+0000","last_became_active":"2024-09-12T17:05:51.555420+0000","last_became_peered":"2024-09-12T17:05:51.555420+0000","last_unstale":"2024-09-12T17:08:33.604412+0000","last_undegraded":"2024-09-12T17:08:33.604412+0000","last_fullsized":"2024-09-12T17:08:33.604412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:56.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"84'13","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607150+0000","last_change":"2024-09-12T17:05:53.554159+0000","last_active":"2024-09-12T17:08:33.607150+0000","last_peered":"2024-09-12T17:08:33.607150+0000","last_clean":"2024-09-12T17:08:33.607150+0000","last_became_active":"2024-09-12T17:05:53.553333+0000","last_became_peered":"2024-09-12T17:05:53.553333+0000","last_unstale":"2024-09-12T17:08:33.607150+0000","last_undegraded":"2024-09-12T17:08:33.607150+0000","last_fullsized":"2024-09-12T17:08:33.607150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:53.266475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"84'14","reported_seq":196,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.590167+0000","last_change":"2024-09-12T17:05:55.556502+0000","last_active":"2024-09-12T17:08:32.590167+0000","last_peered":"2024-09-12T17:08:32.590167+0000","last_clean":"2024-09-12T17:08:32.590167+0000","last_became_active":"2024-09-12T17:05:55.555879+0000","last_became_peered":"2024-09-12T17:05:55.555879+0000","last_unstale":"2024-09-12T17:08:32.590167+0000","last_undegraded":"2024-09-12T17:08:32.590167+0000","last_fullsized":"2024-09-12T17:08:32.590167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:18.672296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602918+0000","last_change":"2024-09-12T17:05:49.553404+0000","last_active":"2024-09-12T17:08:33.602918+0000","last_peered":"2024-09-12T17:08:33.602918+0000","last_clean":"2024-09-12T17:08:33.602918+0000","last_became_active":"2024-09-12T17:05:49.552637+0000","last_became_peered":"2024-09-12T17:05:49.552637+0000","last_unstale":"2024-09-12T17:08:33.602918+0000","last_undegraded":"2024-09-12T17:08:33.602918+0000","last_fullsized":"2024-09-12T17:08:33.602918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607911+0000","last_change":"2024-09-12T17:05:47.562949+0000","last_active":"2024-09-12T17:08:33.607911+0000","last_peered":"2024-09-12T17:08:33.607911+0000","last_clean":"2024-09-12T17:08:33.607911+0000","last_became_active":"2024-09-12T17:05:47.562465+0000","last_became_peered":"2024-09-12T17:05:47.562465+0000","last_unstale":"2024-09-12T17:08:33.607911+0000","last_undegraded":"2024-09-12T17:08:33.607911+0000","last_fullsized":"2024-09-12T17:08:33.607911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24585,"num_write":33,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604488+0000","last_change":"2024-09-12T17:05:51.542349+0000","last_active":"2024-09-12T17:08:33.604488+0000","last_peered":"2024-09-12T17:08:33.604488+0000","last_clean":"2024-09-12T17:08:33.604488+0000","last_became_active":"2024-09-12T17:05:51.541205+0000","last_became_peered":"2024-09-12T17:05:51.541205+0000","last_unstale":"2024-09-12T17:08:33.604488+0000","last_undegraded":"2024-09-12T17:08:33.604488+0000","last_fullsized":"2024-09-12T17:08:33.604488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"84'28","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602256+0000","last_change":"2024-09-12T17:05:53.560400+0000","last_active":"2024-09-12T17:08:33.602256+0000","last_peered":"2024-09-12T17:08:33.602256+0000","last_clean":"2024-09-12T17:08:33.602256+0000","last_became_active":"2024-09-12T17:05:53.559463+0000","last_became_peered":"2024-09-12T17:05:53.559463+0000","last_unstale":"2024-09-12T17:08:33.602256+0000","last_undegraded":"2024-09-12T17:08:33.602256+0000","last_fullsized":"2024-09-12T17:08:33.602256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13033,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":46,"num_read_kb":53,"num_write":34,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940211+0000","last_change":"2024-09-12T17:08:21.463670+0000","last_active":"2024-09-12T17:08:32.940211+0000","last_peered":"2024-09-12T17:08:32.940211+0000","last_clean":"2024-09-12T17:08:32.940211+0000","last_became_active":"2024-09-12T17:08:21.463161+0000","last_became_peered":"2024-09-12T17:08:21.463161+0000","last_unstale":"2024-09-12T17:08:32.940211+0000","last_undegraded":"2024-09-12T17:08:32.940211+0000","last_fullsized":"2024-09-12T17:08:32.940211+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:03.162531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603071+0000","last_change":"2024-09-12T17:05:57.599403+0000","last_active":"2024-09-12T17:08:33.603071+0000","last_peered":"2024-09-12T17:08:33.603071+0000","last_clean":"2024-09-12T17:08:33.603071+0000","last_became_active":"2024-09-12T17:05:57.598703+0000","last_became_peered":"2024-09-12T17:05:57.598703+0000","last_unstale":"2024-09-12T17:08:33.603071+0000","last_undegraded":"2024-09-12T17:08:33.603071+0000","last_fullsized":"2024-09-12T17:08:33.603071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"84'34","reported_seq":215,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587344+0000","last_change":"2024-09-12T17:08:18.474573+0000","last_active":"2024-09-12T17:08:32.587344+0000","last_peered":"2024-09-12T17:08:32.587344+0000","last_clean":"2024-09-12T17:08:32.587344+0000","last_became_active":"2024-09-12T17:08:18.443808+0000","last_became_peered":"2024-09-12T17:08:18.443808+0000","last_unstale":"2024-09-12T17:08:32.587344+0000","last_undegraded":"2024-09-12T17:08:32.587344+0000","last_fullsized":"2024-09-12T17:08:32.587344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:01.200485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"83'8","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607832+0000","last_change":"2024-09-12T17:05:47.563411+0000","last_active":"2024-09-12T17:08:33.607832+0000","last_peered":"2024-09-12T17:08:33.607832+0000","last_clean":"2024-09-12T17:08:33.607832+0000","last_became_active":"2024-09-12T17:05:47.562812+0000","last_became_peered":"2024-09-12T17:05:47.562812+0000","last_unstale":"2024-09-12T17:08:33.607832+0000","last_undegraded":"2024-09-12T17:08:33.607832+0000","last_fullsized":"2024-09-12T17:08:33.607832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:57.659986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24579,"num_write":16,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936741+0000","last_change":"2024-09-12T17:05:51.548944+0000","last_active":"2024-09-12T17:08:32.936741+0000","last_peered":"2024-09-12T17:08:32.936741+0000","last_clean":"2024-09-12T17:08:32.936741+0000","last_became_active":"2024-09-12T17:05:51.544649+0000","last_became_peered":"2024-09-12T17:05:51.544649+0000","last_unstale":"2024-09-12T17:08:32.936741+0000","last_undegraded":"2024-09-12T17:08:32.936741+0000","last_fullsized":"2024-09-12T17:08:32.936741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:01.468390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"84'12","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588360+0000","last_change":"2024-09-12T17:05:53.552838+0000","last_active":"2024-09-12T17:08:32.588360+0000","last_peered":"2024-09-12T17:08:32.588360+0000","last_clean":"2024-09-12T17:08:32.588360+0000","last_became_active":"2024-09-12T17:05:53.550042+0000","last_became_peered":"2024-09-12T17:05:53.550042+0000","last_unstale":"2024-09-12T17:08:32.588360+0000","last_undegraded":"2024-09-12T17:08:32.588360+0000","last_fullsized":"2024-09-12T17:08:32.588360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585935+0000","last_change":"2024-09-12T17:05:55.558761+0000","last_active":"2024-09-12T17:08:32.585935+0000","last_peered":"2024-09-12T17:08:32.585935+0000","last_clean":"2024-09-12T17:08:32.585935+0000","last_became_active":"2024-09-12T17:05:55.557930+0000","last_became_peered":"2024-09-12T17:05:55.557930+0000","last_unstale":"2024-09-12T17:08:32.585935+0000","last_undegraded":"2024-09-12T17:08:32.585935+0000","last_fullsized":"2024-09-12T17:08:32.585935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.015675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940650+0000","last_change":"2024-09-12T17:05:57.592611+0000","last_active":"2024-09-12T17:08:32.940650+0000","last_peered":"2024-09-12T17:08:32.940650+0000","last_clean":"2024-09-12T17:08:32.940650+0000","last_became_active":"2024-09-12T17:05:57.591855+0000","last_became_peered":"2024-09-12T17:05:57.591855+0000","last_unstale":"2024-09-12T17:08:32.940650+0000","last_undegraded":"2024-09-12T17:08:32.940650+0000","last_fullsized":"2024-09-12T17:08:32.940650+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:02.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941416+0000","last_change":"2024-09-12T17:08:18.467848+0000","last_active":"2024-09-12T17:08:32.941416+0000","last_peered":"2024-09-12T17:08:32.941416+0000","last_clean":"2024-09-12T17:08:32.941416+0000","last_became_active":"2024-09-12T17:08:18.466877+0000","last_became_peered":"2024-09-12T17:08:18.466877+0000","last_unstale":"2024-09-12T17:08:32.941416+0000","last_undegraded":"2024-09-12T17:08:32.941416+0000","last_fullsized":"2024-09-12T17:08:32.941416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:08.084076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"74'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608214+0000","last_change":"2024-09-12T17:05:47.562243+0000","last_active":"2024-09-12T17:08:33.608214+0000","last_peered":"2024-09-12T17:08:33.608214+0000","last_clean":"2024-09-12T17:08:33.608214+0000","last_became_active":"2024-09-12T17:05:47.561587+0000","last_became_peered":"2024-09-12T17:05:47.561587+0000","last_unstale":"2024-09-12T17:08:33.608214+0000","last_undegraded":"2024-09-12T17:08:33.608214+0000","last_fullsized":"2024-09-12T17:08:33.608214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":28672,"num_write":9,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"29'1","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.937919+0000","last_change":"2024-09-12T17:05:51.542843+0000","last_active":"2024-09-12T17:08:32.937919+0000","last_peered":"2024-09-12T17:08:32.937919+0000","last_clean":"2024-09-12T17:08:32.937919+0000","last_became_active":"2024-09-12T17:05:51.542457+0000","last_became_peered":"2024-09-12T17:05:51.542457+0000","last_unstale":"2024-09-12T17:08:32.937919+0000","last_undegraded":"2024-09-12T17:08:32.937919+0000","last_fullsized":"2024-09-12T17:08:32.937919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.837373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"84'20","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602092+0000","last_change":"2024-09-12T17:05:53.548729+0000","last_active":"2024-09-12T17:08:33.602092+0000","last_peered":"2024-09-12T17:08:33.602092+0000","last_clean":"2024-09-12T17:08:33.602092+0000","last_became_active":"2024-09-12T17:05:53.547990+0000","last_became_peered":"2024-09-12T17:05:53.547990+0000","last_unstale":"2024-09-12T17:08:33.602092+0000","last_undegraded":"2024-09-12T17:08:33.602092+0000","last_fullsized":"2024-09-12T17:08:33.602092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:22.845485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"91'16","reported_seq":227,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600223+0000","last_change":"2024-09-12T17:08:21.470468+0000","last_active":"2024-09-12T17:08:33.600223+0000","last_peered":"2024-09-12T17:08:33.600223+0000","last_clean":"2024-09-12T17:08:33.600223+0000","last_became_active":"2024-09-12T17:08:21.465057+0000","last_became_peered":"2024-09-12T17:08:21.465057+0000","last_unstale":"2024-09-12T17:08:33.600223+0000","last_undegraded":"2024-09-12T17:08:33.600223+0000","last_fullsized":"2024-09-12T17:08:33.600223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.580430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604073+0000","last_change":"2024-09-12T17:05:57.596229+0000","last_active":"2024-09-12T17:08:33.604073+0000","last_peered":"2024-09-12T17:08:33.604073+0000","last_clean":"2024-09-12T17:08:33.604073+0000","last_became_active":"2024-09-12T17:05:57.595658+0000","last_became_peered":"2024-09-12T17:05:57.595658+0000","last_unstale":"2024-09-12T17:08:33.604073+0000","last_undegraded":"2024-09-12T17:08:33.604073+0000","last_fullsized":"2024-09-12T17:08:33.604073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.644627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603857+0000","last_change":"2024-09-12T17:08:18.465360+0000","last_active":"2024-09-12T17:08:33.603857+0000","last_peered":"2024-09-12T17:08:33.603857+0000","last_clean":"2024-09-12T17:08:33.603857+0000","last_became_active":"2024-09-12T17:08:18.464976+0000","last_became_peered":"2024-09-12T17:08:18.464976+0000","last_unstale":"2024-09-12T17:08:33.603857+0000","last_undegraded":"2024-09-12T17:08:33.603857+0000","last_fullsized":"2024-09-12T17:08:33.603857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.772819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"84'14","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603646+0000","last_change":"2024-09-12T17:05:47.535946+0000","last_active":"2024-09-12T17:08:33.603646+0000","last_peered":"2024-09-12T17:08:33.603646+0000","last_clean":"2024-09-12T17:08:33.603646+0000","last_became_active":"2024-09-12T17:05:47.534607+0000","last_became_peered":"2024-09-12T17:05:47.534607+0000","last_unstale":"2024-09-12T17:08:33.603646+0000","last_undegraded":"2024-09-12T17:08:33.603646+0000","last_fullsized":"2024-09-12T17:08:33.603646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":36876,"num_write":46,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.937118+0000","last_change":"2024-09-12T17:05:51.548391+0000","last_active":"2024-09-12T17:08:32.937118+0000","last_peered":"2024-09-12T17:08:32.937118+0000","last_clean":"2024-09-12T17:08:32.937118+0000","last_became_active":"2024-09-12T17:05:51.547939+0000","last_became_peered":"2024-09-12T17:05:51.547939+0000","last_unstale":"2024-09-12T17:08:32.937118+0000","last_undegraded":"2024-09-12T17:08:32.937118+0000","last_fullsized":"2024-09-12T17:08:32.937118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:08.848247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"84'23","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600674+0000","last_change":"2024-09-12T17:05:53.535756+0000","last_active":"2024-09-12T17:08:33.600674+0000","last_peered":"2024-09-12T17:08:33.600674+0000","last_clean":"2024-09-12T17:08:33.600674+0000","last_became_active":"2024-09-12T17:05:53.535062+0000","last_became_peered":"2024-09-12T17:05:53.535062+0000","last_unstale":"2024-09-12T17:08:33.600674+0000","last_undegraded":"2024-09-12T17:08:33.600674+0000","last_fullsized":"2024-09-12T17:08:33.600674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12086,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":45,"num_write":28,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936826+0000","last_change":"2024-09-12T17:05:55.564010+0000","last_active":"2024-09-12T17:08:32.936826+0000","last_peered":"2024-09-12T17:08:32.936826+0000","last_clean":"2024-09-12T17:08:32.936826+0000","last_became_active":"2024-09-12T17:05:55.563125+0000","last_became_peered":"2024-09-12T17:05:55.563125+0000","last_unstale":"2024-09-12T17:08:32.936826+0000","last_undegraded":"2024-09-12T17:08:32.936826+0000","last_fullsized":"2024-09-12T17:08:32.936826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:00.697571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":37,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940863+0000","last_change":"2024-09-12T17:08:18.459890+0000","last_active":"2024-09-12T17:08:32.940863+0000","last_peered":"2024-09-12T17:08:32.940863+0000","last_clean":"2024-09-12T17:08:32.940863+0000","last_became_active":"2024-09-12T17:08:18.459544+0000","last_became_peered":"2024-09-12T17:08:18.459544+0000","last_unstale":"2024-09-12T17:08:32.940863+0000","last_undegraded":"2024-09-12T17:08:32.940863+0000","last_fullsized":"2024-09-12T17:08:32.940863+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:05.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587730+0000","last_change":"2024-09-12T17:05:49.544092+0000","last_active":"2024-09-12T17:08:32.587730+0000","last_peered":"2024-09-12T17:08:32.587730+0000","last_clean":"2024-09-12T17:08:32.587730+0000","last_became_active":"2024-09-12T17:05:49.543307+0000","last_became_peered":"2024-09-12T17:05:49.543307+0000","last_unstale":"2024-09-12T17:08:32.587730+0000","last_undegraded":"2024-09-12T17:08:32.587730+0000","last_fullsized":"2024-09-12T17:08:32.587730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:36.286410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585443+0000","last_change":"2024-09-12T17:05:47.526678+0000","last_active":"2024-09-12T17:08:32.585443+0000","last_peered":"2024-09-12T17:08:32.585443+0000","last_clean":"2024-09-12T17:08:32.585443+0000","last_became_active":"2024-09-12T17:05:47.525696+0000","last_became_peered":"2024-09-12T17:05:47.525696+0000","last_unstale":"2024-09-12T17:08:32.585443+0000","last_undegraded":"2024-09-12T17:08:32.585443+0000","last_fullsized":"2024-09-12T17:08:32.585443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:59.012258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":18438,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.937378+0000","last_change":"2024-09-12T17:05:51.543404+0000","last_active":"2024-09-12T17:08:32.937378+0000","last_peered":"2024-09-12T17:08:32.937378+0000","last_clean":"2024-09-12T17:08:32.937378+0000","last_became_active":"2024-09-12T17:05:51.542737+0000","last_became_peered":"2024-09-12T17:05:51.542737+0000","last_unstale":"2024-09-12T17:08:32.937378+0000","last_undegraded":"2024-09-12T17:08:32.937378+0000","last_fullsized":"2024-09-12T17:08:32.937378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:30.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"84'19","reported_seq":217,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589555+0000","last_change":"2024-09-12T17:08:21.484446+0000","last_active":"2024-09-12T17:08:32.589555+0000","last_peered":"2024-09-12T17:08:32.589555+0000","last_clean":"2024-09-12T17:08:32.589555+0000","last_became_active":"2024-09-12T17:08:21.465207+0000","last_became_peered":"2024-09-12T17:08:21.465207+0000","last_unstale":"2024-09-12T17:08:32.589555+0000","last_undegraded":"2024-09-12T17:08:32.589555+0000","last_fullsized":"2024-09-12T17:08:32.589555+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:37.839396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7435,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":40,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3559,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603073+0000","last_change":"2024-09-12T17:05:55.565575+0000","last_active":"2024-09-12T17:08:33.603073+0000","last_peered":"2024-09-12T17:08:33.603073+0000","last_clean":"2024-09-12T17:08:33.603073+0000","last_became_active":"2024-09-12T17:05:55.564802+0000","last_became_peered":"2024-09-12T17:05:55.564802+0000","last_unstale":"2024-09-12T17:08:33.603073+0000","last_undegraded":"2024-09-12T17:08:33.603073+0000","last_fullsized":"2024-09-12T17:08:33.603073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585716+0000","last_change":"2024-09-12T17:05:57.592294+0000","last_active":"2024-09-12T17:08:32.585716+0000","last_peered":"2024-09-12T17:08:32.585716+0000","last_clean":"2024-09-12T17:08:32.585716+0000","last_became_active":"2024-09-12T17:05:57.591389+0000","last_became_peered":"2024-09-12T17:05:57.591389+0000","last_unstale":"2024-09-12T17:08:32.585716+0000","last_undegraded":"2024-09-12T17:08:32.585716+0000","last_fullsized":"2024-09-12T17:08:32.585716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'10","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589092+0000","last_change":"2024-09-12T17:05:49.553177+0000","last_active":"2024-09-12T17:08:32.589092+0000","last_peered":"2024-09-12T17:08:32.589092+0000","last_clean":"2024-09-12T17:08:32.589092+0000","last_became_active":"2024-09-12T17:05:49.552270+0000","last_became_peered":"2024-09-12T17:05:49.552270+0000","last_unstale":"2024-09-12T17:08:32.589092+0000","last_undegraded":"2024-09-12T17:08:32.589092+0000","last_fullsized":"2024-09-12T17:08:32.589092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:34.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"74'8","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941709+0000","last_change":"2024-09-12T17:05:47.543064+0000","last_active":"2024-09-12T17:08:32.941709+0000","last_peered":"2024-09-12T17:08:32.941709+0000","last_clean":"2024-09-12T17:08:32.941709+0000","last_became_active":"2024-09-12T17:05:47.542362+0000","last_became_peered":"2024-09-12T17:05:47.542362+0000","last_unstale":"2024-09-12T17:08:32.941709+0000","last_undegraded":"2024-09-12T17:08:32.941709+0000","last_fullsized":"2024-09-12T17:08:32.941709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":37,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942035+0000","last_change":"2024-09-12T17:08:18.456938+0000","last_active":"2024-09-12T17:08:32.942035+0000","last_peered":"2024-09-12T17:08:32.942035+0000","last_clean":"2024-09-12T17:08:32.942035+0000","last_became_active":"2024-09-12T17:08:18.452101+0000","last_became_peered":"2024-09-12T17:08:18.452101+0000","last_unstale":"2024-09-12T17:08:32.942035+0000","last_undegraded":"2024-09-12T17:08:32.942035+0000","last_fullsized":"2024-09-12T17:08:32.942035+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:36.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"84'19","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938078+0000","last_change":"2024-09-12T17:05:53.554531+0000","last_active":"2024-09-12T17:08:32.938078+0000","last_peered":"2024-09-12T17:08:32.938078+0000","last_clean":"2024-09-12T17:08:32.938078+0000","last_became_active":"2024-09-12T17:05:53.554131+0000","last_became_peered":"2024-09-12T17:05:53.554131+0000","last_unstale":"2024-09-12T17:08:32.938078+0000","last_undegraded":"2024-09-12T17:08:32.938078+0000","last_fullsized":"2024-09-12T17:08:32.938078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"84'14","reported_seq":208,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938496+0000","last_change":"2024-09-12T17:05:55.559204+0000","last_active":"2024-09-12T17:08:32.938496+0000","last_peered":"2024-09-12T17:08:32.938496+0000","last_clean":"2024-09-12T17:08:32.938496+0000","last_became_active":"2024-09-12T17:05:55.556488+0000","last_became_peered":"2024-09-12T17:05:55.556488+0000","last_unstale":"2024-09-12T17:08:32.938496+0000","last_undegraded":"2024-09-12T17:08:32.938496+0000","last_fullsized":"2024-09-12T17:08:32.938496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:15.167640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":37,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939582+0000","last_change":"2024-09-12T17:08:18.461886+0000","last_active":"2024-09-12T17:08:32.939582+0000","last_peered":"2024-09-12T17:08:32.939582+0000","last_clean":"2024-09-12T17:08:32.939582+0000","last_became_active":"2024-09-12T17:08:18.460345+0000","last_became_peered":"2024-09-12T17:08:18.460345+0000","last_unstale":"2024-09-12T17:08:32.939582+0000","last_undegraded":"2024-09-12T17:08:32.939582+0000","last_fullsized":"2024-09-12T17:08:32.939582+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:30.011702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"68'6","reported_seq":171,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.590085+0000","last_change":"2024-09-12T17:05:49.562360+0000","last_active":"2024-09-12T17:08:32.590085+0000","last_peered":"2024-09-12T17:08:32.590085+0000","last_clean":"2024-09-12T17:08:32.590085+0000","last_became_active":"2024-09-12T17:05:49.561200+0000","last_became_peered":"2024-09-12T17:05:49.561200+0000","last_unstale":"2024-09-12T17:08:32.590085+0000","last_undegraded":"2024-09-12T17:08:32.590085+0000","last_fullsized":"2024-09-12T17:08:32.590085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.915600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"84'9","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586096+0000","last_change":"2024-09-12T17:05:47.542018+0000","last_active":"2024-09-12T17:08:32.586096+0000","last_peered":"2024-09-12T17:08:32.586096+0000","last_clean":"2024-09-12T17:08:32.586096+0000","last_became_active":"2024-09-12T17:05:47.540484+0000","last_became_peered":"2024-09-12T17:05:47.540484+0000","last_unstale":"2024-09-12T17:08:32.586096+0000","last_undegraded":"2024-09-12T17:08:32.586096+0000","last_fullsized":"2024-09-12T17:08:32.586096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:13.571666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24585,"num_write":33,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606141+0000","last_change":"2024-09-12T17:05:51.556083+0000","last_active":"2024-09-12T17:08:33.606141+0000","last_peered":"2024-09-12T17:08:33.606141+0000","last_clean":"2024-09-12T17:08:33.606141+0000","last_became_active":"2024-09-12T17:05:51.554176+0000","last_became_peered":"2024-09-12T17:05:51.554176+0000","last_unstale":"2024-09-12T17:08:33.606141+0000","last_undegraded":"2024-09-12T17:08:33.606141+0000","last_fullsized":"2024-09-12T17:08:33.606141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:02.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589967+0000","last_change":"2024-09-12T17:05:53.553304+0000","last_active":"2024-09-12T17:08:32.589967+0000","last_peered":"2024-09-12T17:08:32.589967+0000","last_clean":"2024-09-12T17:08:32.589967+0000","last_became_active":"2024-09-12T17:05:53.552545+0000","last_became_peered":"2024-09-12T17:05:53.552545+0000","last_unstale":"2024-09-12T17:08:32.589967+0000","last_undegraded":"2024-09-12T17:08:32.589967+0000","last_fullsized":"2024-09-12T17:08:32.589967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"88'16","reported_seq":227,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941461+0000","last_change":"2024-09-12T17:08:18.628128+0000","last_active":"2024-09-12T17:08:32.941461+0000","last_peered":"2024-09-12T17:08:32.941461+0000","last_clean":"2024-09-12T17:08:32.941461+0000","last_became_active":"2024-09-12T17:08:18.471539+0000","last_became_peered":"2024-09-12T17:08:18.471539+0000","last_unstale":"2024-09-12T17:08:32.941461+0000","last_undegraded":"2024-09-12T17:08:32.941461+0000","last_fullsized":"2024-09-12T17:08:32.941461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:47.486729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589188+0000","last_change":"2024-09-12T17:05:57.597870+0000","last_active":"2024-09-12T17:08:32.589188+0000","last_peered":"2024-09-12T17:08:32.589188+0000","last_clean":"2024-09-12T17:08:32.589188+0000","last_became_active":"2024-09-12T17:05:57.597076+0000","last_became_peered":"2024-09-12T17:05:57.597076+0000","last_unstale":"2024-09-12T17:08:32.589188+0000","last_undegraded":"2024-09-12T17:08:32.589188+0000","last_fullsized":"2024-09-12T17:08:32.589188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.648974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"68'6","reported_seq":41,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941007+0000","last_change":"2024-09-12T17:08:18.887494+0000","last_active":"2024-09-12T17:08:32.941007+0000","last_peered":"2024-09-12T17:08:32.941007+0000","last_clean":"2024-09-12T17:08:32.941007+0000","last_became_active":"2024-09-12T17:08:18.457423+0000","last_became_peered":"2024-09-12T17:08:18.457423+0000","last_unstale":"2024-09-12T17:08:32.941007+0000","last_undegraded":"2024-09-12T17:08:32.941007+0000","last_fullsized":"2024-09-12T17:08:32.941007+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:59.827727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"84'10","reported_seq":216,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.584805+0000","last_change":"2024-09-12T17:08:18.702553+0000","last_active":"2024-09-12T17:08:32.584805+0000","last_peered":"2024-09-12T17:08:32.584805+0000","last_clean":"2024-09-12T17:08:32.584805+0000","last_became_active":"2024-09-12T17:08:18.449468+0000","last_became_peered":"2024-09-12T17:08:18.449468+0000","last_unstale":"2024-09-12T17:08:32.584805+0000","last_undegraded":"2024-09-12T17:08:32.584805+0000","last_fullsized":"2024-09-12T17:08:32.584805+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:54.548414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589842+0000","last_change":"2024-09-12T17:05:51.540047+0000","last_active":"2024-09-12T17:08:32.589842+0000","last_peered":"2024-09-12T17:08:32.589842+0000","last_clean":"2024-09-12T17:08:32.589842+0000","last_became_active":"2024-09-12T17:05:51.539302+0000","last_became_peered":"2024-09-12T17:05:51.539302+0000","last_unstale":"2024-09-12T17:08:32.589842+0000","last_undegraded":"2024-09-12T17:08:32.589842+0000","last_fullsized":"2024-09-12T17:08:32.589842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:21.253801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"84'23","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603583+0000","last_change":"2024-09-12T17:08:21.515721+0000","last_active":"2024-09-12T17:08:33.603583+0000","last_peered":"2024-09-12T17:08:33.603583+0000","last_clean":"2024-09-12T17:08:33.603583+0000","last_became_active":"2024-09-12T17:08:21.467530+0000","last_became_peered":"2024-09-12T17:08:21.467530+0000","last_unstale":"2024-09-12T17:08:33.603583+0000","last_undegraded":"2024-09-12T17:08:33.603583+0000","last_fullsized":"2024-09-12T17:08:33.603583+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:04.806432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":37,"num_read_kb":36,"num_write":26,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":12538,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940695+0000","last_change":"2024-09-12T17:05:55.566749+0000","last_active":"2024-09-12T17:08:32.940695+0000","last_peered":"2024-09-12T17:08:32.940695+0000","last_clean":"2024-09-12T17:08:32.940695+0000","last_became_active":"2024-09-12T17:05:55.565979+0000","last_became_peered":"2024-09-12T17:05:55.565979+0000","last_unstale":"2024-09-12T17:08:32.940695+0000","last_undegraded":"2024-09-12T17:08:32.940695+0000","last_fullsized":"2024-09-12T17:08:32.940695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939843+0000","last_change":"2024-09-12T17:08:21.461881+0000","last_active":"2024-09-12T17:08:32.939843+0000","last_peered":"2024-09-12T17:08:32.939843+0000","last_clean":"2024-09-12T17:08:32.939843+0000","last_became_active":"2024-09-12T17:08:21.461496+0000","last_became_peered":"2024-09-12T17:08:21.461496+0000","last_unstale":"2024-09-12T17:08:32.939843+0000","last_undegraded":"2024-09-12T17:08:32.939843+0000","last_fullsized":"2024-09-12T17:08:32.939843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:41.000825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941738+0000","last_change":"2024-09-12T17:05:49.539487+0000","last_active":"2024-09-12T17:08:32.941738+0000","last_peered":"2024-09-12T17:08:32.941738+0000","last_clean":"2024-09-12T17:08:32.941738+0000","last_became_active":"2024-09-12T17:05:49.538713+0000","last_became_peered":"2024-09-12T17:05:49.538713+0000","last_unstale":"2024-09-12T17:08:32.941738+0000","last_undegraded":"2024-09-12T17:08:32.941738+0000","last_fullsized":"2024-09-12T17:08:32.941738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.731614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":272,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602363+0000","last_change":"2024-09-12T17:05:35.688483+0000","last_active":"2024-09-12T17:08:33.602363+0000","last_peered":"2024-09-12T17:08:33.602363+0000","last_clean":"2024-09-12T17:08:33.602363+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:08:33.602363+0000","last_undegraded":"2024-09-12T17:08:33.602363+0000","last_fullsized":"2024-09-12T17:08:33.602363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_clean_scrub_stamp":"2024-09-12T17:05:34.151079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602740+0000","last_change":"2024-09-12T17:05:42.225793+0000","last_active":"2024-09-12T17:08:33.602740+0000","last_peered":"2024-09-12T17:08:33.602740+0000","last_clean":"2024-09-12T17:08:33.602740+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:08:33.602740+0000","last_undegraded":"2024-09-12T17:08:33.602740+0000","last_fullsized":"2024-09-12T17:08:33.602740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:54.880257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'13","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586806+0000","last_change":"2024-09-12T17:05:47.526243+0000","last_active":"2024-09-12T17:08:32.586806+0000","last_peered":"2024-09-12T17:08:32.586806+0000","last_clean":"2024-09-12T17:08:32.586806+0000","last_became_active":"2024-09-12T17:05:47.525694+0000","last_became_peered":"2024-09-12T17:05:47.525694+0000","last_unstale":"2024-09-12T17:08:32.586806+0000","last_undegraded":"2024-09-12T17:08:32.586806+0000","last_fullsized":"2024-09-12T17:08:32.586806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38921,"num_write":37,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606510+0000","last_change":"2024-09-12T17:05:51.548356+0000","last_active":"2024-09-12T17:08:33.606510+0000","last_peered":"2024-09-12T17:08:33.606510+0000","last_clean":"2024-09-12T17:08:33.606510+0000","last_became_active":"2024-09-12T17:05:51.547503+0000","last_became_peered":"2024-09-12T17:05:51.547503+0000","last_unstale":"2024-09-12T17:08:33.606510+0000","last_undegraded":"2024-09-12T17:08:33.606510+0000","last_fullsized":"2024-09-12T17:08:33.606510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:47.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"84'30","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604943+0000","last_change":"2024-09-12T17:05:53.546057+0000","last_active":"2024-09-12T17:08:33.604943+0000","last_peered":"2024-09-12T17:08:33.604943+0000","last_clean":"2024-09-12T17:08:33.604943+0000","last_became_active":"2024-09-12T17:05:53.545266+0000","last_became_peered":"2024-09-12T17:05:53.545266+0000","last_unstale":"2024-09-12T17:08:33.604943+0000","last_undegraded":"2024-09-12T17:08:33.604943+0000","last_fullsized":"2024-09-12T17:08:33.604943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18405,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604135+0000","last_change":"2024-09-12T17:05:55.562246+0000","last_active":"2024-09-12T17:08:33.604135+0000","last_peered":"2024-09-12T17:08:33.604135+0000","last_clean":"2024-09-12T17:08:33.604135+0000","last_became_active":"2024-09-12T17:05:55.561410+0000","last_became_peered":"2024-09-12T17:05:55.561410+0000","last_unstale":"2024-09-12T17:08:33.604135+0000","last_undegraded":"2024-09-12T17:08:33.604135+0000","last_fullsized":"2024-09-12T17:08:33.604135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.373235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"68'2","reported_seq":148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938080+0000","last_change":"2024-09-12T17:05:57.593095+0000","last_active":"2024-09-12T17:08:32.938080+0000","last_peered":"2024-09-12T17:08:32.938080+0000","last_clean":"2024-09-12T17:08:32.938080+0000","last_became_active":"2024-09-12T17:05:57.592287+0000","last_became_peered":"2024-09-12T17:05:57.592287+0000","last_unstale":"2024-09-12T17:08:32.938080+0000","last_undegraded":"2024-09-12T17:08:32.938080+0000","last_fullsized":"2024-09-12T17:08:32.938080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:52.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604303+0000","last_change":"2024-09-12T17:08:18.465677+0000","last_active":"2024-09-12T17:08:33.604303+0000","last_peered":"2024-09-12T17:08:33.604303+0000","last_clean":"2024-09-12T17:08:33.604303+0000","last_became_active":"2024-09-12T17:08:18.464334+0000","last_became_peered":"2024-09-12T17:08:18.464334+0000","last_unstale":"2024-09-12T17:08:33.604303+0000","last_undegraded":"2024-09-12T17:08:33.604303+0000","last_fullsized":"2024-09-12T17:08:33.604303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:26.356922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601919+0000","last_change":"2024-09-12T17:08:21.462733+0000","last_active":"2024-09-12T17:08:33.601919+0000","last_peered":"2024-09-12T17:08:33.601919+0000","last_clean":"2024-09-12T17:08:33.601919+0000","last_became_active":"2024-09-12T17:08:21.461625+0000","last_became_peered":"2024-09-12T17:08:21.461625+0000","last_unstale":"2024-09-12T17:08:33.601919+0000","last_undegraded":"2024-09-12T17:08:33.601919+0000","last_fullsized":"2024-09-12T17:08:33.601919+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:09.553944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'15","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600772+0000","last_change":"2024-09-12T17:05:47.544269+0000","last_active":"2024-09-12T17:08:33.600772+0000","last_peered":"2024-09-12T17:08:33.600772+0000","last_clean":"2024-09-12T17:08:33.600772+0000","last_became_active":"2024-09-12T17:05:47.543531+0000","last_became_peered":"2024-09-12T17:05:47.543531+0000","last_unstale":"2024-09-12T17:08:33.600772+0000","last_undegraded":"2024-09-12T17:08:33.600772+0000","last_fullsized":"2024-09-12T17:08:33.600772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:55.688363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":40969,"num_write":39,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605269+0000","last_change":"2024-09-12T17:08:18.466066+0000","last_active":"2024-09-12T17:08:33.605269+0000","last_peered":"2024-09-12T17:08:33.605269+0000","last_clean":"2024-09-12T17:08:33.605269+0000","last_became_active":"2024-09-12T17:08:18.465027+0000","last_became_peered":"2024-09-12T17:08:18.465027+0000","last_unstale":"2024-09-12T17:08:33.605269+0000","last_undegraded":"2024-09-12T17:08:33.605269+0000","last_fullsized":"2024-09-12T17:08:33.605269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"91'48","reported_seq":57,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940781+0000","last_change":"2024-09-12T17:08:21.488130+0000","last_active":"2024-09-12T17:08:32.940781+0000","last_peered":"2024-09-12T17:08:32.940781+0000","last_clean":"2024-09-12T17:08:32.940781+0000","last_became_active":"2024-09-12T17:08:21.455260+0000","last_became_peered":"2024-09-12T17:08:21.455260+0000","last_unstale":"2024-09-12T17:08:32.940781+0000","last_undegraded":"2024-09-12T17:08:32.940781+0000","last_fullsized":"2024-09-12T17:08:32.940781+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:08.863638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17326,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":71,"num_read_kb":74,"num_write":44,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":5726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606844+0000","last_change":"2024-09-12T17:05:55.556362+0000","last_active":"2024-09-12T17:08:33.606844+0000","last_peered":"2024-09-12T17:08:33.606844+0000","last_clean":"2024-09-12T17:08:33.606844+0000","last_became_active":"2024-09-12T17:05:55.555625+0000","last_became_peered":"2024-09-12T17:05:55.555625+0000","last_unstale":"2024-09-12T17:08:33.606844+0000","last_undegraded":"2024-09-12T17:08:33.606844+0000","last_fullsized":"2024-09-12T17:08:33.606844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"84'6","reported_seq":43,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940848+0000","last_change":"2024-09-12T17:08:18.577521+0000","last_active":"2024-09-12T17:08:32.940848+0000","last_peered":"2024-09-12T17:08:32.940848+0000","last_clean":"2024-09-12T17:08:32.940848+0000","last_became_active":"2024-09-12T17:08:18.446923+0000","last_became_peered":"2024-09-12T17:08:18.446923+0000","last_unstale":"2024-09-12T17:08:32.940848+0000","last_undegraded":"2024-09-12T17:08:32.940848+0000","last_fullsized":"2024-09-12T17:08:32.940848+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:00.600036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940428+0000","last_change":"2024-09-12T17:08:21.457044+0000","last_active":"2024-09-12T17:08:32.940428+0000","last_peered":"2024-09-12T17:08:32.940428+0000","last_clean":"2024-09-12T17:08:32.940428+0000","last_became_active":"2024-09-12T17:08:21.456705+0000","last_became_peered":"2024-09-12T17:08:21.456705+0000","last_unstale":"2024-09-12T17:08:32.940428+0000","last_undegraded":"2024-09-12T17:08:32.940428+0000","last_fullsized":"2024-09-12T17:08:32.940428+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:57.537595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936855+0000","last_change":"2024-09-12T17:05:42.677413+0000","last_active":"2024-09-12T17:08:32.936855+0000","last_peered":"2024-09-12T17:08:32.936855+0000","last_clean":"2024-09-12T17:08:32.936855+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:08:32.936855+0000","last_undegraded":"2024-09-12T17:08:32.936855+0000","last_fullsized":"2024-09-12T17:08:32.936855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.836885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"84'12","reported_seq":59,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938724+0000","last_change":"2024-09-12T17:08:18.715809+0000","last_active":"2024-09-12T17:08:32.938724+0000","last_peered":"2024-09-12T17:08:32.938724+0000","last_clean":"2024-09-12T17:08:32.938724+0000","last_became_active":"2024-09-12T17:08:18.446837+0000","last_became_peered":"2024-09-12T17:08:18.446837+0000","last_unstale":"2024-09-12T17:08:32.938724+0000","last_undegraded":"2024-09-12T17:08:32.938724+0000","last_fullsized":"2024-09-12T17:08:32.938724+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:22.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":159,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938748+0000","last_change":"2024-09-12T17:05:51.557262+0000","last_active":"2024-09-12T17:08:32.938748+0000","last_peered":"2024-09-12T17:08:32.938748+0000","last_clean":"2024-09-12T17:08:32.938748+0000","last_became_active":"2024-09-12T17:05:51.556959+0000","last_became_peered":"2024-09-12T17:05:51.556959+0000","last_unstale":"2024-09-12T17:08:32.938748+0000","last_undegraded":"2024-09-12T17:08:32.938748+0000","last_fullsized":"2024-09-12T17:08:32.938748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.963181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607471+0000","last_change":"2024-09-12T17:05:53.555384+0000","last_active":"2024-09-12T17:08:33.607471+0000","last_peered":"2024-09-12T17:08:33.607471+0000","last_clean":"2024-09-12T17:08:33.607471+0000","last_became_active":"2024-09-12T17:05:53.554063+0000","last_became_peered":"2024-09-12T17:05:53.554063+0000","last_unstale":"2024-09-12T17:08:33.607471+0000","last_undegraded":"2024-09-12T17:08:33.607471+0000","last_fullsized":"2024-09-12T17:08:33.607471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602091+0000","last_change":"2024-09-12T17:05:55.547595+0000","last_active":"2024-09-12T17:08:33.602091+0000","last_peered":"2024-09-12T17:08:33.602091+0000","last_clean":"2024-09-12T17:08:33.602091+0000","last_became_active":"2024-09-12T17:05:55.546700+0000","last_became_peered":"2024-09-12T17:05:55.546700+0000","last_unstale":"2024-09-12T17:08:33.602091+0000","last_undegraded":"2024-09-12T17:08:33.602091+0000","last_fullsized":"2024-09-12T17:08:33.602091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587807+0000","last_change":"2024-09-12T17:05:57.587955+0000","last_active":"2024-09-12T17:08:32.587807+0000","last_peered":"2024-09-12T17:08:32.587807+0000","last_clean":"2024-09-12T17:08:32.587807+0000","last_became_active":"2024-09-12T17:05:57.587199+0000","last_became_peered":"2024-09-12T17:05:57.587199+0000","last_unstale":"2024-09-12T17:08:32.587807+0000","last_undegraded":"2024-09-12T17:08:32.587807+0000","last_fullsized":"2024-09-12T17:08:32.587807+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.422656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941160+0000","last_change":"2024-09-12T17:08:21.456185+0000","last_active":"2024-09-12T17:08:32.941160+0000","last_peered":"2024-09-12T17:08:32.941160+0000","last_clean":"2024-09-12T17:08:32.941160+0000","last_became_active":"2024-09-12T17:08:21.455573+0000","last_became_peered":"2024-09-12T17:08:21.455573+0000","last_unstale":"2024-09-12T17:08:32.941160+0000","last_undegraded":"2024-09-12T17:08:32.941160+0000","last_fullsized":"2024-09-12T17:08:32.941160+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:45.008694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604023+0000","last_change":"2024-09-12T17:08:18.708570+0000","last_active":"2024-09-12T17:08:33.604023+0000","last_peered":"2024-09-12T17:08:33.604023+0000","last_clean":"2024-09-12T17:08:33.604023+0000","last_became_active":"2024-09-12T17:08:18.474152+0000","last_became_peered":"2024-09-12T17:08:18.474152+0000","last_unstale":"2024-09-12T17:08:33.604023+0000","last_undegraded":"2024-09-12T17:08:33.604023+0000","last_fullsized":"2024-09-12T17:08:33.604023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:17.040784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'10","reported_seq":186,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587943+0000","last_change":"2024-09-12T17:05:47.546543+0000","last_active":"2024-09-12T17:08:32.587943+0000","last_peered":"2024-09-12T17:08:32.587943+0000","last_clean":"2024-09-12T17:08:32.587943+0000","last_became_active":"2024-09-12T17:05:47.545554+0000","last_became_peered":"2024-09-12T17:05:47.545554+0000","last_unstale":"2024-09-12T17:08:32.587943+0000","last_undegraded":"2024-09-12T17:08:32.587943+0000","last_fullsized":"2024-09-12T17:08:32.587943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:07.148131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602766+0000","last_change":"2024-09-12T17:08:18.451242+0000","last_active":"2024-09-12T17:08:33.602766+0000","last_peered":"2024-09-12T17:08:33.602766+0000","last_clean":"2024-09-12T17:08:33.602766+0000","last_became_active":"2024-09-12T17:08:18.450835+0000","last_became_peered":"2024-09-12T17:08:18.450835+0000","last_unstale":"2024-09-12T17:08:33.602766+0000","last_undegraded":"2024-09-12T17:08:33.602766+0000","last_fullsized":"2024-09-12T17:08:33.602766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.591349+0000","last_change":"2024-09-12T17:05:53.551499+0000","last_active":"2024-09-12T17:08:32.591349+0000","last_peered":"2024-09-12T17:08:32.591349+0000","last_clean":"2024-09-12T17:08:32.591349+0000","last_became_active":"2024-09-12T17:05:53.550857+0000","last_became_peered":"2024-09-12T17:05:53.550857+0000","last_unstale":"2024-09-12T17:08:32.591349+0000","last_undegraded":"2024-09-12T17:08:32.591349+0000","last_fullsized":"2024-09-12T17:08:32.591349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942208+0000","last_change":"2024-09-12T17:05:55.571619+0000","last_active":"2024-09-12T17:08:32.942208+0000","last_peered":"2024-09-12T17:08:32.942208+0000","last_clean":"2024-09-12T17:08:32.942208+0000","last_became_active":"2024-09-12T17:05:55.570991+0000","last_became_peered":"2024-09-12T17:05:55.570991+0000","last_unstale":"2024-09-12T17:08:32.942208+0000","last_undegraded":"2024-09-12T17:08:32.942208+0000","last_fullsized":"2024-09-12T17:08:32.942208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:02.401831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"84'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601534+0000","last_change":"2024-09-12T17:05:57.590482+0000","last_active":"2024-09-12T17:08:33.601534+0000","last_peered":"2024-09-12T17:08:33.601534+0000","last_clean":"2024-09-12T17:08:33.601534+0000","last_became_active":"2024-09-12T17:05:57.589542+0000","last_became_peered":"2024-09-12T17:05:57.589542+0000","last_unstale":"2024-09-12T17:08:33.601534+0000","last_undegraded":"2024-09-12T17:08:33.601534+0000","last_fullsized":"2024-09-12T17:08:33.601534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:20.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942334+0000","last_change":"2024-09-12T17:08:21.464126+0000","last_active":"2024-09-12T17:08:32.942334+0000","last_peered":"2024-09-12T17:08:32.942334+0000","last_clean":"2024-09-12T17:08:32.942334+0000","last_became_active":"2024-09-12T17:08:21.462608+0000","last_became_peered":"2024-09-12T17:08:21.462608+0000","last_unstale":"2024-09-12T17:08:32.942334+0000","last_undegraded":"2024-09-12T17:08:32.942334+0000","last_fullsized":"2024-09-12T17:08:32.942334+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:15.261389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"84'18","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606478+0000","last_change":"2024-09-12T17:05:47.525858+0000","last_active":"2024-09-12T17:08:33.606478+0000","last_peered":"2024-09-12T17:08:33.606478+0000","last_clean":"2024-09-12T17:08:33.606478+0000","last_became_active":"2024-09-12T17:05:47.525258+0000","last_became_peered":"2024-09-12T17:05:47.525258+0000","last_unstale":"2024-09-12T17:08:33.606478+0000","last_undegraded":"2024-09-12T17:08:33.606478+0000","last_fullsized":"2024-09-12T17:08:33.606478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":30,"num_read_kb":59401,"num_write":42,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942021+0000","last_change":"2024-09-12T17:08:18.462079+0000","last_active":"2024-09-12T17:08:32.942021+0000","last_peered":"2024-09-12T17:08:32.942021+0000","last_clean":"2024-09-12T17:08:32.942021+0000","last_became_active":"2024-09-12T17:08:18.460435+0000","last_became_peered":"2024-09-12T17:08:18.460435+0000","last_unstale":"2024-09-12T17:08:32.942021+0000","last_undegraded":"2024-09-12T17:08:32.942021+0000","last_fullsized":"2024-09-12T17:08:32.942021+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:32.002970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602556+0000","last_change":"2024-09-12T17:05:51.544848+0000","last_active":"2024-09-12T17:08:33.602556+0000","last_peered":"2024-09-12T17:08:33.602556+0000","last_clean":"2024-09-12T17:08:33.602556+0000","last_became_active":"2024-09-12T17:05:51.544078+0000","last_became_peered":"2024-09-12T17:05:51.544078+0000","last_unstale":"2024-09-12T17:08:33.602556+0000","last_undegraded":"2024-09-12T17:08:33.602556+0000","last_fullsized":"2024-09-12T17:08:33.602556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"84'27","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600730+0000","last_change":"2024-09-12T17:05:53.540181+0000","last_active":"2024-09-12T17:08:33.600730+0000","last_peered":"2024-09-12T17:08:33.600730+0000","last_clean":"2024-09-12T17:08:33.600730+0000","last_became_active":"2024-09-12T17:05:53.539372+0000","last_became_peered":"2024-09-12T17:05:53.539372+0000","last_unstale":"2024-09-12T17:08:33.600730+0000","last_undegraded":"2024-09-12T17:08:33.600730+0000","last_fullsized":"2024-09-12T17:08:33.600730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:58.931466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6989,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588142+0000","last_change":"2024-09-12T17:05:55.554060+0000","last_active":"2024-09-12T17:08:32.588142+0000","last_peered":"2024-09-12T17:08:32.588142+0000","last_clean":"2024-09-12T17:08:32.588142+0000","last_became_active":"2024-09-12T17:05:55.553263+0000","last_became_peered":"2024-09-12T17:05:55.553263+0000","last_unstale":"2024-09-12T17:08:32.588142+0000","last_undegraded":"2024-09-12T17:08:32.588142+0000","last_fullsized":"2024-09-12T17:08:32.588142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:44.303469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602500+0000","last_change":"2024-09-12T17:05:58.121180+0000","last_active":"2024-09-12T17:08:33.602500+0000","last_peered":"2024-09-12T17:08:33.602500+0000","last_clean":"2024-09-12T17:08:33.602500+0000","last_became_active":"2024-09-12T17:05:58.119755+0000","last_became_peered":"2024-09-12T17:05:58.119755+0000","last_unstale":"2024-09-12T17:08:33.602500+0000","last_undegraded":"2024-09-12T17:08:33.602500+0000","last_fullsized":"2024-09-12T17:08:33.602500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603740+0000","last_change":"2024-09-12T17:05:49.550213+0000","last_active":"2024-09-12T17:08:33.603740+0000","last_peered":"2024-09-12T17:08:33.603740+0000","last_clean":"2024-09-12T17:08:33.603740+0000","last_became_active":"2024-09-12T17:05:49.549583+0000","last_became_peered":"2024-09-12T17:05:49.549583+0000","last_unstale":"2024-09-12T17:08:33.603740+0000","last_undegraded":"2024-09-12T17:08:33.603740+0000","last_fullsized":"2024-09-12T17:08:33.603740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:05.085326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"84'11","reported_seq":59,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941694+0000","last_change":"2024-09-12T17:08:18.869145+0000","last_active":"2024-09-12T17:08:32.941694+0000","last_peered":"2024-09-12T17:08:32.941694+0000","last_clean":"2024-09-12T17:08:32.941694+0000","last_became_active":"2024-09-12T17:08:18.448295+0000","last_became_peered":"2024-09-12T17:08:18.448295+0000","last_unstale":"2024-09-12T17:08:32.941694+0000","last_undegraded":"2024-09-12T17:08:32.941694+0000","last_fullsized":"2024-09-12T17:08:32.941694+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:20.400937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36867,"num_write":19,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608651+0000","last_change":"2024-09-12T17:05:42.218804+0000","last_active":"2024-09-12T17:08:33.608651+0000","last_peered":"2024-09-12T17:08:33.608651+0000","last_clean":"2024-09-12T17:08:33.608651+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:08:33.608651+0000","last_undegraded":"2024-09-12T17:08:33.608651+0000","last_fullsized":"2024-09-12T17:08:33.608651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:48.189931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941124+0000","last_change":"2024-09-12T17:05:51.545963+0000","last_active":"2024-09-12T17:08:32.941124+0000","last_peered":"2024-09-12T17:08:32.941124+0000","last_clean":"2024-09-12T17:08:32.941124+0000","last_became_active":"2024-09-12T17:05:51.545225+0000","last_became_peered":"2024-09-12T17:05:51.545225+0000","last_unstale":"2024-09-12T17:08:32.941124+0000","last_undegraded":"2024-09-12T17:08:32.941124+0000","last_fullsized":"2024-09-12T17:08:32.941124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:40.407563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":53,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939344+0000","last_change":"2024-09-12T17:08:18.881993+0000","last_active":"2024-09-12T17:08:32.939344+0000","last_peered":"2024-09-12T17:08:32.939344+0000","last_clean":"2024-09-12T17:08:32.939344+0000","last_became_active":"2024-09-12T17:08:18.456095+0000","last_became_peered":"2024-09-12T17:08:18.456095+0000","last_unstale":"2024-09-12T17:08:32.939344+0000","last_undegraded":"2024-09-12T17:08:32.939344+0000","last_fullsized":"2024-09-12T17:08:32.939344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:37.132692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"91'16","reported_seq":217,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602471+0000","last_change":"2024-09-12T17:08:21.492858+0000","last_active":"2024-09-12T17:08:33.602471+0000","last_peered":"2024-09-12T17:08:33.602471+0000","last_clean":"2024-09-12T17:08:33.602471+0000","last_became_active":"2024-09-12T17:08:21.467026+0000","last_became_peered":"2024-09-12T17:08:21.467026+0000","last_unstale":"2024-09-12T17:08:33.602471+0000","last_undegraded":"2024-09-12T17:08:33.602471+0000","last_fullsized":"2024-09-12T17:08:33.602471+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:08.135205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.592417+0000","last_change":"2024-09-12T17:05:58.118437+0000","last_active":"2024-09-12T17:08:32.592417+0000","last_peered":"2024-09-12T17:08:32.592417+0000","last_clean":"2024-09-12T17:08:32.592417+0000","last_became_active":"2024-09-12T17:05:58.117710+0000","last_became_peered":"2024-09-12T17:05:58.117710+0000","last_unstale":"2024-09-12T17:08:32.592417+0000","last_undegraded":"2024-09-12T17:08:32.592417+0000","last_fullsized":"2024-09-12T17:08:32.592417+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:00.239807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":124,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936170+0000","last_change":"2024-09-12T17:06:27.817661+0000","last_active":"2024-09-12T17:08:32.936170+0000","last_peered":"2024-09-12T17:08:32.936170+0000","last_clean":"2024-09-12T17:08:32.936170+0000","last_became_active":"2024-09-12T17:06:27.817451+0000","last_became_peered":"2024-09-12T17:06:27.817451+0000","last_unstale":"2024-09-12T17:08:32.936170+0000","last_undegraded":"2024-09-12T17:08:32.936170+0000","last_fullsized":"2024-09-12T17:08:32.936170+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:31.000633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"83'8","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.592018+0000","last_change":"2024-09-12T17:05:47.535321+0000","last_active":"2024-09-12T17:08:32.592018+0000","last_peered":"2024-09-12T17:08:32.592018+0000","last_clean":"2024-09-12T17:08:32.592018+0000","last_became_active":"2024-09-12T17:05:47.534790+0000","last_became_peered":"2024-09-12T17:05:47.534790+0000","last_unstale":"2024-09-12T17:08:32.592018+0000","last_undegraded":"2024-09-12T17:08:32.592018+0000","last_fullsized":"2024-09-12T17:08:32.592018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":26627,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.944065+0000","last_change":"2024-09-12T17:08:21.467295+0000","last_active":"2024-09-12T17:08:32.944065+0000","last_peered":"2024-09-12T17:08:32.944065+0000","last_clean":"2024-09-12T17:08:32.944065+0000","last_became_active":"2024-09-12T17:08:21.467016+0000","last_became_peered":"2024-09-12T17:08:21.467016+0000","last_unstale":"2024-09-12T17:08:32.944065+0000","last_undegraded":"2024-09-12T17:08:32.944065+0000","last_fullsized":"2024-09-12T17:08:32.944065+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:24.509905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587607+0000","last_change":"2024-09-12T17:05:51.533668+0000","last_active":"2024-09-12T17:08:32.587607+0000","last_peered":"2024-09-12T17:08:32.587607+0000","last_clean":"2024-09-12T17:08:32.587607+0000","last_became_active":"2024-09-12T17:05:51.532795+0000","last_became_peered":"2024-09-12T17:05:51.532795+0000","last_unstale":"2024-09-12T17:08:32.587607+0000","last_undegraded":"2024-09-12T17:08:32.587607+0000","last_fullsized":"2024-09-12T17:08:32.587607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.655645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589553+0000","last_change":"2024-09-12T17:05:53.544503+0000","last_active":"2024-09-12T17:08:32.589553+0000","last_peered":"2024-09-12T17:08:32.589553+0000","last_clean":"2024-09-12T17:08:32.589553+0000","last_became_active":"2024-09-12T17:05:53.543495+0000","last_became_peered":"2024-09-12T17:05:53.543495+0000","last_unstale":"2024-09-12T17:08:32.589553+0000","last_undegraded":"2024-09-12T17:08:32.589553+0000","last_fullsized":"2024-09-12T17:08:32.589553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.721968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"84'14","reported_seq":196,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588984+0000","last_change":"2024-09-12T17:05:55.567580+0000","last_active":"2024-09-12T17:08:32.588984+0000","last_peered":"2024-09-12T17:08:32.588984+0000","last_clean":"2024-09-12T17:08:32.588984+0000","last_became_active":"2024-09-12T17:05:55.566652+0000","last_became_peered":"2024-09-12T17:05:55.566652+0000","last_unstale":"2024-09-12T17:08:32.588984+0000","last_undegraded":"2024-09-12T17:08:32.588984+0000","last_fullsized":"2024-09-12T17:08:32.588984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:28.904117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"68'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602357+0000","last_change":"2024-09-12T17:05:57.585098+0000","last_active":"2024-09-12T17:08:33.602357+0000","last_peered":"2024-09-12T17:08:33.602357+0000","last_clean":"2024-09-12T17:08:33.602357+0000","last_became_active":"2024-09-12T17:05:57.584326+0000","last_became_peered":"2024-09-12T17:05:57.584326+0000","last_unstale":"2024-09-12T17:08:33.602357+0000","last_undegraded":"2024-09-12T17:08:33.602357+0000","last_fullsized":"2024-09-12T17:08:33.602357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586932+0000","last_change":"2024-09-12T17:05:49.553294+0000","last_active":"2024-09-12T17:08:32.586932+0000","last_peered":"2024-09-12T17:08:32.586932+0000","last_clean":"2024-09-12T17:08:32.586932+0000","last_became_active":"2024-09-12T17:05:49.551726+0000","last_became_peered":"2024-09-12T17:05:49.551726+0000","last_unstale":"2024-09-12T17:08:32.586932+0000","last_undegraded":"2024-09-12T17:08:32.586932+0000","last_fullsized":"2024-09-12T17:08:32.586932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:50.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'8","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604429+0000","last_change":"2024-09-12T17:08:18.767913+0000","last_active":"2024-09-12T17:08:33.604429+0000","last_peered":"2024-09-12T17:08:33.604429+0000","last_clean":"2024-09-12T17:08:33.604429+0000","last_became_active":"2024-09-12T17:08:18.466136+0000","last_became_peered":"2024-09-12T17:08:18.466136+0000","last_unstale":"2024-09-12T17:08:33.604429+0000","last_undegraded":"2024-09-12T17:08:33.604429+0000","last_fullsized":"2024-09-12T17:08:33.604429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:20.220833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942823+0000","last_change":"2024-09-12T17:05:42.680975+0000","last_active":"2024-09-12T17:08:32.942823+0000","last_peered":"2024-09-12T17:08:32.942823+0000","last_clean":"2024-09-12T17:08:32.942823+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:08:32.942823+0000","last_undegraded":"2024-09-12T17:08:32.942823+0000","last_fullsized":"2024-09-12T17:08:32.942823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.660350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":170,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585393+0000","last_change":"2024-09-12T17:08:18.450093+0000","last_active":"2024-09-12T17:08:32.585393+0000","last_peered":"2024-09-12T17:08:32.585393+0000","last_clean":"2024-09-12T17:08:32.585393+0000","last_became_active":"2024-09-12T17:08:18.449746+0000","last_became_peered":"2024-09-12T17:08:18.449746+0000","last_unstale":"2024-09-12T17:08:32.585393+0000","last_undegraded":"2024-09-12T17:08:32.585393+0000","last_fullsized":"2024-09-12T17:08:32.585393+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:58.736246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"84'38","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603887+0000","last_change":"2024-09-12T17:05:53.554751+0000","last_active":"2024-09-12T17:08:33.603887+0000","last_peered":"2024-09-12T17:08:33.603887+0000","last_clean":"2024-09-12T17:08:33.603887+0000","last_became_active":"2024-09-12T17:05:53.553914+0000","last_became_peered":"2024-09-12T17:05:53.553914+0000","last_unstale":"2024-09-12T17:08:33.603887+0000","last_undegraded":"2024-09-12T17:08:33.603887+0000","last_fullsized":"2024-09-12T17:08:33.603887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29607,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":65,"num_read_kb":81,"num_write":48,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586160+0000","last_change":"2024-09-12T17:08:21.458963+0000","last_active":"2024-09-12T17:08:32.586160+0000","last_peered":"2024-09-12T17:08:32.586160+0000","last_clean":"2024-09-12T17:08:32.586160+0000","last_became_active":"2024-09-12T17:08:21.458521+0000","last_became_peered":"2024-09-12T17:08:21.458521+0000","last_unstale":"2024-09-12T17:08:32.586160+0000","last_undegraded":"2024-09-12T17:08:32.586160+0000","last_fullsized":"2024-09-12T17:08:32.586160+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:56.903898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603355+0000","last_change":"2024-09-12T17:05:57.605829+0000","last_active":"2024-09-12T17:08:33.603355+0000","last_peered":"2024-09-12T17:08:33.603355+0000","last_clean":"2024-09-12T17:08:33.603355+0000","last_became_active":"2024-09-12T17:05:57.605041+0000","last_became_peered":"2024-09-12T17:05:57.605041+0000","last_unstale":"2024-09-12T17:08:33.603355+0000","last_undegraded":"2024-09-12T17:08:33.603355+0000","last_fullsized":"2024-09-12T17:08:33.603355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602885+0000","last_change":"2024-09-12T17:05:57.594498+0000","last_active":"2024-09-12T17:08:33.602885+0000","last_peered":"2024-09-12T17:08:33.602885+0000","last_clean":"2024-09-12T17:08:33.602885+0000","last_became_active":"2024-09-12T17:05:57.590196+0000","last_became_peered":"2024-09-12T17:05:57.590196+0000","last_unstale":"2024-09-12T17:08:33.602885+0000","last_undegraded":"2024-09-12T17:08:33.602885+0000","last_fullsized":"2024-09-12T17:08:33.602885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.543735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587220+0000","last_change":"2024-09-12T17:05:49.562121+0000","last_active":"2024-09-12T17:08:32.587220+0000","last_peered":"2024-09-12T17:08:32.587220+0000","last_clean":"2024-09-12T17:08:32.587220+0000","last_became_active":"2024-09-12T17:05:49.561429+0000","last_became_peered":"2024-09-12T17:05:49.561429+0000","last_unstale":"2024-09-12T17:08:32.587220+0000","last_undegraded":"2024-09-12T17:08:32.587220+0000","last_fullsized":"2024-09-12T17:08:32.587220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:47.663366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586907+0000","last_change":"2024-09-12T17:05:47.557270+0000","last_active":"2024-09-12T17:08:32.586907+0000","last_peered":"2024-09-12T17:08:32.586907+0000","last_clean":"2024-09-12T17:08:32.586907+0000","last_became_active":"2024-09-12T17:05:47.556417+0000","last_became_peered":"2024-09-12T17:05:47.556417+0000","last_unstale":"2024-09-12T17:08:32.586907+0000","last_undegraded":"2024-09-12T17:08:32.586907+0000","last_fullsized":"2024-09-12T17:08:32.586907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:00.210632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32774,"num_write":27,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":37,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941660+0000","last_change":"2024-09-12T17:08:18.464941+0000","last_active":"2024-09-12T17:08:32.941660+0000","last_peered":"2024-09-12T17:08:32.941660+0000","last_clean":"2024-09-12T17:08:32.941660+0000","last_became_active":"2024-09-12T17:08:18.464091+0000","last_became_peered":"2024-09-12T17:08:18.464091+0000","last_unstale":"2024-09-12T17:08:32.941660+0000","last_undegraded":"2024-09-12T17:08:32.941660+0000","last_fullsized":"2024-09-12T17:08:32.941660+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:15.952591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"84'16","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585047+0000","last_change":"2024-09-12T17:05:53.542230+0000","last_active":"2024-09-12T17:08:32.585047+0000","last_peered":"2024-09-12T17:08:32.585047+0000","last_clean":"2024-09-12T17:08:32.585047+0000","last_became_active":"2024-09-12T17:05:53.541653+0000","last_became_peered":"2024-09-12T17:05:53.541653+0000","last_unstale":"2024-09-12T17:08:32.585047+0000","last_undegraded":"2024-09-12T17:08:32.585047+0000","last_fullsized":"2024-09-12T17:08:32.585047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585702+0000","last_change":"2024-09-12T17:05:55.556535+0000","last_active":"2024-09-12T17:08:32.585702+0000","last_peered":"2024-09-12T17:08:32.585702+0000","last_clean":"2024-09-12T17:08:32.585702+0000","last_became_active":"2024-09-12T17:05:55.555755+0000","last_became_peered":"2024-09-12T17:05:55.555755+0000","last_unstale":"2024-09-12T17:08:32.585702+0000","last_undegraded":"2024-09-12T17:08:32.585702+0000","last_fullsized":"2024-09-12T17:08:32.585702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.707384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"84'2","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.590927+0000","last_change":"2024-09-12T17:05:57.593418+0000","last_active":"2024-09-12T17:08:32.590927+0000","last_peered":"2024-09-12T17:08:32.590927+0000","last_clean":"2024-09-12T17:08:32.590927+0000","last_became_active":"2024-09-12T17:05:57.592746+0000","last_became_peered":"2024-09-12T17:05:57.592746+0000","last_unstale":"2024-09-12T17:08:32.590927+0000","last_undegraded":"2024-09-12T17:08:32.590927+0000","last_fullsized":"2024-09-12T17:08:32.590927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:24.794382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"68'6","reported_seq":36,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939814+0000","last_change":"2024-09-12T17:08:21.616789+0000","last_active":"2024-09-12T17:08:32.939814+0000","last_peered":"2024-09-12T17:08:32.939814+0000","last_clean":"2024-09-12T17:08:32.939814+0000","last_became_active":"2024-09-12T17:08:21.466328+0000","last_became_peered":"2024-09-12T17:08:21.466328+0000","last_unstale":"2024-09-12T17:08:32.939814+0000","last_undegraded":"2024-09-12T17:08:32.939814+0000","last_fullsized":"2024-09-12T17:08:32.939814+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:16.524646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"84'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608043+0000","last_change":"2024-09-12T17:05:47.559497+0000","last_active":"2024-09-12T17:08:33.608043+0000","last_peered":"2024-09-12T17:08:33.608043+0000","last_clean":"2024-09-12T17:08:33.608043+0000","last_became_active":"2024-09-12T17:05:47.558641+0000","last_became_peered":"2024-09-12T17:05:47.558641+0000","last_unstale":"2024-09-12T17:08:33.608043+0000","last_undegraded":"2024-09-12T17:08:33.608043+0000","last_fullsized":"2024-09-12T17:08:33.608043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:00.096304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24585,"num_write":33,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587638+0000","last_change":"2024-09-12T17:05:51.539784+0000","last_active":"2024-09-12T17:08:32.587638+0000","last_peered":"2024-09-12T17:08:32.587638+0000","last_clean":"2024-09-12T17:08:32.587638+0000","last_became_active":"2024-09-12T17:05:51.539275+0000","last_became_peered":"2024-09-12T17:05:51.539275+0000","last_unstale":"2024-09-12T17:08:32.587638+0000","last_undegraded":"2024-09-12T17:08:32.587638+0000","last_fullsized":"2024-09-12T17:08:32.587638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"84'6","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600440+0000","last_change":"2024-09-12T17:05:53.544731+0000","last_active":"2024-09-12T17:08:33.600440+0000","last_peered":"2024-09-12T17:08:33.600440+0000","last_clean":"2024-09-12T17:08:33.600440+0000","last_became_active":"2024-09-12T17:05:53.544127+0000","last_became_peered":"2024-09-12T17:05:53.544127+0000","last_unstale":"2024-09-12T17:08:33.600440+0000","last_undegraded":"2024-09-12T17:08:33.600440+0000","last_fullsized":"2024-09-12T17:08:33.600440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:04.351698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604873+0000","last_change":"2024-09-12T17:05:55.571541+0000","last_active":"2024-09-12T17:08:33.604873+0000","last_peered":"2024-09-12T17:08:33.604873+0000","last_clean":"2024-09-12T17:08:33.604873+0000","last_became_active":"2024-09-12T17:05:55.570822+0000","last_became_peered":"2024-09-12T17:05:55.570822+0000","last_unstale":"2024-09-12T17:08:33.604873+0000","last_undegraded":"2024-09-12T17:08:33.604873+0000","last_fullsized":"2024-09-12T17:08:33.604873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'2","reported_seq":165,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602495+0000","last_change":"2024-09-12T17:08:18.704689+0000","last_active":"2024-09-12T17:08:33.602495+0000","last_peered":"2024-09-12T17:08:33.602495+0000","last_clean":"2024-09-12T17:08:33.602495+0000","last_became_active":"2024-09-12T17:08:18.450561+0000","last_became_peered":"2024-09-12T17:08:18.450561+0000","last_unstale":"2024-09-12T17:08:33.602495+0000","last_undegraded":"2024-09-12T17:08:33.602495+0000","last_fullsized":"2024-09-12T17:08:33.602495+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:43.088841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585394+0000","last_change":"2024-09-12T17:05:49.520508+0000","last_active":"2024-09-12T17:08:32.585394+0000","last_peered":"2024-09-12T17:08:32.585394+0000","last_clean":"2024-09-12T17:08:32.585394+0000","last_became_active":"2024-09-12T17:05:49.519721+0000","last_became_peered":"2024-09-12T17:05:49.519721+0000","last_unstale":"2024-09-12T17:08:32.585394+0000","last_undegraded":"2024-09-12T17:08:32.585394+0000","last_fullsized":"2024-09-12T17:08:32.585394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"84'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605499+0000","last_change":"2024-09-12T17:05:47.539549+0000","last_active":"2024-09-12T17:08:33.605499+0000","last_peered":"2024-09-12T17:08:33.605499+0000","last_clean":"2024-09-12T17:08:33.605499+0000","last_became_active":"2024-09-12T17:05:47.538581+0000","last_became_peered":"2024-09-12T17:05:47.538581+0000","last_unstale":"2024-09-12T17:08:33.605499+0000","last_undegraded":"2024-09-12T17:08:33.605499+0000","last_fullsized":"2024-09-12T17:08:33.605499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.448924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601093+0000","last_change":"2024-09-12T17:05:51.530541+0000","last_active":"2024-09-12T17:08:33.601093+0000","last_peered":"2024-09-12T17:08:33.601093+0000","last_clean":"2024-09-12T17:08:33.601093+0000","last_became_active":"2024-09-12T17:05:51.527515+0000","last_became_peered":"2024-09-12T17:05:51.527515+0000","last_unstale":"2024-09-12T17:08:33.601093+0000","last_undegraded":"2024-09-12T17:08:33.601093+0000","last_fullsized":"2024-09-12T17:08:33.601093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"84'16","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587117+0000","last_change":"2024-09-12T17:05:53.555017+0000","last_active":"2024-09-12T17:08:32.587117+0000","last_peered":"2024-09-12T17:08:32.587117+0000","last_clean":"2024-09-12T17:08:32.587117+0000","last_became_active":"2024-09-12T17:05:53.551154+0000","last_became_peered":"2024-09-12T17:05:53.551154+0000","last_unstale":"2024-09-12T17:08:32.587117+0000","last_undegraded":"2024-09-12T17:08:32.587117+0000","last_fullsized":"2024-09-12T17:08:32.587117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:50.736153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940929+0000","last_change":"2024-09-12T17:05:55.570872+0000","last_active":"2024-09-12T17:08:32.940929+0000","last_peered":"2024-09-12T17:08:32.940929+0000","last_clean":"2024-09-12T17:08:32.940929+0000","last_became_active":"2024-09-12T17:05:55.570137+0000","last_became_peered":"2024-09-12T17:05:55.570137+0000","last_unstale":"2024-09-12T17:08:32.940929+0000","last_undegraded":"2024-09-12T17:08:32.940929+0000","last_fullsized":"2024-09-12T17:08:32.940929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.684868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602407+0000","last_change":"2024-09-12T17:05:57.597088+0000","last_active":"2024-09-12T17:08:33.602407+0000","last_peered":"2024-09-12T17:08:33.602407+0000","last_clean":"2024-09-12T17:08:33.602407+0000","last_became_active":"2024-09-12T17:05:57.596377+0000","last_became_peered":"2024-09-12T17:05:57.596377+0000","last_unstale":"2024-09-12T17:08:33.602407+0000","last_undegraded":"2024-09-12T17:08:33.602407+0000","last_fullsized":"2024-09-12T17:08:33.602407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"68'2","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585072+0000","last_change":"2024-09-12T17:08:18.478612+0000","last_active":"2024-09-12T17:08:32.585072+0000","last_peered":"2024-09-12T17:08:32.585072+0000","last_clean":"2024-09-12T17:08:32.585072+0000","last_became_active":"2024-09-12T17:08:18.449338+0000","last_became_peered":"2024-09-12T17:08:18.449338+0000","last_unstale":"2024-09-12T17:08:32.585072+0000","last_undegraded":"2024-09-12T17:08:32.585072+0000","last_fullsized":"2024-09-12T17:08:32.585072+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:15.864351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"73'7","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603421+0000","last_change":"2024-09-12T17:05:47.526555+0000","last_active":"2024-09-12T17:08:33.603421+0000","last_peered":"2024-09-12T17:08:33.603421+0000","last_clean":"2024-09-12T17:08:33.603421+0000","last_became_active":"2024-09-12T17:05:47.525874+0000","last_became_peered":"2024-09-12T17:05:47.525874+0000","last_unstale":"2024-09-12T17:08:33.603421+0000","last_undegraded":"2024-09-12T17:08:33.603421+0000","last_fullsized":"2024-09-12T17:08:33.603421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":18435,"num_write":15,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939050+0000","last_change":"2024-09-12T17:05:51.540509+0000","last_active":"2024-09-12T17:08:32.939050+0000","last_peered":"2024-09-12T17:08:32.939050+0000","last_clean":"2024-09-12T17:08:32.939050+0000","last_became_active":"2024-09-12T17:05:51.539607+0000","last_became_peered":"2024-09-12T17:05:51.539607+0000","last_unstale":"2024-09-12T17:08:32.939050+0000","last_undegraded":"2024-09-12T17:08:32.939050+0000","last_fullsized":"2024-09-12T17:08:32.939050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:02.652624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"84'13","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603961+0000","last_change":"2024-09-12T17:05:53.549324+0000","last_active":"2024-09-12T17:08:33.603961+0000","last_peered":"2024-09-12T17:08:33.603961+0000","last_clean":"2024-09-12T17:08:33.603961+0000","last_became_active":"2024-09-12T17:05:53.548561+0000","last_became_peered":"2024-09-12T17:05:53.548561+0000","last_unstale":"2024-09-12T17:08:33.603961+0000","last_undegraded":"2024-09-12T17:08:33.603961+0000","last_fullsized":"2024-09-12T17:08:33.603961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:47.932776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601440+0000","last_change":"2024-09-12T17:05:55.561467+0000","last_active":"2024-09-12T17:08:33.601440+0000","last_peered":"2024-09-12T17:08:33.601440+0000","last_clean":"2024-09-12T17:08:33.601440+0000","last_became_active":"2024-09-12T17:05:55.560708+0000","last_became_peered":"2024-09-12T17:05:55.560708+0000","last_unstale":"2024-09-12T17:08:33.601440+0000","last_undegraded":"2024-09-12T17:08:33.601440+0000","last_fullsized":"2024-09-12T17:08:33.601440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"84'46","reported_seq":211,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942538+0000","last_change":"2024-09-12T17:05:49.547097+0000","last_active":"2024-09-12T17:08:32.942538+0000","last_peered":"2024-09-12T17:08:32.942538+0000","last_clean":"2024-09-12T17:08:32.942538+0000","last_became_active":"2024-09-12T17:05:49.546232+0000","last_became_peered":"2024-09-12T17:05:49.546232+0000","last_unstale":"2024-09-12T17:08:32.942538+0000","last_undegraded":"2024-09-12T17:08:32.942538+0000","last_fullsized":"2024-09-12T17:08:32.942538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'9","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.584853+0000","last_change":"2024-09-12T17:05:47.521779+0000","last_active":"2024-09-12T17:08:32.584853+0000","last_peered":"2024-09-12T17:08:32.584853+0000","last_clean":"2024-09-12T17:08:32.584853+0000","last_became_active":"2024-09-12T17:05:47.521097+0000","last_became_peered":"2024-09-12T17:05:47.521097+0000","last_unstale":"2024-09-12T17:08:32.584853+0000","last_undegraded":"2024-09-12T17:08:32.584853+0000","last_fullsized":"2024-09-12T17:08:32.584853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:37.072896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":24579,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604192+0000","last_change":"2024-09-12T17:05:51.525803+0000","last_active":"2024-09-12T17:08:33.604192+0000","last_peered":"2024-09-12T17:08:33.604192+0000","last_clean":"2024-09-12T17:08:33.604192+0000","last_became_active":"2024-09-12T17:05:51.525457+0000","last_became_peered":"2024-09-12T17:05:51.525457+0000","last_unstale":"2024-09-12T17:08:33.604192+0000","last_undegraded":"2024-09-12T17:08:33.604192+0000","last_fullsized":"2024-09-12T17:08:33.604192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"84'27","reported_seq":49,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.943096+0000","last_change":"2024-09-12T17:08:19.023629+0000","last_active":"2024-09-12T17:08:32.943096+0000","last_peered":"2024-09-12T17:08:32.943096+0000","last_clean":"2024-09-12T17:08:32.943096+0000","last_became_active":"2024-09-12T17:08:18.463961+0000","last_became_peered":"2024-09-12T17:08:18.463961+0000","last_unstale":"2024-09-12T17:08:32.943096+0000","last_undegraded":"2024-09-12T17:08:32.943096+0000","last_fullsized":"2024-09-12T17:08:32.943096+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:09.409031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24405,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":46,"num_read_kb":64,"num_write":36,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":16653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603360+0000","last_change":"2024-09-12T17:05:55.563312+0000","last_active":"2024-09-12T17:08:33.603360+0000","last_peered":"2024-09-12T17:08:33.603360+0000","last_clean":"2024-09-12T17:08:33.603360+0000","last_became_active":"2024-09-12T17:05:55.562405+0000","last_became_peered":"2024-09-12T17:05:55.562405+0000","last_unstale":"2024-09-12T17:08:33.603360+0000","last_undegraded":"2024-09-12T17:08:33.603360+0000","last_fullsized":"2024-09-12T17:08:33.603360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588047+0000","last_change":"2024-09-12T17:05:58.121110+0000","last_active":"2024-09-12T17:08:32.588047+0000","last_peered":"2024-09-12T17:08:32.588047+0000","last_clean":"2024-09-12T17:08:32.588047+0000","last_became_active":"2024-09-12T17:05:58.120367+0000","last_became_peered":"2024-09-12T17:05:58.120367+0000","last_unstale":"2024-09-12T17:08:32.588047+0000","last_undegraded":"2024-09-12T17:08:32.588047+0000","last_fullsized":"2024-09-12T17:08:32.588047+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604265+0000","last_change":"2024-09-12T17:05:49.532377+0000","last_active":"2024-09-12T17:08:33.604265+0000","last_peered":"2024-09-12T17:08:33.604265+0000","last_clean":"2024-09-12T17:08:33.604265+0000","last_became_active":"2024-09-12T17:05:49.531975+0000","last_became_peered":"2024-09-12T17:05:49.531975+0000","last_unstale":"2024-09-12T17:08:33.604265+0000","last_undegraded":"2024-09-12T17:08:33.604265+0000","last_fullsized":"2024-09-12T17:08:33.604265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'13","reported_seq":57,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939920+0000","last_change":"2024-09-12T17:08:19.003420+0000","last_active":"2024-09-12T17:08:32.939920+0000","last_peered":"2024-09-12T17:08:32.939920+0000","last_clean":"2024-09-12T17:08:32.939920+0000","last_became_active":"2024-09-12T17:08:18.457074+0000","last_became_peered":"2024-09-12T17:08:18.457074+0000","last_unstale":"2024-09-12T17:08:32.939920+0000","last_undegraded":"2024-09-12T17:08:32.939920+0000","last_fullsized":"2024-09-12T17:08:32.939920+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:07.545826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":36876,"num_write":45,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942211+0000","last_change":"2024-09-12T17:05:51.546117+0000","last_active":"2024-09-12T17:08:32.942211+0000","last_peered":"2024-09-12T17:08:32.942211+0000","last_clean":"2024-09-12T17:08:32.942211+0000","last_became_active":"2024-09-12T17:05:51.545154+0000","last_became_peered":"2024-09-12T17:05:51.545154+0000","last_unstale":"2024-09-12T17:08:32.942211+0000","last_undegraded":"2024-09-12T17:08:32.942211+0000","last_fullsized":"2024-09-12T17:08:32.942211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:49.670591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"83'19","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603894+0000","last_change":"2024-09-12T17:05:53.558834+0000","last_active":"2024-09-12T17:08:33.603894+0000","last_peered":"2024-09-12T17:08:33.603894+0000","last_clean":"2024-09-12T17:08:33.603894+0000","last_became_active":"2024-09-12T17:05:53.558086+0000","last_became_peered":"2024-09-12T17:05:53.558086+0000","last_unstale":"2024-09-12T17:08:33.603894+0000","last_undegraded":"2024-09-12T17:08:33.603894+0000","last_fullsized":"2024-09-12T17:08:33.603894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:43.690058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941954+0000","last_change":"2024-09-12T17:08:21.466904+0000","last_active":"2024-09-12T17:08:32.941954+0000","last_peered":"2024-09-12T17:08:32.941954+0000","last_clean":"2024-09-12T17:08:32.941954+0000","last_became_active":"2024-09-12T17:08:21.466295+0000","last_became_peered":"2024-09-12T17:08:21.466295+0000","last_unstale":"2024-09-12T17:08:32.941954+0000","last_undegraded":"2024-09-12T17:08:32.941954+0000","last_fullsized":"2024-09-12T17:08:32.941954+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:22.041235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'2","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940467+0000","last_change":"2024-09-12T17:05:57.597468+0000","last_active":"2024-09-12T17:08:32.940467+0000","last_peered":"2024-09-12T17:08:32.940467+0000","last_clean":"2024-09-12T17:08:32.940467+0000","last_became_active":"2024-09-12T17:05:57.596651+0000","last_became_peered":"2024-09-12T17:05:57.596651+0000","last_unstale":"2024-09-12T17:08:32.940467+0000","last_undegraded":"2024-09-12T17:08:32.940467+0000","last_fullsized":"2024-09-12T17:08:32.940467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.466145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589128+0000","last_change":"2024-09-12T17:08:18.465892+0000","last_active":"2024-09-12T17:08:32.589128+0000","last_peered":"2024-09-12T17:08:32.589128+0000","last_clean":"2024-09-12T17:08:32.589128+0000","last_became_active":"2024-09-12T17:08:18.465478+0000","last_became_peered":"2024-09-12T17:08:18.465478+0000","last_unstale":"2024-09-12T17:08:32.589128+0000","last_undegraded":"2024-09-12T17:08:32.589128+0000","last_fullsized":"2024-09-12T17:08:32.589128+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:00.793079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"83'8","reported_seq":210,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.591431+0000","last_change":"2024-09-12T17:08:18.626808+0000","last_active":"2024-09-12T17:08:32.591431+0000","last_peered":"2024-09-12T17:08:32.591431+0000","last_clean":"2024-09-12T17:08:32.591431+0000","last_became_active":"2024-09-12T17:08:18.447694+0000","last_became_peered":"2024-09-12T17:08:18.447694+0000","last_unstale":"2024-09-12T17:08:32.591431+0000","last_undegraded":"2024-09-12T17:08:32.591431+0000","last_fullsized":"2024-09-12T17:08:32.591431+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:09.465286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28675,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588640+0000","last_change":"2024-09-12T17:05:51.539916+0000","last_active":"2024-09-12T17:08:32.588640+0000","last_peered":"2024-09-12T17:08:32.588640+0000","last_clean":"2024-09-12T17:08:32.588640+0000","last_became_active":"2024-09-12T17:05:51.539054+0000","last_became_peered":"2024-09-12T17:05:51.539054+0000","last_unstale":"2024-09-12T17:08:32.588640+0000","last_undegraded":"2024-09-12T17:08:32.588640+0000","last_fullsized":"2024-09-12T17:08:32.588640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:11.640578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"84'16","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.592263+0000","last_change":"2024-09-12T17:05:53.557081+0000","last_active":"2024-09-12T17:08:32.592263+0000","last_peered":"2024-09-12T17:08:32.592263+0000","last_clean":"2024-09-12T17:08:32.592263+0000","last_became_active":"2024-09-12T17:05:53.556357+0000","last_became_peered":"2024-09-12T17:05:53.556357+0000","last_unstale":"2024-09-12T17:08:32.592263+0000","last_undegraded":"2024-09-12T17:08:32.592263+0000","last_fullsized":"2024-09-12T17:08:32.592263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:10.984649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.943470+0000","last_change":"2024-09-12T17:08:21.461633+0000","last_active":"2024-09-12T17:08:32.943470+0000","last_peered":"2024-09-12T17:08:32.943470+0000","last_clean":"2024-09-12T17:08:32.943470+0000","last_became_active":"2024-09-12T17:08:21.460894+0000","last_became_peered":"2024-09-12T17:08:21.460894+0000","last_unstale":"2024-09-12T17:08:32.943470+0000","last_undegraded":"2024-09-12T17:08:32.943470+0000","last_fullsized":"2024-09-12T17:08:32.943470+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:18.857770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601884+0000","last_change":"2024-09-12T17:05:57.596779+0000","last_active":"2024-09-12T17:08:33.601884+0000","last_peered":"2024-09-12T17:08:33.601884+0000","last_clean":"2024-09-12T17:08:33.601884+0000","last_became_active":"2024-09-12T17:05:57.596005+0000","last_became_peered":"2024-09-12T17:05:57.596005+0000","last_unstale":"2024-09-12T17:08:33.601884+0000","last_undegraded":"2024-09-12T17:08:33.601884+0000","last_fullsized":"2024-09-12T17:08:33.601884+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938700+0000","last_change":"2024-09-12T17:08:18.445744+0000","last_active":"2024-09-12T17:08:32.938700+0000","last_peered":"2024-09-12T17:08:32.938700+0000","last_clean":"2024-09-12T17:08:32.938700+0000","last_became_active":"2024-09-12T17:08:18.445415+0000","last_became_peered":"2024-09-12T17:08:18.445415+0000","last_unstale":"2024-09-12T17:08:32.938700+0000","last_undegraded":"2024-09-12T17:08:32.938700+0000","last_fullsized":"2024-09-12T17:08:32.938700+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:17.325226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"84'14","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601797+0000","last_change":"2024-09-12T17:05:47.546051+0000","last_active":"2024-09-12T17:08:33.601797+0000","last_peered":"2024-09-12T17:08:33.601797+0000","last_clean":"2024-09-12T17:08:33.601797+0000","last_became_active":"2024-09-12T17:05:47.545466+0000","last_became_peered":"2024-09-12T17:05:47.545466+0000","last_unstale":"2024-09-12T17:08:33.601797+0000","last_undegraded":"2024-09-12T17:08:33.601797+0000","last_fullsized":"2024-09-12T17:08:33.601797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":40966,"num_write":30,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.943660+0000","last_change":"2024-09-12T17:08:18.457478+0000","last_active":"2024-09-12T17:08:32.943660+0000","last_peered":"2024-09-12T17:08:32.943660+0000","last_clean":"2024-09-12T17:08:32.943660+0000","last_became_active":"2024-09-12T17:08:18.457099+0000","last_became_peered":"2024-09-12T17:08:18.457099+0000","last_unstale":"2024-09-12T17:08:32.943660+0000","last_undegraded":"2024-09-12T17:08:32.943660+0000","last_fullsized":"2024-09-12T17:08:32.943660+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:30.371124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"86'12","reported_seq":171,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589624+0000","last_change":"2024-09-12T17:05:53.561278+0000","last_active":"2024-09-12T17:08:32.589624+0000","last_peered":"2024-09-12T17:08:32.589624+0000","last_clean":"2024-09-12T17:08:32.589624+0000","last_became_active":"2024-09-12T17:05:53.559688+0000","last_became_peered":"2024-09-12T17:05:53.559688+0000","last_unstale":"2024-09-12T17:08:32.589624+0000","last_undegraded":"2024-09-12T17:08:32.589624+0000","last_fullsized":"2024-09-12T17:08:32.589624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:37.392549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":16,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"84'14","reported_seq":202,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941895+0000","last_change":"2024-09-12T17:05:55.576227+0000","last_active":"2024-09-12T17:08:32.941895+0000","last_peered":"2024-09-12T17:08:32.941895+0000","last_clean":"2024-09-12T17:08:32.941895+0000","last_became_active":"2024-09-12T17:05:55.571966+0000","last_became_peered":"2024-09-12T17:05:55.571966+0000","last_unstale":"2024-09-12T17:08:32.941895+0000","last_undegraded":"2024-09-12T17:08:32.941895+0000","last_fullsized":"2024-09-12T17:08:32.941895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:24.680106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601043+0000","last_change":"2024-09-12T17:05:57.595153+0000","last_active":"2024-09-12T17:08:33.601043+0000","last_peered":"2024-09-12T17:08:33.601043+0000","last_clean":"2024-09-12T17:08:33.601043+0000","last_became_active":"2024-09-12T17:05:57.594396+0000","last_became_peered":"2024-09-12T17:05:57.594396+0000","last_unstale":"2024-09-12T17:08:33.601043+0000","last_undegraded":"2024-09-12T17:08:33.601043+0000","last_fullsized":"2024-09-12T17:08:33.601043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:27.040243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586992+0000","last_change":"2024-09-12T17:05:49.543269+0000","last_active":"2024-09-12T17:08:32.586992+0000","last_peered":"2024-09-12T17:08:32.586992+0000","last_clean":"2024-09-12T17:08:32.586992+0000","last_became_active":"2024-09-12T17:05:49.542414+0000","last_became_peered":"2024-09-12T17:05:49.542414+0000","last_unstale":"2024-09-12T17:08:32.586992+0000","last_undegraded":"2024-09-12T17:08:32.586992+0000","last_fullsized":"2024-09-12T17:08:32.586992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:00.645399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"84'14","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.937439+0000","last_change":"2024-09-12T17:06:27.785226+0000","last_active":"2024-09-12T17:08:32.937439+0000","last_peered":"2024-09-12T17:08:32.937439+0000","last_clean":"2024-09-12T17:08:32.937439+0000","last_became_active":"2024-09-12T17:06:27.784897+0000","last_became_peered":"2024-09-12T17:06:27.784897+0000","last_unstale":"2024-09-12T17:08:32.937439+0000","last_undegraded":"2024-09-12T17:08:32.937439+0000","last_fullsized":"2024-09-12T17:08:32.937439+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:25.368283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":49158,"num_write":30,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604574+0000","last_change":"2024-09-12T17:05:51.528322+0000","last_active":"2024-09-12T17:08:33.604574+0000","last_peered":"2024-09-12T17:08:33.604574+0000","last_clean":"2024-09-12T17:08:33.604574+0000","last_became_active":"2024-09-12T17:05:51.527501+0000","last_became_peered":"2024-09-12T17:05:51.527501+0000","last_unstale":"2024-09-12T17:08:33.604574+0000","last_undegraded":"2024-09-12T17:08:33.604574+0000","last_fullsized":"2024-09-12T17:08:33.604574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"84'20","reported_seq":228,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602423+0000","last_change":"2024-09-12T17:08:18.786022+0000","last_active":"2024-09-12T17:08:33.602423+0000","last_peered":"2024-09-12T17:08:33.602423+0000","last_clean":"2024-09-12T17:08:33.602423+0000","last_became_active":"2024-09-12T17:08:18.474969+0000","last_became_peered":"2024-09-12T17:08:18.474969+0000","last_unstale":"2024-09-12T17:08:33.602423+0000","last_undegraded":"2024-09-12T17:08:33.602423+0000","last_fullsized":"2024-09-12T17:08:33.602423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1889,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.599911+0000","last_change":"2024-09-12T17:05:55.567202+0000","last_active":"2024-09-12T17:08:33.599911+0000","last_peered":"2024-09-12T17:08:33.599911+0000","last_clean":"2024-09-12T17:08:33.599911+0000","last_became_active":"2024-09-12T17:05:55.564710+0000","last_became_peered":"2024-09-12T17:05:55.564710+0000","last_unstale":"2024-09-12T17:08:33.599911+0000","last_undegraded":"2024-09-12T17:08:33.599911+0000","last_fullsized":"2024-09-12T17:08:33.599911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608195+0000","last_change":"2024-09-12T17:05:57.604052+0000","last_active":"2024-09-12T17:08:33.608195+0000","last_peered":"2024-09-12T17:08:33.608195+0000","last_clean":"2024-09-12T17:08:33.608195+0000","last_became_active":"2024-09-12T17:05:57.603285+0000","last_became_peered":"2024-09-12T17:05:57.603285+0000","last_unstale":"2024-09-12T17:08:33.608195+0000","last_undegraded":"2024-09-12T17:08:33.608195+0000","last_fullsized":"2024-09-12T17:08:33.608195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:31.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'6","reported_seq":171,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589693+0000","last_change":"2024-09-12T17:05:49.548224+0000","last_active":"2024-09-12T17:08:32.589693+0000","last_peered":"2024-09-12T17:08:32.589693+0000","last_clean":"2024-09-12T17:08:32.589693+0000","last_became_active":"2024-09-12T17:05:49.541007+0000","last_became_peered":"2024-09-12T17:05:49.541007+0000","last_unstale":"2024-09-12T17:08:32.589693+0000","last_undegraded":"2024-09-12T17:08:32.589693+0000","last_fullsized":"2024-09-12T17:08:32.589693+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:59.768842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"75'4","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606348+0000","last_change":"2024-09-12T17:05:47.543197+0000","last_active":"2024-09-12T17:08:33.606348+0000","last_peered":"2024-09-12T17:08:33.606348+0000","last_clean":"2024-09-12T17:08:33.606348+0000","last_became_active":"2024-09-12T17:05:47.542345+0000","last_became_peered":"2024-09-12T17:05:47.542345+0000","last_unstale":"2024-09-12T17:08:33.606348+0000","last_undegraded":"2024-09-12T17:08:33.606348+0000","last_fullsized":"2024-09-12T17:08:33.606348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.858635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602461+0000","last_change":"2024-09-12T17:05:51.556256+0000","last_active":"2024-09-12T17:08:33.602461+0000","last_peered":"2024-09-12T17:08:33.602461+0000","last_clean":"2024-09-12T17:08:33.602461+0000","last_became_active":"2024-09-12T17:05:51.554248+0000","last_became_peered":"2024-09-12T17:05:51.554248+0000","last_unstale":"2024-09-12T17:08:33.602461+0000","last_undegraded":"2024-09-12T17:08:33.602461+0000","last_fullsized":"2024-09-12T17:08:33.602461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"84'13","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.599922+0000","last_change":"2024-09-12T17:08:18.486637+0000","last_active":"2024-09-12T17:08:33.599922+0000","last_peered":"2024-09-12T17:08:33.599922+0000","last_clean":"2024-09-12T17:08:33.599922+0000","last_became_active":"2024-09-12T17:08:18.450594+0000","last_became_peered":"2024-09-12T17:08:18.450594+0000","last_unstale":"2024-09-12T17:08:33.599922+0000","last_undegraded":"2024-09-12T17:08:33.599922+0000","last_fullsized":"2024-09-12T17:08:33.599922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938545+0000","last_change":"2024-09-12T17:05:55.567605+0000","last_active":"2024-09-12T17:08:32.938545+0000","last_peered":"2024-09-12T17:08:32.938545+0000","last_clean":"2024-09-12T17:08:32.938545+0000","last_became_active":"2024-09-12T17:05:55.566774+0000","last_became_peered":"2024-09-12T17:05:55.566774+0000","last_unstale":"2024-09-12T17:08:32.938545+0000","last_undegraded":"2024-09-12T17:08:32.938545+0000","last_fullsized":"2024-09-12T17:08:32.938545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:25.935376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.591110+0000","last_change":"2024-09-12T17:05:58.121216+0000","last_active":"2024-09-12T17:08:32.591110+0000","last_peered":"2024-09-12T17:08:32.591110+0000","last_clean":"2024-09-12T17:08:32.591110+0000","last_became_active":"2024-09-12T17:05:58.120364+0000","last_became_peered":"2024-09-12T17:05:58.120364+0000","last_unstale":"2024-09-12T17:08:32.591110+0000","last_undegraded":"2024-09-12T17:08:32.591110+0000","last_fullsized":"2024-09-12T17:08:32.591110+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585730+0000","last_change":"2024-09-12T17:05:49.549956+0000","last_active":"2024-09-12T17:08:32.585730+0000","last_peered":"2024-09-12T17:08:32.585730+0000","last_clean":"2024-09-12T17:08:32.585730+0000","last_became_active":"2024-09-12T17:05:49.549481+0000","last_became_peered":"2024-09-12T17:05:49.549481+0000","last_unstale":"2024-09-12T17:08:32.585730+0000","last_undegraded":"2024-09-12T17:08:32.585730+0000","last_fullsized":"2024-09-12T17:08:32.585730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'11","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.591969+0000","last_change":"2024-09-12T17:05:47.510898+0000","last_active":"2024-09-12T17:08:32.591969+0000","last_peered":"2024-09-12T17:08:32.591969+0000","last_clean":"2024-09-12T17:08:32.591969+0000","last_became_active":"2024-09-12T17:05:47.510462+0000","last_became_peered":"2024-09-12T17:05:47.510462+0000","last_unstale":"2024-09-12T17:08:32.591969+0000","last_undegraded":"2024-09-12T17:08:32.591969+0000","last_fullsized":"2024-09-12T17:08:32.591969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":30726,"num_write":27,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585968+0000","last_change":"2024-09-12T17:05:51.541454+0000","last_active":"2024-09-12T17:08:32.585968+0000","last_peered":"2024-09-12T17:08:32.585968+0000","last_clean":"2024-09-12T17:08:32.585968+0000","last_became_active":"2024-09-12T17:05:51.539938+0000","last_became_peered":"2024-09-12T17:05:51.539938+0000","last_unstale":"2024-09-12T17:08:32.585968+0000","last_undegraded":"2024-09-12T17:08:32.585968+0000","last_fullsized":"2024-09-12T17:08:32.585968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:18.328350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"84'11","reported_seq":170,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588768+0000","last_change":"2024-09-12T17:05:53.555764+0000","last_active":"2024-09-12T17:08:32.588768+0000","last_peered":"2024-09-12T17:08:32.588768+0000","last_clean":"2024-09-12T17:08:32.588768+0000","last_became_active":"2024-09-12T17:05:53.552095+0000","last_became_peered":"2024-09-12T17:05:53.552095+0000","last_unstale":"2024-09-12T17:08:32.588768+0000","last_undegraded":"2024-09-12T17:08:32.588768+0000","last_fullsized":"2024-09-12T17:08:32.588768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":24,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588375+0000","last_change":"2024-09-12T17:05:55.571520+0000","last_active":"2024-09-12T17:08:32.588375+0000","last_peered":"2024-09-12T17:08:32.588375+0000","last_clean":"2024-09-12T17:08:32.588375+0000","last_became_active":"2024-09-12T17:05:55.570863+0000","last_became_peered":"2024-09-12T17:05:55.570863+0000","last_unstale":"2024-09-12T17:08:32.588375+0000","last_undegraded":"2024-09-12T17:08:32.588375+0000","last_fullsized":"2024-09-12T17:08:32.588375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607147+0000","last_change":"2024-09-12T17:08:21.467058+0000","last_active":"2024-09-12T17:08:33.607147+0000","last_peered":"2024-09-12T17:08:33.607147+0000","last_clean":"2024-09-12T17:08:33.607147+0000","last_became_active":"2024-09-12T17:08:21.466218+0000","last_became_peered":"2024-09-12T17:08:21.466218+0000","last_unstale":"2024-09-12T17:08:33.607147+0000","last_undegraded":"2024-09-12T17:08:33.607147+0000","last_fullsized":"2024-09-12T17:08:33.607147+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.336998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"84'38","reported_seq":203,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586496+0000","last_change":"2024-09-12T17:05:49.561555+0000","last_active":"2024-09-12T17:08:32.586496+0000","last_peered":"2024-09-12T17:08:32.586496+0000","last_clean":"2024-09-12T17:08:32.586496+0000","last_became_active":"2024-09-12T17:05:49.560875+0000","last_became_peered":"2024-09-12T17:05:49.560875+0000","last_unstale":"2024-09-12T17:08:32.586496+0000","last_undegraded":"2024-09-12T17:08:32.586496+0000","last_fullsized":"2024-09-12T17:08:32.586496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.493944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"83'14","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603340+0000","last_change":"2024-09-12T17:05:47.528128+0000","last_active":"2024-09-12T17:08:33.603340+0000","last_peered":"2024-09-12T17:08:33.603340+0000","last_clean":"2024-09-12T17:08:33.603340+0000","last_became_active":"2024-09-12T17:05:47.527364+0000","last_became_peered":"2024-09-12T17:05:47.527364+0000","last_unstale":"2024-09-12T17:08:33.603340+0000","last_undegraded":"2024-09-12T17:08:33.603340+0000","last_fullsized":"2024-09-12T17:08:33.603340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45062,"num_write":30,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":41,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940075+0000","last_change":"2024-09-12T17:08:19.007426+0000","last_active":"2024-09-12T17:08:32.940075+0000","last_peered":"2024-09-12T17:08:32.940075+0000","last_clean":"2024-09-12T17:08:32.940075+0000","last_became_active":"2024-09-12T17:08:18.463879+0000","last_became_peered":"2024-09-12T17:08:18.463879+0000","last_unstale":"2024-09-12T17:08:32.940075+0000","last_undegraded":"2024-09-12T17:08:32.940075+0000","last_fullsized":"2024-09-12T17:08:32.940075+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:10.396675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"84'16","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588651+0000","last_change":"2024-09-12T17:05:53.548391+0000","last_active":"2024-09-12T17:08:32.588651+0000","last_peered":"2024-09-12T17:08:32.588651+0000","last_clean":"2024-09-12T17:08:32.588651+0000","last_became_active":"2024-09-12T17:05:53.547202+0000","last_became_peered":"2024-09-12T17:05:53.547202+0000","last_unstale":"2024-09-12T17:08:32.588651+0000","last_undegraded":"2024-09-12T17:08:32.588651+0000","last_fullsized":"2024-09-12T17:08:32.588651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:00.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":33,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601272+0000","last_change":"2024-09-12T17:05:55.566243+0000","last_active":"2024-09-12T17:08:33.601272+0000","last_peered":"2024-09-12T17:08:33.601272+0000","last_clean":"2024-09-12T17:08:33.601272+0000","last_became_active":"2024-09-12T17:05:55.565403+0000","last_became_peered":"2024-09-12T17:05:55.565403+0000","last_unstale":"2024-09-12T17:08:33.601272+0000","last_undegraded":"2024-09-12T17:08:33.601272+0000","last_fullsized":"2024-09-12T17:08:33.601272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588706+0000","last_change":"2024-09-12T17:05:57.589526+0000","last_active":"2024-09-12T17:08:32.588706+0000","last_peered":"2024-09-12T17:08:32.588706+0000","last_clean":"2024-09-12T17:08:32.588706+0000","last_became_active":"2024-09-12T17:05:57.588626+0000","last_became_peered":"2024-09-12T17:05:57.588626+0000","last_unstale":"2024-09-12T17:08:32.588706+0000","last_undegraded":"2024-09-12T17:08:32.588706+0000","last_fullsized":"2024-09-12T17:08:32.588706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.472663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940565+0000","last_change":"2024-09-12T17:08:21.473957+0000","last_active":"2024-09-12T17:08:32.940565+0000","last_peered":"2024-09-12T17:08:32.940565+0000","last_clean":"2024-09-12T17:08:32.940565+0000","last_became_active":"2024-09-12T17:08:21.473677+0000","last_became_peered":"2024-09-12T17:08:21.473677+0000","last_unstale":"2024-09-12T17:08:32.940565+0000","last_undegraded":"2024-09-12T17:08:32.940565+0000","last_fullsized":"2024-09-12T17:08:32.940565+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:04.662160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"84'11","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939105+0000","last_change":"2024-09-12T17:05:47.532523+0000","last_active":"2024-09-12T17:08:32.939105+0000","last_peered":"2024-09-12T17:08:32.939105+0000","last_clean":"2024-09-12T17:08:32.939105+0000","last_became_active":"2024-09-12T17:05:47.531750+0000","last_became_peered":"2024-09-12T17:05:47.531750+0000","last_unstale":"2024-09-12T17:08:32.939105+0000","last_undegraded":"2024-09-12T17:08:32.939105+0000","last_fullsized":"2024-09-12T17:08:32.939105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:03.075435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36867,"num_write":19,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.944094+0000","last_change":"2024-09-12T17:08:21.463425+0000","last_active":"2024-09-12T17:08:32.944094+0000","last_peered":"2024-09-12T17:08:32.944094+0000","last_clean":"2024-09-12T17:08:32.944094+0000","last_became_active":"2024-09-12T17:08:21.462942+0000","last_became_peered":"2024-09-12T17:08:21.462942+0000","last_unstale":"2024-09-12T17:08:32.944094+0000","last_undegraded":"2024-09-12T17:08:32.944094+0000","last_fullsized":"2024-09-12T17:08:32.944094+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:35.256332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"84'10","reported_seq":186,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936568+0000","last_change":"2024-09-12T17:05:47.526020+0000","last_active":"2024-09-12T17:08:32.936568+0000","last_peered":"2024-09-12T17:08:32.936568+0000","last_clean":"2024-09-12T17:08:32.936568+0000","last_became_active":"2024-09-12T17:05:47.525481+0000","last_became_peered":"2024-09-12T17:05:47.525481+0000","last_unstale":"2024-09-12T17:08:32.936568+0000","last_undegraded":"2024-09-12T17:08:32.936568+0000","last_fullsized":"2024-09-12T17:08:32.936568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:05.949135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34819,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"84'46","reported_seq":211,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604578+0000","last_change":"2024-09-12T17:05:49.546848+0000","last_active":"2024-09-12T17:08:33.604578+0000","last_peered":"2024-09-12T17:08:33.604578+0000","last_clean":"2024-09-12T17:08:33.604578+0000","last_became_active":"2024-09-12T17:05:49.545382+0000","last_became_peered":"2024-09-12T17:05:49.545382+0000","last_unstale":"2024-09-12T17:08:33.604578+0000","last_undegraded":"2024-09-12T17:08:33.604578+0000","last_fullsized":"2024-09-12T17:08:33.604578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:42.832972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"84'10","reported_seq":97,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936839+0000","last_change":"2024-09-12T17:07:28.249892+0000","last_active":"2024-09-12T17:08:32.936839+0000","last_peered":"2024-09-12T17:08:32.936839+0000","last_clean":"2024-09-12T17:08:32.936839+0000","last_became_active":"2024-09-12T17:07:28.191632+0000","last_became_peered":"2024-09-12T17:07:28.191632+0000","last_unstale":"2024-09-12T17:08:32.936839+0000","last_undegraded":"2024-09-12T17:08:32.936839+0000","last_fullsized":"2024-09-12T17:08:32.936839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.324862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":16390,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941687+0000","last_change":"2024-09-12T17:08:21.460639+0000","last_active":"2024-09-12T17:08:32.941687+0000","last_peered":"2024-09-12T17:08:32.941687+0000","last_clean":"2024-09-12T17:08:32.941687+0000","last_became_active":"2024-09-12T17:08:21.457133+0000","last_became_peered":"2024-09-12T17:08:21.457133+0000","last_unstale":"2024-09-12T17:08:32.941687+0000","last_undegraded":"2024-09-12T17:08:32.941687+0000","last_fullsized":"2024-09-12T17:08:32.941687+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:58.322770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"71'10","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602312+0000","last_change":"2024-09-12T17:05:47.530275+0000","last_active":"2024-09-12T17:08:33.602312+0000","last_peered":"2024-09-12T17:08:33.602312+0000","last_clean":"2024-09-12T17:08:33.602312+0000","last_became_active":"2024-09-12T17:05:47.529857+0000","last_became_peered":"2024-09-12T17:05:47.529857+0000","last_unstale":"2024-09-12T17:08:33.602312+0000","last_undegraded":"2024-09-12T17:08:33.602312+0000","last_fullsized":"2024-09-12T17:08:33.602312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:47.999516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":32768,"num_write":10,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'42","reported_seq":207,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588335+0000","last_change":"2024-09-12T17:05:49.525070+0000","last_active":"2024-09-12T17:08:32.588335+0000","last_peered":"2024-09-12T17:08:32.588335+0000","last_clean":"2024-09-12T17:08:32.588335+0000","last_became_active":"2024-09-12T17:05:49.524567+0000","last_became_peered":"2024-09-12T17:05:49.524567+0000","last_unstale":"2024-09-12T17:08:32.588335+0000","last_undegraded":"2024-09-12T17:08:32.588335+0000","last_fullsized":"2024-09-12T17:08:32.588335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:34.320123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"84'11","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589755+0000","last_change":"2024-09-12T17:05:47.547765+0000","last_active":"2024-09-12T17:08:32.589755+0000","last_peered":"2024-09-12T17:08:32.589755+0000","last_clean":"2024-09-12T17:08:32.589755+0000","last_became_active":"2024-09-12T17:05:47.547393+0000","last_became_peered":"2024-09-12T17:05:47.547393+0000","last_unstale":"2024-09-12T17:08:32.589755+0000","last_undegraded":"2024-09-12T17:08:32.589755+0000","last_fullsized":"2024-09-12T17:08:32.589755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:46.746261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":30729,"num_write":35,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.591190+0000","last_change":"2024-09-12T17:05:49.561711+0000","last_active":"2024-09-12T17:08:32.591190+0000","last_peered":"2024-09-12T17:08:32.591190+0000","last_clean":"2024-09-12T17:08:32.591190+0000","last_became_active":"2024-09-12T17:05:49.560993+0000","last_became_peered":"2024-09-12T17:05:49.560993+0000","last_unstale":"2024-09-12T17:08:32.591190+0000","last_undegraded":"2024-09-12T17:08:32.591190+0000","last_fullsized":"2024-09-12T17:08:32.591190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:38.400338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"72'9","reported_seq":50,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941420+0000","last_change":"2024-09-12T17:08:21.614989+0000","last_active":"2024-09-12T17:08:32.941420+0000","last_peered":"2024-09-12T17:08:32.941420+0000","last_clean":"2024-09-12T17:08:32.941420+0000","last_became_active":"2024-09-12T17:08:21.461010+0000","last_became_peered":"2024-09-12T17:08:21.461010+0000","last_unstale":"2024-09-12T17:08:32.941420+0000","last_undegraded":"2024-09-12T17:08:32.941420+0000","last_fullsized":"2024-09-12T17:08:32.941420+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:52.706435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":11,"num_read_kb":24579,"num_write":17,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"68'2","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585397+0000","last_change":"2024-09-12T17:08:28.561852+0000","last_active":"2024-09-12T17:08:32.585397+0000","last_peered":"2024-09-12T17:08:32.585397+0000","last_clean":"2024-09-12T17:08:32.585397+0000","last_became_active":"2024-09-12T17:08:28.558588+0000","last_became_peered":"2024-09-12T17:08:28.558588+0000","last_unstale":"2024-09-12T17:08:32.585397+0000","last_undegraded":"2024-09-12T17:08:32.585397+0000","last_fullsized":"2024-09-12T17:08:32.585397+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:45.704667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'8","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942622+0000","last_change":"2024-09-12T17:05:47.541213+0000","last_active":"2024-09-12T17:08:32.942622+0000","last_peered":"2024-09-12T17:08:32.942622+0000","last_clean":"2024-09-12T17:08:32.942622+0000","last_became_active":"2024-09-12T17:05:47.540469+0000","last_became_peered":"2024-09-12T17:05:47.540469+0000","last_unstale":"2024-09-12T17:08:32.942622+0000","last_undegraded":"2024-09-12T17:08:32.942622+0000","last_fullsized":"2024-09-12T17:08:32.942622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:26.620021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":30720,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"84'42","reported_seq":207,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938835+0000","last_change":"2024-09-12T17:05:49.541113+0000","last_active":"2024-09-12T17:08:32.938835+0000","last_peered":"2024-09-12T17:08:32.938835+0000","last_clean":"2024-09-12T17:08:32.938835+0000","last_became_active":"2024-09-12T17:05:49.540395+0000","last_became_peered":"2024-09-12T17:05:49.540395+0000","last_unstale":"2024-09-12T17:08:32.938835+0000","last_undegraded":"2024-09-12T17:08:32.938835+0000","last_fullsized":"2024-09-12T17:08:32.938835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:32.506502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"84'18","reported_seq":202,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.592287+0000","last_change":"2024-09-12T17:05:47.539986+0000","last_active":"2024-09-12T17:08:32.592287+0000","last_peered":"2024-09-12T17:08:32.592287+0000","last_clean":"2024-09-12T17:08:32.592287+0000","last_became_active":"2024-09-12T17:05:47.539603+0000","last_became_peered":"2024-09-12T17:05:47.539603+0000","last_unstale":"2024-09-12T17:08:32.592287+0000","last_undegraded":"2024-09-12T17:08:32.592287+0000","last_fullsized":"2024-09-12T17:08:32.592287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":26,"num_read_kb":57350,"num_write":34,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603269+0000","last_change":"2024-09-12T17:05:49.533938+0000","last_active":"2024-09-12T17:08:33.603269+0000","last_peered":"2024-09-12T17:08:33.603269+0000","last_clean":"2024-09-12T17:08:33.603269+0000","last_became_active":"2024-09-12T17:05:49.531769+0000","last_became_peered":"2024-09-12T17:05:49.531769+0000","last_unstale":"2024-09-12T17:08:33.603269+0000","last_undegraded":"2024-09-12T17:08:33.603269+0000","last_fullsized":"2024-09-12T17:08:33.603269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:33.763423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"84'11","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603444+0000","last_change":"2024-09-12T17:05:47.525739+0000","last_active":"2024-09-12T17:08:33.603444+0000","last_peered":"2024-09-12T17:08:33.603444+0000","last_clean":"2024-09-12T17:08:33.603444+0000","last_became_active":"2024-09-12T17:05:47.524922+0000","last_became_peered":"2024-09-12T17:05:47.524922+0000","last_unstale":"2024-09-12T17:08:33.603444+0000","last_undegraded":"2024-09-12T17:08:33.603444+0000","last_fullsized":"2024-09-12T17:08:33.603444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38915,"num_write":19,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589917+0000","last_change":"2024-09-12T17:05:49.555307+0000","last_active":"2024-09-12T17:08:32.589917+0000","last_peered":"2024-09-12T17:08:32.589917+0000","last_clean":"2024-09-12T17:08:32.589917+0000","last_became_active":"2024-09-12T17:05:49.554566+0000","last_became_peered":"2024-09-12T17:05:49.554566+0000","last_unstale":"2024-09-12T17:08:32.589917+0000","last_undegraded":"2024-09-12T17:08:32.589917+0000","last_fullsized":"2024-09-12T17:08:32.589917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:45.017623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"84'12","reported_seq":190,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585897+0000","last_change":"2024-09-12T17:05:47.543468+0000","last_active":"2024-09-12T17:08:32.585897+0000","last_peered":"2024-09-12T17:08:32.585897+0000","last_clean":"2024-09-12T17:08:32.585897+0000","last_became_active":"2024-09-12T17:05:47.542753+0000","last_became_peered":"2024-09-12T17:05:47.542753+0000","last_unstale":"2024-09-12T17:08:32.585897+0000","last_undegraded":"2024-09-12T17:08:32.585897+0000","last_fullsized":"2024-09-12T17:08:32.585897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":34825,"num_write":36,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'34","reported_seq":199,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.937821+0000","last_change":"2024-09-12T17:05:49.536693+0000","last_active":"2024-09-12T17:08:32.937821+0000","last_peered":"2024-09-12T17:08:32.937821+0000","last_clean":"2024-09-12T17:08:32.937821+0000","last_became_active":"2024-09-12T17:05:49.536385+0000","last_became_peered":"2024-09-12T17:05:49.536385+0000","last_unstale":"2024-09-12T17:08:32.937821+0000","last_undegraded":"2024-09-12T17:08:32.937821+0000","last_fullsized":"2024-09-12T17:08:32.937821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.024498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"84'6","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603760+0000","last_change":"2024-09-12T17:05:47.545251+0000","last_active":"2024-09-12T17:08:33.603760+0000","last_peered":"2024-09-12T17:08:33.603760+0000","last_clean":"2024-09-12T17:08:33.603760+0000","last_became_active":"2024-09-12T17:05:47.544406+0000","last_became_peered":"2024-09-12T17:05:47.544406+0000","last_unstale":"2024-09-12T17:08:33.603760+0000","last_undegraded":"2024-09-12T17:08:33.603760+0000","last_fullsized":"2024-09-12T17:08:33.603760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:52.167194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20483,"num_write":14,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"84'38","reported_seq":203,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588300+0000","last_change":"2024-09-12T17:05:49.564446+0000","last_active":"2024-09-12T17:08:32.588300+0000","last_peered":"2024-09-12T17:08:32.588300+0000","last_clean":"2024-09-12T17:08:32.588300+0000","last_became_active":"2024-09-12T17:05:49.563625+0000","last_became_peered":"2024-09-12T17:05:49.563625+0000","last_unstale":"2024-09-12T17:08:32.588300+0000","last_undegraded":"2024-09-12T17:08:32.588300+0000","last_fullsized":"2024-09-12T17:08:32.588300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.324265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"72'10","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603144+0000","last_change":"2024-09-12T17:05:47.558422+0000","last_active":"2024-09-12T17:08:33.603144+0000","last_peered":"2024-09-12T17:08:33.603144+0000","last_clean":"2024-09-12T17:08:33.603144+0000","last_became_active":"2024-09-12T17:05:47.558047+0000","last_became_peered":"2024-09-12T17:05:47.558047+0000","last_unstale":"2024-09-12T17:08:33.603144+0000","last_undegraded":"2024-09-12T17:08:33.603144+0000","last_fullsized":"2024-09-12T17:08:33.603144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:25.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":38912,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604202+0000","last_change":"2024-09-12T17:05:49.522750+0000","last_active":"2024-09-12T17:08:33.604202+0000","last_peered":"2024-09-12T17:08:33.604202+0000","last_clean":"2024-09-12T17:08:33.604202+0000","last_became_active":"2024-09-12T17:05:49.522097+0000","last_became_peered":"2024-09-12T17:05:49.522097+0000","last_unstale":"2024-09-12T17:08:33.604202+0000","last_undegraded":"2024-09-12T17:08:33.604202+0000","last_fullsized":"2024-09-12T17:08:33.604202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"84'14","reported_seq":194,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941344+0000","last_change":"2024-09-12T17:05:47.552865+0000","last_active":"2024-09-12T17:08:32.941344+0000","last_peered":"2024-09-12T17:08:32.941344+0000","last_clean":"2024-09-12T17:08:32.941344+0000","last_became_active":"2024-09-12T17:05:47.552207+0000","last_became_peered":"2024-09-12T17:05:47.552207+0000","last_unstale":"2024-09-12T17:08:32.941344+0000","last_undegraded":"2024-09-12T17:08:32.941344+0000","last_fullsized":"2024-09-12T17:08:32.941344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:00.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40969,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601066+0000","last_change":"2024-09-12T17:08:18.465159+0000","last_active":"2024-09-12T17:08:33.601066+0000","last_peered":"2024-09-12T17:08:33.601066+0000","last_clean":"2024-09-12T17:08:33.601066+0000","last_became_active":"2024-09-12T17:08:18.464823+0000","last_became_peered":"2024-09-12T17:08:18.464823+0000","last_unstale":"2024-09-12T17:08:33.601066+0000","last_undegraded":"2024-09-12T17:08:33.601066+0000","last_fullsized":"2024-09-12T17:08:33.601066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:08.427170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"74'14","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608526+0000","last_change":"2024-09-12T17:05:47.561338+0000","last_active":"2024-09-12T17:08:33.608526+0000","last_peered":"2024-09-12T17:08:33.608526+0000","last_clean":"2024-09-12T17:08:33.608526+0000","last_became_active":"2024-09-12T17:05:47.560439+0000","last_became_peered":"2024-09-12T17:05:47.560439+0000","last_unstale":"2024-09-12T17:08:33.608526+0000","last_undegraded":"2024-09-12T17:08:33.608526+0000","last_fullsized":"2024-09-12T17:08:33.608526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:58.530869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":18,"num_read_kb":51203,"num_write":22,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":123,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601554+0000","last_change":"2024-09-12T17:06:27.819106+0000","last_active":"2024-09-12T17:08:33.601554+0000","last_peered":"2024-09-12T17:08:33.601554+0000","last_clean":"2024-09-12T17:08:33.601554+0000","last_became_active":"2024-09-12T17:06:27.818761+0000","last_became_peered":"2024-09-12T17:06:27.818761+0000","last_unstale":"2024-09-12T17:08:33.601554+0000","last_undegraded":"2024-09-12T17:08:33.601554+0000","last_fullsized":"2024-09-12T17:08:33.601554+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:29.107938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"83'9","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939360+0000","last_change":"2024-09-12T17:05:47.512066+0000","last_active":"2024-09-12T17:08:32.939360+0000","last_peered":"2024-09-12T17:08:32.939360+0000","last_clean":"2024-09-12T17:08:32.939360+0000","last_became_active":"2024-09-12T17:05:47.511470+0000","last_became_peered":"2024-09-12T17:05:47.511470+0000","last_unstale":"2024-09-12T17:08:32.939360+0000","last_undegraded":"2024-09-12T17:08:32.939360+0000","last_fullsized":"2024-09-12T17:08:32.939360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:38.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30723,"num_write":17,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601648+0000","last_change":"2024-09-12T17:05:49.523060+0000","last_active":"2024-09-12T17:08:33.601648+0000","last_peered":"2024-09-12T17:08:33.601648+0000","last_clean":"2024-09-12T17:08:33.601648+0000","last_became_active":"2024-09-12T17:05:49.522157+0000","last_became_peered":"2024-09-12T17:05:49.522157+0000","last_unstale":"2024-09-12T17:08:33.601648+0000","last_undegraded":"2024-09-12T17:08:33.601648+0000","last_fullsized":"2024-09-12T17:08:33.601648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"71'5","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606405+0000","last_change":"2024-09-12T17:05:47.538305+0000","last_active":"2024-09-12T17:08:33.606405+0000","last_peered":"2024-09-12T17:08:33.606405+0000","last_clean":"2024-09-12T17:08:33.606405+0000","last_became_active":"2024-09-12T17:05:47.535569+0000","last_became_peered":"2024-09-12T17:05:47.535569+0000","last_unstale":"2024-09-12T17:08:33.606405+0000","last_undegraded":"2024-09-12T17:08:33.606405+0000","last_fullsized":"2024-09-12T17:08:33.606405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:24.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":18432,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'5","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603169+0000","last_change":"2024-09-12T17:05:47.537712+0000","last_active":"2024-09-12T17:08:33.603169+0000","last_peered":"2024-09-12T17:08:33.603169+0000","last_clean":"2024-09-12T17:08:33.603169+0000","last_became_active":"2024-09-12T17:05:47.536958+0000","last_became_peered":"2024-09-12T17:05:47.536958+0000","last_unstale":"2024-09-12T17:08:33.603169+0000","last_undegraded":"2024-09-12T17:08:33.603169+0000","last_fullsized":"2024-09-12T17:08:33.603169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603188+0000","last_change":"2024-09-12T17:05:49.544841+0000","last_active":"2024-09-12T17:08:33.603188+0000","last_peered":"2024-09-12T17:08:33.603188+0000","last_clean":"2024-09-12T17:08:33.603188+0000","last_became_active":"2024-09-12T17:05:49.538757+0000","last_became_peered":"2024-09-12T17:05:49.538757+0000","last_unstale":"2024-09-12T17:08:33.603188+0000","last_undegraded":"2024-09-12T17:08:33.603188+0000","last_fullsized":"2024-09-12T17:08:33.603188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.976348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'9","reported_seq":53,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939720+0000","last_change":"2024-09-12T17:08:18.573927+0000","last_active":"2024-09-12T17:08:32.939720+0000","last_peered":"2024-09-12T17:08:32.939720+0000","last_clean":"2024-09-12T17:08:32.939720+0000","last_became_active":"2024-09-12T17:08:18.441161+0000","last_became_peered":"2024-09-12T17:08:18.441161+0000","last_unstale":"2024-09-12T17:08:32.939720+0000","last_undegraded":"2024-09-12T17:08:32.939720+0000","last_fullsized":"2024-09-12T17:08:32.939720+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:21.365549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24582,"num_write":25,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605089+0000","last_change":"2024-09-12T17:05:49.552327+0000","last_active":"2024-09-12T17:08:33.605089+0000","last_peered":"2024-09-12T17:08:33.605089+0000","last_clean":"2024-09-12T17:08:33.605089+0000","last_became_active":"2024-09-12T17:05:49.551604+0000","last_became_peered":"2024-09-12T17:05:49.551604+0000","last_unstale":"2024-09-12T17:08:33.605089+0000","last_undegraded":"2024-09-12T17:08:33.605089+0000","last_fullsized":"2024-09-12T17:08:33.605089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:55.648527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":40,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":238929,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":924,"num_read_kb":920,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":41697,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":647168,"data_stored":230726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":576,"ondisk_log_size":576,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1867,"num_read_kb":1448,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1093,"num_read_kb":2031945,"num_write":1540,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":241172480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":481656,"kb_used_data":446308,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93890184,"statfs":{"total":96636764160,"available":96143548416,"internally_reserved":0,"allocated":457019392,"data_stored":456418609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397048,"kb_used_data":361700,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93974792,"statfs":{"total":96636764160,"available":96230187008,"internally_reserved":0,"allocated":370380800,"data_stored":369824685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472936,"kb_used_data":437588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93898904,"statfs":{"total":96636764160,"available":96152477696,"internally_reserved":0,"allocated":448090112,"data_stored":447463741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542185,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505556,"kb_used_data":470200,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93866284,"statfs":{"total":96636764160,"available":96119074816,"internally_reserved":0,"allocated":481484800,"data_stored":480955369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":515856,"kb_used_data":480500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93855984,"statfs":{"total":96636764160,"available":96108527616,"internally_reserved":0,"allocated":492032000,"data_stored":491448544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347860,"kb_used_data":312508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94023980,"statfs":{"total":96636764160,"available":96280555520,"internally_reserved":0,"allocated":320008192,"data_stored":319468451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259868,"kb_used_data":224520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94111972,"statfs":{"total":96636764160,"available":96370659328,"internally_reserved":0,"allocated":229908480,"data_stored":229326393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":508220,"kb_used_data":472868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93863620,"statfs":{"total":96636764160,"available":96116346880,"internally_reserved":0,"allocated":484216832,"data_stored":483650572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":228589568,"data_stored":228589568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":318767104,"data_stored":318767104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":490733568,"data_stored":490733568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":480247808,"data_stored":480247808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":446693376,"data_stored":446693376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":369098752,"data_stored":369098752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":455081984,"data_stored":455081984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":18170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":40679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":18459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":11388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":65710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":29852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":42241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:08:37.204 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:08:37.574 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:08:37.580 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:08:37.589 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-09-12T17:08:35.976637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636609489,"num_objects":638,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":638,"num_whiteouts":0,"num_read":4036,"num_read_kb":2034452,"num_write":3052,"num_write_kb":2050296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":241214307,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3489000,"kb_used_data":3206192,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":751485720,"statfs":{"total":773094113280,"available":769521377280,"internally_reserved":0,"allocated":3283140608,"data_stored":3278556364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-5,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.416225"},"pg_stats":[{"pgid":"3.3f","version":"84'19","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607887+0000","last_change":"2024-09-12T17:05:47.561581+0000","last_active":"2024-09-12T17:08:33.607887+0000","last_peered":"2024-09-12T17:08:33.607887+0000","last_clean":"2024-09-12T17:08:33.607887+0000","last_became_active":"2024-09-12T17:05:47.560791+0000","last_became_peered":"2024-09-12T17:05:47.560791+0000","last_unstale":"2024-09-12T17:08:33.607887+0000","last_undegraded":"2024-09-12T17:08:33.607887+0000","last_fullsized":"2024-09-12T17:08:33.607887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:23.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":35,"num_read_kb":57356,"num_write":51,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"84'44","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602148+0000","last_change":"2024-09-12T17:05:49.558060+0000","last_active":"2024-09-12T17:08:33.602148+0000","last_peered":"2024-09-12T17:08:33.602148+0000","last_clean":"2024-09-12T17:08:33.602148+0000","last_became_active":"2024-09-12T17:05:49.557287+0000","last_became_peered":"2024-09-12T17:05:49.557287+0000","last_unstale":"2024-09-12T17:08:33.602148+0000","last_undegraded":"2024-09-12T17:08:33.602148+0000","last_fullsized":"2024-09-12T17:08:33.602148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":132,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"71'3","reported_seq":40,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.945479+0000","last_change":"2024-09-12T17:08:21.529824+0000","last_active":"2024-09-12T17:08:32.945479+0000","last_peered":"2024-09-12T17:08:32.945479+0000","last_clean":"2024-09-12T17:08:32.945479+0000","last_became_active":"2024-09-12T17:08:21.462766+0000","last_became_peered":"2024-09-12T17:08:21.462766+0000","last_unstale":"2024-09-12T17:08:32.945479+0000","last_undegraded":"2024-09-12T17:08:32.945479+0000","last_fullsized":"2024-09-12T17:08:32.945479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:47.442324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605094+0000","last_change":"2024-09-12T17:08:18.454422+0000","last_active":"2024-09-12T17:08:33.605094+0000","last_peered":"2024-09-12T17:08:33.605094+0000","last_clean":"2024-09-12T17:08:33.605094+0000","last_became_active":"2024-09-12T17:08:18.442986+0000","last_became_peered":"2024-09-12T17:08:18.442986+0000","last_unstale":"2024-09-12T17:08:33.605094+0000","last_undegraded":"2024-09-12T17:08:33.605094+0000","last_fullsized":"2024-09-12T17:08:33.605094+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:26.720649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"84'15","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603748+0000","last_change":"2024-09-12T17:05:47.523052+0000","last_active":"2024-09-12T17:08:33.603748+0000","last_peered":"2024-09-12T17:08:33.603748+0000","last_clean":"2024-09-12T17:08:33.603748+0000","last_became_active":"2024-09-12T17:05:47.522544+0000","last_became_peered":"2024-09-12T17:05:47.522544+0000","last_unstale":"2024-09-12T17:08:33.603748+0000","last_undegraded":"2024-09-12T17:08:33.603748+0000","last_fullsized":"2024-09-12T17:08:33.603748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":38921,"num_write":39,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"84'34","reported_seq":199,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589439+0000","last_change":"2024-09-12T17:05:49.549990+0000","last_active":"2024-09-12T17:08:32.589439+0000","last_peered":"2024-09-12T17:08:32.589439+0000","last_clean":"2024-09-12T17:08:32.589439+0000","last_became_active":"2024-09-12T17:05:49.549241+0000","last_became_peered":"2024-09-12T17:05:49.549241+0000","last_unstale":"2024-09-12T17:08:32.589439+0000","last_undegraded":"2024-09-12T17:08:32.589439+0000","last_fullsized":"2024-09-12T17:08:32.589439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.601256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"84'12","reported_seq":148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938452+0000","last_change":"2024-09-12T17:06:27.748679+0000","last_active":"2024-09-12T17:08:32.938452+0000","last_peered":"2024-09-12T17:08:32.938452+0000","last_clean":"2024-09-12T17:08:32.938452+0000","last_became_active":"2024-09-12T17:06:27.748390+0000","last_became_peered":"2024-09-12T17:06:27.748390+0000","last_unstale":"2024-09-12T17:08:32.938452+0000","last_undegraded":"2024-09-12T17:08:32.938452+0000","last_fullsized":"2024-09-12T17:08:32.938452+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:58.547350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":30732,"num_write":44,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602063+0000","last_change":"2024-09-12T17:05:49.542142+0000","last_active":"2024-09-12T17:08:33.602063+0000","last_peered":"2024-09-12T17:08:33.602063+0000","last_clean":"2024-09-12T17:08:33.602063+0000","last_became_active":"2024-09-12T17:05:49.541354+0000","last_became_peered":"2024-09-12T17:05:49.541354+0000","last_unstale":"2024-09-12T17:08:33.602063+0000","last_undegraded":"2024-09-12T17:08:33.602063+0000","last_fullsized":"2024-09-12T17:08:33.602063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.147865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"84'8","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606019+0000","last_change":"2024-09-12T17:05:47.556154+0000","last_active":"2024-09-12T17:08:33.606019+0000","last_peered":"2024-09-12T17:08:33.606019+0000","last_clean":"2024-09-12T17:08:33.606019+0000","last_became_active":"2024-09-12T17:05:47.555396+0000","last_became_peered":"2024-09-12T17:05:47.555396+0000","last_unstale":"2024-09-12T17:08:33.606019+0000","last_undegraded":"2024-09-12T17:08:33.606019+0000","last_fullsized":"2024-09-12T17:08:33.606019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:27.784208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941104+0000","last_change":"2024-09-12T17:05:49.529344+0000","last_active":"2024-09-12T17:08:32.941104+0000","last_peered":"2024-09-12T17:08:32.941104+0000","last_clean":"2024-09-12T17:08:32.941104+0000","last_became_active":"2024-09-12T17:05:49.528184+0000","last_became_peered":"2024-09-12T17:05:49.528184+0000","last_unstale":"2024-09-12T17:08:32.941104+0000","last_undegraded":"2024-09-12T17:08:32.941104+0000","last_fullsized":"2024-09-12T17:08:32.941104+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:18.357328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"84'11","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603007+0000","last_change":"2024-09-12T17:05:47.532931+0000","last_active":"2024-09-12T17:08:33.603007+0000","last_peered":"2024-09-12T17:08:33.603007+0000","last_clean":"2024-09-12T17:08:33.603007+0000","last_became_active":"2024-09-12T17:05:47.531427+0000","last_became_peered":"2024-09-12T17:05:47.531427+0000","last_unstale":"2024-09-12T17:08:33.603007+0000","last_undegraded":"2024-09-12T17:08:33.603007+0000","last_fullsized":"2024-09-12T17:08:33.603007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588848+0000","last_change":"2024-09-12T17:05:49.550694+0000","last_active":"2024-09-12T17:08:32.588848+0000","last_peered":"2024-09-12T17:08:32.588848+0000","last_clean":"2024-09-12T17:08:32.588848+0000","last_became_active":"2024-09-12T17:05:49.549066+0000","last_became_peered":"2024-09-12T17:05:49.549066+0000","last_unstale":"2024-09-12T17:08:32.588848+0000","last_undegraded":"2024-09-12T17:08:32.588848+0000","last_fullsized":"2024-09-12T17:08:32.588848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:24.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"84'7","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605517+0000","last_change":"2024-09-12T17:05:47.560085+0000","last_active":"2024-09-12T17:08:33.605517+0000","last_peered":"2024-09-12T17:08:33.605517+0000","last_clean":"2024-09-12T17:08:33.605517+0000","last_became_active":"2024-09-12T17:05:47.559160+0000","last_became_peered":"2024-09-12T17:05:47.559160+0000","last_unstale":"2024-09-12T17:08:33.605517+0000","last_undegraded":"2024-09-12T17:08:33.605517+0000","last_fullsized":"2024-09-12T17:08:33.605517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:06.664677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'2","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604685+0000","last_change":"2024-09-12T17:08:18.490456+0000","last_active":"2024-09-12T17:08:33.604685+0000","last_peered":"2024-09-12T17:08:33.604685+0000","last_clean":"2024-09-12T17:08:33.604685+0000","last_became_active":"2024-09-12T17:08:18.471124+0000","last_became_peered":"2024-09-12T17:08:18.471124+0000","last_unstale":"2024-09-12T17:08:33.604685+0000","last_undegraded":"2024-09-12T17:08:33.604685+0000","last_fullsized":"2024-09-12T17:08:33.604685+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.772819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"84'10","reported_seq":143,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936168+0000","last_change":"2024-09-12T17:06:27.748750+0000","last_active":"2024-09-12T17:08:32.936168+0000","last_peered":"2024-09-12T17:08:32.936168+0000","last_clean":"2024-09-12T17:08:32.936168+0000","last_became_active":"2024-09-12T17:06:27.748329+0000","last_became_peered":"2024-09-12T17:06:27.748329+0000","last_unstale":"2024-09-12T17:08:32.936168+0000","last_undegraded":"2024-09-12T17:08:32.936168+0000","last_fullsized":"2024-09-12T17:08:32.936168+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:26.773943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26633,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938254+0000","last_change":"2024-09-12T17:07:28.190678+0000","last_active":"2024-09-12T17:08:32.938254+0000","last_peered":"2024-09-12T17:08:32.938254+0000","last_clean":"2024-09-12T17:08:32.938254+0000","last_became_active":"2024-09-12T17:07:28.190245+0000","last_became_peered":"2024-09-12T17:07:28.190245+0000","last_unstale":"2024-09-12T17:08:32.938254+0000","last_undegraded":"2024-09-12T17:08:32.938254+0000","last_fullsized":"2024-09-12T17:08:32.938254+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:04.220150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586445+0000","last_change":"2024-09-12T17:05:49.549575+0000","last_active":"2024-09-12T17:08:32.586445+0000","last_peered":"2024-09-12T17:08:32.586445+0000","last_clean":"2024-09-12T17:08:32.586445+0000","last_became_active":"2024-09-12T17:05:49.548292+0000","last_became_peered":"2024-09-12T17:05:49.548292+0000","last_unstale":"2024-09-12T17:08:32.586445+0000","last_undegraded":"2024-09-12T17:08:32.586445+0000","last_fullsized":"2024-09-12T17:08:32.586445+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"84'6","reported_seq":30,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940291+0000","last_change":"2024-09-12T17:08:28.649055+0000","last_active":"2024-09-12T17:08:32.940291+0000","last_peered":"2024-09-12T17:08:32.940291+0000","last_clean":"2024-09-12T17:08:32.940291+0000","last_became_active":"2024-09-12T17:08:28.568157+0000","last_became_peered":"2024-09-12T17:08:28.568157+0000","last_unstale":"2024-09-12T17:08:32.940291+0000","last_undegraded":"2024-09-12T17:08:32.940291+0000","last_fullsized":"2024-09-12T17:08:32.940291+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:11.023137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":18434,"num_write":14,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605305+0000","last_change":"2024-09-12T17:08:18.455416+0000","last_active":"2024-09-12T17:08:33.605305+0000","last_peered":"2024-09-12T17:08:33.605305+0000","last_clean":"2024-09-12T17:08:33.605305+0000","last_became_active":"2024-09-12T17:08:18.454062+0000","last_became_peered":"2024-09-12T17:08:18.454062+0000","last_unstale":"2024-09-12T17:08:33.605305+0000","last_undegraded":"2024-09-12T17:08:33.605305+0000","last_fullsized":"2024-09-12T17:08:33.605305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:38.260106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'13","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942226+0000","last_change":"2024-09-12T17:05:47.528338+0000","last_active":"2024-09-12T17:08:32.942226+0000","last_peered":"2024-09-12T17:08:32.942226+0000","last_clean":"2024-09-12T17:08:32.942226+0000","last_became_active":"2024-09-12T17:05:47.527533+0000","last_became_peered":"2024-09-12T17:05:47.527533+0000","last_unstale":"2024-09-12T17:08:32.942226+0000","last_undegraded":"2024-09-12T17:08:32.942226+0000","last_fullsized":"2024-09-12T17:08:32.942226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.693731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":34828,"num_write":45,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"84'30","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603444+0000","last_change":"2024-09-12T17:05:49.543097+0000","last_active":"2024-09-12T17:08:33.603444+0000","last_peered":"2024-09-12T17:08:33.603444+0000","last_clean":"2024-09-12T17:08:33.603444+0000","last_became_active":"2024-09-12T17:05:49.542113+0000","last_became_peered":"2024-09-12T17:05:49.542113+0000","last_unstale":"2024-09-12T17:08:33.603444+0000","last_undegraded":"2024-09-12T17:08:33.603444+0000","last_fullsized":"2024-09-12T17:08:33.603444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":90,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"83'13","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942024+0000","last_change":"2024-09-12T17:05:47.529868+0000","last_active":"2024-09-12T17:08:32.942024+0000","last_peered":"2024-09-12T17:08:32.942024+0000","last_clean":"2024-09-12T17:08:32.942024+0000","last_became_active":"2024-09-12T17:05:47.529083+0000","last_became_peered":"2024-09-12T17:05:47.529083+0000","last_unstale":"2024-09-12T17:08:32.942024+0000","last_undegraded":"2024-09-12T17:08:32.942024+0000","last_fullsized":"2024-09-12T17:08:32.942024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:16.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":40969,"num_write":37,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938860+0000","last_change":"2024-09-12T17:05:49.548084+0000","last_active":"2024-09-12T17:08:32.938860+0000","last_peered":"2024-09-12T17:08:32.938860+0000","last_clean":"2024-09-12T17:08:32.938860+0000","last_became_active":"2024-09-12T17:05:49.539930+0000","last_became_peered":"2024-09-12T17:05:49.539930+0000","last_unstale":"2024-09-12T17:08:32.938860+0000","last_undegraded":"2024-09-12T17:08:32.938860+0000","last_fullsized":"2024-09-12T17:08:32.938860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:11.453390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587178+0000","last_change":"2024-09-12T17:05:47.548316+0000","last_active":"2024-09-12T17:08:32.587178+0000","last_peered":"2024-09-12T17:08:32.587178+0000","last_clean":"2024-09-12T17:08:32.587178+0000","last_became_active":"2024-09-12T17:05:47.547430+0000","last_became_peered":"2024-09-12T17:05:47.547430+0000","last_unstale":"2024-09-12T17:08:32.587178+0000","last_undegraded":"2024-09-12T17:08:32.587178+0000","last_fullsized":"2024-09-12T17:08:32.587178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:21.143073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938230+0000","last_change":"2024-09-12T17:05:49.556144+0000","last_active":"2024-09-12T17:08:32.938230+0000","last_peered":"2024-09-12T17:08:32.938230+0000","last_clean":"2024-09-12T17:08:32.938230+0000","last_became_active":"2024-09-12T17:05:49.555033+0000","last_became_peered":"2024-09-12T17:05:49.555033+0000","last_unstale":"2024-09-12T17:08:32.938230+0000","last_undegraded":"2024-09-12T17:08:32.938230+0000","last_fullsized":"2024-09-12T17:08:32.938230+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:08.056726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":186,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587374+0000","last_change":"2024-09-12T17:05:47.511375+0000","last_active":"2024-09-12T17:08:32.587374+0000","last_peered":"2024-09-12T17:08:32.587374+0000","last_clean":"2024-09-12T17:08:32.587374+0000","last_became_active":"2024-09-12T17:05:47.510364+0000","last_became_peered":"2024-09-12T17:05:47.510364+0000","last_unstale":"2024-09-12T17:08:32.587374+0000","last_undegraded":"2024-09-12T17:08:32.587374+0000","last_fullsized":"2024-09-12T17:08:32.587374+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":38912,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588969+0000","last_change":"2024-09-12T17:08:18.448181+0000","last_active":"2024-09-12T17:08:32.588969+0000","last_peered":"2024-09-12T17:08:32.588969+0000","last_clean":"2024-09-12T17:08:32.588969+0000","last_became_active":"2024-09-12T17:08:18.447353+0000","last_became_peered":"2024-09-12T17:08:18.447353+0000","last_unstale":"2024-09-12T17:08:32.588969+0000","last_undegraded":"2024-09-12T17:08:32.588969+0000","last_fullsized":"2024-09-12T17:08:32.588969+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:07.836287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"83'5","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601601+0000","last_change":"2024-09-12T17:08:18.831302+0000","last_active":"2024-09-12T17:08:33.601601+0000","last_peered":"2024-09-12T17:08:33.601601+0000","last_clean":"2024-09-12T17:08:33.601601+0000","last_became_active":"2024-09-12T17:08:18.467826+0000","last_became_peered":"2024-09-12T17:08:18.467826+0000","last_unstale":"2024-09-12T17:08:33.601601+0000","last_undegraded":"2024-09-12T17:08:33.601601+0000","last_fullsized":"2024-09-12T17:08:33.601601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:24.964574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14339,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10485760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"84'2","reported_seq":148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585952+0000","last_change":"2024-09-12T17:05:57.588515+0000","last_active":"2024-09-12T17:08:32.585952+0000","last_peered":"2024-09-12T17:08:32.585952+0000","last_clean":"2024-09-12T17:08:32.585952+0000","last_became_active":"2024-09-12T17:05:57.587891+0000","last_became_peered":"2024-09-12T17:05:57.587891+0000","last_unstale":"2024-09-12T17:08:32.585952+0000","last_undegraded":"2024-09-12T17:08:32.585952+0000","last_fullsized":"2024-09-12T17:08:32.585952+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:24.257847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588921+0000","last_change":"2024-09-12T17:08:21.457874+0000","last_active":"2024-09-12T17:08:32.588921+0000","last_peered":"2024-09-12T17:08:32.588921+0000","last_clean":"2024-09-12T17:08:32.588921+0000","last_became_active":"2024-09-12T17:08:21.457526+0000","last_became_peered":"2024-09-12T17:08:21.457526+0000","last_unstale":"2024-09-12T17:08:32.588921+0000","last_undegraded":"2024-09-12T17:08:32.588921+0000","last_fullsized":"2024-09-12T17:08:32.588921+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:37.646866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"84'13","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604660+0000","last_change":"2024-09-12T17:05:47.557687+0000","last_active":"2024-09-12T17:08:33.604660+0000","last_peered":"2024-09-12T17:08:33.604660+0000","last_clean":"2024-09-12T17:08:33.604660+0000","last_became_active":"2024-09-12T17:05:47.556980+0000","last_became_peered":"2024-09-12T17:05:47.556980+0000","last_unstale":"2024-09-12T17:08:33.604660+0000","last_undegraded":"2024-09-12T17:08:33.604660+0000","last_fullsized":"2024-09-12T17:08:33.604660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.891909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38921,"num_write":37,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606120+0000","last_change":"2024-09-12T17:08:18.472276+0000","last_active":"2024-09-12T17:08:33.606120+0000","last_peered":"2024-09-12T17:08:33.606120+0000","last_clean":"2024-09-12T17:08:33.606120+0000","last_became_active":"2024-09-12T17:08:18.471264+0000","last_became_peered":"2024-09-12T17:08:18.471264+0000","last_unstale":"2024-09-12T17:08:33.606120+0000","last_undegraded":"2024-09-12T17:08:33.606120+0000","last_fullsized":"2024-09-12T17:08:33.606120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:10.434396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"84'14","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602673+0000","last_change":"2024-09-12T17:05:53.537592+0000","last_active":"2024-09-12T17:08:33.602673+0000","last_peered":"2024-09-12T17:08:33.602673+0000","last_clean":"2024-09-12T17:08:33.602673+0000","last_became_active":"2024-09-12T17:05:53.536921+0000","last_became_peered":"2024-09-12T17:05:53.536921+0000","last_unstale":"2024-09-12T17:08:33.602673+0000","last_undegraded":"2024-09-12T17:08:33.602673+0000","last_fullsized":"2024-09-12T17:08:33.602673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:25.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607496+0000","last_change":"2024-09-12T17:05:55.559431+0000","last_active":"2024-09-12T17:08:33.607496+0000","last_peered":"2024-09-12T17:08:33.607496+0000","last_clean":"2024-09-12T17:08:33.607496+0000","last_became_active":"2024-09-12T17:05:55.558297+0000","last_became_peered":"2024-09-12T17:05:55.558297+0000","last_unstale":"2024-09-12T17:08:33.607496+0000","last_undegraded":"2024-09-12T17:08:33.607496+0000","last_fullsized":"2024-09-12T17:08:33.607496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"84'4","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601882+0000","last_change":"2024-09-12T17:05:57.592599+0000","last_active":"2024-09-12T17:08:33.601882+0000","last_peered":"2024-09-12T17:08:33.601882+0000","last_clean":"2024-09-12T17:08:33.601882+0000","last_became_active":"2024-09-12T17:05:57.591877+0000","last_became_peered":"2024-09-12T17:05:57.591877+0000","last_unstale":"2024-09-12T17:08:33.601882+0000","last_undegraded":"2024-09-12T17:08:33.601882+0000","last_fullsized":"2024-09-12T17:08:33.601882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:57.557525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"68'6","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605335+0000","last_change":"2024-09-12T17:05:49.546093+0000","last_active":"2024-09-12T17:08:33.605335+0000","last_peered":"2024-09-12T17:08:33.605335+0000","last_clean":"2024-09-12T17:08:33.605335+0000","last_became_active":"2024-09-12T17:05:49.544425+0000","last_became_peered":"2024-09-12T17:05:49.544425+0000","last_unstale":"2024-09-12T17:08:33.605335+0000","last_undegraded":"2024-09-12T17:08:33.605335+0000","last_fullsized":"2024-09-12T17:08:33.605335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.495950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"72'6","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601748+0000","last_change":"2024-09-12T17:05:47.535295+0000","last_active":"2024-09-12T17:08:33.601748+0000","last_peered":"2024-09-12T17:08:33.601748+0000","last_clean":"2024-09-12T17:08:33.601748+0000","last_became_active":"2024-09-12T17:05:47.534833+0000","last_became_peered":"2024-09-12T17:05:47.534833+0000","last_unstale":"2024-09-12T17:08:33.601748+0000","last_undegraded":"2024-09-12T17:08:33.601748+0000","last_fullsized":"2024-09-12T17:08:33.601748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589416+0000","last_change":"2024-09-12T17:05:51.533888+0000","last_active":"2024-09-12T17:08:32.589416+0000","last_peered":"2024-09-12T17:08:32.589416+0000","last_clean":"2024-09-12T17:08:32.589416+0000","last_became_active":"2024-09-12T17:05:51.533164+0000","last_became_peered":"2024-09-12T17:05:51.533164+0000","last_unstale":"2024-09-12T17:08:32.589416+0000","last_undegraded":"2024-09-12T17:08:32.589416+0000","last_fullsized":"2024-09-12T17:08:32.589416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:33.007858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.590259+0000","last_change":"2024-09-12T17:05:53.549534+0000","last_active":"2024-09-12T17:08:32.590259+0000","last_peered":"2024-09-12T17:08:32.590259+0000","last_clean":"2024-09-12T17:08:32.590259+0000","last_became_active":"2024-09-12T17:05:53.548824+0000","last_became_peered":"2024-09-12T17:05:53.548824+0000","last_unstale":"2024-09-12T17:08:32.590259+0000","last_undegraded":"2024-09-12T17:08:32.590259+0000","last_fullsized":"2024-09-12T17:08:32.590259+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.765832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589324+0000","last_change":"2024-09-12T17:05:55.557468+0000","last_active":"2024-09-12T17:08:32.589324+0000","last_peered":"2024-09-12T17:08:32.589324+0000","last_clean":"2024-09-12T17:08:32.589324+0000","last_became_active":"2024-09-12T17:05:55.556689+0000","last_became_peered":"2024-09-12T17:05:55.556689+0000","last_unstale":"2024-09-12T17:08:32.589324+0000","last_undegraded":"2024-09-12T17:08:32.589324+0000","last_fullsized":"2024-09-12T17:08:32.589324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:56.879576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601144+0000","last_change":"2024-09-12T17:05:57.589569+0000","last_active":"2024-09-12T17:08:33.601144+0000","last_peered":"2024-09-12T17:08:33.601144+0000","last_clean":"2024-09-12T17:08:33.601144+0000","last_became_active":"2024-09-12T17:05:57.588649+0000","last_became_peered":"2024-09-12T17:05:57.588649+0000","last_unstale":"2024-09-12T17:08:33.601144+0000","last_undegraded":"2024-09-12T17:08:33.601144+0000","last_fullsized":"2024-09-12T17:08:33.601144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"68'10","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604412+0000","last_change":"2024-09-12T17:05:49.531436+0000","last_active":"2024-09-12T17:08:33.604412+0000","last_peered":"2024-09-12T17:08:33.604412+0000","last_clean":"2024-09-12T17:08:33.604412+0000","last_became_active":"2024-09-12T17:05:49.530687+0000","last_became_peered":"2024-09-12T17:05:49.530687+0000","last_unstale":"2024-09-12T17:08:33.604412+0000","last_undegraded":"2024-09-12T17:08:33.604412+0000","last_fullsized":"2024-09-12T17:08:33.604412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"83'12","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605777+0000","last_change":"2024-09-12T17:05:47.564709+0000","last_active":"2024-09-12T17:08:33.605777+0000","last_peered":"2024-09-12T17:08:33.605777+0000","last_clean":"2024-09-12T17:08:33.605777+0000","last_became_active":"2024-09-12T17:05:47.564189+0000","last_became_peered":"2024-09-12T17:05:47.564189+0000","last_unstale":"2024-09-12T17:08:33.605777+0000","last_undegraded":"2024-09-12T17:08:33.605777+0000","last_fullsized":"2024-09-12T17:08:33.605777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":34825,"num_write":36,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":170,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.592479+0000","last_change":"2024-09-12T17:08:18.465074+0000","last_active":"2024-09-12T17:08:32.592479+0000","last_peered":"2024-09-12T17:08:32.592479+0000","last_clean":"2024-09-12T17:08:32.592479+0000","last_became_active":"2024-09-12T17:08:18.464648+0000","last_became_peered":"2024-09-12T17:08:18.464648+0000","last_unstale":"2024-09-12T17:08:32.592479+0000","last_undegraded":"2024-09-12T17:08:32.592479+0000","last_fullsized":"2024-09-12T17:08:32.592479+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:04.122655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.937705+0000","last_change":"2024-09-12T17:05:53.549328+0000","last_active":"2024-09-12T17:08:32.937705+0000","last_peered":"2024-09-12T17:08:32.937705+0000","last_clean":"2024-09-12T17:08:32.937705+0000","last_became_active":"2024-09-12T17:05:53.548968+0000","last_became_peered":"2024-09-12T17:05:53.548968+0000","last_unstale":"2024-09-12T17:08:32.937705+0000","last_undegraded":"2024-09-12T17:08:32.937705+0000","last_fullsized":"2024-09-12T17:08:32.937705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:36.974950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"91'16","reported_seq":229,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606823+0000","last_change":"2024-09-12T17:08:21.488239+0000","last_active":"2024-09-12T17:08:33.606823+0000","last_peered":"2024-09-12T17:08:33.606823+0000","last_clean":"2024-09-12T17:08:33.606823+0000","last_became_active":"2024-09-12T17:08:21.464957+0000","last_became_peered":"2024-09-12T17:08:21.464957+0000","last_unstale":"2024-09-12T17:08:33.606823+0000","last_undegraded":"2024-09-12T17:08:33.606823+0000","last_fullsized":"2024-09-12T17:08:33.606823+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.266320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586739+0000","last_change":"2024-09-12T17:05:58.122522+0000","last_active":"2024-09-12T17:08:32.586739+0000","last_peered":"2024-09-12T17:08:32.586739+0000","last_clean":"2024-09-12T17:08:32.586739+0000","last_became_active":"2024-09-12T17:05:58.121871+0000","last_became_peered":"2024-09-12T17:05:58.121871+0000","last_unstale":"2024-09-12T17:08:32.586739+0000","last_undegraded":"2024-09-12T17:08:32.586739+0000","last_fullsized":"2024-09-12T17:08:32.586739+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:22.625236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.592100+0000","last_change":"2024-09-12T17:05:49.528766+0000","last_active":"2024-09-12T17:08:32.592100+0000","last_peered":"2024-09-12T17:08:32.592100+0000","last_clean":"2024-09-12T17:08:32.592100+0000","last_became_active":"2024-09-12T17:05:49.527758+0000","last_became_peered":"2024-09-12T17:05:49.527758+0000","last_unstale":"2024-09-12T17:08:32.592100+0000","last_undegraded":"2024-09-12T17:08:32.592100+0000","last_fullsized":"2024-09-12T17:08:32.592100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:06.399711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"84'15","reported_seq":196,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939316+0000","last_change":"2024-09-12T17:05:47.521727+0000","last_active":"2024-09-12T17:08:32.939316+0000","last_peered":"2024-09-12T17:08:32.939316+0000","last_clean":"2024-09-12T17:08:32.939316+0000","last_became_active":"2024-09-12T17:05:47.520943+0000","last_became_peered":"2024-09-12T17:05:47.520943+0000","last_unstale":"2024-09-12T17:08:32.939316+0000","last_undegraded":"2024-09-12T17:08:32.939316+0000","last_fullsized":"2024-09-12T17:08:32.939316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:24.772296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":19,"num_read_kb":51203,"num_write":23,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"29'1","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604412+0000","last_change":"2024-09-12T17:05:51.556202+0000","last_active":"2024-09-12T17:08:33.604412+0000","last_peered":"2024-09-12T17:08:33.604412+0000","last_clean":"2024-09-12T17:08:33.604412+0000","last_became_active":"2024-09-12T17:05:51.555420+0000","last_became_peered":"2024-09-12T17:05:51.555420+0000","last_unstale":"2024-09-12T17:08:33.604412+0000","last_undegraded":"2024-09-12T17:08:33.604412+0000","last_fullsized":"2024-09-12T17:08:33.604412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:56.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"84'13","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607150+0000","last_change":"2024-09-12T17:05:53.554159+0000","last_active":"2024-09-12T17:08:33.607150+0000","last_peered":"2024-09-12T17:08:33.607150+0000","last_clean":"2024-09-12T17:08:33.607150+0000","last_became_active":"2024-09-12T17:05:53.553333+0000","last_became_peered":"2024-09-12T17:05:53.553333+0000","last_unstale":"2024-09-12T17:08:33.607150+0000","last_undegraded":"2024-09-12T17:08:33.607150+0000","last_fullsized":"2024-09-12T17:08:33.607150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:53.266475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"84'14","reported_seq":196,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.590167+0000","last_change":"2024-09-12T17:05:55.556502+0000","last_active":"2024-09-12T17:08:32.590167+0000","last_peered":"2024-09-12T17:08:32.590167+0000","last_clean":"2024-09-12T17:08:32.590167+0000","last_became_active":"2024-09-12T17:05:55.555879+0000","last_became_peered":"2024-09-12T17:05:55.555879+0000","last_unstale":"2024-09-12T17:08:32.590167+0000","last_undegraded":"2024-09-12T17:08:32.590167+0000","last_fullsized":"2024-09-12T17:08:32.590167+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:18.672296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602918+0000","last_change":"2024-09-12T17:05:49.553404+0000","last_active":"2024-09-12T17:08:33.602918+0000","last_peered":"2024-09-12T17:08:33.602918+0000","last_clean":"2024-09-12T17:08:33.602918+0000","last_became_active":"2024-09-12T17:05:49.552637+0000","last_became_peered":"2024-09-12T17:05:49.552637+0000","last_unstale":"2024-09-12T17:08:33.602918+0000","last_undegraded":"2024-09-12T17:08:33.602918+0000","last_fullsized":"2024-09-12T17:08:33.602918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607911+0000","last_change":"2024-09-12T17:05:47.562949+0000","last_active":"2024-09-12T17:08:33.607911+0000","last_peered":"2024-09-12T17:08:33.607911+0000","last_clean":"2024-09-12T17:08:33.607911+0000","last_became_active":"2024-09-12T17:05:47.562465+0000","last_became_peered":"2024-09-12T17:05:47.562465+0000","last_unstale":"2024-09-12T17:08:33.607911+0000","last_undegraded":"2024-09-12T17:08:33.607911+0000","last_fullsized":"2024-09-12T17:08:33.607911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24585,"num_write":33,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604488+0000","last_change":"2024-09-12T17:05:51.542349+0000","last_active":"2024-09-12T17:08:33.604488+0000","last_peered":"2024-09-12T17:08:33.604488+0000","last_clean":"2024-09-12T17:08:33.604488+0000","last_became_active":"2024-09-12T17:05:51.541205+0000","last_became_peered":"2024-09-12T17:05:51.541205+0000","last_unstale":"2024-09-12T17:08:33.604488+0000","last_undegraded":"2024-09-12T17:08:33.604488+0000","last_fullsized":"2024-09-12T17:08:33.604488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"84'28","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602256+0000","last_change":"2024-09-12T17:05:53.560400+0000","last_active":"2024-09-12T17:08:33.602256+0000","last_peered":"2024-09-12T17:08:33.602256+0000","last_clean":"2024-09-12T17:08:33.602256+0000","last_became_active":"2024-09-12T17:05:53.559463+0000","last_became_peered":"2024-09-12T17:05:53.559463+0000","last_unstale":"2024-09-12T17:08:33.602256+0000","last_undegraded":"2024-09-12T17:08:33.602256+0000","last_fullsized":"2024-09-12T17:08:33.602256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13033,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":46,"num_read_kb":53,"num_write":34,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940211+0000","last_change":"2024-09-12T17:08:21.463670+0000","last_active":"2024-09-12T17:08:32.940211+0000","last_peered":"2024-09-12T17:08:32.940211+0000","last_clean":"2024-09-12T17:08:32.940211+0000","last_became_active":"2024-09-12T17:08:21.463161+0000","last_became_peered":"2024-09-12T17:08:21.463161+0000","last_unstale":"2024-09-12T17:08:32.940211+0000","last_undegraded":"2024-09-12T17:08:32.940211+0000","last_fullsized":"2024-09-12T17:08:32.940211+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:03.162531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603071+0000","last_change":"2024-09-12T17:05:57.599403+0000","last_active":"2024-09-12T17:08:33.603071+0000","last_peered":"2024-09-12T17:08:33.603071+0000","last_clean":"2024-09-12T17:08:33.603071+0000","last_became_active":"2024-09-12T17:05:57.598703+0000","last_became_peered":"2024-09-12T17:05:57.598703+0000","last_unstale":"2024-09-12T17:08:33.603071+0000","last_undegraded":"2024-09-12T17:08:33.603071+0000","last_fullsized":"2024-09-12T17:08:33.603071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"84'34","reported_seq":215,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587344+0000","last_change":"2024-09-12T17:08:18.474573+0000","last_active":"2024-09-12T17:08:32.587344+0000","last_peered":"2024-09-12T17:08:32.587344+0000","last_clean":"2024-09-12T17:08:32.587344+0000","last_became_active":"2024-09-12T17:08:18.443808+0000","last_became_peered":"2024-09-12T17:08:18.443808+0000","last_unstale":"2024-09-12T17:08:32.587344+0000","last_undegraded":"2024-09-12T17:08:32.587344+0000","last_fullsized":"2024-09-12T17:08:32.587344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:01.200485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"83'8","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607832+0000","last_change":"2024-09-12T17:05:47.563411+0000","last_active":"2024-09-12T17:08:33.607832+0000","last_peered":"2024-09-12T17:08:33.607832+0000","last_clean":"2024-09-12T17:08:33.607832+0000","last_became_active":"2024-09-12T17:05:47.562812+0000","last_became_peered":"2024-09-12T17:05:47.562812+0000","last_unstale":"2024-09-12T17:08:33.607832+0000","last_undegraded":"2024-09-12T17:08:33.607832+0000","last_fullsized":"2024-09-12T17:08:33.607832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:57.659986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24579,"num_write":16,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936741+0000","last_change":"2024-09-12T17:05:51.548944+0000","last_active":"2024-09-12T17:08:32.936741+0000","last_peered":"2024-09-12T17:08:32.936741+0000","last_clean":"2024-09-12T17:08:32.936741+0000","last_became_active":"2024-09-12T17:05:51.544649+0000","last_became_peered":"2024-09-12T17:05:51.544649+0000","last_unstale":"2024-09-12T17:08:32.936741+0000","last_undegraded":"2024-09-12T17:08:32.936741+0000","last_fullsized":"2024-09-12T17:08:32.936741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:01.468390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"84'12","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588360+0000","last_change":"2024-09-12T17:05:53.552838+0000","last_active":"2024-09-12T17:08:32.588360+0000","last_peered":"2024-09-12T17:08:32.588360+0000","last_clean":"2024-09-12T17:08:32.588360+0000","last_became_active":"2024-09-12T17:05:53.550042+0000","last_became_peered":"2024-09-12T17:05:53.550042+0000","last_unstale":"2024-09-12T17:08:32.588360+0000","last_undegraded":"2024-09-12T17:08:32.588360+0000","last_fullsized":"2024-09-12T17:08:32.588360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585935+0000","last_change":"2024-09-12T17:05:55.558761+0000","last_active":"2024-09-12T17:08:32.585935+0000","last_peered":"2024-09-12T17:08:32.585935+0000","last_clean":"2024-09-12T17:08:32.585935+0000","last_became_active":"2024-09-12T17:05:55.557930+0000","last_became_peered":"2024-09-12T17:05:55.557930+0000","last_unstale":"2024-09-12T17:08:32.585935+0000","last_undegraded":"2024-09-12T17:08:32.585935+0000","last_fullsized":"2024-09-12T17:08:32.585935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.015675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940650+0000","last_change":"2024-09-12T17:05:57.592611+0000","last_active":"2024-09-12T17:08:32.940650+0000","last_peered":"2024-09-12T17:08:32.940650+0000","last_clean":"2024-09-12T17:08:32.940650+0000","last_became_active":"2024-09-12T17:05:57.591855+0000","last_became_peered":"2024-09-12T17:05:57.591855+0000","last_unstale":"2024-09-12T17:08:32.940650+0000","last_undegraded":"2024-09-12T17:08:32.940650+0000","last_fullsized":"2024-09-12T17:08:32.940650+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:02.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941416+0000","last_change":"2024-09-12T17:08:18.467848+0000","last_active":"2024-09-12T17:08:32.941416+0000","last_peered":"2024-09-12T17:08:32.941416+0000","last_clean":"2024-09-12T17:08:32.941416+0000","last_became_active":"2024-09-12T17:08:18.466877+0000","last_became_peered":"2024-09-12T17:08:18.466877+0000","last_unstale":"2024-09-12T17:08:32.941416+0000","last_undegraded":"2024-09-12T17:08:32.941416+0000","last_fullsized":"2024-09-12T17:08:32.941416+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:08.084076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"74'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608214+0000","last_change":"2024-09-12T17:05:47.562243+0000","last_active":"2024-09-12T17:08:33.608214+0000","last_peered":"2024-09-12T17:08:33.608214+0000","last_clean":"2024-09-12T17:08:33.608214+0000","last_became_active":"2024-09-12T17:05:47.561587+0000","last_became_peered":"2024-09-12T17:05:47.561587+0000","last_unstale":"2024-09-12T17:08:33.608214+0000","last_undegraded":"2024-09-12T17:08:33.608214+0000","last_fullsized":"2024-09-12T17:08:33.608214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":28672,"num_write":9,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"29'1","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.937919+0000","last_change":"2024-09-12T17:05:51.542843+0000","last_active":"2024-09-12T17:08:32.937919+0000","last_peered":"2024-09-12T17:08:32.937919+0000","last_clean":"2024-09-12T17:08:32.937919+0000","last_became_active":"2024-09-12T17:05:51.542457+0000","last_became_peered":"2024-09-12T17:05:51.542457+0000","last_unstale":"2024-09-12T17:08:32.937919+0000","last_undegraded":"2024-09-12T17:08:32.937919+0000","last_fullsized":"2024-09-12T17:08:32.937919+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.837373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"84'20","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602092+0000","last_change":"2024-09-12T17:05:53.548729+0000","last_active":"2024-09-12T17:08:33.602092+0000","last_peered":"2024-09-12T17:08:33.602092+0000","last_clean":"2024-09-12T17:08:33.602092+0000","last_became_active":"2024-09-12T17:05:53.547990+0000","last_became_peered":"2024-09-12T17:05:53.547990+0000","last_unstale":"2024-09-12T17:08:33.602092+0000","last_undegraded":"2024-09-12T17:08:33.602092+0000","last_fullsized":"2024-09-12T17:08:33.602092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:22.845485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"91'16","reported_seq":227,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600223+0000","last_change":"2024-09-12T17:08:21.470468+0000","last_active":"2024-09-12T17:08:33.600223+0000","last_peered":"2024-09-12T17:08:33.600223+0000","last_clean":"2024-09-12T17:08:33.600223+0000","last_became_active":"2024-09-12T17:08:21.465057+0000","last_became_peered":"2024-09-12T17:08:21.465057+0000","last_unstale":"2024-09-12T17:08:33.600223+0000","last_undegraded":"2024-09-12T17:08:33.600223+0000","last_fullsized":"2024-09-12T17:08:33.600223+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.580430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604073+0000","last_change":"2024-09-12T17:05:57.596229+0000","last_active":"2024-09-12T17:08:33.604073+0000","last_peered":"2024-09-12T17:08:33.604073+0000","last_clean":"2024-09-12T17:08:33.604073+0000","last_became_active":"2024-09-12T17:05:57.595658+0000","last_became_peered":"2024-09-12T17:05:57.595658+0000","last_unstale":"2024-09-12T17:08:33.604073+0000","last_undegraded":"2024-09-12T17:08:33.604073+0000","last_fullsized":"2024-09-12T17:08:33.604073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.644627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603857+0000","last_change":"2024-09-12T17:08:18.465360+0000","last_active":"2024-09-12T17:08:33.603857+0000","last_peered":"2024-09-12T17:08:33.603857+0000","last_clean":"2024-09-12T17:08:33.603857+0000","last_became_active":"2024-09-12T17:08:18.464976+0000","last_became_peered":"2024-09-12T17:08:18.464976+0000","last_unstale":"2024-09-12T17:08:33.603857+0000","last_undegraded":"2024-09-12T17:08:33.603857+0000","last_fullsized":"2024-09-12T17:08:33.603857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.772819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"84'14","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603646+0000","last_change":"2024-09-12T17:05:47.535946+0000","last_active":"2024-09-12T17:08:33.603646+0000","last_peered":"2024-09-12T17:08:33.603646+0000","last_clean":"2024-09-12T17:08:33.603646+0000","last_became_active":"2024-09-12T17:05:47.534607+0000","last_became_peered":"2024-09-12T17:05:47.534607+0000","last_unstale":"2024-09-12T17:08:33.603646+0000","last_undegraded":"2024-09-12T17:08:33.603646+0000","last_fullsized":"2024-09-12T17:08:33.603646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":36876,"num_write":46,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.937118+0000","last_change":"2024-09-12T17:05:51.548391+0000","last_active":"2024-09-12T17:08:32.937118+0000","last_peered":"2024-09-12T17:08:32.937118+0000","last_clean":"2024-09-12T17:08:32.937118+0000","last_became_active":"2024-09-12T17:05:51.547939+0000","last_became_peered":"2024-09-12T17:05:51.547939+0000","last_unstale":"2024-09-12T17:08:32.937118+0000","last_undegraded":"2024-09-12T17:08:32.937118+0000","last_fullsized":"2024-09-12T17:08:32.937118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:08.848247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"84'23","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600674+0000","last_change":"2024-09-12T17:05:53.535756+0000","last_active":"2024-09-12T17:08:33.600674+0000","last_peered":"2024-09-12T17:08:33.600674+0000","last_clean":"2024-09-12T17:08:33.600674+0000","last_became_active":"2024-09-12T17:05:53.535062+0000","last_became_peered":"2024-09-12T17:05:53.535062+0000","last_unstale":"2024-09-12T17:08:33.600674+0000","last_undegraded":"2024-09-12T17:08:33.600674+0000","last_fullsized":"2024-09-12T17:08:33.600674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12086,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":45,"num_write":28,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936826+0000","last_change":"2024-09-12T17:05:55.564010+0000","last_active":"2024-09-12T17:08:32.936826+0000","last_peered":"2024-09-12T17:08:32.936826+0000","last_clean":"2024-09-12T17:08:32.936826+0000","last_became_active":"2024-09-12T17:05:55.563125+0000","last_became_peered":"2024-09-12T17:05:55.563125+0000","last_unstale":"2024-09-12T17:08:32.936826+0000","last_undegraded":"2024-09-12T17:08:32.936826+0000","last_fullsized":"2024-09-12T17:08:32.936826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:00.697571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":37,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940863+0000","last_change":"2024-09-12T17:08:18.459890+0000","last_active":"2024-09-12T17:08:32.940863+0000","last_peered":"2024-09-12T17:08:32.940863+0000","last_clean":"2024-09-12T17:08:32.940863+0000","last_became_active":"2024-09-12T17:08:18.459544+0000","last_became_peered":"2024-09-12T17:08:18.459544+0000","last_unstale":"2024-09-12T17:08:32.940863+0000","last_undegraded":"2024-09-12T17:08:32.940863+0000","last_fullsized":"2024-09-12T17:08:32.940863+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:05.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587730+0000","last_change":"2024-09-12T17:05:49.544092+0000","last_active":"2024-09-12T17:08:32.587730+0000","last_peered":"2024-09-12T17:08:32.587730+0000","last_clean":"2024-09-12T17:08:32.587730+0000","last_became_active":"2024-09-12T17:05:49.543307+0000","last_became_peered":"2024-09-12T17:05:49.543307+0000","last_unstale":"2024-09-12T17:08:32.587730+0000","last_undegraded":"2024-09-12T17:08:32.587730+0000","last_fullsized":"2024-09-12T17:08:32.587730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:36.286410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585443+0000","last_change":"2024-09-12T17:05:47.526678+0000","last_active":"2024-09-12T17:08:32.585443+0000","last_peered":"2024-09-12T17:08:32.585443+0000","last_clean":"2024-09-12T17:08:32.585443+0000","last_became_active":"2024-09-12T17:05:47.525696+0000","last_became_peered":"2024-09-12T17:05:47.525696+0000","last_unstale":"2024-09-12T17:08:32.585443+0000","last_undegraded":"2024-09-12T17:08:32.585443+0000","last_fullsized":"2024-09-12T17:08:32.585443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:59.012258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":18438,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.937378+0000","last_change":"2024-09-12T17:05:51.543404+0000","last_active":"2024-09-12T17:08:32.937378+0000","last_peered":"2024-09-12T17:08:32.937378+0000","last_clean":"2024-09-12T17:08:32.937378+0000","last_became_active":"2024-09-12T17:05:51.542737+0000","last_became_peered":"2024-09-12T17:05:51.542737+0000","last_unstale":"2024-09-12T17:08:32.937378+0000","last_undegraded":"2024-09-12T17:08:32.937378+0000","last_fullsized":"2024-09-12T17:08:32.937378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:30.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"84'19","reported_seq":217,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589555+0000","last_change":"2024-09-12T17:08:21.484446+0000","last_active":"2024-09-12T17:08:32.589555+0000","last_peered":"2024-09-12T17:08:32.589555+0000","last_clean":"2024-09-12T17:08:32.589555+0000","last_became_active":"2024-09-12T17:08:21.465207+0000","last_became_peered":"2024-09-12T17:08:21.465207+0000","last_unstale":"2024-09-12T17:08:32.589555+0000","last_undegraded":"2024-09-12T17:08:32.589555+0000","last_fullsized":"2024-09-12T17:08:32.589555+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:37.839396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7435,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":40,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3559,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603073+0000","last_change":"2024-09-12T17:05:55.565575+0000","last_active":"2024-09-12T17:08:33.603073+0000","last_peered":"2024-09-12T17:08:33.603073+0000","last_clean":"2024-09-12T17:08:33.603073+0000","last_became_active":"2024-09-12T17:05:55.564802+0000","last_became_peered":"2024-09-12T17:05:55.564802+0000","last_unstale":"2024-09-12T17:08:33.603073+0000","last_undegraded":"2024-09-12T17:08:33.603073+0000","last_fullsized":"2024-09-12T17:08:33.603073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585716+0000","last_change":"2024-09-12T17:05:57.592294+0000","last_active":"2024-09-12T17:08:32.585716+0000","last_peered":"2024-09-12T17:08:32.585716+0000","last_clean":"2024-09-12T17:08:32.585716+0000","last_became_active":"2024-09-12T17:05:57.591389+0000","last_became_peered":"2024-09-12T17:05:57.591389+0000","last_unstale":"2024-09-12T17:08:32.585716+0000","last_undegraded":"2024-09-12T17:08:32.585716+0000","last_fullsized":"2024-09-12T17:08:32.585716+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'10","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589092+0000","last_change":"2024-09-12T17:05:49.553177+0000","last_active":"2024-09-12T17:08:32.589092+0000","last_peered":"2024-09-12T17:08:32.589092+0000","last_clean":"2024-09-12T17:08:32.589092+0000","last_became_active":"2024-09-12T17:05:49.552270+0000","last_became_peered":"2024-09-12T17:05:49.552270+0000","last_unstale":"2024-09-12T17:08:32.589092+0000","last_undegraded":"2024-09-12T17:08:32.589092+0000","last_fullsized":"2024-09-12T17:08:32.589092+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:34.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"74'8","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941709+0000","last_change":"2024-09-12T17:05:47.543064+0000","last_active":"2024-09-12T17:08:32.941709+0000","last_peered":"2024-09-12T17:08:32.941709+0000","last_clean":"2024-09-12T17:08:32.941709+0000","last_became_active":"2024-09-12T17:05:47.542362+0000","last_became_peered":"2024-09-12T17:05:47.542362+0000","last_unstale":"2024-09-12T17:08:32.941709+0000","last_undegraded":"2024-09-12T17:08:32.941709+0000","last_fullsized":"2024-09-12T17:08:32.941709+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":37,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942035+0000","last_change":"2024-09-12T17:08:18.456938+0000","last_active":"2024-09-12T17:08:32.942035+0000","last_peered":"2024-09-12T17:08:32.942035+0000","last_clean":"2024-09-12T17:08:32.942035+0000","last_became_active":"2024-09-12T17:08:18.452101+0000","last_became_peered":"2024-09-12T17:08:18.452101+0000","last_unstale":"2024-09-12T17:08:32.942035+0000","last_undegraded":"2024-09-12T17:08:32.942035+0000","last_fullsized":"2024-09-12T17:08:32.942035+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:36.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"84'19","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938078+0000","last_change":"2024-09-12T17:05:53.554531+0000","last_active":"2024-09-12T17:08:32.938078+0000","last_peered":"2024-09-12T17:08:32.938078+0000","last_clean":"2024-09-12T17:08:32.938078+0000","last_became_active":"2024-09-12T17:05:53.554131+0000","last_became_peered":"2024-09-12T17:05:53.554131+0000","last_unstale":"2024-09-12T17:08:32.938078+0000","last_undegraded":"2024-09-12T17:08:32.938078+0000","last_fullsized":"2024-09-12T17:08:32.938078+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"84'14","reported_seq":208,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938496+0000","last_change":"2024-09-12T17:05:55.559204+0000","last_active":"2024-09-12T17:08:32.938496+0000","last_peered":"2024-09-12T17:08:32.938496+0000","last_clean":"2024-09-12T17:08:32.938496+0000","last_became_active":"2024-09-12T17:05:55.556488+0000","last_became_peered":"2024-09-12T17:05:55.556488+0000","last_unstale":"2024-09-12T17:08:32.938496+0000","last_undegraded":"2024-09-12T17:08:32.938496+0000","last_fullsized":"2024-09-12T17:08:32.938496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:15.167640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":37,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939582+0000","last_change":"2024-09-12T17:08:18.461886+0000","last_active":"2024-09-12T17:08:32.939582+0000","last_peered":"2024-09-12T17:08:32.939582+0000","last_clean":"2024-09-12T17:08:32.939582+0000","last_became_active":"2024-09-12T17:08:18.460345+0000","last_became_peered":"2024-09-12T17:08:18.460345+0000","last_unstale":"2024-09-12T17:08:32.939582+0000","last_undegraded":"2024-09-12T17:08:32.939582+0000","last_fullsized":"2024-09-12T17:08:32.939582+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:30.011702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"68'6","reported_seq":171,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.590085+0000","last_change":"2024-09-12T17:05:49.562360+0000","last_active":"2024-09-12T17:08:32.590085+0000","last_peered":"2024-09-12T17:08:32.590085+0000","last_clean":"2024-09-12T17:08:32.590085+0000","last_became_active":"2024-09-12T17:05:49.561200+0000","last_became_peered":"2024-09-12T17:05:49.561200+0000","last_unstale":"2024-09-12T17:08:32.590085+0000","last_undegraded":"2024-09-12T17:08:32.590085+0000","last_fullsized":"2024-09-12T17:08:32.590085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.915600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"84'9","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586096+0000","last_change":"2024-09-12T17:05:47.542018+0000","last_active":"2024-09-12T17:08:32.586096+0000","last_peered":"2024-09-12T17:08:32.586096+0000","last_clean":"2024-09-12T17:08:32.586096+0000","last_became_active":"2024-09-12T17:05:47.540484+0000","last_became_peered":"2024-09-12T17:05:47.540484+0000","last_unstale":"2024-09-12T17:08:32.586096+0000","last_undegraded":"2024-09-12T17:08:32.586096+0000","last_fullsized":"2024-09-12T17:08:32.586096+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:13.571666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24585,"num_write":33,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606141+0000","last_change":"2024-09-12T17:05:51.556083+0000","last_active":"2024-09-12T17:08:33.606141+0000","last_peered":"2024-09-12T17:08:33.606141+0000","last_clean":"2024-09-12T17:08:33.606141+0000","last_became_active":"2024-09-12T17:05:51.554176+0000","last_became_peered":"2024-09-12T17:05:51.554176+0000","last_unstale":"2024-09-12T17:08:33.606141+0000","last_undegraded":"2024-09-12T17:08:33.606141+0000","last_fullsized":"2024-09-12T17:08:33.606141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:02.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589967+0000","last_change":"2024-09-12T17:05:53.553304+0000","last_active":"2024-09-12T17:08:32.589967+0000","last_peered":"2024-09-12T17:08:32.589967+0000","last_clean":"2024-09-12T17:08:32.589967+0000","last_became_active":"2024-09-12T17:05:53.552545+0000","last_became_peered":"2024-09-12T17:05:53.552545+0000","last_unstale":"2024-09-12T17:08:32.589967+0000","last_undegraded":"2024-09-12T17:08:32.589967+0000","last_fullsized":"2024-09-12T17:08:32.589967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"88'16","reported_seq":227,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941461+0000","last_change":"2024-09-12T17:08:18.628128+0000","last_active":"2024-09-12T17:08:32.941461+0000","last_peered":"2024-09-12T17:08:32.941461+0000","last_clean":"2024-09-12T17:08:32.941461+0000","last_became_active":"2024-09-12T17:08:18.471539+0000","last_became_peered":"2024-09-12T17:08:18.471539+0000","last_unstale":"2024-09-12T17:08:32.941461+0000","last_undegraded":"2024-09-12T17:08:32.941461+0000","last_fullsized":"2024-09-12T17:08:32.941461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:47.486729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589188+0000","last_change":"2024-09-12T17:05:57.597870+0000","last_active":"2024-09-12T17:08:32.589188+0000","last_peered":"2024-09-12T17:08:32.589188+0000","last_clean":"2024-09-12T17:08:32.589188+0000","last_became_active":"2024-09-12T17:05:57.597076+0000","last_became_peered":"2024-09-12T17:05:57.597076+0000","last_unstale":"2024-09-12T17:08:32.589188+0000","last_undegraded":"2024-09-12T17:08:32.589188+0000","last_fullsized":"2024-09-12T17:08:32.589188+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.648974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"68'6","reported_seq":41,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941007+0000","last_change":"2024-09-12T17:08:18.887494+0000","last_active":"2024-09-12T17:08:32.941007+0000","last_peered":"2024-09-12T17:08:32.941007+0000","last_clean":"2024-09-12T17:08:32.941007+0000","last_became_active":"2024-09-12T17:08:18.457423+0000","last_became_peered":"2024-09-12T17:08:18.457423+0000","last_unstale":"2024-09-12T17:08:32.941007+0000","last_undegraded":"2024-09-12T17:08:32.941007+0000","last_fullsized":"2024-09-12T17:08:32.941007+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:59.827727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"84'10","reported_seq":216,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.584805+0000","last_change":"2024-09-12T17:08:18.702553+0000","last_active":"2024-09-12T17:08:32.584805+0000","last_peered":"2024-09-12T17:08:32.584805+0000","last_clean":"2024-09-12T17:08:32.584805+0000","last_became_active":"2024-09-12T17:08:18.449468+0000","last_became_peered":"2024-09-12T17:08:18.449468+0000","last_unstale":"2024-09-12T17:08:32.584805+0000","last_undegraded":"2024-09-12T17:08:32.584805+0000","last_fullsized":"2024-09-12T17:08:32.584805+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:54.548414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589842+0000","last_change":"2024-09-12T17:05:51.540047+0000","last_active":"2024-09-12T17:08:32.589842+0000","last_peered":"2024-09-12T17:08:32.589842+0000","last_clean":"2024-09-12T17:08:32.589842+0000","last_became_active":"2024-09-12T17:05:51.539302+0000","last_became_peered":"2024-09-12T17:05:51.539302+0000","last_unstale":"2024-09-12T17:08:32.589842+0000","last_undegraded":"2024-09-12T17:08:32.589842+0000","last_fullsized":"2024-09-12T17:08:32.589842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:21.253801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"84'23","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603583+0000","last_change":"2024-09-12T17:08:21.515721+0000","last_active":"2024-09-12T17:08:33.603583+0000","last_peered":"2024-09-12T17:08:33.603583+0000","last_clean":"2024-09-12T17:08:33.603583+0000","last_became_active":"2024-09-12T17:08:21.467530+0000","last_became_peered":"2024-09-12T17:08:21.467530+0000","last_unstale":"2024-09-12T17:08:33.603583+0000","last_undegraded":"2024-09-12T17:08:33.603583+0000","last_fullsized":"2024-09-12T17:08:33.603583+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:04.806432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":37,"num_read_kb":36,"num_write":26,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":12538,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940695+0000","last_change":"2024-09-12T17:05:55.566749+0000","last_active":"2024-09-12T17:08:32.940695+0000","last_peered":"2024-09-12T17:08:32.940695+0000","last_clean":"2024-09-12T17:08:32.940695+0000","last_became_active":"2024-09-12T17:05:55.565979+0000","last_became_peered":"2024-09-12T17:05:55.565979+0000","last_unstale":"2024-09-12T17:08:32.940695+0000","last_undegraded":"2024-09-12T17:08:32.940695+0000","last_fullsized":"2024-09-12T17:08:32.940695+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939843+0000","last_change":"2024-09-12T17:08:21.461881+0000","last_active":"2024-09-12T17:08:32.939843+0000","last_peered":"2024-09-12T17:08:32.939843+0000","last_clean":"2024-09-12T17:08:32.939843+0000","last_became_active":"2024-09-12T17:08:21.461496+0000","last_became_peered":"2024-09-12T17:08:21.461496+0000","last_unstale":"2024-09-12T17:08:32.939843+0000","last_undegraded":"2024-09-12T17:08:32.939843+0000","last_fullsized":"2024-09-12T17:08:32.939843+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:41.000825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941738+0000","last_change":"2024-09-12T17:05:49.539487+0000","last_active":"2024-09-12T17:08:32.941738+0000","last_peered":"2024-09-12T17:08:32.941738+0000","last_clean":"2024-09-12T17:08:32.941738+0000","last_became_active":"2024-09-12T17:05:49.538713+0000","last_became_peered":"2024-09-12T17:05:49.538713+0000","last_unstale":"2024-09-12T17:08:32.941738+0000","last_undegraded":"2024-09-12T17:08:32.941738+0000","last_fullsized":"2024-09-12T17:08:32.941738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.731614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":272,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602363+0000","last_change":"2024-09-12T17:05:35.688483+0000","last_active":"2024-09-12T17:08:33.602363+0000","last_peered":"2024-09-12T17:08:33.602363+0000","last_clean":"2024-09-12T17:08:33.602363+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:08:33.602363+0000","last_undegraded":"2024-09-12T17:08:33.602363+0000","last_fullsized":"2024-09-12T17:08:33.602363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_clean_scrub_stamp":"2024-09-12T17:05:34.151079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602740+0000","last_change":"2024-09-12T17:05:42.225793+0000","last_active":"2024-09-12T17:08:33.602740+0000","last_peered":"2024-09-12T17:08:33.602740+0000","last_clean":"2024-09-12T17:08:33.602740+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:08:33.602740+0000","last_undegraded":"2024-09-12T17:08:33.602740+0000","last_fullsized":"2024-09-12T17:08:33.602740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:54.880257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'13","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586806+0000","last_change":"2024-09-12T17:05:47.526243+0000","last_active":"2024-09-12T17:08:32.586806+0000","last_peered":"2024-09-12T17:08:32.586806+0000","last_clean":"2024-09-12T17:08:32.586806+0000","last_became_active":"2024-09-12T17:05:47.525694+0000","last_became_peered":"2024-09-12T17:05:47.525694+0000","last_unstale":"2024-09-12T17:08:32.586806+0000","last_undegraded":"2024-09-12T17:08:32.586806+0000","last_fullsized":"2024-09-12T17:08:32.586806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38921,"num_write":37,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606510+0000","last_change":"2024-09-12T17:05:51.548356+0000","last_active":"2024-09-12T17:08:33.606510+0000","last_peered":"2024-09-12T17:08:33.606510+0000","last_clean":"2024-09-12T17:08:33.606510+0000","last_became_active":"2024-09-12T17:05:51.547503+0000","last_became_peered":"2024-09-12T17:05:51.547503+0000","last_unstale":"2024-09-12T17:08:33.606510+0000","last_undegraded":"2024-09-12T17:08:33.606510+0000","last_fullsized":"2024-09-12T17:08:33.606510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:47.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"84'30","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604943+0000","last_change":"2024-09-12T17:05:53.546057+0000","last_active":"2024-09-12T17:08:33.604943+0000","last_peered":"2024-09-12T17:08:33.604943+0000","last_clean":"2024-09-12T17:08:33.604943+0000","last_became_active":"2024-09-12T17:05:53.545266+0000","last_became_peered":"2024-09-12T17:05:53.545266+0000","last_unstale":"2024-09-12T17:08:33.604943+0000","last_undegraded":"2024-09-12T17:08:33.604943+0000","last_fullsized":"2024-09-12T17:08:33.604943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18405,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604135+0000","last_change":"2024-09-12T17:05:55.562246+0000","last_active":"2024-09-12T17:08:33.604135+0000","last_peered":"2024-09-12T17:08:33.604135+0000","last_clean":"2024-09-12T17:08:33.604135+0000","last_became_active":"2024-09-12T17:05:55.561410+0000","last_became_peered":"2024-09-12T17:05:55.561410+0000","last_unstale":"2024-09-12T17:08:33.604135+0000","last_undegraded":"2024-09-12T17:08:33.604135+0000","last_fullsized":"2024-09-12T17:08:33.604135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.373235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"68'2","reported_seq":148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938080+0000","last_change":"2024-09-12T17:05:57.593095+0000","last_active":"2024-09-12T17:08:32.938080+0000","last_peered":"2024-09-12T17:08:32.938080+0000","last_clean":"2024-09-12T17:08:32.938080+0000","last_became_active":"2024-09-12T17:05:57.592287+0000","last_became_peered":"2024-09-12T17:05:57.592287+0000","last_unstale":"2024-09-12T17:08:32.938080+0000","last_undegraded":"2024-09-12T17:08:32.938080+0000","last_fullsized":"2024-09-12T17:08:32.938080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:52.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604303+0000","last_change":"2024-09-12T17:08:18.465677+0000","last_active":"2024-09-12T17:08:33.604303+0000","last_peered":"2024-09-12T17:08:33.604303+0000","last_clean":"2024-09-12T17:08:33.604303+0000","last_became_active":"2024-09-12T17:08:18.464334+0000","last_became_peered":"2024-09-12T17:08:18.464334+0000","last_unstale":"2024-09-12T17:08:33.604303+0000","last_undegraded":"2024-09-12T17:08:33.604303+0000","last_fullsized":"2024-09-12T17:08:33.604303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:26.356922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601919+0000","last_change":"2024-09-12T17:08:21.462733+0000","last_active":"2024-09-12T17:08:33.601919+0000","last_peered":"2024-09-12T17:08:33.601919+0000","last_clean":"2024-09-12T17:08:33.601919+0000","last_became_active":"2024-09-12T17:08:21.461625+0000","last_became_peered":"2024-09-12T17:08:21.461625+0000","last_unstale":"2024-09-12T17:08:33.601919+0000","last_undegraded":"2024-09-12T17:08:33.601919+0000","last_fullsized":"2024-09-12T17:08:33.601919+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:09.553944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'15","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600772+0000","last_change":"2024-09-12T17:05:47.544269+0000","last_active":"2024-09-12T17:08:33.600772+0000","last_peered":"2024-09-12T17:08:33.600772+0000","last_clean":"2024-09-12T17:08:33.600772+0000","last_became_active":"2024-09-12T17:05:47.543531+0000","last_became_peered":"2024-09-12T17:05:47.543531+0000","last_unstale":"2024-09-12T17:08:33.600772+0000","last_undegraded":"2024-09-12T17:08:33.600772+0000","last_fullsized":"2024-09-12T17:08:33.600772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:55.688363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":40969,"num_write":39,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605269+0000","last_change":"2024-09-12T17:08:18.466066+0000","last_active":"2024-09-12T17:08:33.605269+0000","last_peered":"2024-09-12T17:08:33.605269+0000","last_clean":"2024-09-12T17:08:33.605269+0000","last_became_active":"2024-09-12T17:08:18.465027+0000","last_became_peered":"2024-09-12T17:08:18.465027+0000","last_unstale":"2024-09-12T17:08:33.605269+0000","last_undegraded":"2024-09-12T17:08:33.605269+0000","last_fullsized":"2024-09-12T17:08:33.605269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"91'48","reported_seq":57,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940781+0000","last_change":"2024-09-12T17:08:21.488130+0000","last_active":"2024-09-12T17:08:32.940781+0000","last_peered":"2024-09-12T17:08:32.940781+0000","last_clean":"2024-09-12T17:08:32.940781+0000","last_became_active":"2024-09-12T17:08:21.455260+0000","last_became_peered":"2024-09-12T17:08:21.455260+0000","last_unstale":"2024-09-12T17:08:32.940781+0000","last_undegraded":"2024-09-12T17:08:32.940781+0000","last_fullsized":"2024-09-12T17:08:32.940781+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:08.863638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17326,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":71,"num_read_kb":74,"num_write":44,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":5726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606844+0000","last_change":"2024-09-12T17:05:55.556362+0000","last_active":"2024-09-12T17:08:33.606844+0000","last_peered":"2024-09-12T17:08:33.606844+0000","last_clean":"2024-09-12T17:08:33.606844+0000","last_became_active":"2024-09-12T17:05:55.555625+0000","last_became_peered":"2024-09-12T17:05:55.555625+0000","last_unstale":"2024-09-12T17:08:33.606844+0000","last_undegraded":"2024-09-12T17:08:33.606844+0000","last_fullsized":"2024-09-12T17:08:33.606844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"84'6","reported_seq":43,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940848+0000","last_change":"2024-09-12T17:08:18.577521+0000","last_active":"2024-09-12T17:08:32.940848+0000","last_peered":"2024-09-12T17:08:32.940848+0000","last_clean":"2024-09-12T17:08:32.940848+0000","last_became_active":"2024-09-12T17:08:18.446923+0000","last_became_peered":"2024-09-12T17:08:18.446923+0000","last_unstale":"2024-09-12T17:08:32.940848+0000","last_undegraded":"2024-09-12T17:08:32.940848+0000","last_fullsized":"2024-09-12T17:08:32.940848+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:00.600036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940428+0000","last_change":"2024-09-12T17:08:21.457044+0000","last_active":"2024-09-12T17:08:32.940428+0000","last_peered":"2024-09-12T17:08:32.940428+0000","last_clean":"2024-09-12T17:08:32.940428+0000","last_became_active":"2024-09-12T17:08:21.456705+0000","last_became_peered":"2024-09-12T17:08:21.456705+0000","last_unstale":"2024-09-12T17:08:32.940428+0000","last_undegraded":"2024-09-12T17:08:32.940428+0000","last_fullsized":"2024-09-12T17:08:32.940428+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:57.537595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936855+0000","last_change":"2024-09-12T17:05:42.677413+0000","last_active":"2024-09-12T17:08:32.936855+0000","last_peered":"2024-09-12T17:08:32.936855+0000","last_clean":"2024-09-12T17:08:32.936855+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:08:32.936855+0000","last_undegraded":"2024-09-12T17:08:32.936855+0000","last_fullsized":"2024-09-12T17:08:32.936855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.836885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"84'12","reported_seq":59,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938724+0000","last_change":"2024-09-12T17:08:18.715809+0000","last_active":"2024-09-12T17:08:32.938724+0000","last_peered":"2024-09-12T17:08:32.938724+0000","last_clean":"2024-09-12T17:08:32.938724+0000","last_became_active":"2024-09-12T17:08:18.446837+0000","last_became_peered":"2024-09-12T17:08:18.446837+0000","last_unstale":"2024-09-12T17:08:32.938724+0000","last_undegraded":"2024-09-12T17:08:32.938724+0000","last_fullsized":"2024-09-12T17:08:32.938724+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:22.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":159,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938748+0000","last_change":"2024-09-12T17:05:51.557262+0000","last_active":"2024-09-12T17:08:32.938748+0000","last_peered":"2024-09-12T17:08:32.938748+0000","last_clean":"2024-09-12T17:08:32.938748+0000","last_became_active":"2024-09-12T17:05:51.556959+0000","last_became_peered":"2024-09-12T17:05:51.556959+0000","last_unstale":"2024-09-12T17:08:32.938748+0000","last_undegraded":"2024-09-12T17:08:32.938748+0000","last_fullsized":"2024-09-12T17:08:32.938748+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.963181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"36'15","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607471+0000","last_change":"2024-09-12T17:05:53.555384+0000","last_active":"2024-09-12T17:08:33.607471+0000","last_peered":"2024-09-12T17:08:33.607471+0000","last_clean":"2024-09-12T17:08:33.607471+0000","last_became_active":"2024-09-12T17:05:53.554063+0000","last_became_peered":"2024-09-12T17:05:53.554063+0000","last_unstale":"2024-09-12T17:08:33.607471+0000","last_undegraded":"2024-09-12T17:08:33.607471+0000","last_fullsized":"2024-09-12T17:08:33.607471+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602091+0000","last_change":"2024-09-12T17:05:55.547595+0000","last_active":"2024-09-12T17:08:33.602091+0000","last_peered":"2024-09-12T17:08:33.602091+0000","last_clean":"2024-09-12T17:08:33.602091+0000","last_became_active":"2024-09-12T17:05:55.546700+0000","last_became_peered":"2024-09-12T17:05:55.546700+0000","last_unstale":"2024-09-12T17:08:33.602091+0000","last_undegraded":"2024-09-12T17:08:33.602091+0000","last_fullsized":"2024-09-12T17:08:33.602091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587807+0000","last_change":"2024-09-12T17:05:57.587955+0000","last_active":"2024-09-12T17:08:32.587807+0000","last_peered":"2024-09-12T17:08:32.587807+0000","last_clean":"2024-09-12T17:08:32.587807+0000","last_became_active":"2024-09-12T17:05:57.587199+0000","last_became_peered":"2024-09-12T17:05:57.587199+0000","last_unstale":"2024-09-12T17:08:32.587807+0000","last_undegraded":"2024-09-12T17:08:32.587807+0000","last_fullsized":"2024-09-12T17:08:32.587807+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.422656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941160+0000","last_change":"2024-09-12T17:08:21.456185+0000","last_active":"2024-09-12T17:08:32.941160+0000","last_peered":"2024-09-12T17:08:32.941160+0000","last_clean":"2024-09-12T17:08:32.941160+0000","last_became_active":"2024-09-12T17:08:21.455573+0000","last_became_peered":"2024-09-12T17:08:21.455573+0000","last_unstale":"2024-09-12T17:08:32.941160+0000","last_undegraded":"2024-09-12T17:08:32.941160+0000","last_fullsized":"2024-09-12T17:08:32.941160+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:45.008694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604023+0000","last_change":"2024-09-12T17:08:18.708570+0000","last_active":"2024-09-12T17:08:33.604023+0000","last_peered":"2024-09-12T17:08:33.604023+0000","last_clean":"2024-09-12T17:08:33.604023+0000","last_became_active":"2024-09-12T17:08:18.474152+0000","last_became_peered":"2024-09-12T17:08:18.474152+0000","last_unstale":"2024-09-12T17:08:33.604023+0000","last_undegraded":"2024-09-12T17:08:33.604023+0000","last_fullsized":"2024-09-12T17:08:33.604023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:17.040784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'10","reported_seq":186,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587943+0000","last_change":"2024-09-12T17:05:47.546543+0000","last_active":"2024-09-12T17:08:32.587943+0000","last_peered":"2024-09-12T17:08:32.587943+0000","last_clean":"2024-09-12T17:08:32.587943+0000","last_became_active":"2024-09-12T17:05:47.545554+0000","last_became_peered":"2024-09-12T17:05:47.545554+0000","last_unstale":"2024-09-12T17:08:32.587943+0000","last_undegraded":"2024-09-12T17:08:32.587943+0000","last_fullsized":"2024-09-12T17:08:32.587943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:07.148131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602766+0000","last_change":"2024-09-12T17:08:18.451242+0000","last_active":"2024-09-12T17:08:33.602766+0000","last_peered":"2024-09-12T17:08:33.602766+0000","last_clean":"2024-09-12T17:08:33.602766+0000","last_became_active":"2024-09-12T17:08:18.450835+0000","last_became_peered":"2024-09-12T17:08:18.450835+0000","last_unstale":"2024-09-12T17:08:33.602766+0000","last_undegraded":"2024-09-12T17:08:33.602766+0000","last_fullsized":"2024-09-12T17:08:33.602766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.591349+0000","last_change":"2024-09-12T17:05:53.551499+0000","last_active":"2024-09-12T17:08:32.591349+0000","last_peered":"2024-09-12T17:08:32.591349+0000","last_clean":"2024-09-12T17:08:32.591349+0000","last_became_active":"2024-09-12T17:05:53.550857+0000","last_became_peered":"2024-09-12T17:05:53.550857+0000","last_unstale":"2024-09-12T17:08:32.591349+0000","last_undegraded":"2024-09-12T17:08:32.591349+0000","last_fullsized":"2024-09-12T17:08:32.591349+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942208+0000","last_change":"2024-09-12T17:05:55.571619+0000","last_active":"2024-09-12T17:08:32.942208+0000","last_peered":"2024-09-12T17:08:32.942208+0000","last_clean":"2024-09-12T17:08:32.942208+0000","last_became_active":"2024-09-12T17:05:55.570991+0000","last_became_peered":"2024-09-12T17:05:55.570991+0000","last_unstale":"2024-09-12T17:08:32.942208+0000","last_undegraded":"2024-09-12T17:08:32.942208+0000","last_fullsized":"2024-09-12T17:08:32.942208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:02.401831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"84'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601534+0000","last_change":"2024-09-12T17:05:57.590482+0000","last_active":"2024-09-12T17:08:33.601534+0000","last_peered":"2024-09-12T17:08:33.601534+0000","last_clean":"2024-09-12T17:08:33.601534+0000","last_became_active":"2024-09-12T17:05:57.589542+0000","last_became_peered":"2024-09-12T17:05:57.589542+0000","last_unstale":"2024-09-12T17:08:33.601534+0000","last_undegraded":"2024-09-12T17:08:33.601534+0000","last_fullsized":"2024-09-12T17:08:33.601534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:20.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942334+0000","last_change":"2024-09-12T17:08:21.464126+0000","last_active":"2024-09-12T17:08:32.942334+0000","last_peered":"2024-09-12T17:08:32.942334+0000","last_clean":"2024-09-12T17:08:32.942334+0000","last_became_active":"2024-09-12T17:08:21.462608+0000","last_became_peered":"2024-09-12T17:08:21.462608+0000","last_unstale":"2024-09-12T17:08:32.942334+0000","last_undegraded":"2024-09-12T17:08:32.942334+0000","last_fullsized":"2024-09-12T17:08:32.942334+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:15.261389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"84'18","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606478+0000","last_change":"2024-09-12T17:05:47.525858+0000","last_active":"2024-09-12T17:08:33.606478+0000","last_peered":"2024-09-12T17:08:33.606478+0000","last_clean":"2024-09-12T17:08:33.606478+0000","last_became_active":"2024-09-12T17:05:47.525258+0000","last_became_peered":"2024-09-12T17:05:47.525258+0000","last_unstale":"2024-09-12T17:08:33.606478+0000","last_undegraded":"2024-09-12T17:08:33.606478+0000","last_fullsized":"2024-09-12T17:08:33.606478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":30,"num_read_kb":59401,"num_write":42,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942021+0000","last_change":"2024-09-12T17:08:18.462079+0000","last_active":"2024-09-12T17:08:32.942021+0000","last_peered":"2024-09-12T17:08:32.942021+0000","last_clean":"2024-09-12T17:08:32.942021+0000","last_became_active":"2024-09-12T17:08:18.460435+0000","last_became_peered":"2024-09-12T17:08:18.460435+0000","last_unstale":"2024-09-12T17:08:32.942021+0000","last_undegraded":"2024-09-12T17:08:32.942021+0000","last_fullsized":"2024-09-12T17:08:32.942021+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:32.002970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602556+0000","last_change":"2024-09-12T17:05:51.544848+0000","last_active":"2024-09-12T17:08:33.602556+0000","last_peered":"2024-09-12T17:08:33.602556+0000","last_clean":"2024-09-12T17:08:33.602556+0000","last_became_active":"2024-09-12T17:05:51.544078+0000","last_became_peered":"2024-09-12T17:05:51.544078+0000","last_unstale":"2024-09-12T17:08:33.602556+0000","last_undegraded":"2024-09-12T17:08:33.602556+0000","last_fullsized":"2024-09-12T17:08:33.602556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"84'27","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600730+0000","last_change":"2024-09-12T17:05:53.540181+0000","last_active":"2024-09-12T17:08:33.600730+0000","last_peered":"2024-09-12T17:08:33.600730+0000","last_clean":"2024-09-12T17:08:33.600730+0000","last_became_active":"2024-09-12T17:05:53.539372+0000","last_became_peered":"2024-09-12T17:05:53.539372+0000","last_unstale":"2024-09-12T17:08:33.600730+0000","last_undegraded":"2024-09-12T17:08:33.600730+0000","last_fullsized":"2024-09-12T17:08:33.600730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:58.931466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6989,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588142+0000","last_change":"2024-09-12T17:05:55.554060+0000","last_active":"2024-09-12T17:08:32.588142+0000","last_peered":"2024-09-12T17:08:32.588142+0000","last_clean":"2024-09-12T17:08:32.588142+0000","last_became_active":"2024-09-12T17:05:55.553263+0000","last_became_peered":"2024-09-12T17:05:55.553263+0000","last_unstale":"2024-09-12T17:08:32.588142+0000","last_undegraded":"2024-09-12T17:08:32.588142+0000","last_fullsized":"2024-09-12T17:08:32.588142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:44.303469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602500+0000","last_change":"2024-09-12T17:05:58.121180+0000","last_active":"2024-09-12T17:08:33.602500+0000","last_peered":"2024-09-12T17:08:33.602500+0000","last_clean":"2024-09-12T17:08:33.602500+0000","last_became_active":"2024-09-12T17:05:58.119755+0000","last_became_peered":"2024-09-12T17:05:58.119755+0000","last_unstale":"2024-09-12T17:08:33.602500+0000","last_undegraded":"2024-09-12T17:08:33.602500+0000","last_fullsized":"2024-09-12T17:08:33.602500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603740+0000","last_change":"2024-09-12T17:05:49.550213+0000","last_active":"2024-09-12T17:08:33.603740+0000","last_peered":"2024-09-12T17:08:33.603740+0000","last_clean":"2024-09-12T17:08:33.603740+0000","last_became_active":"2024-09-12T17:05:49.549583+0000","last_became_peered":"2024-09-12T17:05:49.549583+0000","last_unstale":"2024-09-12T17:08:33.603740+0000","last_undegraded":"2024-09-12T17:08:33.603740+0000","last_fullsized":"2024-09-12T17:08:33.603740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:05.085326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"84'11","reported_seq":59,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941694+0000","last_change":"2024-09-12T17:08:18.869145+0000","last_active":"2024-09-12T17:08:32.941694+0000","last_peered":"2024-09-12T17:08:32.941694+0000","last_clean":"2024-09-12T17:08:32.941694+0000","last_became_active":"2024-09-12T17:08:18.448295+0000","last_became_peered":"2024-09-12T17:08:18.448295+0000","last_unstale":"2024-09-12T17:08:32.941694+0000","last_undegraded":"2024-09-12T17:08:32.941694+0000","last_fullsized":"2024-09-12T17:08:32.941694+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:20.400937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36867,"num_write":19,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608651+0000","last_change":"2024-09-12T17:05:42.218804+0000","last_active":"2024-09-12T17:08:33.608651+0000","last_peered":"2024-09-12T17:08:33.608651+0000","last_clean":"2024-09-12T17:08:33.608651+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:08:33.608651+0000","last_undegraded":"2024-09-12T17:08:33.608651+0000","last_fullsized":"2024-09-12T17:08:33.608651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:48.189931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941124+0000","last_change":"2024-09-12T17:05:51.545963+0000","last_active":"2024-09-12T17:08:32.941124+0000","last_peered":"2024-09-12T17:08:32.941124+0000","last_clean":"2024-09-12T17:08:32.941124+0000","last_became_active":"2024-09-12T17:05:51.545225+0000","last_became_peered":"2024-09-12T17:05:51.545225+0000","last_unstale":"2024-09-12T17:08:32.941124+0000","last_undegraded":"2024-09-12T17:08:32.941124+0000","last_fullsized":"2024-09-12T17:08:32.941124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:40.407563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":53,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939344+0000","last_change":"2024-09-12T17:08:18.881993+0000","last_active":"2024-09-12T17:08:32.939344+0000","last_peered":"2024-09-12T17:08:32.939344+0000","last_clean":"2024-09-12T17:08:32.939344+0000","last_became_active":"2024-09-12T17:08:18.456095+0000","last_became_peered":"2024-09-12T17:08:18.456095+0000","last_unstale":"2024-09-12T17:08:32.939344+0000","last_undegraded":"2024-09-12T17:08:32.939344+0000","last_fullsized":"2024-09-12T17:08:32.939344+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:37.132692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"91'16","reported_seq":217,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602471+0000","last_change":"2024-09-12T17:08:21.492858+0000","last_active":"2024-09-12T17:08:33.602471+0000","last_peered":"2024-09-12T17:08:33.602471+0000","last_clean":"2024-09-12T17:08:33.602471+0000","last_became_active":"2024-09-12T17:08:21.467026+0000","last_became_peered":"2024-09-12T17:08:21.467026+0000","last_unstale":"2024-09-12T17:08:33.602471+0000","last_undegraded":"2024-09-12T17:08:33.602471+0000","last_fullsized":"2024-09-12T17:08:33.602471+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:08.135205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.592417+0000","last_change":"2024-09-12T17:05:58.118437+0000","last_active":"2024-09-12T17:08:32.592417+0000","last_peered":"2024-09-12T17:08:32.592417+0000","last_clean":"2024-09-12T17:08:32.592417+0000","last_became_active":"2024-09-12T17:05:58.117710+0000","last_became_peered":"2024-09-12T17:05:58.117710+0000","last_unstale":"2024-09-12T17:08:32.592417+0000","last_undegraded":"2024-09-12T17:08:32.592417+0000","last_fullsized":"2024-09-12T17:08:32.592417+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:00.239807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":124,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936170+0000","last_change":"2024-09-12T17:06:27.817661+0000","last_active":"2024-09-12T17:08:32.936170+0000","last_peered":"2024-09-12T17:08:32.936170+0000","last_clean":"2024-09-12T17:08:32.936170+0000","last_became_active":"2024-09-12T17:06:27.817451+0000","last_became_peered":"2024-09-12T17:06:27.817451+0000","last_unstale":"2024-09-12T17:08:32.936170+0000","last_undegraded":"2024-09-12T17:08:32.936170+0000","last_fullsized":"2024-09-12T17:08:32.936170+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:31.000633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"83'8","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.592018+0000","last_change":"2024-09-12T17:05:47.535321+0000","last_active":"2024-09-12T17:08:32.592018+0000","last_peered":"2024-09-12T17:08:32.592018+0000","last_clean":"2024-09-12T17:08:32.592018+0000","last_became_active":"2024-09-12T17:05:47.534790+0000","last_became_peered":"2024-09-12T17:05:47.534790+0000","last_unstale":"2024-09-12T17:08:32.592018+0000","last_undegraded":"2024-09-12T17:08:32.592018+0000","last_fullsized":"2024-09-12T17:08:32.592018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":26627,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.944065+0000","last_change":"2024-09-12T17:08:21.467295+0000","last_active":"2024-09-12T17:08:32.944065+0000","last_peered":"2024-09-12T17:08:32.944065+0000","last_clean":"2024-09-12T17:08:32.944065+0000","last_became_active":"2024-09-12T17:08:21.467016+0000","last_became_peered":"2024-09-12T17:08:21.467016+0000","last_unstale":"2024-09-12T17:08:32.944065+0000","last_undegraded":"2024-09-12T17:08:32.944065+0000","last_fullsized":"2024-09-12T17:08:32.944065+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:24.509905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587607+0000","last_change":"2024-09-12T17:05:51.533668+0000","last_active":"2024-09-12T17:08:32.587607+0000","last_peered":"2024-09-12T17:08:32.587607+0000","last_clean":"2024-09-12T17:08:32.587607+0000","last_became_active":"2024-09-12T17:05:51.532795+0000","last_became_peered":"2024-09-12T17:05:51.532795+0000","last_unstale":"2024-09-12T17:08:32.587607+0000","last_undegraded":"2024-09-12T17:08:32.587607+0000","last_fullsized":"2024-09-12T17:08:32.587607+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.655645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":169,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589553+0000","last_change":"2024-09-12T17:05:53.544503+0000","last_active":"2024-09-12T17:08:32.589553+0000","last_peered":"2024-09-12T17:08:32.589553+0000","last_clean":"2024-09-12T17:08:32.589553+0000","last_became_active":"2024-09-12T17:05:53.543495+0000","last_became_peered":"2024-09-12T17:05:53.543495+0000","last_unstale":"2024-09-12T17:08:32.589553+0000","last_undegraded":"2024-09-12T17:08:32.589553+0000","last_fullsized":"2024-09-12T17:08:32.589553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.721968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"84'14","reported_seq":196,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588984+0000","last_change":"2024-09-12T17:05:55.567580+0000","last_active":"2024-09-12T17:08:32.588984+0000","last_peered":"2024-09-12T17:08:32.588984+0000","last_clean":"2024-09-12T17:08:32.588984+0000","last_became_active":"2024-09-12T17:05:55.566652+0000","last_became_peered":"2024-09-12T17:05:55.566652+0000","last_unstale":"2024-09-12T17:08:32.588984+0000","last_undegraded":"2024-09-12T17:08:32.588984+0000","last_fullsized":"2024-09-12T17:08:32.588984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:28.904117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"68'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602357+0000","last_change":"2024-09-12T17:05:57.585098+0000","last_active":"2024-09-12T17:08:33.602357+0000","last_peered":"2024-09-12T17:08:33.602357+0000","last_clean":"2024-09-12T17:08:33.602357+0000","last_became_active":"2024-09-12T17:05:57.584326+0000","last_became_peered":"2024-09-12T17:05:57.584326+0000","last_unstale":"2024-09-12T17:08:33.602357+0000","last_undegraded":"2024-09-12T17:08:33.602357+0000","last_fullsized":"2024-09-12T17:08:33.602357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586932+0000","last_change":"2024-09-12T17:05:49.553294+0000","last_active":"2024-09-12T17:08:32.586932+0000","last_peered":"2024-09-12T17:08:32.586932+0000","last_clean":"2024-09-12T17:08:32.586932+0000","last_became_active":"2024-09-12T17:05:49.551726+0000","last_became_peered":"2024-09-12T17:05:49.551726+0000","last_unstale":"2024-09-12T17:08:32.586932+0000","last_undegraded":"2024-09-12T17:08:32.586932+0000","last_fullsized":"2024-09-12T17:08:32.586932+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:50.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'8","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604429+0000","last_change":"2024-09-12T17:08:18.767913+0000","last_active":"2024-09-12T17:08:33.604429+0000","last_peered":"2024-09-12T17:08:33.604429+0000","last_clean":"2024-09-12T17:08:33.604429+0000","last_became_active":"2024-09-12T17:08:18.466136+0000","last_became_peered":"2024-09-12T17:08:18.466136+0000","last_unstale":"2024-09-12T17:08:33.604429+0000","last_undegraded":"2024-09-12T17:08:33.604429+0000","last_fullsized":"2024-09-12T17:08:33.604429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:20.220833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942823+0000","last_change":"2024-09-12T17:05:42.680975+0000","last_active":"2024-09-12T17:08:32.942823+0000","last_peered":"2024-09-12T17:08:32.942823+0000","last_clean":"2024-09-12T17:08:32.942823+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:08:32.942823+0000","last_undegraded":"2024-09-12T17:08:32.942823+0000","last_fullsized":"2024-09-12T17:08:32.942823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.660350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":170,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585393+0000","last_change":"2024-09-12T17:08:18.450093+0000","last_active":"2024-09-12T17:08:32.585393+0000","last_peered":"2024-09-12T17:08:32.585393+0000","last_clean":"2024-09-12T17:08:32.585393+0000","last_became_active":"2024-09-12T17:08:18.449746+0000","last_became_peered":"2024-09-12T17:08:18.449746+0000","last_unstale":"2024-09-12T17:08:32.585393+0000","last_undegraded":"2024-09-12T17:08:32.585393+0000","last_fullsized":"2024-09-12T17:08:32.585393+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:58.736246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"84'38","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603887+0000","last_change":"2024-09-12T17:05:53.554751+0000","last_active":"2024-09-12T17:08:33.603887+0000","last_peered":"2024-09-12T17:08:33.603887+0000","last_clean":"2024-09-12T17:08:33.603887+0000","last_became_active":"2024-09-12T17:05:53.553914+0000","last_became_peered":"2024-09-12T17:05:53.553914+0000","last_unstale":"2024-09-12T17:08:33.603887+0000","last_undegraded":"2024-09-12T17:08:33.603887+0000","last_fullsized":"2024-09-12T17:08:33.603887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29607,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":65,"num_read_kb":81,"num_write":48,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586160+0000","last_change":"2024-09-12T17:08:21.458963+0000","last_active":"2024-09-12T17:08:32.586160+0000","last_peered":"2024-09-12T17:08:32.586160+0000","last_clean":"2024-09-12T17:08:32.586160+0000","last_became_active":"2024-09-12T17:08:21.458521+0000","last_became_peered":"2024-09-12T17:08:21.458521+0000","last_unstale":"2024-09-12T17:08:32.586160+0000","last_undegraded":"2024-09-12T17:08:32.586160+0000","last_fullsized":"2024-09-12T17:08:32.586160+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:56.903898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603355+0000","last_change":"2024-09-12T17:05:57.605829+0000","last_active":"2024-09-12T17:08:33.603355+0000","last_peered":"2024-09-12T17:08:33.603355+0000","last_clean":"2024-09-12T17:08:33.603355+0000","last_became_active":"2024-09-12T17:05:57.605041+0000","last_became_peered":"2024-09-12T17:05:57.605041+0000","last_unstale":"2024-09-12T17:08:33.603355+0000","last_undegraded":"2024-09-12T17:08:33.603355+0000","last_fullsized":"2024-09-12T17:08:33.603355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602885+0000","last_change":"2024-09-12T17:05:57.594498+0000","last_active":"2024-09-12T17:08:33.602885+0000","last_peered":"2024-09-12T17:08:33.602885+0000","last_clean":"2024-09-12T17:08:33.602885+0000","last_became_active":"2024-09-12T17:05:57.590196+0000","last_became_peered":"2024-09-12T17:05:57.590196+0000","last_unstale":"2024-09-12T17:08:33.602885+0000","last_undegraded":"2024-09-12T17:08:33.602885+0000","last_fullsized":"2024-09-12T17:08:33.602885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.543735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587220+0000","last_change":"2024-09-12T17:05:49.562121+0000","last_active":"2024-09-12T17:08:32.587220+0000","last_peered":"2024-09-12T17:08:32.587220+0000","last_clean":"2024-09-12T17:08:32.587220+0000","last_became_active":"2024-09-12T17:05:49.561429+0000","last_became_peered":"2024-09-12T17:05:49.561429+0000","last_unstale":"2024-09-12T17:08:32.587220+0000","last_undegraded":"2024-09-12T17:08:32.587220+0000","last_fullsized":"2024-09-12T17:08:32.587220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:47.663366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586907+0000","last_change":"2024-09-12T17:05:47.557270+0000","last_active":"2024-09-12T17:08:32.586907+0000","last_peered":"2024-09-12T17:08:32.586907+0000","last_clean":"2024-09-12T17:08:32.586907+0000","last_became_active":"2024-09-12T17:05:47.556417+0000","last_became_peered":"2024-09-12T17:05:47.556417+0000","last_unstale":"2024-09-12T17:08:32.586907+0000","last_undegraded":"2024-09-12T17:08:32.586907+0000","last_fullsized":"2024-09-12T17:08:32.586907+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:00.210632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32774,"num_write":27,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":37,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941660+0000","last_change":"2024-09-12T17:08:18.464941+0000","last_active":"2024-09-12T17:08:32.941660+0000","last_peered":"2024-09-12T17:08:32.941660+0000","last_clean":"2024-09-12T17:08:32.941660+0000","last_became_active":"2024-09-12T17:08:18.464091+0000","last_became_peered":"2024-09-12T17:08:18.464091+0000","last_unstale":"2024-09-12T17:08:32.941660+0000","last_undegraded":"2024-09-12T17:08:32.941660+0000","last_fullsized":"2024-09-12T17:08:32.941660+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:15.952591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"84'16","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585047+0000","last_change":"2024-09-12T17:05:53.542230+0000","last_active":"2024-09-12T17:08:32.585047+0000","last_peered":"2024-09-12T17:08:32.585047+0000","last_clean":"2024-09-12T17:08:32.585047+0000","last_became_active":"2024-09-12T17:05:53.541653+0000","last_became_peered":"2024-09-12T17:05:53.541653+0000","last_unstale":"2024-09-12T17:08:32.585047+0000","last_undegraded":"2024-09-12T17:08:32.585047+0000","last_fullsized":"2024-09-12T17:08:32.585047+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585702+0000","last_change":"2024-09-12T17:05:55.556535+0000","last_active":"2024-09-12T17:08:32.585702+0000","last_peered":"2024-09-12T17:08:32.585702+0000","last_clean":"2024-09-12T17:08:32.585702+0000","last_became_active":"2024-09-12T17:05:55.555755+0000","last_became_peered":"2024-09-12T17:05:55.555755+0000","last_unstale":"2024-09-12T17:08:32.585702+0000","last_undegraded":"2024-09-12T17:08:32.585702+0000","last_fullsized":"2024-09-12T17:08:32.585702+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.707384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"84'2","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.590927+0000","last_change":"2024-09-12T17:05:57.593418+0000","last_active":"2024-09-12T17:08:32.590927+0000","last_peered":"2024-09-12T17:08:32.590927+0000","last_clean":"2024-09-12T17:08:32.590927+0000","last_became_active":"2024-09-12T17:05:57.592746+0000","last_became_peered":"2024-09-12T17:05:57.592746+0000","last_unstale":"2024-09-12T17:08:32.590927+0000","last_undegraded":"2024-09-12T17:08:32.590927+0000","last_fullsized":"2024-09-12T17:08:32.590927+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:24.794382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"68'6","reported_seq":36,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939814+0000","last_change":"2024-09-12T17:08:21.616789+0000","last_active":"2024-09-12T17:08:32.939814+0000","last_peered":"2024-09-12T17:08:32.939814+0000","last_clean":"2024-09-12T17:08:32.939814+0000","last_became_active":"2024-09-12T17:08:21.466328+0000","last_became_peered":"2024-09-12T17:08:21.466328+0000","last_unstale":"2024-09-12T17:08:32.939814+0000","last_undegraded":"2024-09-12T17:08:32.939814+0000","last_fullsized":"2024-09-12T17:08:32.939814+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:16.524646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"84'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608043+0000","last_change":"2024-09-12T17:05:47.559497+0000","last_active":"2024-09-12T17:08:33.608043+0000","last_peered":"2024-09-12T17:08:33.608043+0000","last_clean":"2024-09-12T17:08:33.608043+0000","last_became_active":"2024-09-12T17:05:47.558641+0000","last_became_peered":"2024-09-12T17:05:47.558641+0000","last_unstale":"2024-09-12T17:08:33.608043+0000","last_undegraded":"2024-09-12T17:08:33.608043+0000","last_fullsized":"2024-09-12T17:08:33.608043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:00.096304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24585,"num_write":33,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587638+0000","last_change":"2024-09-12T17:05:51.539784+0000","last_active":"2024-09-12T17:08:32.587638+0000","last_peered":"2024-09-12T17:08:32.587638+0000","last_clean":"2024-09-12T17:08:32.587638+0000","last_became_active":"2024-09-12T17:05:51.539275+0000","last_became_peered":"2024-09-12T17:05:51.539275+0000","last_unstale":"2024-09-12T17:08:32.587638+0000","last_undegraded":"2024-09-12T17:08:32.587638+0000","last_fullsized":"2024-09-12T17:08:32.587638+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"84'6","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600440+0000","last_change":"2024-09-12T17:05:53.544731+0000","last_active":"2024-09-12T17:08:33.600440+0000","last_peered":"2024-09-12T17:08:33.600440+0000","last_clean":"2024-09-12T17:08:33.600440+0000","last_became_active":"2024-09-12T17:05:53.544127+0000","last_became_peered":"2024-09-12T17:05:53.544127+0000","last_unstale":"2024-09-12T17:08:33.600440+0000","last_undegraded":"2024-09-12T17:08:33.600440+0000","last_fullsized":"2024-09-12T17:08:33.600440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:04.351698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604873+0000","last_change":"2024-09-12T17:05:55.571541+0000","last_active":"2024-09-12T17:08:33.604873+0000","last_peered":"2024-09-12T17:08:33.604873+0000","last_clean":"2024-09-12T17:08:33.604873+0000","last_became_active":"2024-09-12T17:05:55.570822+0000","last_became_peered":"2024-09-12T17:05:55.570822+0000","last_unstale":"2024-09-12T17:08:33.604873+0000","last_undegraded":"2024-09-12T17:08:33.604873+0000","last_fullsized":"2024-09-12T17:08:33.604873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'2","reported_seq":165,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602495+0000","last_change":"2024-09-12T17:08:18.704689+0000","last_active":"2024-09-12T17:08:33.602495+0000","last_peered":"2024-09-12T17:08:33.602495+0000","last_clean":"2024-09-12T17:08:33.602495+0000","last_became_active":"2024-09-12T17:08:18.450561+0000","last_became_peered":"2024-09-12T17:08:18.450561+0000","last_unstale":"2024-09-12T17:08:33.602495+0000","last_undegraded":"2024-09-12T17:08:33.602495+0000","last_fullsized":"2024-09-12T17:08:33.602495+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:43.088841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585394+0000","last_change":"2024-09-12T17:05:49.520508+0000","last_active":"2024-09-12T17:08:32.585394+0000","last_peered":"2024-09-12T17:08:32.585394+0000","last_clean":"2024-09-12T17:08:32.585394+0000","last_became_active":"2024-09-12T17:05:49.519721+0000","last_became_peered":"2024-09-12T17:05:49.519721+0000","last_unstale":"2024-09-12T17:08:32.585394+0000","last_undegraded":"2024-09-12T17:08:32.585394+0000","last_fullsized":"2024-09-12T17:08:32.585394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"84'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605499+0000","last_change":"2024-09-12T17:05:47.539549+0000","last_active":"2024-09-12T17:08:33.605499+0000","last_peered":"2024-09-12T17:08:33.605499+0000","last_clean":"2024-09-12T17:08:33.605499+0000","last_became_active":"2024-09-12T17:05:47.538581+0000","last_became_peered":"2024-09-12T17:05:47.538581+0000","last_unstale":"2024-09-12T17:08:33.605499+0000","last_undegraded":"2024-09-12T17:08:33.605499+0000","last_fullsized":"2024-09-12T17:08:33.605499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.448924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601093+0000","last_change":"2024-09-12T17:05:51.530541+0000","last_active":"2024-09-12T17:08:33.601093+0000","last_peered":"2024-09-12T17:08:33.601093+0000","last_clean":"2024-09-12T17:08:33.601093+0000","last_became_active":"2024-09-12T17:05:51.527515+0000","last_became_peered":"2024-09-12T17:05:51.527515+0000","last_unstale":"2024-09-12T17:08:33.601093+0000","last_undegraded":"2024-09-12T17:08:33.601093+0000","last_fullsized":"2024-09-12T17:08:33.601093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"84'16","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.587117+0000","last_change":"2024-09-12T17:05:53.555017+0000","last_active":"2024-09-12T17:08:32.587117+0000","last_peered":"2024-09-12T17:08:32.587117+0000","last_clean":"2024-09-12T17:08:32.587117+0000","last_became_active":"2024-09-12T17:05:53.551154+0000","last_became_peered":"2024-09-12T17:05:53.551154+0000","last_unstale":"2024-09-12T17:08:32.587117+0000","last_undegraded":"2024-09-12T17:08:32.587117+0000","last_fullsized":"2024-09-12T17:08:32.587117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:50.736153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940929+0000","last_change":"2024-09-12T17:05:55.570872+0000","last_active":"2024-09-12T17:08:32.940929+0000","last_peered":"2024-09-12T17:08:32.940929+0000","last_clean":"2024-09-12T17:08:32.940929+0000","last_became_active":"2024-09-12T17:05:55.570137+0000","last_became_peered":"2024-09-12T17:05:55.570137+0000","last_unstale":"2024-09-12T17:08:32.940929+0000","last_undegraded":"2024-09-12T17:08:32.940929+0000","last_fullsized":"2024-09-12T17:08:32.940929+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.684868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602407+0000","last_change":"2024-09-12T17:05:57.597088+0000","last_active":"2024-09-12T17:08:33.602407+0000","last_peered":"2024-09-12T17:08:33.602407+0000","last_clean":"2024-09-12T17:08:33.602407+0000","last_became_active":"2024-09-12T17:05:57.596377+0000","last_became_peered":"2024-09-12T17:05:57.596377+0000","last_unstale":"2024-09-12T17:08:33.602407+0000","last_undegraded":"2024-09-12T17:08:33.602407+0000","last_fullsized":"2024-09-12T17:08:33.602407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"68'2","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585072+0000","last_change":"2024-09-12T17:08:18.478612+0000","last_active":"2024-09-12T17:08:32.585072+0000","last_peered":"2024-09-12T17:08:32.585072+0000","last_clean":"2024-09-12T17:08:32.585072+0000","last_became_active":"2024-09-12T17:08:18.449338+0000","last_became_peered":"2024-09-12T17:08:18.449338+0000","last_unstale":"2024-09-12T17:08:32.585072+0000","last_undegraded":"2024-09-12T17:08:32.585072+0000","last_fullsized":"2024-09-12T17:08:32.585072+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:15.864351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"73'7","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603421+0000","last_change":"2024-09-12T17:05:47.526555+0000","last_active":"2024-09-12T17:08:33.603421+0000","last_peered":"2024-09-12T17:08:33.603421+0000","last_clean":"2024-09-12T17:08:33.603421+0000","last_became_active":"2024-09-12T17:05:47.525874+0000","last_became_peered":"2024-09-12T17:05:47.525874+0000","last_unstale":"2024-09-12T17:08:33.603421+0000","last_undegraded":"2024-09-12T17:08:33.603421+0000","last_fullsized":"2024-09-12T17:08:33.603421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":18435,"num_write":15,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939050+0000","last_change":"2024-09-12T17:05:51.540509+0000","last_active":"2024-09-12T17:08:32.939050+0000","last_peered":"2024-09-12T17:08:32.939050+0000","last_clean":"2024-09-12T17:08:32.939050+0000","last_became_active":"2024-09-12T17:05:51.539607+0000","last_became_peered":"2024-09-12T17:05:51.539607+0000","last_unstale":"2024-09-12T17:08:32.939050+0000","last_undegraded":"2024-09-12T17:08:32.939050+0000","last_fullsized":"2024-09-12T17:08:32.939050+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:02.652624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"84'13","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603961+0000","last_change":"2024-09-12T17:05:53.549324+0000","last_active":"2024-09-12T17:08:33.603961+0000","last_peered":"2024-09-12T17:08:33.603961+0000","last_clean":"2024-09-12T17:08:33.603961+0000","last_became_active":"2024-09-12T17:05:53.548561+0000","last_became_peered":"2024-09-12T17:05:53.548561+0000","last_unstale":"2024-09-12T17:08:33.603961+0000","last_undegraded":"2024-09-12T17:08:33.603961+0000","last_fullsized":"2024-09-12T17:08:33.603961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:47.932776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601440+0000","last_change":"2024-09-12T17:05:55.561467+0000","last_active":"2024-09-12T17:08:33.601440+0000","last_peered":"2024-09-12T17:08:33.601440+0000","last_clean":"2024-09-12T17:08:33.601440+0000","last_became_active":"2024-09-12T17:05:55.560708+0000","last_became_peered":"2024-09-12T17:05:55.560708+0000","last_unstale":"2024-09-12T17:08:33.601440+0000","last_undegraded":"2024-09-12T17:08:33.601440+0000","last_fullsized":"2024-09-12T17:08:33.601440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"84'46","reported_seq":211,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942538+0000","last_change":"2024-09-12T17:05:49.547097+0000","last_active":"2024-09-12T17:08:32.942538+0000","last_peered":"2024-09-12T17:08:32.942538+0000","last_clean":"2024-09-12T17:08:32.942538+0000","last_became_active":"2024-09-12T17:05:49.546232+0000","last_became_peered":"2024-09-12T17:05:49.546232+0000","last_unstale":"2024-09-12T17:08:32.942538+0000","last_undegraded":"2024-09-12T17:08:32.942538+0000","last_fullsized":"2024-09-12T17:08:32.942538+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'9","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.584853+0000","last_change":"2024-09-12T17:05:47.521779+0000","last_active":"2024-09-12T17:08:32.584853+0000","last_peered":"2024-09-12T17:08:32.584853+0000","last_clean":"2024-09-12T17:08:32.584853+0000","last_became_active":"2024-09-12T17:05:47.521097+0000","last_became_peered":"2024-09-12T17:05:47.521097+0000","last_unstale":"2024-09-12T17:08:32.584853+0000","last_undegraded":"2024-09-12T17:08:32.584853+0000","last_fullsized":"2024-09-12T17:08:32.584853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:37.072896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":24579,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604192+0000","last_change":"2024-09-12T17:05:51.525803+0000","last_active":"2024-09-12T17:08:33.604192+0000","last_peered":"2024-09-12T17:08:33.604192+0000","last_clean":"2024-09-12T17:08:33.604192+0000","last_became_active":"2024-09-12T17:05:51.525457+0000","last_became_peered":"2024-09-12T17:05:51.525457+0000","last_unstale":"2024-09-12T17:08:33.604192+0000","last_undegraded":"2024-09-12T17:08:33.604192+0000","last_fullsized":"2024-09-12T17:08:33.604192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"84'27","reported_seq":49,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.943096+0000","last_change":"2024-09-12T17:08:19.023629+0000","last_active":"2024-09-12T17:08:32.943096+0000","last_peered":"2024-09-12T17:08:32.943096+0000","last_clean":"2024-09-12T17:08:32.943096+0000","last_became_active":"2024-09-12T17:08:18.463961+0000","last_became_peered":"2024-09-12T17:08:18.463961+0000","last_unstale":"2024-09-12T17:08:32.943096+0000","last_undegraded":"2024-09-12T17:08:32.943096+0000","last_fullsized":"2024-09-12T17:08:32.943096+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:09.409031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24405,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":46,"num_read_kb":64,"num_write":36,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":16653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603360+0000","last_change":"2024-09-12T17:05:55.563312+0000","last_active":"2024-09-12T17:08:33.603360+0000","last_peered":"2024-09-12T17:08:33.603360+0000","last_clean":"2024-09-12T17:08:33.603360+0000","last_became_active":"2024-09-12T17:05:55.562405+0000","last_became_peered":"2024-09-12T17:05:55.562405+0000","last_unstale":"2024-09-12T17:08:33.603360+0000","last_undegraded":"2024-09-12T17:08:33.603360+0000","last_fullsized":"2024-09-12T17:08:33.603360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588047+0000","last_change":"2024-09-12T17:05:58.121110+0000","last_active":"2024-09-12T17:08:32.588047+0000","last_peered":"2024-09-12T17:08:32.588047+0000","last_clean":"2024-09-12T17:08:32.588047+0000","last_became_active":"2024-09-12T17:05:58.120367+0000","last_became_peered":"2024-09-12T17:05:58.120367+0000","last_unstale":"2024-09-12T17:08:32.588047+0000","last_undegraded":"2024-09-12T17:08:32.588047+0000","last_fullsized":"2024-09-12T17:08:32.588047+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604265+0000","last_change":"2024-09-12T17:05:49.532377+0000","last_active":"2024-09-12T17:08:33.604265+0000","last_peered":"2024-09-12T17:08:33.604265+0000","last_clean":"2024-09-12T17:08:33.604265+0000","last_became_active":"2024-09-12T17:05:49.531975+0000","last_became_peered":"2024-09-12T17:05:49.531975+0000","last_unstale":"2024-09-12T17:08:33.604265+0000","last_undegraded":"2024-09-12T17:08:33.604265+0000","last_fullsized":"2024-09-12T17:08:33.604265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'13","reported_seq":57,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939920+0000","last_change":"2024-09-12T17:08:19.003420+0000","last_active":"2024-09-12T17:08:32.939920+0000","last_peered":"2024-09-12T17:08:32.939920+0000","last_clean":"2024-09-12T17:08:32.939920+0000","last_became_active":"2024-09-12T17:08:18.457074+0000","last_became_peered":"2024-09-12T17:08:18.457074+0000","last_unstale":"2024-09-12T17:08:32.939920+0000","last_undegraded":"2024-09-12T17:08:32.939920+0000","last_fullsized":"2024-09-12T17:08:32.939920+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:07.545826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":36876,"num_write":45,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942211+0000","last_change":"2024-09-12T17:05:51.546117+0000","last_active":"2024-09-12T17:08:32.942211+0000","last_peered":"2024-09-12T17:08:32.942211+0000","last_clean":"2024-09-12T17:08:32.942211+0000","last_became_active":"2024-09-12T17:05:51.545154+0000","last_became_peered":"2024-09-12T17:05:51.545154+0000","last_unstale":"2024-09-12T17:08:32.942211+0000","last_undegraded":"2024-09-12T17:08:32.942211+0000","last_fullsized":"2024-09-12T17:08:32.942211+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:49.670591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"83'19","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603894+0000","last_change":"2024-09-12T17:05:53.558834+0000","last_active":"2024-09-12T17:08:33.603894+0000","last_peered":"2024-09-12T17:08:33.603894+0000","last_clean":"2024-09-12T17:08:33.603894+0000","last_became_active":"2024-09-12T17:05:53.558086+0000","last_became_peered":"2024-09-12T17:05:53.558086+0000","last_unstale":"2024-09-12T17:08:33.603894+0000","last_undegraded":"2024-09-12T17:08:33.603894+0000","last_fullsized":"2024-09-12T17:08:33.603894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:43.690058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941954+0000","last_change":"2024-09-12T17:08:21.466904+0000","last_active":"2024-09-12T17:08:32.941954+0000","last_peered":"2024-09-12T17:08:32.941954+0000","last_clean":"2024-09-12T17:08:32.941954+0000","last_became_active":"2024-09-12T17:08:21.466295+0000","last_became_peered":"2024-09-12T17:08:21.466295+0000","last_unstale":"2024-09-12T17:08:32.941954+0000","last_undegraded":"2024-09-12T17:08:32.941954+0000","last_fullsized":"2024-09-12T17:08:32.941954+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:22.041235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'2","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940467+0000","last_change":"2024-09-12T17:05:57.597468+0000","last_active":"2024-09-12T17:08:32.940467+0000","last_peered":"2024-09-12T17:08:32.940467+0000","last_clean":"2024-09-12T17:08:32.940467+0000","last_became_active":"2024-09-12T17:05:57.596651+0000","last_became_peered":"2024-09-12T17:05:57.596651+0000","last_unstale":"2024-09-12T17:08:32.940467+0000","last_undegraded":"2024-09-12T17:08:32.940467+0000","last_fullsized":"2024-09-12T17:08:32.940467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.466145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589128+0000","last_change":"2024-09-12T17:08:18.465892+0000","last_active":"2024-09-12T17:08:32.589128+0000","last_peered":"2024-09-12T17:08:32.589128+0000","last_clean":"2024-09-12T17:08:32.589128+0000","last_became_active":"2024-09-12T17:08:18.465478+0000","last_became_peered":"2024-09-12T17:08:18.465478+0000","last_unstale":"2024-09-12T17:08:32.589128+0000","last_undegraded":"2024-09-12T17:08:32.589128+0000","last_fullsized":"2024-09-12T17:08:32.589128+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:00.793079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"83'8","reported_seq":210,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.591431+0000","last_change":"2024-09-12T17:08:18.626808+0000","last_active":"2024-09-12T17:08:32.591431+0000","last_peered":"2024-09-12T17:08:32.591431+0000","last_clean":"2024-09-12T17:08:32.591431+0000","last_became_active":"2024-09-12T17:08:18.447694+0000","last_became_peered":"2024-09-12T17:08:18.447694+0000","last_unstale":"2024-09-12T17:08:32.591431+0000","last_undegraded":"2024-09-12T17:08:32.591431+0000","last_fullsized":"2024-09-12T17:08:32.591431+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:09.465286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28675,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588640+0000","last_change":"2024-09-12T17:05:51.539916+0000","last_active":"2024-09-12T17:08:32.588640+0000","last_peered":"2024-09-12T17:08:32.588640+0000","last_clean":"2024-09-12T17:08:32.588640+0000","last_became_active":"2024-09-12T17:05:51.539054+0000","last_became_peered":"2024-09-12T17:05:51.539054+0000","last_unstale":"2024-09-12T17:08:32.588640+0000","last_undegraded":"2024-09-12T17:08:32.588640+0000","last_fullsized":"2024-09-12T17:08:32.588640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:11.640578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"84'16","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.592263+0000","last_change":"2024-09-12T17:05:53.557081+0000","last_active":"2024-09-12T17:08:32.592263+0000","last_peered":"2024-09-12T17:08:32.592263+0000","last_clean":"2024-09-12T17:08:32.592263+0000","last_became_active":"2024-09-12T17:05:53.556357+0000","last_became_peered":"2024-09-12T17:05:53.556357+0000","last_unstale":"2024-09-12T17:08:32.592263+0000","last_undegraded":"2024-09-12T17:08:32.592263+0000","last_fullsized":"2024-09-12T17:08:32.592263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:10.984649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.943470+0000","last_change":"2024-09-12T17:08:21.461633+0000","last_active":"2024-09-12T17:08:32.943470+0000","last_peered":"2024-09-12T17:08:32.943470+0000","last_clean":"2024-09-12T17:08:32.943470+0000","last_became_active":"2024-09-12T17:08:21.460894+0000","last_became_peered":"2024-09-12T17:08:21.460894+0000","last_unstale":"2024-09-12T17:08:32.943470+0000","last_undegraded":"2024-09-12T17:08:32.943470+0000","last_fullsized":"2024-09-12T17:08:32.943470+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:18.857770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601884+0000","last_change":"2024-09-12T17:05:57.596779+0000","last_active":"2024-09-12T17:08:33.601884+0000","last_peered":"2024-09-12T17:08:33.601884+0000","last_clean":"2024-09-12T17:08:33.601884+0000","last_became_active":"2024-09-12T17:05:57.596005+0000","last_became_peered":"2024-09-12T17:05:57.596005+0000","last_unstale":"2024-09-12T17:08:33.601884+0000","last_undegraded":"2024-09-12T17:08:33.601884+0000","last_fullsized":"2024-09-12T17:08:33.601884+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938700+0000","last_change":"2024-09-12T17:08:18.445744+0000","last_active":"2024-09-12T17:08:32.938700+0000","last_peered":"2024-09-12T17:08:32.938700+0000","last_clean":"2024-09-12T17:08:32.938700+0000","last_became_active":"2024-09-12T17:08:18.445415+0000","last_became_peered":"2024-09-12T17:08:18.445415+0000","last_unstale":"2024-09-12T17:08:32.938700+0000","last_undegraded":"2024-09-12T17:08:32.938700+0000","last_fullsized":"2024-09-12T17:08:32.938700+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:17.325226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"84'14","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601797+0000","last_change":"2024-09-12T17:05:47.546051+0000","last_active":"2024-09-12T17:08:33.601797+0000","last_peered":"2024-09-12T17:08:33.601797+0000","last_clean":"2024-09-12T17:08:33.601797+0000","last_became_active":"2024-09-12T17:05:47.545466+0000","last_became_peered":"2024-09-12T17:05:47.545466+0000","last_unstale":"2024-09-12T17:08:33.601797+0000","last_undegraded":"2024-09-12T17:08:33.601797+0000","last_fullsized":"2024-09-12T17:08:33.601797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":40966,"num_write":30,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.943660+0000","last_change":"2024-09-12T17:08:18.457478+0000","last_active":"2024-09-12T17:08:32.943660+0000","last_peered":"2024-09-12T17:08:32.943660+0000","last_clean":"2024-09-12T17:08:32.943660+0000","last_became_active":"2024-09-12T17:08:18.457099+0000","last_became_peered":"2024-09-12T17:08:18.457099+0000","last_unstale":"2024-09-12T17:08:32.943660+0000","last_undegraded":"2024-09-12T17:08:32.943660+0000","last_fullsized":"2024-09-12T17:08:32.943660+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:30.371124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"86'12","reported_seq":171,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589624+0000","last_change":"2024-09-12T17:05:53.561278+0000","last_active":"2024-09-12T17:08:32.589624+0000","last_peered":"2024-09-12T17:08:32.589624+0000","last_clean":"2024-09-12T17:08:32.589624+0000","last_became_active":"2024-09-12T17:05:53.559688+0000","last_became_peered":"2024-09-12T17:05:53.559688+0000","last_unstale":"2024-09-12T17:08:32.589624+0000","last_undegraded":"2024-09-12T17:08:32.589624+0000","last_fullsized":"2024-09-12T17:08:32.589624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:37.392549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":16,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"84'14","reported_seq":202,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941895+0000","last_change":"2024-09-12T17:05:55.576227+0000","last_active":"2024-09-12T17:08:32.941895+0000","last_peered":"2024-09-12T17:08:32.941895+0000","last_clean":"2024-09-12T17:08:32.941895+0000","last_became_active":"2024-09-12T17:05:55.571966+0000","last_became_peered":"2024-09-12T17:05:55.571966+0000","last_unstale":"2024-09-12T17:08:32.941895+0000","last_undegraded":"2024-09-12T17:08:32.941895+0000","last_fullsized":"2024-09-12T17:08:32.941895+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:24.680106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601043+0000","last_change":"2024-09-12T17:05:57.595153+0000","last_active":"2024-09-12T17:08:33.601043+0000","last_peered":"2024-09-12T17:08:33.601043+0000","last_clean":"2024-09-12T17:08:33.601043+0000","last_became_active":"2024-09-12T17:05:57.594396+0000","last_became_peered":"2024-09-12T17:05:57.594396+0000","last_unstale":"2024-09-12T17:08:33.601043+0000","last_undegraded":"2024-09-12T17:08:33.601043+0000","last_fullsized":"2024-09-12T17:08:33.601043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:27.040243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586992+0000","last_change":"2024-09-12T17:05:49.543269+0000","last_active":"2024-09-12T17:08:32.586992+0000","last_peered":"2024-09-12T17:08:32.586992+0000","last_clean":"2024-09-12T17:08:32.586992+0000","last_became_active":"2024-09-12T17:05:49.542414+0000","last_became_peered":"2024-09-12T17:05:49.542414+0000","last_unstale":"2024-09-12T17:08:32.586992+0000","last_undegraded":"2024-09-12T17:08:32.586992+0000","last_fullsized":"2024-09-12T17:08:32.586992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:00.645399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"84'14","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.937439+0000","last_change":"2024-09-12T17:06:27.785226+0000","last_active":"2024-09-12T17:08:32.937439+0000","last_peered":"2024-09-12T17:08:32.937439+0000","last_clean":"2024-09-12T17:08:32.937439+0000","last_became_active":"2024-09-12T17:06:27.784897+0000","last_became_peered":"2024-09-12T17:06:27.784897+0000","last_unstale":"2024-09-12T17:08:32.937439+0000","last_undegraded":"2024-09-12T17:08:32.937439+0000","last_fullsized":"2024-09-12T17:08:32.937439+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:25.368283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":49158,"num_write":30,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604574+0000","last_change":"2024-09-12T17:05:51.528322+0000","last_active":"2024-09-12T17:08:33.604574+0000","last_peered":"2024-09-12T17:08:33.604574+0000","last_clean":"2024-09-12T17:08:33.604574+0000","last_became_active":"2024-09-12T17:05:51.527501+0000","last_became_peered":"2024-09-12T17:05:51.527501+0000","last_unstale":"2024-09-12T17:08:33.604574+0000","last_undegraded":"2024-09-12T17:08:33.604574+0000","last_fullsized":"2024-09-12T17:08:33.604574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"84'20","reported_seq":228,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602423+0000","last_change":"2024-09-12T17:08:18.786022+0000","last_active":"2024-09-12T17:08:33.602423+0000","last_peered":"2024-09-12T17:08:33.602423+0000","last_clean":"2024-09-12T17:08:33.602423+0000","last_became_active":"2024-09-12T17:08:18.474969+0000","last_became_peered":"2024-09-12T17:08:18.474969+0000","last_unstale":"2024-09-12T17:08:33.602423+0000","last_undegraded":"2024-09-12T17:08:33.602423+0000","last_fullsized":"2024-09-12T17:08:33.602423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1889,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.599911+0000","last_change":"2024-09-12T17:05:55.567202+0000","last_active":"2024-09-12T17:08:33.599911+0000","last_peered":"2024-09-12T17:08:33.599911+0000","last_clean":"2024-09-12T17:08:33.599911+0000","last_became_active":"2024-09-12T17:05:55.564710+0000","last_became_peered":"2024-09-12T17:05:55.564710+0000","last_unstale":"2024-09-12T17:08:33.599911+0000","last_undegraded":"2024-09-12T17:08:33.599911+0000","last_fullsized":"2024-09-12T17:08:33.599911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608195+0000","last_change":"2024-09-12T17:05:57.604052+0000","last_active":"2024-09-12T17:08:33.608195+0000","last_peered":"2024-09-12T17:08:33.608195+0000","last_clean":"2024-09-12T17:08:33.608195+0000","last_became_active":"2024-09-12T17:05:57.603285+0000","last_became_peered":"2024-09-12T17:05:57.603285+0000","last_unstale":"2024-09-12T17:08:33.608195+0000","last_undegraded":"2024-09-12T17:08:33.608195+0000","last_fullsized":"2024-09-12T17:08:33.608195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:31.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'6","reported_seq":171,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589693+0000","last_change":"2024-09-12T17:05:49.548224+0000","last_active":"2024-09-12T17:08:32.589693+0000","last_peered":"2024-09-12T17:08:32.589693+0000","last_clean":"2024-09-12T17:08:32.589693+0000","last_became_active":"2024-09-12T17:05:49.541007+0000","last_became_peered":"2024-09-12T17:05:49.541007+0000","last_unstale":"2024-09-12T17:08:32.589693+0000","last_undegraded":"2024-09-12T17:08:32.589693+0000","last_fullsized":"2024-09-12T17:08:32.589693+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:59.768842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"75'4","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606348+0000","last_change":"2024-09-12T17:05:47.543197+0000","last_active":"2024-09-12T17:08:33.606348+0000","last_peered":"2024-09-12T17:08:33.606348+0000","last_clean":"2024-09-12T17:08:33.606348+0000","last_became_active":"2024-09-12T17:05:47.542345+0000","last_became_peered":"2024-09-12T17:05:47.542345+0000","last_unstale":"2024-09-12T17:08:33.606348+0000","last_undegraded":"2024-09-12T17:08:33.606348+0000","last_fullsized":"2024-09-12T17:08:33.606348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.858635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602461+0000","last_change":"2024-09-12T17:05:51.556256+0000","last_active":"2024-09-12T17:08:33.602461+0000","last_peered":"2024-09-12T17:08:33.602461+0000","last_clean":"2024-09-12T17:08:33.602461+0000","last_became_active":"2024-09-12T17:05:51.554248+0000","last_became_peered":"2024-09-12T17:05:51.554248+0000","last_unstale":"2024-09-12T17:08:33.602461+0000","last_undegraded":"2024-09-12T17:08:33.602461+0000","last_fullsized":"2024-09-12T17:08:33.602461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"84'13","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.599922+0000","last_change":"2024-09-12T17:08:18.486637+0000","last_active":"2024-09-12T17:08:33.599922+0000","last_peered":"2024-09-12T17:08:33.599922+0000","last_clean":"2024-09-12T17:08:33.599922+0000","last_became_active":"2024-09-12T17:08:18.450594+0000","last_became_peered":"2024-09-12T17:08:18.450594+0000","last_unstale":"2024-09-12T17:08:33.599922+0000","last_undegraded":"2024-09-12T17:08:33.599922+0000","last_fullsized":"2024-09-12T17:08:33.599922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938545+0000","last_change":"2024-09-12T17:05:55.567605+0000","last_active":"2024-09-12T17:08:32.938545+0000","last_peered":"2024-09-12T17:08:32.938545+0000","last_clean":"2024-09-12T17:08:32.938545+0000","last_became_active":"2024-09-12T17:05:55.566774+0000","last_became_peered":"2024-09-12T17:05:55.566774+0000","last_unstale":"2024-09-12T17:08:32.938545+0000","last_undegraded":"2024-09-12T17:08:32.938545+0000","last_fullsized":"2024-09-12T17:08:32.938545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:25.935376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.591110+0000","last_change":"2024-09-12T17:05:58.121216+0000","last_active":"2024-09-12T17:08:32.591110+0000","last_peered":"2024-09-12T17:08:32.591110+0000","last_clean":"2024-09-12T17:08:32.591110+0000","last_became_active":"2024-09-12T17:05:58.120364+0000","last_became_peered":"2024-09-12T17:05:58.120364+0000","last_unstale":"2024-09-12T17:08:32.591110+0000","last_undegraded":"2024-09-12T17:08:32.591110+0000","last_fullsized":"2024-09-12T17:08:32.591110+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585730+0000","last_change":"2024-09-12T17:05:49.549956+0000","last_active":"2024-09-12T17:08:32.585730+0000","last_peered":"2024-09-12T17:08:32.585730+0000","last_clean":"2024-09-12T17:08:32.585730+0000","last_became_active":"2024-09-12T17:05:49.549481+0000","last_became_peered":"2024-09-12T17:05:49.549481+0000","last_unstale":"2024-09-12T17:08:32.585730+0000","last_undegraded":"2024-09-12T17:08:32.585730+0000","last_fullsized":"2024-09-12T17:08:32.585730+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'11","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.591969+0000","last_change":"2024-09-12T17:05:47.510898+0000","last_active":"2024-09-12T17:08:32.591969+0000","last_peered":"2024-09-12T17:08:32.591969+0000","last_clean":"2024-09-12T17:08:32.591969+0000","last_became_active":"2024-09-12T17:05:47.510462+0000","last_became_peered":"2024-09-12T17:05:47.510462+0000","last_unstale":"2024-09-12T17:08:32.591969+0000","last_undegraded":"2024-09-12T17:08:32.591969+0000","last_fullsized":"2024-09-12T17:08:32.591969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":30726,"num_write":27,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585968+0000","last_change":"2024-09-12T17:05:51.541454+0000","last_active":"2024-09-12T17:08:32.585968+0000","last_peered":"2024-09-12T17:08:32.585968+0000","last_clean":"2024-09-12T17:08:32.585968+0000","last_became_active":"2024-09-12T17:05:51.539938+0000","last_became_peered":"2024-09-12T17:05:51.539938+0000","last_unstale":"2024-09-12T17:08:32.585968+0000","last_undegraded":"2024-09-12T17:08:32.585968+0000","last_fullsized":"2024-09-12T17:08:32.585968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:18.328350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"84'11","reported_seq":170,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588768+0000","last_change":"2024-09-12T17:05:53.555764+0000","last_active":"2024-09-12T17:08:32.588768+0000","last_peered":"2024-09-12T17:08:32.588768+0000","last_clean":"2024-09-12T17:08:32.588768+0000","last_became_active":"2024-09-12T17:05:53.552095+0000","last_became_peered":"2024-09-12T17:05:53.552095+0000","last_unstale":"2024-09-12T17:08:32.588768+0000","last_undegraded":"2024-09-12T17:08:32.588768+0000","last_fullsized":"2024-09-12T17:08:32.588768+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":24,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588375+0000","last_change":"2024-09-12T17:05:55.571520+0000","last_active":"2024-09-12T17:08:32.588375+0000","last_peered":"2024-09-12T17:08:32.588375+0000","last_clean":"2024-09-12T17:08:32.588375+0000","last_became_active":"2024-09-12T17:05:55.570863+0000","last_became_peered":"2024-09-12T17:05:55.570863+0000","last_unstale":"2024-09-12T17:08:32.588375+0000","last_undegraded":"2024-09-12T17:08:32.588375+0000","last_fullsized":"2024-09-12T17:08:32.588375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607147+0000","last_change":"2024-09-12T17:08:21.467058+0000","last_active":"2024-09-12T17:08:33.607147+0000","last_peered":"2024-09-12T17:08:33.607147+0000","last_clean":"2024-09-12T17:08:33.607147+0000","last_became_active":"2024-09-12T17:08:21.466218+0000","last_became_peered":"2024-09-12T17:08:21.466218+0000","last_unstale":"2024-09-12T17:08:33.607147+0000","last_undegraded":"2024-09-12T17:08:33.607147+0000","last_fullsized":"2024-09-12T17:08:33.607147+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.336998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"84'38","reported_seq":203,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.586496+0000","last_change":"2024-09-12T17:05:49.561555+0000","last_active":"2024-09-12T17:08:32.586496+0000","last_peered":"2024-09-12T17:08:32.586496+0000","last_clean":"2024-09-12T17:08:32.586496+0000","last_became_active":"2024-09-12T17:05:49.560875+0000","last_became_peered":"2024-09-12T17:05:49.560875+0000","last_unstale":"2024-09-12T17:08:32.586496+0000","last_undegraded":"2024-09-12T17:08:32.586496+0000","last_fullsized":"2024-09-12T17:08:32.586496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.493944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"83'14","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603340+0000","last_change":"2024-09-12T17:05:47.528128+0000","last_active":"2024-09-12T17:08:33.603340+0000","last_peered":"2024-09-12T17:08:33.603340+0000","last_clean":"2024-09-12T17:08:33.603340+0000","last_became_active":"2024-09-12T17:05:47.527364+0000","last_became_peered":"2024-09-12T17:05:47.527364+0000","last_unstale":"2024-09-12T17:08:33.603340+0000","last_undegraded":"2024-09-12T17:08:33.603340+0000","last_fullsized":"2024-09-12T17:08:33.603340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45062,"num_write":30,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":41,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940075+0000","last_change":"2024-09-12T17:08:19.007426+0000","last_active":"2024-09-12T17:08:32.940075+0000","last_peered":"2024-09-12T17:08:32.940075+0000","last_clean":"2024-09-12T17:08:32.940075+0000","last_became_active":"2024-09-12T17:08:18.463879+0000","last_became_peered":"2024-09-12T17:08:18.463879+0000","last_unstale":"2024-09-12T17:08:32.940075+0000","last_undegraded":"2024-09-12T17:08:32.940075+0000","last_fullsized":"2024-09-12T17:08:32.940075+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:10.396675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"84'16","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588651+0000","last_change":"2024-09-12T17:05:53.548391+0000","last_active":"2024-09-12T17:08:32.588651+0000","last_peered":"2024-09-12T17:08:32.588651+0000","last_clean":"2024-09-12T17:08:32.588651+0000","last_became_active":"2024-09-12T17:05:53.547202+0000","last_became_peered":"2024-09-12T17:05:53.547202+0000","last_unstale":"2024-09-12T17:08:32.588651+0000","last_undegraded":"2024-09-12T17:08:32.588651+0000","last_fullsized":"2024-09-12T17:08:32.588651+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:00.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":33,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601272+0000","last_change":"2024-09-12T17:05:55.566243+0000","last_active":"2024-09-12T17:08:33.601272+0000","last_peered":"2024-09-12T17:08:33.601272+0000","last_clean":"2024-09-12T17:08:33.601272+0000","last_became_active":"2024-09-12T17:05:55.565403+0000","last_became_peered":"2024-09-12T17:05:55.565403+0000","last_unstale":"2024-09-12T17:08:33.601272+0000","last_undegraded":"2024-09-12T17:08:33.601272+0000","last_fullsized":"2024-09-12T17:08:33.601272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":146,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588706+0000","last_change":"2024-09-12T17:05:57.589526+0000","last_active":"2024-09-12T17:08:32.588706+0000","last_peered":"2024-09-12T17:08:32.588706+0000","last_clean":"2024-09-12T17:08:32.588706+0000","last_became_active":"2024-09-12T17:05:57.588626+0000","last_became_peered":"2024-09-12T17:05:57.588626+0000","last_unstale":"2024-09-12T17:08:32.588706+0000","last_undegraded":"2024-09-12T17:08:32.588706+0000","last_fullsized":"2024-09-12T17:08:32.588706+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.472663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.940565+0000","last_change":"2024-09-12T17:08:21.473957+0000","last_active":"2024-09-12T17:08:32.940565+0000","last_peered":"2024-09-12T17:08:32.940565+0000","last_clean":"2024-09-12T17:08:32.940565+0000","last_became_active":"2024-09-12T17:08:21.473677+0000","last_became_peered":"2024-09-12T17:08:21.473677+0000","last_unstale":"2024-09-12T17:08:32.940565+0000","last_undegraded":"2024-09-12T17:08:32.940565+0000","last_fullsized":"2024-09-12T17:08:32.940565+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:04.662160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"84'11","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939105+0000","last_change":"2024-09-12T17:05:47.532523+0000","last_active":"2024-09-12T17:08:32.939105+0000","last_peered":"2024-09-12T17:08:32.939105+0000","last_clean":"2024-09-12T17:08:32.939105+0000","last_became_active":"2024-09-12T17:05:47.531750+0000","last_became_peered":"2024-09-12T17:05:47.531750+0000","last_unstale":"2024-09-12T17:08:32.939105+0000","last_undegraded":"2024-09-12T17:08:32.939105+0000","last_fullsized":"2024-09-12T17:08:32.939105+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:03.075435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36867,"num_write":19,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.944094+0000","last_change":"2024-09-12T17:08:21.463425+0000","last_active":"2024-09-12T17:08:32.944094+0000","last_peered":"2024-09-12T17:08:32.944094+0000","last_clean":"2024-09-12T17:08:32.944094+0000","last_became_active":"2024-09-12T17:08:21.462942+0000","last_became_peered":"2024-09-12T17:08:21.462942+0000","last_unstale":"2024-09-12T17:08:32.944094+0000","last_undegraded":"2024-09-12T17:08:32.944094+0000","last_fullsized":"2024-09-12T17:08:32.944094+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:35.256332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"84'10","reported_seq":186,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936568+0000","last_change":"2024-09-12T17:05:47.526020+0000","last_active":"2024-09-12T17:08:32.936568+0000","last_peered":"2024-09-12T17:08:32.936568+0000","last_clean":"2024-09-12T17:08:32.936568+0000","last_became_active":"2024-09-12T17:05:47.525481+0000","last_became_peered":"2024-09-12T17:05:47.525481+0000","last_unstale":"2024-09-12T17:08:32.936568+0000","last_undegraded":"2024-09-12T17:08:32.936568+0000","last_fullsized":"2024-09-12T17:08:32.936568+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:05.949135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34819,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"84'46","reported_seq":211,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604578+0000","last_change":"2024-09-12T17:05:49.546848+0000","last_active":"2024-09-12T17:08:33.604578+0000","last_peered":"2024-09-12T17:08:33.604578+0000","last_clean":"2024-09-12T17:08:33.604578+0000","last_became_active":"2024-09-12T17:05:49.545382+0000","last_became_peered":"2024-09-12T17:05:49.545382+0000","last_unstale":"2024-09-12T17:08:33.604578+0000","last_undegraded":"2024-09-12T17:08:33.604578+0000","last_fullsized":"2024-09-12T17:08:33.604578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:42.832972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"84'10","reported_seq":97,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.936839+0000","last_change":"2024-09-12T17:07:28.249892+0000","last_active":"2024-09-12T17:08:32.936839+0000","last_peered":"2024-09-12T17:08:32.936839+0000","last_clean":"2024-09-12T17:08:32.936839+0000","last_became_active":"2024-09-12T17:07:28.191632+0000","last_became_peered":"2024-09-12T17:07:28.191632+0000","last_unstale":"2024-09-12T17:08:32.936839+0000","last_undegraded":"2024-09-12T17:08:32.936839+0000","last_fullsized":"2024-09-12T17:08:32.936839+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.324862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":16390,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":32,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941687+0000","last_change":"2024-09-12T17:08:21.460639+0000","last_active":"2024-09-12T17:08:32.941687+0000","last_peered":"2024-09-12T17:08:32.941687+0000","last_clean":"2024-09-12T17:08:32.941687+0000","last_became_active":"2024-09-12T17:08:21.457133+0000","last_became_peered":"2024-09-12T17:08:21.457133+0000","last_unstale":"2024-09-12T17:08:32.941687+0000","last_undegraded":"2024-09-12T17:08:32.941687+0000","last_fullsized":"2024-09-12T17:08:32.941687+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:58.322770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"71'10","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602312+0000","last_change":"2024-09-12T17:05:47.530275+0000","last_active":"2024-09-12T17:08:33.602312+0000","last_peered":"2024-09-12T17:08:33.602312+0000","last_clean":"2024-09-12T17:08:33.602312+0000","last_became_active":"2024-09-12T17:05:47.529857+0000","last_became_peered":"2024-09-12T17:05:47.529857+0000","last_unstale":"2024-09-12T17:08:33.602312+0000","last_undegraded":"2024-09-12T17:08:33.602312+0000","last_fullsized":"2024-09-12T17:08:33.602312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:47.999516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":32768,"num_write":10,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'42","reported_seq":207,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588335+0000","last_change":"2024-09-12T17:05:49.525070+0000","last_active":"2024-09-12T17:08:32.588335+0000","last_peered":"2024-09-12T17:08:32.588335+0000","last_clean":"2024-09-12T17:08:32.588335+0000","last_became_active":"2024-09-12T17:05:49.524567+0000","last_became_peered":"2024-09-12T17:05:49.524567+0000","last_unstale":"2024-09-12T17:08:32.588335+0000","last_undegraded":"2024-09-12T17:08:32.588335+0000","last_fullsized":"2024-09-12T17:08:32.588335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:34.320123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"84'11","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589755+0000","last_change":"2024-09-12T17:05:47.547765+0000","last_active":"2024-09-12T17:08:32.589755+0000","last_peered":"2024-09-12T17:08:32.589755+0000","last_clean":"2024-09-12T17:08:32.589755+0000","last_became_active":"2024-09-12T17:05:47.547393+0000","last_became_peered":"2024-09-12T17:05:47.547393+0000","last_unstale":"2024-09-12T17:08:32.589755+0000","last_undegraded":"2024-09-12T17:08:32.589755+0000","last_fullsized":"2024-09-12T17:08:32.589755+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:46.746261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":30729,"num_write":35,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.591190+0000","last_change":"2024-09-12T17:05:49.561711+0000","last_active":"2024-09-12T17:08:32.591190+0000","last_peered":"2024-09-12T17:08:32.591190+0000","last_clean":"2024-09-12T17:08:32.591190+0000","last_became_active":"2024-09-12T17:05:49.560993+0000","last_became_peered":"2024-09-12T17:05:49.560993+0000","last_unstale":"2024-09-12T17:08:32.591190+0000","last_undegraded":"2024-09-12T17:08:32.591190+0000","last_fullsized":"2024-09-12T17:08:32.591190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:38.400338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"72'9","reported_seq":50,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941420+0000","last_change":"2024-09-12T17:08:21.614989+0000","last_active":"2024-09-12T17:08:32.941420+0000","last_peered":"2024-09-12T17:08:32.941420+0000","last_clean":"2024-09-12T17:08:32.941420+0000","last_became_active":"2024-09-12T17:08:21.461010+0000","last_became_peered":"2024-09-12T17:08:21.461010+0000","last_unstale":"2024-09-12T17:08:32.941420+0000","last_undegraded":"2024-09-12T17:08:32.941420+0000","last_fullsized":"2024-09-12T17:08:32.941420+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:52.706435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":11,"num_read_kb":24579,"num_write":17,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"68'2","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585397+0000","last_change":"2024-09-12T17:08:28.561852+0000","last_active":"2024-09-12T17:08:32.585397+0000","last_peered":"2024-09-12T17:08:32.585397+0000","last_clean":"2024-09-12T17:08:32.585397+0000","last_became_active":"2024-09-12T17:08:28.558588+0000","last_became_peered":"2024-09-12T17:08:28.558588+0000","last_unstale":"2024-09-12T17:08:32.585397+0000","last_undegraded":"2024-09-12T17:08:32.585397+0000","last_fullsized":"2024-09-12T17:08:32.585397+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:45.704667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'8","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.942622+0000","last_change":"2024-09-12T17:05:47.541213+0000","last_active":"2024-09-12T17:08:32.942622+0000","last_peered":"2024-09-12T17:08:32.942622+0000","last_clean":"2024-09-12T17:08:32.942622+0000","last_became_active":"2024-09-12T17:05:47.540469+0000","last_became_peered":"2024-09-12T17:05:47.540469+0000","last_unstale":"2024-09-12T17:08:32.942622+0000","last_undegraded":"2024-09-12T17:08:32.942622+0000","last_fullsized":"2024-09-12T17:08:32.942622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:26.620021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":30720,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"84'42","reported_seq":207,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.938835+0000","last_change":"2024-09-12T17:05:49.541113+0000","last_active":"2024-09-12T17:08:32.938835+0000","last_peered":"2024-09-12T17:08:32.938835+0000","last_clean":"2024-09-12T17:08:32.938835+0000","last_became_active":"2024-09-12T17:05:49.540395+0000","last_became_peered":"2024-09-12T17:05:49.540395+0000","last_unstale":"2024-09-12T17:08:32.938835+0000","last_undegraded":"2024-09-12T17:08:32.938835+0000","last_fullsized":"2024-09-12T17:08:32.938835+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:32.506502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"84'18","reported_seq":202,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.592287+0000","last_change":"2024-09-12T17:05:47.539986+0000","last_active":"2024-09-12T17:08:32.592287+0000","last_peered":"2024-09-12T17:08:32.592287+0000","last_clean":"2024-09-12T17:08:32.592287+0000","last_became_active":"2024-09-12T17:05:47.539603+0000","last_became_peered":"2024-09-12T17:05:47.539603+0000","last_unstale":"2024-09-12T17:08:32.592287+0000","last_undegraded":"2024-09-12T17:08:32.592287+0000","last_fullsized":"2024-09-12T17:08:32.592287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":26,"num_read_kb":57350,"num_write":34,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603269+0000","last_change":"2024-09-12T17:05:49.533938+0000","last_active":"2024-09-12T17:08:33.603269+0000","last_peered":"2024-09-12T17:08:33.603269+0000","last_clean":"2024-09-12T17:08:33.603269+0000","last_became_active":"2024-09-12T17:05:49.531769+0000","last_became_peered":"2024-09-12T17:05:49.531769+0000","last_unstale":"2024-09-12T17:08:33.603269+0000","last_undegraded":"2024-09-12T17:08:33.603269+0000","last_fullsized":"2024-09-12T17:08:33.603269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:33.763423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"84'11","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603444+0000","last_change":"2024-09-12T17:05:47.525739+0000","last_active":"2024-09-12T17:08:33.603444+0000","last_peered":"2024-09-12T17:08:33.603444+0000","last_clean":"2024-09-12T17:08:33.603444+0000","last_became_active":"2024-09-12T17:05:47.524922+0000","last_became_peered":"2024-09-12T17:05:47.524922+0000","last_unstale":"2024-09-12T17:08:33.603444+0000","last_undegraded":"2024-09-12T17:08:33.603444+0000","last_fullsized":"2024-09-12T17:08:33.603444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38915,"num_write":19,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.589917+0000","last_change":"2024-09-12T17:05:49.555307+0000","last_active":"2024-09-12T17:08:32.589917+0000","last_peered":"2024-09-12T17:08:32.589917+0000","last_clean":"2024-09-12T17:08:32.589917+0000","last_became_active":"2024-09-12T17:05:49.554566+0000","last_became_peered":"2024-09-12T17:05:49.554566+0000","last_unstale":"2024-09-12T17:08:32.589917+0000","last_undegraded":"2024-09-12T17:08:32.589917+0000","last_fullsized":"2024-09-12T17:08:32.589917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:45.017623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"84'12","reported_seq":190,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.585897+0000","last_change":"2024-09-12T17:05:47.543468+0000","last_active":"2024-09-12T17:08:32.585897+0000","last_peered":"2024-09-12T17:08:32.585897+0000","last_clean":"2024-09-12T17:08:32.585897+0000","last_became_active":"2024-09-12T17:05:47.542753+0000","last_became_peered":"2024-09-12T17:05:47.542753+0000","last_unstale":"2024-09-12T17:08:32.585897+0000","last_undegraded":"2024-09-12T17:08:32.585897+0000","last_fullsized":"2024-09-12T17:08:32.585897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":34825,"num_write":36,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'34","reported_seq":199,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.937821+0000","last_change":"2024-09-12T17:05:49.536693+0000","last_active":"2024-09-12T17:08:32.937821+0000","last_peered":"2024-09-12T17:08:32.937821+0000","last_clean":"2024-09-12T17:08:32.937821+0000","last_became_active":"2024-09-12T17:05:49.536385+0000","last_became_peered":"2024-09-12T17:05:49.536385+0000","last_unstale":"2024-09-12T17:08:32.937821+0000","last_undegraded":"2024-09-12T17:08:32.937821+0000","last_fullsized":"2024-09-12T17:08:32.937821+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.024498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"84'6","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603760+0000","last_change":"2024-09-12T17:05:47.545251+0000","last_active":"2024-09-12T17:08:33.603760+0000","last_peered":"2024-09-12T17:08:33.603760+0000","last_clean":"2024-09-12T17:08:33.603760+0000","last_became_active":"2024-09-12T17:05:47.544406+0000","last_became_peered":"2024-09-12T17:05:47.544406+0000","last_unstale":"2024-09-12T17:08:33.603760+0000","last_undegraded":"2024-09-12T17:08:33.603760+0000","last_fullsized":"2024-09-12T17:08:33.603760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:52.167194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20483,"num_write":14,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"84'38","reported_seq":203,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.588300+0000","last_change":"2024-09-12T17:05:49.564446+0000","last_active":"2024-09-12T17:08:32.588300+0000","last_peered":"2024-09-12T17:08:32.588300+0000","last_clean":"2024-09-12T17:08:32.588300+0000","last_became_active":"2024-09-12T17:05:49.563625+0000","last_became_peered":"2024-09-12T17:05:49.563625+0000","last_unstale":"2024-09-12T17:08:32.588300+0000","last_undegraded":"2024-09-12T17:08:32.588300+0000","last_fullsized":"2024-09-12T17:08:32.588300+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.324265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"72'10","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603144+0000","last_change":"2024-09-12T17:05:47.558422+0000","last_active":"2024-09-12T17:08:33.603144+0000","last_peered":"2024-09-12T17:08:33.603144+0000","last_clean":"2024-09-12T17:08:33.603144+0000","last_became_active":"2024-09-12T17:05:47.558047+0000","last_became_peered":"2024-09-12T17:05:47.558047+0000","last_unstale":"2024-09-12T17:08:33.603144+0000","last_undegraded":"2024-09-12T17:08:33.603144+0000","last_fullsized":"2024-09-12T17:08:33.603144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:25.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":38912,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604202+0000","last_change":"2024-09-12T17:05:49.522750+0000","last_active":"2024-09-12T17:08:33.604202+0000","last_peered":"2024-09-12T17:08:33.604202+0000","last_clean":"2024-09-12T17:08:33.604202+0000","last_became_active":"2024-09-12T17:05:49.522097+0000","last_became_peered":"2024-09-12T17:05:49.522097+0000","last_unstale":"2024-09-12T17:08:33.604202+0000","last_undegraded":"2024-09-12T17:08:33.604202+0000","last_fullsized":"2024-09-12T17:08:33.604202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"84'14","reported_seq":194,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.941344+0000","last_change":"2024-09-12T17:05:47.552865+0000","last_active":"2024-09-12T17:08:32.941344+0000","last_peered":"2024-09-12T17:08:32.941344+0000","last_clean":"2024-09-12T17:08:32.941344+0000","last_became_active":"2024-09-12T17:05:47.552207+0000","last_became_peered":"2024-09-12T17:05:47.552207+0000","last_unstale":"2024-09-12T17:08:32.941344+0000","last_undegraded":"2024-09-12T17:08:32.941344+0000","last_fullsized":"2024-09-12T17:08:32.941344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:00.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40969,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601066+0000","last_change":"2024-09-12T17:08:18.465159+0000","last_active":"2024-09-12T17:08:33.601066+0000","last_peered":"2024-09-12T17:08:33.601066+0000","last_clean":"2024-09-12T17:08:33.601066+0000","last_became_active":"2024-09-12T17:08:18.464823+0000","last_became_peered":"2024-09-12T17:08:18.464823+0000","last_unstale":"2024-09-12T17:08:33.601066+0000","last_undegraded":"2024-09-12T17:08:33.601066+0000","last_fullsized":"2024-09-12T17:08:33.601066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:08.427170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"74'14","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608526+0000","last_change":"2024-09-12T17:05:47.561338+0000","last_active":"2024-09-12T17:08:33.608526+0000","last_peered":"2024-09-12T17:08:33.608526+0000","last_clean":"2024-09-12T17:08:33.608526+0000","last_became_active":"2024-09-12T17:05:47.560439+0000","last_became_peered":"2024-09-12T17:05:47.560439+0000","last_unstale":"2024-09-12T17:08:33.608526+0000","last_undegraded":"2024-09-12T17:08:33.608526+0000","last_fullsized":"2024-09-12T17:08:33.608526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:58.530869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":18,"num_read_kb":51203,"num_write":22,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":123,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601554+0000","last_change":"2024-09-12T17:06:27.819106+0000","last_active":"2024-09-12T17:08:33.601554+0000","last_peered":"2024-09-12T17:08:33.601554+0000","last_clean":"2024-09-12T17:08:33.601554+0000","last_became_active":"2024-09-12T17:06:27.818761+0000","last_became_peered":"2024-09-12T17:06:27.818761+0000","last_unstale":"2024-09-12T17:08:33.601554+0000","last_undegraded":"2024-09-12T17:08:33.601554+0000","last_fullsized":"2024-09-12T17:08:33.601554+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:29.107938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"83'9","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939360+0000","last_change":"2024-09-12T17:05:47.512066+0000","last_active":"2024-09-12T17:08:32.939360+0000","last_peered":"2024-09-12T17:08:32.939360+0000","last_clean":"2024-09-12T17:08:32.939360+0000","last_became_active":"2024-09-12T17:05:47.511470+0000","last_became_peered":"2024-09-12T17:05:47.511470+0000","last_unstale":"2024-09-12T17:08:32.939360+0000","last_undegraded":"2024-09-12T17:08:32.939360+0000","last_fullsized":"2024-09-12T17:08:32.939360+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:38.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30723,"num_write":17,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601648+0000","last_change":"2024-09-12T17:05:49.523060+0000","last_active":"2024-09-12T17:08:33.601648+0000","last_peered":"2024-09-12T17:08:33.601648+0000","last_clean":"2024-09-12T17:08:33.601648+0000","last_became_active":"2024-09-12T17:05:49.522157+0000","last_became_peered":"2024-09-12T17:05:49.522157+0000","last_unstale":"2024-09-12T17:08:33.601648+0000","last_undegraded":"2024-09-12T17:08:33.601648+0000","last_fullsized":"2024-09-12T17:08:33.601648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"71'5","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606405+0000","last_change":"2024-09-12T17:05:47.538305+0000","last_active":"2024-09-12T17:08:33.606405+0000","last_peered":"2024-09-12T17:08:33.606405+0000","last_clean":"2024-09-12T17:08:33.606405+0000","last_became_active":"2024-09-12T17:05:47.535569+0000","last_became_peered":"2024-09-12T17:05:47.535569+0000","last_unstale":"2024-09-12T17:08:33.606405+0000","last_undegraded":"2024-09-12T17:08:33.606405+0000","last_fullsized":"2024-09-12T17:08:33.606405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:24.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":18432,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'5","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603169+0000","last_change":"2024-09-12T17:05:47.537712+0000","last_active":"2024-09-12T17:08:33.603169+0000","last_peered":"2024-09-12T17:08:33.603169+0000","last_clean":"2024-09-12T17:08:33.603169+0000","last_became_active":"2024-09-12T17:05:47.536958+0000","last_became_peered":"2024-09-12T17:05:47.536958+0000","last_unstale":"2024-09-12T17:08:33.603169+0000","last_undegraded":"2024-09-12T17:08:33.603169+0000","last_fullsized":"2024-09-12T17:08:33.603169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603188+0000","last_change":"2024-09-12T17:05:49.544841+0000","last_active":"2024-09-12T17:08:33.603188+0000","last_peered":"2024-09-12T17:08:33.603188+0000","last_clean":"2024-09-12T17:08:33.603188+0000","last_became_active":"2024-09-12T17:05:49.538757+0000","last_became_peered":"2024-09-12T17:05:49.538757+0000","last_unstale":"2024-09-12T17:08:33.603188+0000","last_undegraded":"2024-09-12T17:08:33.603188+0000","last_fullsized":"2024-09-12T17:08:33.603188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.976348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'9","reported_seq":53,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-09-12T17:08:32.939720+0000","last_change":"2024-09-12T17:08:18.573927+0000","last_active":"2024-09-12T17:08:32.939720+0000","last_peered":"2024-09-12T17:08:32.939720+0000","last_clean":"2024-09-12T17:08:32.939720+0000","last_became_active":"2024-09-12T17:08:18.441161+0000","last_became_peered":"2024-09-12T17:08:18.441161+0000","last_unstale":"2024-09-12T17:08:32.939720+0000","last_undegraded":"2024-09-12T17:08:32.939720+0000","last_fullsized":"2024-09-12T17:08:32.939720+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:21.365549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24582,"num_write":25,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605089+0000","last_change":"2024-09-12T17:05:49.552327+0000","last_active":"2024-09-12T17:08:33.605089+0000","last_peered":"2024-09-12T17:08:33.605089+0000","last_clean":"2024-09-12T17:08:33.605089+0000","last_became_active":"2024-09-12T17:05:49.551604+0000","last_became_peered":"2024-09-12T17:05:49.551604+0000","last_unstale":"2024-09-12T17:08:33.605089+0000","last_undegraded":"2024-09-12T17:08:33.605089+0000","last_fullsized":"2024-09-12T17:08:33.605089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:55.648527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":40,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":238929,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":924,"num_read_kb":920,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":41697,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":647168,"data_stored":230726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":576,"ondisk_log_size":576,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1867,"num_read_kb":1448,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1093,"num_read_kb":2031945,"num_write":1540,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":241172480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542184,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":481656,"kb_used_data":446308,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93890184,"statfs":{"total":96636764160,"available":96143548416,"internally_reserved":0,"allocated":457019392,"data_stored":456418609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542185,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397048,"kb_used_data":361700,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93974792,"statfs":{"total":96636764160,"available":96230187008,"internally_reserved":0,"allocated":370380800,"data_stored":369824685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472936,"kb_used_data":437588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93898904,"statfs":{"total":96636764160,"available":96152477696,"internally_reserved":0,"allocated":448090112,"data_stored":447463741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542185,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505556,"kb_used_data":470200,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93866284,"statfs":{"total":96636764160,"available":96119074816,"internally_reserved":0,"allocated":481484800,"data_stored":480955369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":515856,"kb_used_data":480500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93855984,"statfs":{"total":96636764160,"available":96108527616,"internally_reserved":0,"allocated":492032000,"data_stored":491448544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347860,"kb_used_data":312508,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94023980,"statfs":{"total":96636764160,"available":96280555520,"internally_reserved":0,"allocated":320008192,"data_stored":319468451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542184,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259868,"kb_used_data":224520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94111972,"statfs":{"total":96636764160,"available":96370659328,"internally_reserved":0,"allocated":229908480,"data_stored":229326393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":508220,"kb_used_data":472868,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93863620,"statfs":{"total":96636764160,"available":96116346880,"internally_reserved":0,"allocated":484216832,"data_stored":483650572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":228589568,"data_stored":228589568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":318767104,"data_stored":318767104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":490733568,"data_stored":490733568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":480247808,"data_stored":480247808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":446693376,"data_stored":446693376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":369098752,"data_stored":369098752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":455081984,"data_stored":455081984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":18170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":40679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":18459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":11388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":65710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":29852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":42241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:08:37.598 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T17:08:37.598 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T17:08:37.957 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T17:08:37.966 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T17:08:37.966 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:08:37.967 INFO:tasks.rgw.client.0.smithi017.stdout:2024-09-12T17:08:37.963+0000 7f603786e640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 31216) UID: 0 2024-09-12T17:08:37.967 INFO:tasks.rgw.client.0.smithi017.stdout:2024-09-12T17:08:37.963+0000 7f603b0b6a40 -1 shutting down 2024-09-12T17:09:02.374 INFO:tasks.rgw.client.0:Stopped 2024-09-12T17:09:02.374 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T17:09:02.381 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T17:09:02.437 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T17:09:02.492 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T17:09:02.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T17:09:02.492 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T17:09:03.471 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T17:09:03.481 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T17:09:03.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:09:03.835 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:09:03.841 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:09:03.857 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2024-09-12T17:09:01.990470+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636609489,"num_objects":638,"num_object_clones":0,"num_object_copies":1276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":638,"num_whiteouts":0,"num_read":4036,"num_read_kb":2034452,"num_write":3052,"num_write_kb":2050296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":241214307,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1955,"ondisk_log_size":1955,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3489024,"kb_used_data":3206264,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":751485696,"statfs":{"total":773094113280,"available":769521352704,"internally_reserved":0,"allocated":3283214336,"data_stored":3278603974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006608"},"pg_stats":[{"pgid":"3.3f","version":"84'19","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607887+0000","last_change":"2024-09-12T17:05:47.561581+0000","last_active":"2024-09-12T17:08:33.607887+0000","last_peered":"2024-09-12T17:08:33.607887+0000","last_clean":"2024-09-12T17:08:33.607887+0000","last_became_active":"2024-09-12T17:05:47.560791+0000","last_became_peered":"2024-09-12T17:05:47.560791+0000","last_unstale":"2024-09-12T17:08:33.607887+0000","last_undegraded":"2024-09-12T17:08:33.607887+0000","last_fullsized":"2024-09-12T17:08:33.607887+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:23.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":35,"num_read_kb":57356,"num_write":51,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"84'44","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602148+0000","last_change":"2024-09-12T17:05:49.558060+0000","last_active":"2024-09-12T17:08:33.602148+0000","last_peered":"2024-09-12T17:08:33.602148+0000","last_clean":"2024-09-12T17:08:33.602148+0000","last_became_active":"2024-09-12T17:05:49.557287+0000","last_became_peered":"2024-09-12T17:05:49.557287+0000","last_unstale":"2024-09-12T17:08:33.602148+0000","last_undegraded":"2024-09-12T17:08:33.602148+0000","last_fullsized":"2024-09-12T17:08:33.602148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":132,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"71'3","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115541+0000","last_change":"2024-09-12T17:08:21.529824+0000","last_active":"2024-09-12T17:08:35.115541+0000","last_peered":"2024-09-12T17:08:35.115541+0000","last_clean":"2024-09-12T17:08:35.115541+0000","last_became_active":"2024-09-12T17:08:21.462766+0000","last_became_peered":"2024-09-12T17:08:21.462766+0000","last_unstale":"2024-09-12T17:08:35.115541+0000","last_undegraded":"2024-09-12T17:08:35.115541+0000","last_fullsized":"2024-09-12T17:08:35.115541+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:47.442324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605094+0000","last_change":"2024-09-12T17:08:18.454422+0000","last_active":"2024-09-12T17:08:33.605094+0000","last_peered":"2024-09-12T17:08:33.605094+0000","last_clean":"2024-09-12T17:08:33.605094+0000","last_became_active":"2024-09-12T17:08:18.442986+0000","last_became_peered":"2024-09-12T17:08:18.442986+0000","last_unstale":"2024-09-12T17:08:33.605094+0000","last_undegraded":"2024-09-12T17:08:33.605094+0000","last_fullsized":"2024-09-12T17:08:33.605094+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:26.720649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"84'15","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603748+0000","last_change":"2024-09-12T17:05:47.523052+0000","last_active":"2024-09-12T17:08:33.603748+0000","last_peered":"2024-09-12T17:08:33.603748+0000","last_clean":"2024-09-12T17:08:33.603748+0000","last_became_active":"2024-09-12T17:05:47.522544+0000","last_became_peered":"2024-09-12T17:05:47.522544+0000","last_unstale":"2024-09-12T17:08:33.603748+0000","last_undegraded":"2024-09-12T17:08:33.603748+0000","last_fullsized":"2024-09-12T17:08:33.603748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":38921,"num_write":39,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"84'34","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211197+0000","last_change":"2024-09-12T17:05:49.549990+0000","last_active":"2024-09-12T17:08:35.211197+0000","last_peered":"2024-09-12T17:08:35.211197+0000","last_clean":"2024-09-12T17:08:35.211197+0000","last_became_active":"2024-09-12T17:05:49.549241+0000","last_became_peered":"2024-09-12T17:05:49.549241+0000","last_unstale":"2024-09-12T17:08:35.211197+0000","last_undegraded":"2024-09-12T17:08:35.211197+0000","last_fullsized":"2024-09-12T17:08:35.211197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.601256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"84'12","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024742+0000","last_change":"2024-09-12T17:06:27.748679+0000","last_active":"2024-09-12T17:08:36.024742+0000","last_peered":"2024-09-12T17:08:36.024742+0000","last_clean":"2024-09-12T17:08:36.024742+0000","last_became_active":"2024-09-12T17:06:27.748390+0000","last_became_peered":"2024-09-12T17:06:27.748390+0000","last_unstale":"2024-09-12T17:08:36.024742+0000","last_undegraded":"2024-09-12T17:08:36.024742+0000","last_fullsized":"2024-09-12T17:08:36.024742+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:58.547350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":30732,"num_write":44,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602063+0000","last_change":"2024-09-12T17:05:49.542142+0000","last_active":"2024-09-12T17:08:33.602063+0000","last_peered":"2024-09-12T17:08:33.602063+0000","last_clean":"2024-09-12T17:08:33.602063+0000","last_became_active":"2024-09-12T17:05:49.541354+0000","last_became_peered":"2024-09-12T17:05:49.541354+0000","last_unstale":"2024-09-12T17:08:33.602063+0000","last_undegraded":"2024-09-12T17:08:33.602063+0000","last_fullsized":"2024-09-12T17:08:33.602063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.147865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"84'8","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606019+0000","last_change":"2024-09-12T17:05:47.556154+0000","last_active":"2024-09-12T17:08:33.606019+0000","last_peered":"2024-09-12T17:08:33.606019+0000","last_clean":"2024-09-12T17:08:33.606019+0000","last_became_active":"2024-09-12T17:05:47.555396+0000","last_became_peered":"2024-09-12T17:05:47.555396+0000","last_unstale":"2024-09-12T17:08:33.606019+0000","last_undegraded":"2024-09-12T17:08:33.606019+0000","last_fullsized":"2024-09-12T17:08:33.606019+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:27.784208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353568+0000","last_change":"2024-09-12T17:05:49.529344+0000","last_active":"2024-09-12T17:08:35.353568+0000","last_peered":"2024-09-12T17:08:35.353568+0000","last_clean":"2024-09-12T17:08:35.353568+0000","last_became_active":"2024-09-12T17:05:49.528184+0000","last_became_peered":"2024-09-12T17:05:49.528184+0000","last_unstale":"2024-09-12T17:08:35.353568+0000","last_undegraded":"2024-09-12T17:08:35.353568+0000","last_fullsized":"2024-09-12T17:08:35.353568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:18.357328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"84'11","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603007+0000","last_change":"2024-09-12T17:05:47.532931+0000","last_active":"2024-09-12T17:08:33.603007+0000","last_peered":"2024-09-12T17:08:33.603007+0000","last_clean":"2024-09-12T17:08:33.603007+0000","last_became_active":"2024-09-12T17:05:47.531427+0000","last_became_peered":"2024-09-12T17:05:47.531427+0000","last_unstale":"2024-09-12T17:08:33.603007+0000","last_undegraded":"2024-09-12T17:08:33.603007+0000","last_fullsized":"2024-09-12T17:08:33.603007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212195+0000","last_change":"2024-09-12T17:05:49.550694+0000","last_active":"2024-09-12T17:08:35.212195+0000","last_peered":"2024-09-12T17:08:35.212195+0000","last_clean":"2024-09-12T17:08:35.212195+0000","last_became_active":"2024-09-12T17:05:49.549066+0000","last_became_peered":"2024-09-12T17:05:49.549066+0000","last_unstale":"2024-09-12T17:08:35.212195+0000","last_undegraded":"2024-09-12T17:08:35.212195+0000","last_fullsized":"2024-09-12T17:08:35.212195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:24.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"84'7","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605517+0000","last_change":"2024-09-12T17:05:47.560085+0000","last_active":"2024-09-12T17:08:33.605517+0000","last_peered":"2024-09-12T17:08:33.605517+0000","last_clean":"2024-09-12T17:08:33.605517+0000","last_became_active":"2024-09-12T17:05:47.559160+0000","last_became_peered":"2024-09-12T17:05:47.559160+0000","last_unstale":"2024-09-12T17:08:33.605517+0000","last_undegraded":"2024-09-12T17:08:33.605517+0000","last_fullsized":"2024-09-12T17:08:33.605517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:06.664677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'2","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604685+0000","last_change":"2024-09-12T17:08:18.490456+0000","last_active":"2024-09-12T17:08:33.604685+0000","last_peered":"2024-09-12T17:08:33.604685+0000","last_clean":"2024-09-12T17:08:33.604685+0000","last_became_active":"2024-09-12T17:08:18.471124+0000","last_became_peered":"2024-09-12T17:08:18.471124+0000","last_unstale":"2024-09-12T17:08:33.604685+0000","last_undegraded":"2024-09-12T17:08:33.604685+0000","last_fullsized":"2024-09-12T17:08:33.604685+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.772819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"84'10","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019526+0000","last_change":"2024-09-12T17:06:27.748750+0000","last_active":"2024-09-12T17:08:36.019526+0000","last_peered":"2024-09-12T17:08:36.019526+0000","last_clean":"2024-09-12T17:08:36.019526+0000","last_became_active":"2024-09-12T17:06:27.748329+0000","last_became_peered":"2024-09-12T17:06:27.748329+0000","last_unstale":"2024-09-12T17:08:36.019526+0000","last_undegraded":"2024-09-12T17:08:36.019526+0000","last_fullsized":"2024-09-12T17:08:36.019526+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:26.773943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26633,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024893+0000","last_change":"2024-09-12T17:07:28.190678+0000","last_active":"2024-09-12T17:08:36.024893+0000","last_peered":"2024-09-12T17:08:36.024893+0000","last_clean":"2024-09-12T17:08:36.024893+0000","last_became_active":"2024-09-12T17:07:28.190245+0000","last_became_peered":"2024-09-12T17:07:28.190245+0000","last_unstale":"2024-09-12T17:08:36.024893+0000","last_undegraded":"2024-09-12T17:08:36.024893+0000","last_fullsized":"2024-09-12T17:08:36.024893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:04.220150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210683+0000","last_change":"2024-09-12T17:05:49.549575+0000","last_active":"2024-09-12T17:08:35.210683+0000","last_peered":"2024-09-12T17:08:35.210683+0000","last_clean":"2024-09-12T17:08:35.210683+0000","last_became_active":"2024-09-12T17:05:49.548292+0000","last_became_peered":"2024-09-12T17:05:49.548292+0000","last_unstale":"2024-09-12T17:08:35.210683+0000","last_undegraded":"2024-09-12T17:08:35.210683+0000","last_fullsized":"2024-09-12T17:08:35.210683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"84'6","reported_seq":32,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114349+0000","last_change":"2024-09-12T17:08:28.649055+0000","last_active":"2024-09-12T17:08:35.114349+0000","last_peered":"2024-09-12T17:08:35.114349+0000","last_clean":"2024-09-12T17:08:35.114349+0000","last_became_active":"2024-09-12T17:08:28.568157+0000","last_became_peered":"2024-09-12T17:08:28.568157+0000","last_unstale":"2024-09-12T17:08:35.114349+0000","last_undegraded":"2024-09-12T17:08:35.114349+0000","last_fullsized":"2024-09-12T17:08:35.114349+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:11.023137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":8,"num_read_kb":18434,"num_write":14,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605305+0000","last_change":"2024-09-12T17:08:18.455416+0000","last_active":"2024-09-12T17:08:33.605305+0000","last_peered":"2024-09-12T17:08:33.605305+0000","last_clean":"2024-09-12T17:08:33.605305+0000","last_became_active":"2024-09-12T17:08:18.454062+0000","last_became_peered":"2024-09-12T17:08:18.454062+0000","last_unstale":"2024-09-12T17:08:33.605305+0000","last_undegraded":"2024-09-12T17:08:33.605305+0000","last_fullsized":"2024-09-12T17:08:33.605305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:38.260106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"84'13","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354373+0000","last_change":"2024-09-12T17:05:47.528338+0000","last_active":"2024-09-12T17:08:35.354373+0000","last_peered":"2024-09-12T17:08:35.354373+0000","last_clean":"2024-09-12T17:08:35.354373+0000","last_became_active":"2024-09-12T17:05:47.527533+0000","last_became_peered":"2024-09-12T17:05:47.527533+0000","last_unstale":"2024-09-12T17:08:35.354373+0000","last_undegraded":"2024-09-12T17:08:35.354373+0000","last_fullsized":"2024-09-12T17:08:35.354373+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.693731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":34828,"num_write":45,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"84'30","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603444+0000","last_change":"2024-09-12T17:05:49.543097+0000","last_active":"2024-09-12T17:08:33.603444+0000","last_peered":"2024-09-12T17:08:33.603444+0000","last_clean":"2024-09-12T17:08:33.603444+0000","last_became_active":"2024-09-12T17:05:49.542113+0000","last_became_peered":"2024-09-12T17:05:49.542113+0000","last_unstale":"2024-09-12T17:08:33.603444+0000","last_undegraded":"2024-09-12T17:08:33.603444+0000","last_fullsized":"2024-09-12T17:08:33.603444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":90,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"83'13","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354495+0000","last_change":"2024-09-12T17:05:47.529868+0000","last_active":"2024-09-12T17:08:35.354495+0000","last_peered":"2024-09-12T17:08:35.354495+0000","last_clean":"2024-09-12T17:08:35.354495+0000","last_became_active":"2024-09-12T17:05:47.529083+0000","last_became_peered":"2024-09-12T17:05:47.529083+0000","last_unstale":"2024-09-12T17:08:35.354495+0000","last_undegraded":"2024-09-12T17:08:35.354495+0000","last_fullsized":"2024-09-12T17:08:35.354495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:16.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":40969,"num_write":37,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023501+0000","last_change":"2024-09-12T17:05:49.548084+0000","last_active":"2024-09-12T17:08:36.023501+0000","last_peered":"2024-09-12T17:08:36.023501+0000","last_clean":"2024-09-12T17:08:36.023501+0000","last_became_active":"2024-09-12T17:05:49.539930+0000","last_became_peered":"2024-09-12T17:05:49.539930+0000","last_unstale":"2024-09-12T17:08:36.023501+0000","last_undegraded":"2024-09-12T17:08:36.023501+0000","last_fullsized":"2024-09-12T17:08:36.023501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:11.453390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"83'7","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211207+0000","last_change":"2024-09-12T17:05:47.548316+0000","last_active":"2024-09-12T17:08:35.211207+0000","last_peered":"2024-09-12T17:08:35.211207+0000","last_clean":"2024-09-12T17:08:35.211207+0000","last_became_active":"2024-09-12T17:05:47.547430+0000","last_became_peered":"2024-09-12T17:05:47.547430+0000","last_unstale":"2024-09-12T17:08:35.211207+0000","last_undegraded":"2024-09-12T17:08:35.211207+0000","last_fullsized":"2024-09-12T17:08:35.211207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:21.143073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024500+0000","last_change":"2024-09-12T17:05:49.556144+0000","last_active":"2024-09-12T17:08:36.024500+0000","last_peered":"2024-09-12T17:08:36.024500+0000","last_clean":"2024-09-12T17:08:36.024500+0000","last_became_active":"2024-09-12T17:05:49.555033+0000","last_became_peered":"2024-09-12T17:05:49.555033+0000","last_unstale":"2024-09-12T17:08:36.024500+0000","last_undegraded":"2024-09-12T17:08:36.024500+0000","last_fullsized":"2024-09-12T17:08:36.024500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:08.056726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"75'10","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020348+0000","last_change":"2024-09-12T17:05:47.511375+0000","last_active":"2024-09-12T17:08:36.020348+0000","last_peered":"2024-09-12T17:08:36.020348+0000","last_clean":"2024-09-12T17:08:36.020348+0000","last_became_active":"2024-09-12T17:05:47.510364+0000","last_became_peered":"2024-09-12T17:05:47.510364+0000","last_unstale":"2024-09-12T17:08:36.020348+0000","last_undegraded":"2024-09-12T17:08:36.020348+0000","last_fullsized":"2024-09-12T17:08:36.020348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":38912,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212219+0000","last_change":"2024-09-12T17:08:18.448181+0000","last_active":"2024-09-12T17:08:35.212219+0000","last_peered":"2024-09-12T17:08:35.212219+0000","last_clean":"2024-09-12T17:08:35.212219+0000","last_became_active":"2024-09-12T17:08:18.447353+0000","last_became_peered":"2024-09-12T17:08:18.447353+0000","last_unstale":"2024-09-12T17:08:35.212219+0000","last_undegraded":"2024-09-12T17:08:35.212219+0000","last_fullsized":"2024-09-12T17:08:35.212219+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:07.836287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"83'5","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601601+0000","last_change":"2024-09-12T17:08:18.831302+0000","last_active":"2024-09-12T17:08:33.601601+0000","last_peered":"2024-09-12T17:08:33.601601+0000","last_clean":"2024-09-12T17:08:33.601601+0000","last_became_active":"2024-09-12T17:08:18.467826+0000","last_became_peered":"2024-09-12T17:08:18.467826+0000","last_unstale":"2024-09-12T17:08:33.601601+0000","last_undegraded":"2024-09-12T17:08:33.601601+0000","last_fullsized":"2024-09-12T17:08:33.601601+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:24.964574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14339,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10485760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"84'2","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210149+0000","last_change":"2024-09-12T17:05:57.588515+0000","last_active":"2024-09-12T17:08:35.210149+0000","last_peered":"2024-09-12T17:08:35.210149+0000","last_clean":"2024-09-12T17:08:35.210149+0000","last_became_active":"2024-09-12T17:05:57.587891+0000","last_became_peered":"2024-09-12T17:05:57.587891+0000","last_unstale":"2024-09-12T17:08:35.210149+0000","last_undegraded":"2024-09-12T17:08:35.210149+0000","last_fullsized":"2024-09-12T17:08:35.210149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:24.257847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022681+0000","last_change":"2024-09-12T17:08:21.457874+0000","last_active":"2024-09-12T17:08:36.022681+0000","last_peered":"2024-09-12T17:08:36.022681+0000","last_clean":"2024-09-12T17:08:36.022681+0000","last_became_active":"2024-09-12T17:08:21.457526+0000","last_became_peered":"2024-09-12T17:08:21.457526+0000","last_unstale":"2024-09-12T17:08:36.022681+0000","last_undegraded":"2024-09-12T17:08:36.022681+0000","last_fullsized":"2024-09-12T17:08:36.022681+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:37.646866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"84'13","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604660+0000","last_change":"2024-09-12T17:05:47.557687+0000","last_active":"2024-09-12T17:08:33.604660+0000","last_peered":"2024-09-12T17:08:33.604660+0000","last_clean":"2024-09-12T17:08:33.604660+0000","last_became_active":"2024-09-12T17:05:47.556980+0000","last_became_peered":"2024-09-12T17:05:47.556980+0000","last_unstale":"2024-09-12T17:08:33.604660+0000","last_undegraded":"2024-09-12T17:08:33.604660+0000","last_fullsized":"2024-09-12T17:08:33.604660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.891909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38921,"num_write":37,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606120+0000","last_change":"2024-09-12T17:08:18.472276+0000","last_active":"2024-09-12T17:08:33.606120+0000","last_peered":"2024-09-12T17:08:33.606120+0000","last_clean":"2024-09-12T17:08:33.606120+0000","last_became_active":"2024-09-12T17:08:18.471264+0000","last_became_peered":"2024-09-12T17:08:18.471264+0000","last_unstale":"2024-09-12T17:08:33.606120+0000","last_undegraded":"2024-09-12T17:08:33.606120+0000","last_fullsized":"2024-09-12T17:08:33.606120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:10.434396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"84'14","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602673+0000","last_change":"2024-09-12T17:05:53.537592+0000","last_active":"2024-09-12T17:08:33.602673+0000","last_peered":"2024-09-12T17:08:33.602673+0000","last_clean":"2024-09-12T17:08:33.602673+0000","last_became_active":"2024-09-12T17:05:53.536921+0000","last_became_peered":"2024-09-12T17:05:53.536921+0000","last_unstale":"2024-09-12T17:08:33.602673+0000","last_undegraded":"2024-09-12T17:08:33.602673+0000","last_fullsized":"2024-09-12T17:08:33.602673+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:25.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607496+0000","last_change":"2024-09-12T17:05:55.559431+0000","last_active":"2024-09-12T17:08:33.607496+0000","last_peered":"2024-09-12T17:08:33.607496+0000","last_clean":"2024-09-12T17:08:33.607496+0000","last_became_active":"2024-09-12T17:05:55.558297+0000","last_became_peered":"2024-09-12T17:05:55.558297+0000","last_unstale":"2024-09-12T17:08:33.607496+0000","last_undegraded":"2024-09-12T17:08:33.607496+0000","last_fullsized":"2024-09-12T17:08:33.607496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"84'4","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601882+0000","last_change":"2024-09-12T17:05:57.592599+0000","last_active":"2024-09-12T17:08:33.601882+0000","last_peered":"2024-09-12T17:08:33.601882+0000","last_clean":"2024-09-12T17:08:33.601882+0000","last_became_active":"2024-09-12T17:05:57.591877+0000","last_became_peered":"2024-09-12T17:05:57.591877+0000","last_unstale":"2024-09-12T17:08:33.601882+0000","last_undegraded":"2024-09-12T17:08:33.601882+0000","last_fullsized":"2024-09-12T17:08:33.601882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:57.557525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"68'6","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605335+0000","last_change":"2024-09-12T17:05:49.546093+0000","last_active":"2024-09-12T17:08:33.605335+0000","last_peered":"2024-09-12T17:08:33.605335+0000","last_clean":"2024-09-12T17:08:33.605335+0000","last_became_active":"2024-09-12T17:05:49.544425+0000","last_became_peered":"2024-09-12T17:05:49.544425+0000","last_unstale":"2024-09-12T17:08:33.605335+0000","last_undegraded":"2024-09-12T17:08:33.605335+0000","last_fullsized":"2024-09-12T17:08:33.605335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.495950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"72'6","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601748+0000","last_change":"2024-09-12T17:05:47.535295+0000","last_active":"2024-09-12T17:08:33.601748+0000","last_peered":"2024-09-12T17:08:33.601748+0000","last_clean":"2024-09-12T17:08:33.601748+0000","last_became_active":"2024-09-12T17:05:47.534833+0000","last_became_peered":"2024-09-12T17:05:47.534833+0000","last_unstale":"2024-09-12T17:08:33.601748+0000","last_undegraded":"2024-09-12T17:08:33.601748+0000","last_fullsized":"2024-09-12T17:08:33.601748+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":22528,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023193+0000","last_change":"2024-09-12T17:05:51.533888+0000","last_active":"2024-09-12T17:08:36.023193+0000","last_peered":"2024-09-12T17:08:36.023193+0000","last_clean":"2024-09-12T17:08:36.023193+0000","last_became_active":"2024-09-12T17:05:51.533164+0000","last_became_peered":"2024-09-12T17:05:51.533164+0000","last_unstale":"2024-09-12T17:08:36.023193+0000","last_undegraded":"2024-09-12T17:08:36.023193+0000","last_fullsized":"2024-09-12T17:08:36.023193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:33.007858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":165,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212582+0000","last_change":"2024-09-12T17:05:53.549534+0000","last_active":"2024-09-12T17:08:35.212582+0000","last_peered":"2024-09-12T17:08:35.212582+0000","last_clean":"2024-09-12T17:08:35.212582+0000","last_became_active":"2024-09-12T17:05:53.548824+0000","last_became_peered":"2024-09-12T17:05:53.548824+0000","last_unstale":"2024-09-12T17:08:35.212582+0000","last_undegraded":"2024-09-12T17:08:35.212582+0000","last_fullsized":"2024-09-12T17:08:35.212582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.765832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211657+0000","last_change":"2024-09-12T17:05:55.557468+0000","last_active":"2024-09-12T17:08:35.211657+0000","last_peered":"2024-09-12T17:08:35.211657+0000","last_clean":"2024-09-12T17:08:35.211657+0000","last_became_active":"2024-09-12T17:05:55.556689+0000","last_became_peered":"2024-09-12T17:05:55.556689+0000","last_unstale":"2024-09-12T17:08:35.211657+0000","last_undegraded":"2024-09-12T17:08:35.211657+0000","last_fullsized":"2024-09-12T17:08:35.211657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:56.879576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601144+0000","last_change":"2024-09-12T17:05:57.589569+0000","last_active":"2024-09-12T17:08:33.601144+0000","last_peered":"2024-09-12T17:08:33.601144+0000","last_clean":"2024-09-12T17:08:33.601144+0000","last_became_active":"2024-09-12T17:05:57.588649+0000","last_became_peered":"2024-09-12T17:05:57.588649+0000","last_unstale":"2024-09-12T17:08:33.601144+0000","last_undegraded":"2024-09-12T17:08:33.601144+0000","last_fullsized":"2024-09-12T17:08:33.601144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"68'10","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604412+0000","last_change":"2024-09-12T17:05:49.531436+0000","last_active":"2024-09-12T17:08:33.604412+0000","last_peered":"2024-09-12T17:08:33.604412+0000","last_clean":"2024-09-12T17:08:33.604412+0000","last_became_active":"2024-09-12T17:05:49.530687+0000","last_became_peered":"2024-09-12T17:05:49.530687+0000","last_unstale":"2024-09-12T17:08:33.604412+0000","last_undegraded":"2024-09-12T17:08:33.604412+0000","last_fullsized":"2024-09-12T17:08:33.604412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"83'12","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605777+0000","last_change":"2024-09-12T17:05:47.564709+0000","last_active":"2024-09-12T17:08:33.605777+0000","last_peered":"2024-09-12T17:08:33.605777+0000","last_clean":"2024-09-12T17:08:33.605777+0000","last_became_active":"2024-09-12T17:05:47.564189+0000","last_became_peered":"2024-09-12T17:05:47.564189+0000","last_unstale":"2024-09-12T17:08:33.605777+0000","last_undegraded":"2024-09-12T17:08:33.605777+0000","last_fullsized":"2024-09-12T17:08:33.605777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":34825,"num_write":36,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.026238+0000","last_change":"2024-09-12T17:08:18.465074+0000","last_active":"2024-09-12T17:08:36.026238+0000","last_peered":"2024-09-12T17:08:36.026238+0000","last_clean":"2024-09-12T17:08:36.026238+0000","last_became_active":"2024-09-12T17:08:18.464648+0000","last_became_peered":"2024-09-12T17:08:18.464648+0000","last_unstale":"2024-09-12T17:08:36.026238+0000","last_undegraded":"2024-09-12T17:08:36.026238+0000","last_fullsized":"2024-09-12T17:08:36.026238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:04.122655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023933+0000","last_change":"2024-09-12T17:05:53.549328+0000","last_active":"2024-09-12T17:08:36.023933+0000","last_peered":"2024-09-12T17:08:36.023933+0000","last_clean":"2024-09-12T17:08:36.023933+0000","last_became_active":"2024-09-12T17:05:53.548968+0000","last_became_peered":"2024-09-12T17:05:53.548968+0000","last_unstale":"2024-09-12T17:08:36.023933+0000","last_undegraded":"2024-09-12T17:08:36.023933+0000","last_fullsized":"2024-09-12T17:08:36.023933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:36.974950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"103'17","reported_seq":231,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.760644+0000","last_change":"2024-09-12T17:08:21.488239+0000","last_active":"2024-09-12T17:08:36.760644+0000","last_peered":"2024-09-12T17:08:36.760644+0000","last_clean":"2024-09-12T17:08:36.760644+0000","last_became_active":"2024-09-12T17:08:21.464957+0000","last_became_peered":"2024-09-12T17:08:21.464957+0000","last_unstale":"2024-09-12T17:08:36.760644+0000","last_undegraded":"2024-09-12T17:08:36.760644+0000","last_fullsized":"2024-09-12T17:08:36.760644+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.266320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210946+0000","last_change":"2024-09-12T17:05:58.122522+0000","last_active":"2024-09-12T17:08:35.210946+0000","last_peered":"2024-09-12T17:08:35.210946+0000","last_clean":"2024-09-12T17:08:35.210946+0000","last_became_active":"2024-09-12T17:05:58.121871+0000","last_became_peered":"2024-09-12T17:05:58.121871+0000","last_unstale":"2024-09-12T17:08:35.210946+0000","last_undegraded":"2024-09-12T17:08:35.210946+0000","last_fullsized":"2024-09-12T17:08:35.210946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:22.625236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025587+0000","last_change":"2024-09-12T17:05:49.528766+0000","last_active":"2024-09-12T17:08:36.025587+0000","last_peered":"2024-09-12T17:08:36.025587+0000","last_clean":"2024-09-12T17:08:36.025587+0000","last_became_active":"2024-09-12T17:05:49.527758+0000","last_became_peered":"2024-09-12T17:05:49.527758+0000","last_unstale":"2024-09-12T17:08:36.025587+0000","last_undegraded":"2024-09-12T17:08:36.025587+0000","last_fullsized":"2024-09-12T17:08:36.025587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:06.399711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"84'15","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352889+0000","last_change":"2024-09-12T17:05:47.521727+0000","last_active":"2024-09-12T17:08:35.352889+0000","last_peered":"2024-09-12T17:08:35.352889+0000","last_clean":"2024-09-12T17:08:35.352889+0000","last_became_active":"2024-09-12T17:05:47.520943+0000","last_became_peered":"2024-09-12T17:05:47.520943+0000","last_unstale":"2024-09-12T17:08:35.352889+0000","last_undegraded":"2024-09-12T17:08:35.352889+0000","last_fullsized":"2024-09-12T17:08:35.352889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:24.772296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":19,"num_read_kb":51203,"num_write":23,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"29'1","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604412+0000","last_change":"2024-09-12T17:05:51.556202+0000","last_active":"2024-09-12T17:08:33.604412+0000","last_peered":"2024-09-12T17:08:33.604412+0000","last_clean":"2024-09-12T17:08:33.604412+0000","last_became_active":"2024-09-12T17:05:51.555420+0000","last_became_peered":"2024-09-12T17:05:51.555420+0000","last_unstale":"2024-09-12T17:08:33.604412+0000","last_undegraded":"2024-09-12T17:08:33.604412+0000","last_fullsized":"2024-09-12T17:08:33.604412+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:56.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"84'13","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607150+0000","last_change":"2024-09-12T17:05:53.554159+0000","last_active":"2024-09-12T17:08:33.607150+0000","last_peered":"2024-09-12T17:08:33.607150+0000","last_clean":"2024-09-12T17:08:33.607150+0000","last_became_active":"2024-09-12T17:05:53.553333+0000","last_became_peered":"2024-09-12T17:05:53.553333+0000","last_unstale":"2024-09-12T17:08:33.607150+0000","last_undegraded":"2024-09-12T17:08:33.607150+0000","last_fullsized":"2024-09-12T17:08:33.607150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:53.266475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"103'15","reported_seq":200,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.759540+0000","last_change":"2024-09-12T17:05:55.556502+0000","last_active":"2024-09-12T17:08:36.759540+0000","last_peered":"2024-09-12T17:08:36.759540+0000","last_clean":"2024-09-12T17:08:36.759540+0000","last_became_active":"2024-09-12T17:05:55.555879+0000","last_became_peered":"2024-09-12T17:05:55.555879+0000","last_unstale":"2024-09-12T17:08:36.759540+0000","last_undegraded":"2024-09-12T17:08:36.759540+0000","last_fullsized":"2024-09-12T17:08:36.759540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:18.672296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602918+0000","last_change":"2024-09-12T17:05:49.553404+0000","last_active":"2024-09-12T17:08:33.602918+0000","last_peered":"2024-09-12T17:08:33.602918+0000","last_clean":"2024-09-12T17:08:33.602918+0000","last_became_active":"2024-09-12T17:05:49.552637+0000","last_became_peered":"2024-09-12T17:05:49.552637+0000","last_unstale":"2024-09-12T17:08:33.602918+0000","last_undegraded":"2024-09-12T17:08:33.602918+0000","last_fullsized":"2024-09-12T17:08:33.602918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607911+0000","last_change":"2024-09-12T17:05:47.562949+0000","last_active":"2024-09-12T17:08:33.607911+0000","last_peered":"2024-09-12T17:08:33.607911+0000","last_clean":"2024-09-12T17:08:33.607911+0000","last_became_active":"2024-09-12T17:05:47.562465+0000","last_became_peered":"2024-09-12T17:05:47.562465+0000","last_unstale":"2024-09-12T17:08:33.607911+0000","last_undegraded":"2024-09-12T17:08:33.607911+0000","last_fullsized":"2024-09-12T17:08:33.607911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24585,"num_write":33,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604488+0000","last_change":"2024-09-12T17:05:51.542349+0000","last_active":"2024-09-12T17:08:33.604488+0000","last_peered":"2024-09-12T17:08:33.604488+0000","last_clean":"2024-09-12T17:08:33.604488+0000","last_became_active":"2024-09-12T17:05:51.541205+0000","last_became_peered":"2024-09-12T17:05:51.541205+0000","last_unstale":"2024-09-12T17:08:33.604488+0000","last_undegraded":"2024-09-12T17:08:33.604488+0000","last_fullsized":"2024-09-12T17:08:33.604488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"84'28","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602256+0000","last_change":"2024-09-12T17:05:53.560400+0000","last_active":"2024-09-12T17:08:33.602256+0000","last_peered":"2024-09-12T17:08:33.602256+0000","last_clean":"2024-09-12T17:08:33.602256+0000","last_became_active":"2024-09-12T17:05:53.559463+0000","last_became_peered":"2024-09-12T17:05:53.559463+0000","last_unstale":"2024-09-12T17:08:33.602256+0000","last_undegraded":"2024-09-12T17:08:33.602256+0000","last_fullsized":"2024-09-12T17:08:33.602256+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13033,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":46,"num_read_kb":53,"num_write":34,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114027+0000","last_change":"2024-09-12T17:08:21.463670+0000","last_active":"2024-09-12T17:08:35.114027+0000","last_peered":"2024-09-12T17:08:35.114027+0000","last_clean":"2024-09-12T17:08:35.114027+0000","last_became_active":"2024-09-12T17:08:21.463161+0000","last_became_peered":"2024-09-12T17:08:21.463161+0000","last_unstale":"2024-09-12T17:08:35.114027+0000","last_undegraded":"2024-09-12T17:08:35.114027+0000","last_fullsized":"2024-09-12T17:08:35.114027+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:03.162531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603071+0000","last_change":"2024-09-12T17:05:57.599403+0000","last_active":"2024-09-12T17:08:33.603071+0000","last_peered":"2024-09-12T17:08:33.603071+0000","last_clean":"2024-09-12T17:08:33.603071+0000","last_became_active":"2024-09-12T17:05:57.598703+0000","last_became_peered":"2024-09-12T17:05:57.598703+0000","last_unstale":"2024-09-12T17:08:33.603071+0000","last_undegraded":"2024-09-12T17:08:33.603071+0000","last_fullsized":"2024-09-12T17:08:33.603071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"84'34","reported_seq":217,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210937+0000","last_change":"2024-09-12T17:08:18.474573+0000","last_active":"2024-09-12T17:08:35.210937+0000","last_peered":"2024-09-12T17:08:35.210937+0000","last_clean":"2024-09-12T17:08:35.210937+0000","last_became_active":"2024-09-12T17:08:18.443808+0000","last_became_peered":"2024-09-12T17:08:18.443808+0000","last_unstale":"2024-09-12T17:08:35.210937+0000","last_undegraded":"2024-09-12T17:08:35.210937+0000","last_fullsized":"2024-09-12T17:08:35.210937+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:01.200485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"83'8","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607832+0000","last_change":"2024-09-12T17:05:47.563411+0000","last_active":"2024-09-12T17:08:33.607832+0000","last_peered":"2024-09-12T17:08:33.607832+0000","last_clean":"2024-09-12T17:08:33.607832+0000","last_became_active":"2024-09-12T17:05:47.562812+0000","last_became_peered":"2024-09-12T17:05:47.562812+0000","last_unstale":"2024-09-12T17:08:33.607832+0000","last_undegraded":"2024-09-12T17:08:33.607832+0000","last_fullsized":"2024-09-12T17:08:33.607832+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:57.659986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24579,"num_write":16,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021678+0000","last_change":"2024-09-12T17:05:51.548944+0000","last_active":"2024-09-12T17:08:36.021678+0000","last_peered":"2024-09-12T17:08:36.021678+0000","last_clean":"2024-09-12T17:08:36.021678+0000","last_became_active":"2024-09-12T17:05:51.544649+0000","last_became_peered":"2024-09-12T17:05:51.544649+0000","last_unstale":"2024-09-12T17:08:36.021678+0000","last_undegraded":"2024-09-12T17:08:36.021678+0000","last_fullsized":"2024-09-12T17:08:36.021678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:01.468390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"84'12","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023478+0000","last_change":"2024-09-12T17:05:53.552838+0000","last_active":"2024-09-12T17:08:36.023478+0000","last_peered":"2024-09-12T17:08:36.023478+0000","last_clean":"2024-09-12T17:08:36.023478+0000","last_became_active":"2024-09-12T17:05:53.550042+0000","last_became_peered":"2024-09-12T17:05:53.550042+0000","last_unstale":"2024-09-12T17:08:36.023478+0000","last_undegraded":"2024-09-12T17:08:36.023478+0000","last_fullsized":"2024-09-12T17:08:36.023478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021994+0000","last_change":"2024-09-12T17:05:55.558761+0000","last_active":"2024-09-12T17:08:36.021994+0000","last_peered":"2024-09-12T17:08:36.021994+0000","last_clean":"2024-09-12T17:08:36.021994+0000","last_became_active":"2024-09-12T17:05:55.557930+0000","last_became_peered":"2024-09-12T17:05:55.557930+0000","last_unstale":"2024-09-12T17:08:36.021994+0000","last_undegraded":"2024-09-12T17:08:36.021994+0000","last_fullsized":"2024-09-12T17:08:36.021994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.015675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353619+0000","last_change":"2024-09-12T17:05:57.592611+0000","last_active":"2024-09-12T17:08:35.353619+0000","last_peered":"2024-09-12T17:08:35.353619+0000","last_clean":"2024-09-12T17:08:35.353619+0000","last_became_active":"2024-09-12T17:05:57.591855+0000","last_became_peered":"2024-09-12T17:05:57.591855+0000","last_unstale":"2024-09-12T17:08:35.353619+0000","last_undegraded":"2024-09-12T17:08:35.353619+0000","last_fullsized":"2024-09-12T17:08:35.353619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:02.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353645+0000","last_change":"2024-09-12T17:08:18.467848+0000","last_active":"2024-09-12T17:08:35.353645+0000","last_peered":"2024-09-12T17:08:35.353645+0000","last_clean":"2024-09-12T17:08:35.353645+0000","last_became_active":"2024-09-12T17:08:18.466877+0000","last_became_peered":"2024-09-12T17:08:18.466877+0000","last_unstale":"2024-09-12T17:08:35.353645+0000","last_undegraded":"2024-09-12T17:08:35.353645+0000","last_fullsized":"2024-09-12T17:08:35.353645+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:08.084076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"74'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608214+0000","last_change":"2024-09-12T17:05:47.562243+0000","last_active":"2024-09-12T17:08:33.608214+0000","last_peered":"2024-09-12T17:08:33.608214+0000","last_clean":"2024-09-12T17:08:33.608214+0000","last_became_active":"2024-09-12T17:05:47.561587+0000","last_became_peered":"2024-09-12T17:05:47.561587+0000","last_unstale":"2024-09-12T17:08:33.608214+0000","last_undegraded":"2024-09-12T17:08:33.608214+0000","last_fullsized":"2024-09-12T17:08:33.608214+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":28672,"num_write":9,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"29'1","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024124+0000","last_change":"2024-09-12T17:05:51.542843+0000","last_active":"2024-09-12T17:08:36.024124+0000","last_peered":"2024-09-12T17:08:36.024124+0000","last_clean":"2024-09-12T17:08:36.024124+0000","last_became_active":"2024-09-12T17:05:51.542457+0000","last_became_peered":"2024-09-12T17:05:51.542457+0000","last_unstale":"2024-09-12T17:08:36.024124+0000","last_undegraded":"2024-09-12T17:08:36.024124+0000","last_fullsized":"2024-09-12T17:08:36.024124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.837373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"84'20","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602092+0000","last_change":"2024-09-12T17:05:53.548729+0000","last_active":"2024-09-12T17:08:33.602092+0000","last_peered":"2024-09-12T17:08:33.602092+0000","last_clean":"2024-09-12T17:08:33.602092+0000","last_became_active":"2024-09-12T17:05:53.547990+0000","last_became_peered":"2024-09-12T17:05:53.547990+0000","last_unstale":"2024-09-12T17:08:33.602092+0000","last_undegraded":"2024-09-12T17:08:33.602092+0000","last_fullsized":"2024-09-12T17:08:33.602092+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:22.845485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"103'17","reported_seq":229,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.760055+0000","last_change":"2024-09-12T17:08:21.470468+0000","last_active":"2024-09-12T17:08:36.760055+0000","last_peered":"2024-09-12T17:08:36.760055+0000","last_clean":"2024-09-12T17:08:36.760055+0000","last_became_active":"2024-09-12T17:08:21.465057+0000","last_became_peered":"2024-09-12T17:08:21.465057+0000","last_unstale":"2024-09-12T17:08:36.760055+0000","last_undegraded":"2024-09-12T17:08:36.760055+0000","last_fullsized":"2024-09-12T17:08:36.760055+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.580430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604073+0000","last_change":"2024-09-12T17:05:57.596229+0000","last_active":"2024-09-12T17:08:33.604073+0000","last_peered":"2024-09-12T17:08:33.604073+0000","last_clean":"2024-09-12T17:08:33.604073+0000","last_became_active":"2024-09-12T17:05:57.595658+0000","last_became_peered":"2024-09-12T17:05:57.595658+0000","last_unstale":"2024-09-12T17:08:33.604073+0000","last_undegraded":"2024-09-12T17:08:33.604073+0000","last_fullsized":"2024-09-12T17:08:33.604073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.644627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603857+0000","last_change":"2024-09-12T17:08:18.465360+0000","last_active":"2024-09-12T17:08:33.603857+0000","last_peered":"2024-09-12T17:08:33.603857+0000","last_clean":"2024-09-12T17:08:33.603857+0000","last_became_active":"2024-09-12T17:08:18.464976+0000","last_became_peered":"2024-09-12T17:08:18.464976+0000","last_unstale":"2024-09-12T17:08:33.603857+0000","last_undegraded":"2024-09-12T17:08:33.603857+0000","last_fullsized":"2024-09-12T17:08:33.603857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.772819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"84'14","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603646+0000","last_change":"2024-09-12T17:05:47.535946+0000","last_active":"2024-09-12T17:08:33.603646+0000","last_peered":"2024-09-12T17:08:33.603646+0000","last_clean":"2024-09-12T17:08:33.603646+0000","last_became_active":"2024-09-12T17:05:47.534607+0000","last_became_peered":"2024-09-12T17:05:47.534607+0000","last_unstale":"2024-09-12T17:08:33.603646+0000","last_undegraded":"2024-09-12T17:08:33.603646+0000","last_fullsized":"2024-09-12T17:08:33.603646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":30,"num_read_kb":36876,"num_write":46,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022424+0000","last_change":"2024-09-12T17:05:51.548391+0000","last_active":"2024-09-12T17:08:36.022424+0000","last_peered":"2024-09-12T17:08:36.022424+0000","last_clean":"2024-09-12T17:08:36.022424+0000","last_became_active":"2024-09-12T17:05:51.547939+0000","last_became_peered":"2024-09-12T17:05:51.547939+0000","last_unstale":"2024-09-12T17:08:36.022424+0000","last_undegraded":"2024-09-12T17:08:36.022424+0000","last_fullsized":"2024-09-12T17:08:36.022424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:08.848247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"84'23","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600674+0000","last_change":"2024-09-12T17:05:53.535756+0000","last_active":"2024-09-12T17:08:33.600674+0000","last_peered":"2024-09-12T17:08:33.600674+0000","last_clean":"2024-09-12T17:08:33.600674+0000","last_became_active":"2024-09-12T17:05:53.535062+0000","last_became_peered":"2024-09-12T17:05:53.535062+0000","last_unstale":"2024-09-12T17:08:33.600674+0000","last_undegraded":"2024-09-12T17:08:33.600674+0000","last_fullsized":"2024-09-12T17:08:33.600674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12086,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":39,"num_read_kb":45,"num_write":28,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019032+0000","last_change":"2024-09-12T17:05:55.564010+0000","last_active":"2024-09-12T17:08:36.019032+0000","last_peered":"2024-09-12T17:08:36.019032+0000","last_clean":"2024-09-12T17:08:36.019032+0000","last_became_active":"2024-09-12T17:05:55.563125+0000","last_became_peered":"2024-09-12T17:05:55.563125+0000","last_unstale":"2024-09-12T17:08:36.019032+0000","last_undegraded":"2024-09-12T17:08:36.019032+0000","last_fullsized":"2024-09-12T17:08:36.019032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:00.697571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114671+0000","last_change":"2024-09-12T17:08:18.459890+0000","last_active":"2024-09-12T17:08:35.114671+0000","last_peered":"2024-09-12T17:08:35.114671+0000","last_clean":"2024-09-12T17:08:35.114671+0000","last_became_active":"2024-09-12T17:08:18.459544+0000","last_became_peered":"2024-09-12T17:08:18.459544+0000","last_unstale":"2024-09-12T17:08:35.114671+0000","last_undegraded":"2024-09-12T17:08:35.114671+0000","last_fullsized":"2024-09-12T17:08:35.114671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:05.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211812+0000","last_change":"2024-09-12T17:05:49.544092+0000","last_active":"2024-09-12T17:08:35.211812+0000","last_peered":"2024-09-12T17:08:35.211812+0000","last_clean":"2024-09-12T17:08:35.211812+0000","last_became_active":"2024-09-12T17:05:49.543307+0000","last_became_peered":"2024-09-12T17:05:49.543307+0000","last_unstale":"2024-09-12T17:08:35.211812+0000","last_undegraded":"2024-09-12T17:08:35.211812+0000","last_fullsized":"2024-09-12T17:08:35.211812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:36.286410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"83'8","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020487+0000","last_change":"2024-09-12T17:05:47.526678+0000","last_active":"2024-09-12T17:08:36.020487+0000","last_peered":"2024-09-12T17:08:36.020487+0000","last_clean":"2024-09-12T17:08:36.020487+0000","last_became_active":"2024-09-12T17:05:47.525696+0000","last_became_peered":"2024-09-12T17:05:47.525696+0000","last_unstale":"2024-09-12T17:08:36.020487+0000","last_undegraded":"2024-09-12T17:08:36.020487+0000","last_fullsized":"2024-09-12T17:08:36.020487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:59.012258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":18438,"num_write":24,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023952+0000","last_change":"2024-09-12T17:05:51.543404+0000","last_active":"2024-09-12T17:08:36.023952+0000","last_peered":"2024-09-12T17:08:36.023952+0000","last_clean":"2024-09-12T17:08:36.023952+0000","last_became_active":"2024-09-12T17:05:51.542737+0000","last_became_peered":"2024-09-12T17:05:51.542737+0000","last_unstale":"2024-09-12T17:08:36.023952+0000","last_undegraded":"2024-09-12T17:08:36.023952+0000","last_fullsized":"2024-09-12T17:08:36.023952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:30.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"84'19","reported_seq":219,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211951+0000","last_change":"2024-09-12T17:08:21.484446+0000","last_active":"2024-09-12T17:08:35.211951+0000","last_peered":"2024-09-12T17:08:35.211951+0000","last_clean":"2024-09-12T17:08:35.211951+0000","last_became_active":"2024-09-12T17:08:21.465207+0000","last_became_peered":"2024-09-12T17:08:21.465207+0000","last_unstale":"2024-09-12T17:08:35.211951+0000","last_undegraded":"2024-09-12T17:08:35.211951+0000","last_fullsized":"2024-09-12T17:08:35.211951+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:37.839396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7435,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":40,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3559,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603073+0000","last_change":"2024-09-12T17:05:55.565575+0000","last_active":"2024-09-12T17:08:33.603073+0000","last_peered":"2024-09-12T17:08:33.603073+0000","last_clean":"2024-09-12T17:08:33.603073+0000","last_became_active":"2024-09-12T17:05:55.564802+0000","last_became_peered":"2024-09-12T17:05:55.564802+0000","last_unstale":"2024-09-12T17:08:33.603073+0000","last_undegraded":"2024-09-12T17:08:33.603073+0000","last_fullsized":"2024-09-12T17:08:33.603073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022911+0000","last_change":"2024-09-12T17:05:57.592294+0000","last_active":"2024-09-12T17:08:36.022911+0000","last_peered":"2024-09-12T17:08:36.022911+0000","last_clean":"2024-09-12T17:08:36.022911+0000","last_became_active":"2024-09-12T17:05:57.591389+0000","last_became_peered":"2024-09-12T17:05:57.591389+0000","last_unstale":"2024-09-12T17:08:36.022911+0000","last_undegraded":"2024-09-12T17:08:36.022911+0000","last_fullsized":"2024-09-12T17:08:36.022911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'10","reported_seq":177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212458+0000","last_change":"2024-09-12T17:05:49.553177+0000","last_active":"2024-09-12T17:08:35.212458+0000","last_peered":"2024-09-12T17:08:35.212458+0000","last_clean":"2024-09-12T17:08:35.212458+0000","last_became_active":"2024-09-12T17:05:49.552270+0000","last_became_peered":"2024-09-12T17:05:49.552270+0000","last_unstale":"2024-09-12T17:08:35.212458+0000","last_undegraded":"2024-09-12T17:08:35.212458+0000","last_fullsized":"2024-09-12T17:08:35.212458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:34.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"74'8","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353708+0000","last_change":"2024-09-12T17:05:47.543064+0000","last_active":"2024-09-12T17:08:35.353708+0000","last_peered":"2024-09-12T17:08:35.353708+0000","last_clean":"2024-09-12T17:08:35.353708+0000","last_became_active":"2024-09-12T17:05:47.542362+0000","last_became_peered":"2024-09-12T17:05:47.542362+0000","last_unstale":"2024-09-12T17:08:35.353708+0000","last_undegraded":"2024-09-12T17:08:35.353708+0000","last_fullsized":"2024-09-12T17:08:35.353708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114518+0000","last_change":"2024-09-12T17:08:18.456938+0000","last_active":"2024-09-12T17:08:35.114518+0000","last_peered":"2024-09-12T17:08:35.114518+0000","last_clean":"2024-09-12T17:08:35.114518+0000","last_became_active":"2024-09-12T17:08:18.452101+0000","last_became_peered":"2024-09-12T17:08:18.452101+0000","last_unstale":"2024-09-12T17:08:35.114518+0000","last_undegraded":"2024-09-12T17:08:35.114518+0000","last_fullsized":"2024-09-12T17:08:35.114518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:36.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"84'19","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024463+0000","last_change":"2024-09-12T17:05:53.554531+0000","last_active":"2024-09-12T17:08:36.024463+0000","last_peered":"2024-09-12T17:08:36.024463+0000","last_clean":"2024-09-12T17:08:36.024463+0000","last_became_active":"2024-09-12T17:05:53.554131+0000","last_became_peered":"2024-09-12T17:05:53.554131+0000","last_unstale":"2024-09-12T17:08:36.024463+0000","last_undegraded":"2024-09-12T17:08:36.024463+0000","last_fullsized":"2024-09-12T17:08:36.024463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"103'15","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.759563+0000","last_change":"2024-09-12T17:05:55.559204+0000","last_active":"2024-09-12T17:08:36.759563+0000","last_peered":"2024-09-12T17:08:36.759563+0000","last_clean":"2024-09-12T17:08:36.759563+0000","last_became_active":"2024-09-12T17:05:55.556488+0000","last_became_peered":"2024-09-12T17:05:55.556488+0000","last_unstale":"2024-09-12T17:08:36.759563+0000","last_undegraded":"2024-09-12T17:08:36.759563+0000","last_fullsized":"2024-09-12T17:08:36.759563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:15.167640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111231+0000","last_change":"2024-09-12T17:08:18.461886+0000","last_active":"2024-09-12T17:08:35.111231+0000","last_peered":"2024-09-12T17:08:35.111231+0000","last_clean":"2024-09-12T17:08:35.111231+0000","last_became_active":"2024-09-12T17:08:18.460345+0000","last_became_peered":"2024-09-12T17:08:18.460345+0000","last_unstale":"2024-09-12T17:08:35.111231+0000","last_undegraded":"2024-09-12T17:08:35.111231+0000","last_fullsized":"2024-09-12T17:08:35.111231+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:30.011702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"68'6","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212463+0000","last_change":"2024-09-12T17:05:49.562360+0000","last_active":"2024-09-12T17:08:35.212463+0000","last_peered":"2024-09-12T17:08:35.212463+0000","last_clean":"2024-09-12T17:08:35.212463+0000","last_became_active":"2024-09-12T17:05:49.561200+0000","last_became_peered":"2024-09-12T17:05:49.561200+0000","last_unstale":"2024-09-12T17:08:35.212463+0000","last_undegraded":"2024-09-12T17:08:35.212463+0000","last_fullsized":"2024-09-12T17:08:35.212463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.915600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"84'9","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210194+0000","last_change":"2024-09-12T17:05:47.542018+0000","last_active":"2024-09-12T17:08:35.210194+0000","last_peered":"2024-09-12T17:08:35.210194+0000","last_clean":"2024-09-12T17:08:35.210194+0000","last_became_active":"2024-09-12T17:05:47.540484+0000","last_became_peered":"2024-09-12T17:05:47.540484+0000","last_unstale":"2024-09-12T17:08:35.210194+0000","last_undegraded":"2024-09-12T17:08:35.210194+0000","last_fullsized":"2024-09-12T17:08:35.210194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:13.571666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24585,"num_write":33,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606141+0000","last_change":"2024-09-12T17:05:51.556083+0000","last_active":"2024-09-12T17:08:33.606141+0000","last_peered":"2024-09-12T17:08:33.606141+0000","last_clean":"2024-09-12T17:08:33.606141+0000","last_became_active":"2024-09-12T17:05:51.554176+0000","last_became_peered":"2024-09-12T17:05:51.554176+0000","last_unstale":"2024-09-12T17:08:33.606141+0000","last_undegraded":"2024-09-12T17:08:33.606141+0000","last_fullsized":"2024-09-12T17:08:33.606141+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:02.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024529+0000","last_change":"2024-09-12T17:05:53.553304+0000","last_active":"2024-09-12T17:08:36.024529+0000","last_peered":"2024-09-12T17:08:36.024529+0000","last_clean":"2024-09-12T17:08:36.024529+0000","last_became_active":"2024-09-12T17:05:53.552545+0000","last_became_peered":"2024-09-12T17:05:53.552545+0000","last_unstale":"2024-09-12T17:08:36.024529+0000","last_undegraded":"2024-09-12T17:08:36.024529+0000","last_fullsized":"2024-09-12T17:08:36.024529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"103'17","reported_seq":231,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.760375+0000","last_change":"2024-09-12T17:08:18.628128+0000","last_active":"2024-09-12T17:08:36.760375+0000","last_peered":"2024-09-12T17:08:36.760375+0000","last_clean":"2024-09-12T17:08:36.760375+0000","last_became_active":"2024-09-12T17:08:18.471539+0000","last_became_peered":"2024-09-12T17:08:18.471539+0000","last_unstale":"2024-09-12T17:08:36.760375+0000","last_undegraded":"2024-09-12T17:08:36.760375+0000","last_fullsized":"2024-09-12T17:08:36.760375+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:47.486729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210930+0000","last_change":"2024-09-12T17:05:57.597870+0000","last_active":"2024-09-12T17:08:35.210930+0000","last_peered":"2024-09-12T17:08:35.210930+0000","last_clean":"2024-09-12T17:08:35.210930+0000","last_became_active":"2024-09-12T17:05:57.597076+0000","last_became_peered":"2024-09-12T17:05:57.597076+0000","last_unstale":"2024-09-12T17:08:35.210930+0000","last_undegraded":"2024-09-12T17:08:35.210930+0000","last_fullsized":"2024-09-12T17:08:35.210930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.648974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"68'6","reported_seq":43,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114680+0000","last_change":"2024-09-12T17:08:18.887494+0000","last_active":"2024-09-12T17:08:35.114680+0000","last_peered":"2024-09-12T17:08:35.114680+0000","last_clean":"2024-09-12T17:08:35.114680+0000","last_became_active":"2024-09-12T17:08:18.457423+0000","last_became_peered":"2024-09-12T17:08:18.457423+0000","last_unstale":"2024-09-12T17:08:35.114680+0000","last_undegraded":"2024-09-12T17:08:35.114680+0000","last_fullsized":"2024-09-12T17:08:35.114680+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:59.827727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"84'10","reported_seq":218,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021224+0000","last_change":"2024-09-12T17:08:18.702553+0000","last_active":"2024-09-12T17:08:36.021224+0000","last_peered":"2024-09-12T17:08:36.021224+0000","last_clean":"2024-09-12T17:08:36.021224+0000","last_became_active":"2024-09-12T17:08:18.449468+0000","last_became_peered":"2024-09-12T17:08:18.449468+0000","last_unstale":"2024-09-12T17:08:36.021224+0000","last_undegraded":"2024-09-12T17:08:36.021224+0000","last_fullsized":"2024-09-12T17:08:36.021224+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:54.548414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212218+0000","last_change":"2024-09-12T17:05:51.540047+0000","last_active":"2024-09-12T17:08:35.212218+0000","last_peered":"2024-09-12T17:08:35.212218+0000","last_clean":"2024-09-12T17:08:35.212218+0000","last_became_active":"2024-09-12T17:05:51.539302+0000","last_became_peered":"2024-09-12T17:05:51.539302+0000","last_unstale":"2024-09-12T17:08:35.212218+0000","last_undegraded":"2024-09-12T17:08:35.212218+0000","last_fullsized":"2024-09-12T17:08:35.212218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:21.253801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"84'23","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603583+0000","last_change":"2024-09-12T17:08:21.515721+0000","last_active":"2024-09-12T17:08:33.603583+0000","last_peered":"2024-09-12T17:08:33.603583+0000","last_clean":"2024-09-12T17:08:33.603583+0000","last_became_active":"2024-09-12T17:08:21.467530+0000","last_became_peered":"2024-09-12T17:08:21.467530+0000","last_unstale":"2024-09-12T17:08:33.603583+0000","last_undegraded":"2024-09-12T17:08:33.603583+0000","last_fullsized":"2024-09-12T17:08:33.603583+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:04.806432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":37,"num_read_kb":36,"num_write":26,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":12538,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353193+0000","last_change":"2024-09-12T17:05:55.566749+0000","last_active":"2024-09-12T17:08:35.353193+0000","last_peered":"2024-09-12T17:08:35.353193+0000","last_clean":"2024-09-12T17:08:35.353193+0000","last_became_active":"2024-09-12T17:05:55.565979+0000","last_became_peered":"2024-09-12T17:05:55.565979+0000","last_unstale":"2024-09-12T17:08:35.353193+0000","last_undegraded":"2024-09-12T17:08:35.353193+0000","last_fullsized":"2024-09-12T17:08:35.353193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113928+0000","last_change":"2024-09-12T17:08:21.461881+0000","last_active":"2024-09-12T17:08:35.113928+0000","last_peered":"2024-09-12T17:08:35.113928+0000","last_clean":"2024-09-12T17:08:35.113928+0000","last_became_active":"2024-09-12T17:08:21.461496+0000","last_became_peered":"2024-09-12T17:08:21.461496+0000","last_unstale":"2024-09-12T17:08:35.113928+0000","last_undegraded":"2024-09-12T17:08:35.113928+0000","last_fullsized":"2024-09-12T17:08:35.113928+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:41.000825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354192+0000","last_change":"2024-09-12T17:05:49.539487+0000","last_active":"2024-09-12T17:08:35.354192+0000","last_peered":"2024-09-12T17:08:35.354192+0000","last_clean":"2024-09-12T17:08:35.354192+0000","last_became_active":"2024-09-12T17:05:49.538713+0000","last_became_peered":"2024-09-12T17:05:49.538713+0000","last_unstale":"2024-09-12T17:08:35.354192+0000","last_undegraded":"2024-09-12T17:08:35.354192+0000","last_fullsized":"2024-09-12T17:08:35.354192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.731614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":272,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602363+0000","last_change":"2024-09-12T17:05:35.688483+0000","last_active":"2024-09-12T17:08:33.602363+0000","last_peered":"2024-09-12T17:08:33.602363+0000","last_clean":"2024-09-12T17:08:33.602363+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:08:33.602363+0000","last_undegraded":"2024-09-12T17:08:33.602363+0000","last_fullsized":"2024-09-12T17:08:33.602363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_clean_scrub_stamp":"2024-09-12T17:05:34.151079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602740+0000","last_change":"2024-09-12T17:05:42.225793+0000","last_active":"2024-09-12T17:08:33.602740+0000","last_peered":"2024-09-12T17:08:33.602740+0000","last_clean":"2024-09-12T17:08:33.602740+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:08:33.602740+0000","last_undegraded":"2024-09-12T17:08:33.602740+0000","last_fullsized":"2024-09-12T17:08:33.602740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:54.880257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"84'13","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019462+0000","last_change":"2024-09-12T17:05:47.526243+0000","last_active":"2024-09-12T17:08:36.019462+0000","last_peered":"2024-09-12T17:08:36.019462+0000","last_clean":"2024-09-12T17:08:36.019462+0000","last_became_active":"2024-09-12T17:05:47.525694+0000","last_became_peered":"2024-09-12T17:05:47.525694+0000","last_unstale":"2024-09-12T17:08:36.019462+0000","last_undegraded":"2024-09-12T17:08:36.019462+0000","last_fullsized":"2024-09-12T17:08:36.019462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":38921,"num_write":37,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606510+0000","last_change":"2024-09-12T17:05:51.548356+0000","last_active":"2024-09-12T17:08:33.606510+0000","last_peered":"2024-09-12T17:08:33.606510+0000","last_clean":"2024-09-12T17:08:33.606510+0000","last_became_active":"2024-09-12T17:05:51.547503+0000","last_became_peered":"2024-09-12T17:05:51.547503+0000","last_unstale":"2024-09-12T17:08:33.606510+0000","last_undegraded":"2024-09-12T17:08:33.606510+0000","last_fullsized":"2024-09-12T17:08:33.606510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:47.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"84'30","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604943+0000","last_change":"2024-09-12T17:05:53.546057+0000","last_active":"2024-09-12T17:08:33.604943+0000","last_peered":"2024-09-12T17:08:33.604943+0000","last_clean":"2024-09-12T17:08:33.604943+0000","last_became_active":"2024-09-12T17:05:53.545266+0000","last_became_peered":"2024-09-12T17:05:53.545266+0000","last_unstale":"2024-09-12T17:08:33.604943+0000","last_undegraded":"2024-09-12T17:08:33.604943+0000","last_fullsized":"2024-09-12T17:08:33.604943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18405,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":52,"num_read_kb":65,"num_write":38,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604135+0000","last_change":"2024-09-12T17:05:55.562246+0000","last_active":"2024-09-12T17:08:33.604135+0000","last_peered":"2024-09-12T17:08:33.604135+0000","last_clean":"2024-09-12T17:08:33.604135+0000","last_became_active":"2024-09-12T17:05:55.561410+0000","last_became_peered":"2024-09-12T17:05:55.561410+0000","last_unstale":"2024-09-12T17:08:33.604135+0000","last_undegraded":"2024-09-12T17:08:33.604135+0000","last_fullsized":"2024-09-12T17:08:33.604135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.373235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"68'2","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352549+0000","last_change":"2024-09-12T17:05:57.593095+0000","last_active":"2024-09-12T17:08:35.352549+0000","last_peered":"2024-09-12T17:08:35.352549+0000","last_clean":"2024-09-12T17:08:35.352549+0000","last_became_active":"2024-09-12T17:05:57.592287+0000","last_became_peered":"2024-09-12T17:05:57.592287+0000","last_unstale":"2024-09-12T17:08:35.352549+0000","last_undegraded":"2024-09-12T17:08:35.352549+0000","last_fullsized":"2024-09-12T17:08:35.352549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:52.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604303+0000","last_change":"2024-09-12T17:08:18.465677+0000","last_active":"2024-09-12T17:08:33.604303+0000","last_peered":"2024-09-12T17:08:33.604303+0000","last_clean":"2024-09-12T17:08:33.604303+0000","last_became_active":"2024-09-12T17:08:18.464334+0000","last_became_peered":"2024-09-12T17:08:18.464334+0000","last_unstale":"2024-09-12T17:08:33.604303+0000","last_undegraded":"2024-09-12T17:08:33.604303+0000","last_fullsized":"2024-09-12T17:08:33.604303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:26.356922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601919+0000","last_change":"2024-09-12T17:08:21.462733+0000","last_active":"2024-09-12T17:08:33.601919+0000","last_peered":"2024-09-12T17:08:33.601919+0000","last_clean":"2024-09-12T17:08:33.601919+0000","last_became_active":"2024-09-12T17:08:21.461625+0000","last_became_peered":"2024-09-12T17:08:21.461625+0000","last_unstale":"2024-09-12T17:08:33.601919+0000","last_undegraded":"2024-09-12T17:08:33.601919+0000","last_fullsized":"2024-09-12T17:08:33.601919+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:09.553944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'15","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600772+0000","last_change":"2024-09-12T17:05:47.544269+0000","last_active":"2024-09-12T17:08:33.600772+0000","last_peered":"2024-09-12T17:08:33.600772+0000","last_clean":"2024-09-12T17:08:33.600772+0000","last_became_active":"2024-09-12T17:05:47.543531+0000","last_became_peered":"2024-09-12T17:05:47.543531+0000","last_unstale":"2024-09-12T17:08:33.600772+0000","last_undegraded":"2024-09-12T17:08:33.600772+0000","last_fullsized":"2024-09-12T17:08:33.600772+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:55.688363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":40969,"num_write":39,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605269+0000","last_change":"2024-09-12T17:08:18.466066+0000","last_active":"2024-09-12T17:08:33.605269+0000","last_peered":"2024-09-12T17:08:33.605269+0000","last_clean":"2024-09-12T17:08:33.605269+0000","last_became_active":"2024-09-12T17:08:18.465027+0000","last_became_peered":"2024-09-12T17:08:18.465027+0000","last_unstale":"2024-09-12T17:08:33.605269+0000","last_undegraded":"2024-09-12T17:08:33.605269+0000","last_fullsized":"2024-09-12T17:08:33.605269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"103'49","reported_seq":61,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.759922+0000","last_change":"2024-09-12T17:08:21.488130+0000","last_active":"2024-09-12T17:08:36.759922+0000","last_peered":"2024-09-12T17:08:36.759922+0000","last_clean":"2024-09-12T17:08:36.759922+0000","last_became_active":"2024-09-12T17:08:21.455260+0000","last_became_peered":"2024-09-12T17:08:21.455260+0000","last_unstale":"2024-09-12T17:08:36.759922+0000","last_undegraded":"2024-09-12T17:08:36.759922+0000","last_fullsized":"2024-09-12T17:08:36.759922+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:08.863638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17326,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":71,"num_read_kb":74,"num_write":44,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":5726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606844+0000","last_change":"2024-09-12T17:05:55.556362+0000","last_active":"2024-09-12T17:08:33.606844+0000","last_peered":"2024-09-12T17:08:33.606844+0000","last_clean":"2024-09-12T17:08:33.606844+0000","last_became_active":"2024-09-12T17:05:55.555625+0000","last_became_peered":"2024-09-12T17:05:55.555625+0000","last_unstale":"2024-09-12T17:08:33.606844+0000","last_undegraded":"2024-09-12T17:08:33.606844+0000","last_fullsized":"2024-09-12T17:08:33.606844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"84'6","reported_seq":45,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114189+0000","last_change":"2024-09-12T17:08:18.577521+0000","last_active":"2024-09-12T17:08:35.114189+0000","last_peered":"2024-09-12T17:08:35.114189+0000","last_clean":"2024-09-12T17:08:35.114189+0000","last_became_active":"2024-09-12T17:08:18.446923+0000","last_became_peered":"2024-09-12T17:08:18.446923+0000","last_unstale":"2024-09-12T17:08:35.114189+0000","last_undegraded":"2024-09-12T17:08:35.114189+0000","last_fullsized":"2024-09-12T17:08:35.114189+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:00.600036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114457+0000","last_change":"2024-09-12T17:08:21.457044+0000","last_active":"2024-09-12T17:08:35.114457+0000","last_peered":"2024-09-12T17:08:35.114457+0000","last_clean":"2024-09-12T17:08:35.114457+0000","last_became_active":"2024-09-12T17:08:21.456705+0000","last_became_peered":"2024-09-12T17:08:21.456705+0000","last_unstale":"2024-09-12T17:08:35.114457+0000","last_undegraded":"2024-09-12T17:08:35.114457+0000","last_fullsized":"2024-09-12T17:08:35.114457+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:57.537595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023245+0000","last_change":"2024-09-12T17:05:42.677413+0000","last_active":"2024-09-12T17:08:36.023245+0000","last_peered":"2024-09-12T17:08:36.023245+0000","last_clean":"2024-09-12T17:08:36.023245+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:08:36.023245+0000","last_undegraded":"2024-09-12T17:08:36.023245+0000","last_fullsized":"2024-09-12T17:08:36.023245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.836885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"84'12","reported_seq":61,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111935+0000","last_change":"2024-09-12T17:08:18.715809+0000","last_active":"2024-09-12T17:08:35.111935+0000","last_peered":"2024-09-12T17:08:35.111935+0000","last_clean":"2024-09-12T17:08:35.111935+0000","last_became_active":"2024-09-12T17:08:18.446837+0000","last_became_peered":"2024-09-12T17:08:18.446837+0000","last_unstale":"2024-09-12T17:08:35.111935+0000","last_undegraded":"2024-09-12T17:08:35.111935+0000","last_fullsized":"2024-09-12T17:08:35.111935+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:22.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":161,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025411+0000","last_change":"2024-09-12T17:05:51.557262+0000","last_active":"2024-09-12T17:08:36.025411+0000","last_peered":"2024-09-12T17:08:36.025411+0000","last_clean":"2024-09-12T17:08:36.025411+0000","last_became_active":"2024-09-12T17:05:51.556959+0000","last_became_peered":"2024-09-12T17:05:51.556959+0000","last_unstale":"2024-09-12T17:08:36.025411+0000","last_undegraded":"2024-09-12T17:08:36.025411+0000","last_fullsized":"2024-09-12T17:08:36.025411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.963181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"103'16","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.760375+0000","last_change":"2024-09-12T17:05:53.555384+0000","last_active":"2024-09-12T17:08:36.760375+0000","last_peered":"2024-09-12T17:08:36.760375+0000","last_clean":"2024-09-12T17:08:36.760375+0000","last_became_active":"2024-09-12T17:05:53.554063+0000","last_became_peered":"2024-09-12T17:05:53.554063+0000","last_unstale":"2024-09-12T17:08:36.760375+0000","last_undegraded":"2024-09-12T17:08:36.760375+0000","last_fullsized":"2024-09-12T17:08:36.760375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602091+0000","last_change":"2024-09-12T17:05:55.547595+0000","last_active":"2024-09-12T17:08:33.602091+0000","last_peered":"2024-09-12T17:08:33.602091+0000","last_clean":"2024-09-12T17:08:33.602091+0000","last_became_active":"2024-09-12T17:05:55.546700+0000","last_became_peered":"2024-09-12T17:05:55.546700+0000","last_unstale":"2024-09-12T17:08:33.602091+0000","last_undegraded":"2024-09-12T17:08:33.602091+0000","last_fullsized":"2024-09-12T17:08:33.602091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023225+0000","last_change":"2024-09-12T17:05:57.587955+0000","last_active":"2024-09-12T17:08:36.023225+0000","last_peered":"2024-09-12T17:08:36.023225+0000","last_clean":"2024-09-12T17:08:36.023225+0000","last_became_active":"2024-09-12T17:05:57.587199+0000","last_became_peered":"2024-09-12T17:05:57.587199+0000","last_unstale":"2024-09-12T17:08:36.023225+0000","last_undegraded":"2024-09-12T17:08:36.023225+0000","last_fullsized":"2024-09-12T17:08:36.023225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.422656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114194+0000","last_change":"2024-09-12T17:08:21.456185+0000","last_active":"2024-09-12T17:08:35.114194+0000","last_peered":"2024-09-12T17:08:35.114194+0000","last_clean":"2024-09-12T17:08:35.114194+0000","last_became_active":"2024-09-12T17:08:21.455573+0000","last_became_peered":"2024-09-12T17:08:21.455573+0000","last_unstale":"2024-09-12T17:08:35.114194+0000","last_undegraded":"2024-09-12T17:08:35.114194+0000","last_fullsized":"2024-09-12T17:08:35.114194+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:45.008694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604023+0000","last_change":"2024-09-12T17:08:18.708570+0000","last_active":"2024-09-12T17:08:33.604023+0000","last_peered":"2024-09-12T17:08:33.604023+0000","last_clean":"2024-09-12T17:08:33.604023+0000","last_became_active":"2024-09-12T17:08:18.474152+0000","last_became_peered":"2024-09-12T17:08:18.474152+0000","last_unstale":"2024-09-12T17:08:33.604023+0000","last_undegraded":"2024-09-12T17:08:33.604023+0000","last_fullsized":"2024-09-12T17:08:33.604023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:17.040784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"73'10","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211877+0000","last_change":"2024-09-12T17:05:47.546543+0000","last_active":"2024-09-12T17:08:35.211877+0000","last_peered":"2024-09-12T17:08:35.211877+0000","last_clean":"2024-09-12T17:08:35.211877+0000","last_became_active":"2024-09-12T17:05:47.545554+0000","last_became_peered":"2024-09-12T17:05:47.545554+0000","last_unstale":"2024-09-12T17:08:35.211877+0000","last_undegraded":"2024-09-12T17:08:35.211877+0000","last_fullsized":"2024-09-12T17:08:35.211877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:07.148131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602766+0000","last_change":"2024-09-12T17:08:18.451242+0000","last_active":"2024-09-12T17:08:33.602766+0000","last_peered":"2024-09-12T17:08:33.602766+0000","last_clean":"2024-09-12T17:08:33.602766+0000","last_became_active":"2024-09-12T17:08:18.450835+0000","last_became_peered":"2024-09-12T17:08:18.450835+0000","last_unstale":"2024-09-12T17:08:33.602766+0000","last_undegraded":"2024-09-12T17:08:33.602766+0000","last_fullsized":"2024-09-12T17:08:33.602766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025686+0000","last_change":"2024-09-12T17:05:53.551499+0000","last_active":"2024-09-12T17:08:36.025686+0000","last_peered":"2024-09-12T17:08:36.025686+0000","last_clean":"2024-09-12T17:08:36.025686+0000","last_became_active":"2024-09-12T17:05:53.550857+0000","last_became_peered":"2024-09-12T17:05:53.550857+0000","last_unstale":"2024-09-12T17:08:36.025686+0000","last_undegraded":"2024-09-12T17:08:36.025686+0000","last_fullsized":"2024-09-12T17:08:36.025686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354430+0000","last_change":"2024-09-12T17:05:55.571619+0000","last_active":"2024-09-12T17:08:35.354430+0000","last_peered":"2024-09-12T17:08:35.354430+0000","last_clean":"2024-09-12T17:08:35.354430+0000","last_became_active":"2024-09-12T17:05:55.570991+0000","last_became_peered":"2024-09-12T17:05:55.570991+0000","last_unstale":"2024-09-12T17:08:35.354430+0000","last_undegraded":"2024-09-12T17:08:35.354430+0000","last_fullsized":"2024-09-12T17:08:35.354430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:02.401831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"84'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601534+0000","last_change":"2024-09-12T17:05:57.590482+0000","last_active":"2024-09-12T17:08:33.601534+0000","last_peered":"2024-09-12T17:08:33.601534+0000","last_clean":"2024-09-12T17:08:33.601534+0000","last_became_active":"2024-09-12T17:05:57.589542+0000","last_became_peered":"2024-09-12T17:05:57.589542+0000","last_unstale":"2024-09-12T17:08:33.601534+0000","last_undegraded":"2024-09-12T17:08:33.601534+0000","last_fullsized":"2024-09-12T17:08:33.601534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:20.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114011+0000","last_change":"2024-09-12T17:08:21.464126+0000","last_active":"2024-09-12T17:08:35.114011+0000","last_peered":"2024-09-12T17:08:35.114011+0000","last_clean":"2024-09-12T17:08:35.114011+0000","last_became_active":"2024-09-12T17:08:21.462608+0000","last_became_peered":"2024-09-12T17:08:21.462608+0000","last_unstale":"2024-09-12T17:08:35.114011+0000","last_undegraded":"2024-09-12T17:08:35.114011+0000","last_fullsized":"2024-09-12T17:08:35.114011+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:15.261389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"84'18","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606478+0000","last_change":"2024-09-12T17:05:47.525858+0000","last_active":"2024-09-12T17:08:33.606478+0000","last_peered":"2024-09-12T17:08:33.606478+0000","last_clean":"2024-09-12T17:08:33.606478+0000","last_became_active":"2024-09-12T17:05:47.525258+0000","last_became_peered":"2024-09-12T17:05:47.525258+0000","last_unstale":"2024-09-12T17:08:33.606478+0000","last_undegraded":"2024-09-12T17:08:33.606478+0000","last_fullsized":"2024-09-12T17:08:33.606478+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":30,"num_read_kb":59401,"num_write":42,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111334+0000","last_change":"2024-09-12T17:08:18.462079+0000","last_active":"2024-09-12T17:08:35.111334+0000","last_peered":"2024-09-12T17:08:35.111334+0000","last_clean":"2024-09-12T17:08:35.111334+0000","last_became_active":"2024-09-12T17:08:18.460435+0000","last_became_peered":"2024-09-12T17:08:18.460435+0000","last_unstale":"2024-09-12T17:08:35.111334+0000","last_undegraded":"2024-09-12T17:08:35.111334+0000","last_fullsized":"2024-09-12T17:08:35.111334+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:32.002970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602556+0000","last_change":"2024-09-12T17:05:51.544848+0000","last_active":"2024-09-12T17:08:33.602556+0000","last_peered":"2024-09-12T17:08:33.602556+0000","last_clean":"2024-09-12T17:08:33.602556+0000","last_became_active":"2024-09-12T17:05:51.544078+0000","last_became_peered":"2024-09-12T17:05:51.544078+0000","last_unstale":"2024-09-12T17:08:33.602556+0000","last_undegraded":"2024-09-12T17:08:33.602556+0000","last_fullsized":"2024-09-12T17:08:33.602556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"84'27","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600730+0000","last_change":"2024-09-12T17:05:53.540181+0000","last_active":"2024-09-12T17:08:33.600730+0000","last_peered":"2024-09-12T17:08:33.600730+0000","last_clean":"2024-09-12T17:08:33.600730+0000","last_became_active":"2024-09-12T17:05:53.539372+0000","last_became_peered":"2024-09-12T17:05:53.539372+0000","last_unstale":"2024-09-12T17:08:33.600730+0000","last_undegraded":"2024-09-12T17:08:33.600730+0000","last_fullsized":"2024-09-12T17:08:33.600730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:58.931466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6989,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211474+0000","last_change":"2024-09-12T17:05:55.554060+0000","last_active":"2024-09-12T17:08:35.211474+0000","last_peered":"2024-09-12T17:08:35.211474+0000","last_clean":"2024-09-12T17:08:35.211474+0000","last_became_active":"2024-09-12T17:05:55.553263+0000","last_became_peered":"2024-09-12T17:05:55.553263+0000","last_unstale":"2024-09-12T17:08:35.211474+0000","last_undegraded":"2024-09-12T17:08:35.211474+0000","last_fullsized":"2024-09-12T17:08:35.211474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:44.303469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602500+0000","last_change":"2024-09-12T17:05:58.121180+0000","last_active":"2024-09-12T17:08:33.602500+0000","last_peered":"2024-09-12T17:08:33.602500+0000","last_clean":"2024-09-12T17:08:33.602500+0000","last_became_active":"2024-09-12T17:05:58.119755+0000","last_became_peered":"2024-09-12T17:05:58.119755+0000","last_unstale":"2024-09-12T17:08:33.602500+0000","last_undegraded":"2024-09-12T17:08:33.602500+0000","last_fullsized":"2024-09-12T17:08:33.602500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603740+0000","last_change":"2024-09-12T17:05:49.550213+0000","last_active":"2024-09-12T17:08:33.603740+0000","last_peered":"2024-09-12T17:08:33.603740+0000","last_clean":"2024-09-12T17:08:33.603740+0000","last_became_active":"2024-09-12T17:05:49.549583+0000","last_became_peered":"2024-09-12T17:05:49.549583+0000","last_unstale":"2024-09-12T17:08:33.603740+0000","last_undegraded":"2024-09-12T17:08:33.603740+0000","last_fullsized":"2024-09-12T17:08:33.603740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:05.085326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"84'11","reported_seq":61,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114413+0000","last_change":"2024-09-12T17:08:18.869145+0000","last_active":"2024-09-12T17:08:35.114413+0000","last_peered":"2024-09-12T17:08:35.114413+0000","last_clean":"2024-09-12T17:08:35.114413+0000","last_became_active":"2024-09-12T17:08:18.448295+0000","last_became_peered":"2024-09-12T17:08:18.448295+0000","last_unstale":"2024-09-12T17:08:35.114413+0000","last_undegraded":"2024-09-12T17:08:35.114413+0000","last_fullsized":"2024-09-12T17:08:35.114413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:20.400937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36867,"num_write":19,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608651+0000","last_change":"2024-09-12T17:05:42.218804+0000","last_active":"2024-09-12T17:08:33.608651+0000","last_peered":"2024-09-12T17:08:33.608651+0000","last_clean":"2024-09-12T17:08:33.608651+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:08:33.608651+0000","last_undegraded":"2024-09-12T17:08:33.608651+0000","last_fullsized":"2024-09-12T17:08:33.608651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:48.189931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353195+0000","last_change":"2024-09-12T17:05:51.545963+0000","last_active":"2024-09-12T17:08:35.353195+0000","last_peered":"2024-09-12T17:08:35.353195+0000","last_clean":"2024-09-12T17:08:35.353195+0000","last_became_active":"2024-09-12T17:05:51.545225+0000","last_became_peered":"2024-09-12T17:05:51.545225+0000","last_unstale":"2024-09-12T17:08:35.353195+0000","last_undegraded":"2024-09-12T17:08:35.353195+0000","last_fullsized":"2024-09-12T17:08:35.353195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:40.407563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":55,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111954+0000","last_change":"2024-09-12T17:08:18.881993+0000","last_active":"2024-09-12T17:08:35.111954+0000","last_peered":"2024-09-12T17:08:35.111954+0000","last_clean":"2024-09-12T17:08:35.111954+0000","last_became_active":"2024-09-12T17:08:18.456095+0000","last_became_peered":"2024-09-12T17:08:18.456095+0000","last_unstale":"2024-09-12T17:08:35.111954+0000","last_undegraded":"2024-09-12T17:08:35.111954+0000","last_fullsized":"2024-09-12T17:08:35.111954+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:37.132692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"103'17","reported_seq":219,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.760544+0000","last_change":"2024-09-12T17:08:21.492858+0000","last_active":"2024-09-12T17:08:36.760544+0000","last_peered":"2024-09-12T17:08:36.760544+0000","last_clean":"2024-09-12T17:08:36.760544+0000","last_became_active":"2024-09-12T17:08:21.467026+0000","last_became_peered":"2024-09-12T17:08:21.467026+0000","last_unstale":"2024-09-12T17:08:36.760544+0000","last_undegraded":"2024-09-12T17:08:36.760544+0000","last_fullsized":"2024-09-12T17:08:36.760544+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:08.135205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.026036+0000","last_change":"2024-09-12T17:05:58.118437+0000","last_active":"2024-09-12T17:08:36.026036+0000","last_peered":"2024-09-12T17:08:36.026036+0000","last_clean":"2024-09-12T17:08:36.026036+0000","last_became_active":"2024-09-12T17:05:58.117710+0000","last_became_peered":"2024-09-12T17:05:58.117710+0000","last_unstale":"2024-09-12T17:08:36.026036+0000","last_undegraded":"2024-09-12T17:08:36.026036+0000","last_fullsized":"2024-09-12T17:08:36.026036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:00.239807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":126,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019063+0000","last_change":"2024-09-12T17:06:27.817661+0000","last_active":"2024-09-12T17:08:36.019063+0000","last_peered":"2024-09-12T17:08:36.019063+0000","last_clean":"2024-09-12T17:08:36.019063+0000","last_became_active":"2024-09-12T17:06:27.817451+0000","last_became_peered":"2024-09-12T17:06:27.817451+0000","last_unstale":"2024-09-12T17:08:36.019063+0000","last_undegraded":"2024-09-12T17:08:36.019063+0000","last_fullsized":"2024-09-12T17:08:36.019063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:31.000633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"83'8","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020171+0000","last_change":"2024-09-12T17:05:47.535321+0000","last_active":"2024-09-12T17:08:36.020171+0000","last_peered":"2024-09-12T17:08:36.020171+0000","last_clean":"2024-09-12T17:08:36.020171+0000","last_became_active":"2024-09-12T17:05:47.534790+0000","last_became_peered":"2024-09-12T17:05:47.534790+0000","last_unstale":"2024-09-12T17:08:36.020171+0000","last_undegraded":"2024-09-12T17:08:36.020171+0000","last_fullsized":"2024-09-12T17:08:36.020171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":26627,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115452+0000","last_change":"2024-09-12T17:08:21.467295+0000","last_active":"2024-09-12T17:08:35.115452+0000","last_peered":"2024-09-12T17:08:35.115452+0000","last_clean":"2024-09-12T17:08:35.115452+0000","last_became_active":"2024-09-12T17:08:21.467016+0000","last_became_peered":"2024-09-12T17:08:21.467016+0000","last_unstale":"2024-09-12T17:08:35.115452+0000","last_undegraded":"2024-09-12T17:08:35.115452+0000","last_fullsized":"2024-09-12T17:08:35.115452+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:24.509905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211005+0000","last_change":"2024-09-12T17:05:51.533668+0000","last_active":"2024-09-12T17:08:35.211005+0000","last_peered":"2024-09-12T17:08:35.211005+0000","last_clean":"2024-09-12T17:08:35.211005+0000","last_became_active":"2024-09-12T17:05:51.532795+0000","last_became_peered":"2024-09-12T17:05:51.532795+0000","last_unstale":"2024-09-12T17:08:35.211005+0000","last_undegraded":"2024-09-12T17:08:35.211005+0000","last_fullsized":"2024-09-12T17:08:35.211005+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.655645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211301+0000","last_change":"2024-09-12T17:05:53.544503+0000","last_active":"2024-09-12T17:08:35.211301+0000","last_peered":"2024-09-12T17:08:35.211301+0000","last_clean":"2024-09-12T17:08:35.211301+0000","last_became_active":"2024-09-12T17:05:53.543495+0000","last_became_peered":"2024-09-12T17:05:53.543495+0000","last_unstale":"2024-09-12T17:08:35.211301+0000","last_undegraded":"2024-09-12T17:08:35.211301+0000","last_fullsized":"2024-09-12T17:08:35.211301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.721968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"103'15","reported_seq":200,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.759469+0000","last_change":"2024-09-12T17:05:55.567580+0000","last_active":"2024-09-12T17:08:36.759469+0000","last_peered":"2024-09-12T17:08:36.759469+0000","last_clean":"2024-09-12T17:08:36.759469+0000","last_became_active":"2024-09-12T17:05:55.566652+0000","last_became_peered":"2024-09-12T17:05:55.566652+0000","last_unstale":"2024-09-12T17:08:36.759469+0000","last_undegraded":"2024-09-12T17:08:36.759469+0000","last_fullsized":"2024-09-12T17:08:36.759469+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:28.904117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"68'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602357+0000","last_change":"2024-09-12T17:05:57.585098+0000","last_active":"2024-09-12T17:08:33.602357+0000","last_peered":"2024-09-12T17:08:33.602357+0000","last_clean":"2024-09-12T17:08:33.602357+0000","last_became_active":"2024-09-12T17:05:57.584326+0000","last_became_peered":"2024-09-12T17:05:57.584326+0000","last_unstale":"2024-09-12T17:08:33.602357+0000","last_undegraded":"2024-09-12T17:08:33.602357+0000","last_fullsized":"2024-09-12T17:08:33.602357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210656+0000","last_change":"2024-09-12T17:05:49.553294+0000","last_active":"2024-09-12T17:08:35.210656+0000","last_peered":"2024-09-12T17:08:35.210656+0000","last_clean":"2024-09-12T17:08:35.210656+0000","last_became_active":"2024-09-12T17:05:49.551726+0000","last_became_peered":"2024-09-12T17:05:49.551726+0000","last_unstale":"2024-09-12T17:08:35.210656+0000","last_undegraded":"2024-09-12T17:08:35.210656+0000","last_fullsized":"2024-09-12T17:08:35.210656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:50.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'8","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604429+0000","last_change":"2024-09-12T17:08:18.767913+0000","last_active":"2024-09-12T17:08:33.604429+0000","last_peered":"2024-09-12T17:08:33.604429+0000","last_clean":"2024-09-12T17:08:33.604429+0000","last_became_active":"2024-09-12T17:08:18.466136+0000","last_became_peered":"2024-09-12T17:08:18.466136+0000","last_unstale":"2024-09-12T17:08:33.604429+0000","last_undegraded":"2024-09-12T17:08:33.604429+0000","last_fullsized":"2024-09-12T17:08:33.604429+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:20.220833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.355006+0000","last_change":"2024-09-12T17:05:42.680975+0000","last_active":"2024-09-12T17:08:35.355006+0000","last_peered":"2024-09-12T17:08:35.355006+0000","last_clean":"2024-09-12T17:08:35.355006+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:08:35.355006+0000","last_undegraded":"2024-09-12T17:08:35.355006+0000","last_fullsized":"2024-09-12T17:08:35.355006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.660350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022223+0000","last_change":"2024-09-12T17:08:18.450093+0000","last_active":"2024-09-12T17:08:36.022223+0000","last_peered":"2024-09-12T17:08:36.022223+0000","last_clean":"2024-09-12T17:08:36.022223+0000","last_became_active":"2024-09-12T17:08:18.449746+0000","last_became_peered":"2024-09-12T17:08:18.449746+0000","last_unstale":"2024-09-12T17:08:36.022223+0000","last_undegraded":"2024-09-12T17:08:36.022223+0000","last_fullsized":"2024-09-12T17:08:36.022223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:58.736246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"84'38","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603887+0000","last_change":"2024-09-12T17:05:53.554751+0000","last_active":"2024-09-12T17:08:33.603887+0000","last_peered":"2024-09-12T17:08:33.603887+0000","last_clean":"2024-09-12T17:08:33.603887+0000","last_became_active":"2024-09-12T17:05:53.553914+0000","last_became_peered":"2024-09-12T17:05:53.553914+0000","last_unstale":"2024-09-12T17:08:33.603887+0000","last_undegraded":"2024-09-12T17:08:33.603887+0000","last_fullsized":"2024-09-12T17:08:33.603887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29607,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":65,"num_read_kb":81,"num_write":48,"num_write_kb":39,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022004+0000","last_change":"2024-09-12T17:08:21.458963+0000","last_active":"2024-09-12T17:08:36.022004+0000","last_peered":"2024-09-12T17:08:36.022004+0000","last_clean":"2024-09-12T17:08:36.022004+0000","last_became_active":"2024-09-12T17:08:21.458521+0000","last_became_peered":"2024-09-12T17:08:21.458521+0000","last_unstale":"2024-09-12T17:08:36.022004+0000","last_undegraded":"2024-09-12T17:08:36.022004+0000","last_fullsized":"2024-09-12T17:08:36.022004+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:56.903898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603355+0000","last_change":"2024-09-12T17:05:57.605829+0000","last_active":"2024-09-12T17:08:33.603355+0000","last_peered":"2024-09-12T17:08:33.603355+0000","last_clean":"2024-09-12T17:08:33.603355+0000","last_became_active":"2024-09-12T17:05:57.605041+0000","last_became_peered":"2024-09-12T17:05:57.605041+0000","last_unstale":"2024-09-12T17:08:33.603355+0000","last_undegraded":"2024-09-12T17:08:33.603355+0000","last_fullsized":"2024-09-12T17:08:33.603355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602885+0000","last_change":"2024-09-12T17:05:57.594498+0000","last_active":"2024-09-12T17:08:33.602885+0000","last_peered":"2024-09-12T17:08:33.602885+0000","last_clean":"2024-09-12T17:08:33.602885+0000","last_became_active":"2024-09-12T17:05:57.590196+0000","last_became_peered":"2024-09-12T17:05:57.590196+0000","last_unstale":"2024-09-12T17:08:33.602885+0000","last_undegraded":"2024-09-12T17:08:33.602885+0000","last_fullsized":"2024-09-12T17:08:33.602885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.543735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212141+0000","last_change":"2024-09-12T17:05:49.562121+0000","last_active":"2024-09-12T17:08:35.212141+0000","last_peered":"2024-09-12T17:08:35.212141+0000","last_clean":"2024-09-12T17:08:35.212141+0000","last_became_active":"2024-09-12T17:05:49.561429+0000","last_became_peered":"2024-09-12T17:05:49.561429+0000","last_unstale":"2024-09-12T17:08:35.212141+0000","last_undegraded":"2024-09-12T17:08:35.212141+0000","last_fullsized":"2024-09-12T17:08:35.212141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:47.663366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210950+0000","last_change":"2024-09-12T17:05:47.557270+0000","last_active":"2024-09-12T17:08:35.210950+0000","last_peered":"2024-09-12T17:08:35.210950+0000","last_clean":"2024-09-12T17:08:35.210950+0000","last_became_active":"2024-09-12T17:05:47.556417+0000","last_became_peered":"2024-09-12T17:05:47.556417+0000","last_unstale":"2024-09-12T17:08:35.210950+0000","last_undegraded":"2024-09-12T17:08:35.210950+0000","last_fullsized":"2024-09-12T17:08:35.210950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:00.210632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":32774,"num_write":27,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111337+0000","last_change":"2024-09-12T17:08:18.464941+0000","last_active":"2024-09-12T17:08:35.111337+0000","last_peered":"2024-09-12T17:08:35.111337+0000","last_clean":"2024-09-12T17:08:35.111337+0000","last_became_active":"2024-09-12T17:08:18.464091+0000","last_became_peered":"2024-09-12T17:08:18.464091+0000","last_unstale":"2024-09-12T17:08:35.111337+0000","last_undegraded":"2024-09-12T17:08:35.111337+0000","last_fullsized":"2024-09-12T17:08:35.111337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:15.952591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"84'16","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020522+0000","last_change":"2024-09-12T17:05:53.542230+0000","last_active":"2024-09-12T17:08:36.020522+0000","last_peered":"2024-09-12T17:08:36.020522+0000","last_clean":"2024-09-12T17:08:36.020522+0000","last_became_active":"2024-09-12T17:05:53.541653+0000","last_became_peered":"2024-09-12T17:05:53.541653+0000","last_unstale":"2024-09-12T17:08:36.020522+0000","last_undegraded":"2024-09-12T17:08:36.020522+0000","last_fullsized":"2024-09-12T17:08:36.020522+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022656+0000","last_change":"2024-09-12T17:05:55.556535+0000","last_active":"2024-09-12T17:08:36.022656+0000","last_peered":"2024-09-12T17:08:36.022656+0000","last_clean":"2024-09-12T17:08:36.022656+0000","last_became_active":"2024-09-12T17:05:55.555755+0000","last_became_peered":"2024-09-12T17:05:55.555755+0000","last_unstale":"2024-09-12T17:08:36.022656+0000","last_undegraded":"2024-09-12T17:08:36.022656+0000","last_fullsized":"2024-09-12T17:08:36.022656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.707384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"84'2","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025238+0000","last_change":"2024-09-12T17:05:57.593418+0000","last_active":"2024-09-12T17:08:36.025238+0000","last_peered":"2024-09-12T17:08:36.025238+0000","last_clean":"2024-09-12T17:08:36.025238+0000","last_became_active":"2024-09-12T17:05:57.592746+0000","last_became_peered":"2024-09-12T17:05:57.592746+0000","last_unstale":"2024-09-12T17:08:36.025238+0000","last_undegraded":"2024-09-12T17:08:36.025238+0000","last_fullsized":"2024-09-12T17:08:36.025238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:24.794382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"68'6","reported_seq":38,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113920+0000","last_change":"2024-09-12T17:08:21.616789+0000","last_active":"2024-09-12T17:08:35.113920+0000","last_peered":"2024-09-12T17:08:35.113920+0000","last_clean":"2024-09-12T17:08:35.113920+0000","last_became_active":"2024-09-12T17:08:21.466328+0000","last_became_peered":"2024-09-12T17:08:21.466328+0000","last_unstale":"2024-09-12T17:08:35.113920+0000","last_undegraded":"2024-09-12T17:08:35.113920+0000","last_fullsized":"2024-09-12T17:08:35.113920+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:16.524646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"84'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608043+0000","last_change":"2024-09-12T17:05:47.559497+0000","last_active":"2024-09-12T17:08:33.608043+0000","last_peered":"2024-09-12T17:08:33.608043+0000","last_clean":"2024-09-12T17:08:33.608043+0000","last_became_active":"2024-09-12T17:05:47.558641+0000","last_became_peered":"2024-09-12T17:05:47.558641+0000","last_unstale":"2024-09-12T17:08:33.608043+0000","last_undegraded":"2024-09-12T17:08:33.608043+0000","last_fullsized":"2024-09-12T17:08:33.608043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:00.096304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24585,"num_write":33,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022987+0000","last_change":"2024-09-12T17:05:51.539784+0000","last_active":"2024-09-12T17:08:36.022987+0000","last_peered":"2024-09-12T17:08:36.022987+0000","last_clean":"2024-09-12T17:08:36.022987+0000","last_became_active":"2024-09-12T17:05:51.539275+0000","last_became_peered":"2024-09-12T17:05:51.539275+0000","last_unstale":"2024-09-12T17:08:36.022987+0000","last_undegraded":"2024-09-12T17:08:36.022987+0000","last_fullsized":"2024-09-12T17:08:36.022987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"84'6","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600440+0000","last_change":"2024-09-12T17:05:53.544731+0000","last_active":"2024-09-12T17:08:33.600440+0000","last_peered":"2024-09-12T17:08:33.600440+0000","last_clean":"2024-09-12T17:08:33.600440+0000","last_became_active":"2024-09-12T17:05:53.544127+0000","last_became_peered":"2024-09-12T17:05:53.544127+0000","last_unstale":"2024-09-12T17:08:33.600440+0000","last_undegraded":"2024-09-12T17:08:33.600440+0000","last_fullsized":"2024-09-12T17:08:33.600440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:04.351698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604873+0000","last_change":"2024-09-12T17:05:55.571541+0000","last_active":"2024-09-12T17:08:33.604873+0000","last_peered":"2024-09-12T17:08:33.604873+0000","last_clean":"2024-09-12T17:08:33.604873+0000","last_became_active":"2024-09-12T17:05:55.570822+0000","last_became_peered":"2024-09-12T17:05:55.570822+0000","last_unstale":"2024-09-12T17:08:33.604873+0000","last_undegraded":"2024-09-12T17:08:33.604873+0000","last_fullsized":"2024-09-12T17:08:33.604873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'2","reported_seq":165,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602495+0000","last_change":"2024-09-12T17:08:18.704689+0000","last_active":"2024-09-12T17:08:33.602495+0000","last_peered":"2024-09-12T17:08:33.602495+0000","last_clean":"2024-09-12T17:08:33.602495+0000","last_became_active":"2024-09-12T17:08:18.450561+0000","last_became_peered":"2024-09-12T17:08:18.450561+0000","last_unstale":"2024-09-12T17:08:33.602495+0000","last_undegraded":"2024-09-12T17:08:33.602495+0000","last_fullsized":"2024-09-12T17:08:33.602495+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:43.088841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021066+0000","last_change":"2024-09-12T17:05:49.520508+0000","last_active":"2024-09-12T17:08:36.021066+0000","last_peered":"2024-09-12T17:08:36.021066+0000","last_clean":"2024-09-12T17:08:36.021066+0000","last_became_active":"2024-09-12T17:05:49.519721+0000","last_became_peered":"2024-09-12T17:05:49.519721+0000","last_unstale":"2024-09-12T17:08:36.021066+0000","last_undegraded":"2024-09-12T17:08:36.021066+0000","last_fullsized":"2024-09-12T17:08:36.021066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"84'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605499+0000","last_change":"2024-09-12T17:05:47.539549+0000","last_active":"2024-09-12T17:08:33.605499+0000","last_peered":"2024-09-12T17:08:33.605499+0000","last_clean":"2024-09-12T17:08:33.605499+0000","last_became_active":"2024-09-12T17:05:47.538581+0000","last_became_peered":"2024-09-12T17:05:47.538581+0000","last_unstale":"2024-09-12T17:08:33.605499+0000","last_undegraded":"2024-09-12T17:08:33.605499+0000","last_fullsized":"2024-09-12T17:08:33.605499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.448924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601093+0000","last_change":"2024-09-12T17:05:51.530541+0000","last_active":"2024-09-12T17:08:33.601093+0000","last_peered":"2024-09-12T17:08:33.601093+0000","last_clean":"2024-09-12T17:08:33.601093+0000","last_became_active":"2024-09-12T17:05:51.527515+0000","last_became_peered":"2024-09-12T17:05:51.527515+0000","last_unstale":"2024-09-12T17:08:33.601093+0000","last_undegraded":"2024-09-12T17:08:33.601093+0000","last_fullsized":"2024-09-12T17:08:33.601093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"84'16","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022754+0000","last_change":"2024-09-12T17:05:53.555017+0000","last_active":"2024-09-12T17:08:36.022754+0000","last_peered":"2024-09-12T17:08:36.022754+0000","last_clean":"2024-09-12T17:08:36.022754+0000","last_became_active":"2024-09-12T17:05:53.551154+0000","last_became_peered":"2024-09-12T17:05:53.551154+0000","last_unstale":"2024-09-12T17:08:36.022754+0000","last_undegraded":"2024-09-12T17:08:36.022754+0000","last_fullsized":"2024-09-12T17:08:36.022754+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:50.736153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5210,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353172+0000","last_change":"2024-09-12T17:05:55.570872+0000","last_active":"2024-09-12T17:08:35.353172+0000","last_peered":"2024-09-12T17:08:35.353172+0000","last_clean":"2024-09-12T17:08:35.353172+0000","last_became_active":"2024-09-12T17:05:55.570137+0000","last_became_peered":"2024-09-12T17:05:55.570137+0000","last_unstale":"2024-09-12T17:08:35.353172+0000","last_undegraded":"2024-09-12T17:08:35.353172+0000","last_fullsized":"2024-09-12T17:08:35.353172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.684868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602407+0000","last_change":"2024-09-12T17:05:57.597088+0000","last_active":"2024-09-12T17:08:33.602407+0000","last_peered":"2024-09-12T17:08:33.602407+0000","last_clean":"2024-09-12T17:08:33.602407+0000","last_became_active":"2024-09-12T17:05:57.596377+0000","last_became_peered":"2024-09-12T17:05:57.596377+0000","last_unstale":"2024-09-12T17:08:33.602407+0000","last_undegraded":"2024-09-12T17:08:33.602407+0000","last_fullsized":"2024-09-12T17:08:33.602407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"68'2","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021754+0000","last_change":"2024-09-12T17:08:18.478612+0000","last_active":"2024-09-12T17:08:36.021754+0000","last_peered":"2024-09-12T17:08:36.021754+0000","last_clean":"2024-09-12T17:08:36.021754+0000","last_became_active":"2024-09-12T17:08:18.449338+0000","last_became_peered":"2024-09-12T17:08:18.449338+0000","last_unstale":"2024-09-12T17:08:36.021754+0000","last_undegraded":"2024-09-12T17:08:36.021754+0000","last_fullsized":"2024-09-12T17:08:36.021754+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:15.864351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"73'7","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603421+0000","last_change":"2024-09-12T17:05:47.526555+0000","last_active":"2024-09-12T17:08:33.603421+0000","last_peered":"2024-09-12T17:08:33.603421+0000","last_clean":"2024-09-12T17:08:33.603421+0000","last_became_active":"2024-09-12T17:05:47.525874+0000","last_became_peered":"2024-09-12T17:05:47.525874+0000","last_unstale":"2024-09-12T17:08:33.603421+0000","last_undegraded":"2024-09-12T17:08:33.603421+0000","last_fullsized":"2024-09-12T17:08:33.603421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":18435,"num_write":15,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353031+0000","last_change":"2024-09-12T17:05:51.540509+0000","last_active":"2024-09-12T17:08:35.353031+0000","last_peered":"2024-09-12T17:08:35.353031+0000","last_clean":"2024-09-12T17:08:35.353031+0000","last_became_active":"2024-09-12T17:05:51.539607+0000","last_became_peered":"2024-09-12T17:05:51.539607+0000","last_unstale":"2024-09-12T17:08:35.353031+0000","last_undegraded":"2024-09-12T17:08:35.353031+0000","last_fullsized":"2024-09-12T17:08:35.353031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:02.652624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"84'13","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603961+0000","last_change":"2024-09-12T17:05:53.549324+0000","last_active":"2024-09-12T17:08:33.603961+0000","last_peered":"2024-09-12T17:08:33.603961+0000","last_clean":"2024-09-12T17:08:33.603961+0000","last_became_active":"2024-09-12T17:05:53.548561+0000","last_became_peered":"2024-09-12T17:05:53.548561+0000","last_unstale":"2024-09-12T17:08:33.603961+0000","last_undegraded":"2024-09-12T17:08:33.603961+0000","last_fullsized":"2024-09-12T17:08:33.603961+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:47.932776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601440+0000","last_change":"2024-09-12T17:05:55.561467+0000","last_active":"2024-09-12T17:08:33.601440+0000","last_peered":"2024-09-12T17:08:33.601440+0000","last_clean":"2024-09-12T17:08:33.601440+0000","last_became_active":"2024-09-12T17:05:55.560708+0000","last_became_peered":"2024-09-12T17:05:55.560708+0000","last_unstale":"2024-09-12T17:08:33.601440+0000","last_undegraded":"2024-09-12T17:08:33.601440+0000","last_fullsized":"2024-09-12T17:08:33.601440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"84'46","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354839+0000","last_change":"2024-09-12T17:05:49.547097+0000","last_active":"2024-09-12T17:08:35.354839+0000","last_peered":"2024-09-12T17:08:35.354839+0000","last_clean":"2024-09-12T17:08:35.354839+0000","last_became_active":"2024-09-12T17:05:49.546232+0000","last_became_peered":"2024-09-12T17:05:49.546232+0000","last_unstale":"2024-09-12T17:08:35.354839+0000","last_undegraded":"2024-09-12T17:08:35.354839+0000","last_fullsized":"2024-09-12T17:08:35.354839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'9","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019761+0000","last_change":"2024-09-12T17:05:47.521779+0000","last_active":"2024-09-12T17:08:36.019761+0000","last_peered":"2024-09-12T17:08:36.019761+0000","last_clean":"2024-09-12T17:08:36.019761+0000","last_became_active":"2024-09-12T17:05:47.521097+0000","last_became_peered":"2024-09-12T17:05:47.521097+0000","last_unstale":"2024-09-12T17:08:36.019761+0000","last_undegraded":"2024-09-12T17:08:36.019761+0000","last_fullsized":"2024-09-12T17:08:36.019761+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:37.072896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":24579,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604192+0000","last_change":"2024-09-12T17:05:51.525803+0000","last_active":"2024-09-12T17:08:33.604192+0000","last_peered":"2024-09-12T17:08:33.604192+0000","last_clean":"2024-09-12T17:08:33.604192+0000","last_became_active":"2024-09-12T17:05:51.525457+0000","last_became_peered":"2024-09-12T17:05:51.525457+0000","last_unstale":"2024-09-12T17:08:33.604192+0000","last_undegraded":"2024-09-12T17:08:33.604192+0000","last_fullsized":"2024-09-12T17:08:33.604192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"84'27","reported_seq":51,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111283+0000","last_change":"2024-09-12T17:08:19.023629+0000","last_active":"2024-09-12T17:08:35.111283+0000","last_peered":"2024-09-12T17:08:35.111283+0000","last_clean":"2024-09-12T17:08:35.111283+0000","last_became_active":"2024-09-12T17:08:18.463961+0000","last_became_peered":"2024-09-12T17:08:18.463961+0000","last_unstale":"2024-09-12T17:08:35.111283+0000","last_undegraded":"2024-09-12T17:08:35.111283+0000","last_fullsized":"2024-09-12T17:08:35.111283+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:09.409031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24405,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":46,"num_read_kb":64,"num_write":36,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":16653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603360+0000","last_change":"2024-09-12T17:05:55.563312+0000","last_active":"2024-09-12T17:08:33.603360+0000","last_peered":"2024-09-12T17:08:33.603360+0000","last_clean":"2024-09-12T17:08:33.603360+0000","last_became_active":"2024-09-12T17:05:55.562405+0000","last_became_peered":"2024-09-12T17:05:55.562405+0000","last_unstale":"2024-09-12T17:08:33.603360+0000","last_undegraded":"2024-09-12T17:08:33.603360+0000","last_fullsized":"2024-09-12T17:08:33.603360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022413+0000","last_change":"2024-09-12T17:05:58.121110+0000","last_active":"2024-09-12T17:08:36.022413+0000","last_peered":"2024-09-12T17:08:36.022413+0000","last_clean":"2024-09-12T17:08:36.022413+0000","last_became_active":"2024-09-12T17:05:58.120367+0000","last_became_peered":"2024-09-12T17:05:58.120367+0000","last_unstale":"2024-09-12T17:08:36.022413+0000","last_undegraded":"2024-09-12T17:08:36.022413+0000","last_fullsized":"2024-09-12T17:08:36.022413+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604265+0000","last_change":"2024-09-12T17:05:49.532377+0000","last_active":"2024-09-12T17:08:33.604265+0000","last_peered":"2024-09-12T17:08:33.604265+0000","last_clean":"2024-09-12T17:08:33.604265+0000","last_became_active":"2024-09-12T17:05:49.531975+0000","last_became_peered":"2024-09-12T17:05:49.531975+0000","last_unstale":"2024-09-12T17:08:33.604265+0000","last_undegraded":"2024-09-12T17:08:33.604265+0000","last_fullsized":"2024-09-12T17:08:33.604265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"84'13","reported_seq":59,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113983+0000","last_change":"2024-09-12T17:08:19.003420+0000","last_active":"2024-09-12T17:08:35.113983+0000","last_peered":"2024-09-12T17:08:35.113983+0000","last_clean":"2024-09-12T17:08:35.113983+0000","last_became_active":"2024-09-12T17:08:18.457074+0000","last_became_peered":"2024-09-12T17:08:18.457074+0000","last_unstale":"2024-09-12T17:08:35.113983+0000","last_undegraded":"2024-09-12T17:08:35.113983+0000","last_fullsized":"2024-09-12T17:08:35.113983+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:07.545826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":29,"num_read_kb":36876,"num_write":45,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354606+0000","last_change":"2024-09-12T17:05:51.546117+0000","last_active":"2024-09-12T17:08:35.354606+0000","last_peered":"2024-09-12T17:08:35.354606+0000","last_clean":"2024-09-12T17:08:35.354606+0000","last_became_active":"2024-09-12T17:05:51.545154+0000","last_became_peered":"2024-09-12T17:05:51.545154+0000","last_unstale":"2024-09-12T17:08:35.354606+0000","last_undegraded":"2024-09-12T17:08:35.354606+0000","last_fullsized":"2024-09-12T17:08:35.354606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:49.670591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"83'19","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603894+0000","last_change":"2024-09-12T17:05:53.558834+0000","last_active":"2024-09-12T17:08:33.603894+0000","last_peered":"2024-09-12T17:08:33.603894+0000","last_clean":"2024-09-12T17:08:33.603894+0000","last_became_active":"2024-09-12T17:05:53.558086+0000","last_became_peered":"2024-09-12T17:05:53.558086+0000","last_unstale":"2024-09-12T17:08:33.603894+0000","last_undegraded":"2024-09-12T17:08:33.603894+0000","last_fullsized":"2024-09-12T17:08:33.603894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:43.690058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10255,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114479+0000","last_change":"2024-09-12T17:08:21.466904+0000","last_active":"2024-09-12T17:08:35.114479+0000","last_peered":"2024-09-12T17:08:35.114479+0000","last_clean":"2024-09-12T17:08:35.114479+0000","last_became_active":"2024-09-12T17:08:21.466295+0000","last_became_peered":"2024-09-12T17:08:21.466295+0000","last_unstale":"2024-09-12T17:08:35.114479+0000","last_undegraded":"2024-09-12T17:08:35.114479+0000","last_fullsized":"2024-09-12T17:08:35.114479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:22.041235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'2","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352817+0000","last_change":"2024-09-12T17:05:57.597468+0000","last_active":"2024-09-12T17:08:35.352817+0000","last_peered":"2024-09-12T17:08:35.352817+0000","last_clean":"2024-09-12T17:08:35.352817+0000","last_became_active":"2024-09-12T17:05:57.596651+0000","last_became_peered":"2024-09-12T17:05:57.596651+0000","last_unstale":"2024-09-12T17:08:35.352817+0000","last_undegraded":"2024-09-12T17:08:35.352817+0000","last_fullsized":"2024-09-12T17:08:35.352817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.466145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024382+0000","last_change":"2024-09-12T17:08:18.465892+0000","last_active":"2024-09-12T17:08:36.024382+0000","last_peered":"2024-09-12T17:08:36.024382+0000","last_clean":"2024-09-12T17:08:36.024382+0000","last_became_active":"2024-09-12T17:08:18.465478+0000","last_became_peered":"2024-09-12T17:08:18.465478+0000","last_unstale":"2024-09-12T17:08:36.024382+0000","last_undegraded":"2024-09-12T17:08:36.024382+0000","last_fullsized":"2024-09-12T17:08:36.024382+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:00.793079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"83'8","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212556+0000","last_change":"2024-09-12T17:08:18.626808+0000","last_active":"2024-09-12T17:08:35.212556+0000","last_peered":"2024-09-12T17:08:35.212556+0000","last_clean":"2024-09-12T17:08:35.212556+0000","last_became_active":"2024-09-12T17:08:18.447694+0000","last_became_peered":"2024-09-12T17:08:18.447694+0000","last_unstale":"2024-09-12T17:08:35.212556+0000","last_undegraded":"2024-09-12T17:08:35.212556+0000","last_fullsized":"2024-09-12T17:08:35.212556+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:09.465286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28675,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212636+0000","last_change":"2024-09-12T17:05:51.539916+0000","last_active":"2024-09-12T17:08:35.212636+0000","last_peered":"2024-09-12T17:08:35.212636+0000","last_clean":"2024-09-12T17:08:35.212636+0000","last_became_active":"2024-09-12T17:05:51.539054+0000","last_became_peered":"2024-09-12T17:05:51.539054+0000","last_unstale":"2024-09-12T17:08:35.212636+0000","last_undegraded":"2024-09-12T17:08:35.212636+0000","last_fullsized":"2024-09-12T17:08:35.212636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:11.640578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"84'16","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025974+0000","last_change":"2024-09-12T17:05:53.557081+0000","last_active":"2024-09-12T17:08:36.025974+0000","last_peered":"2024-09-12T17:08:36.025974+0000","last_clean":"2024-09-12T17:08:36.025974+0000","last_became_active":"2024-09-12T17:05:53.556357+0000","last_became_peered":"2024-09-12T17:05:53.556357+0000","last_unstale":"2024-09-12T17:08:36.025974+0000","last_undegraded":"2024-09-12T17:08:36.025974+0000","last_fullsized":"2024-09-12T17:08:36.025974+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:10.984649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115218+0000","last_change":"2024-09-12T17:08:21.461633+0000","last_active":"2024-09-12T17:08:35.115218+0000","last_peered":"2024-09-12T17:08:35.115218+0000","last_clean":"2024-09-12T17:08:35.115218+0000","last_became_active":"2024-09-12T17:08:21.460894+0000","last_became_peered":"2024-09-12T17:08:21.460894+0000","last_unstale":"2024-09-12T17:08:35.115218+0000","last_undegraded":"2024-09-12T17:08:35.115218+0000","last_fullsized":"2024-09-12T17:08:35.115218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:18.857770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601884+0000","last_change":"2024-09-12T17:05:57.596779+0000","last_active":"2024-09-12T17:08:33.601884+0000","last_peered":"2024-09-12T17:08:33.601884+0000","last_clean":"2024-09-12T17:08:33.601884+0000","last_became_active":"2024-09-12T17:05:57.596005+0000","last_became_peered":"2024-09-12T17:05:57.596005+0000","last_unstale":"2024-09-12T17:08:33.601884+0000","last_undegraded":"2024-09-12T17:08:33.601884+0000","last_fullsized":"2024-09-12T17:08:33.601884+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024995+0000","last_change":"2024-09-12T17:08:18.445744+0000","last_active":"2024-09-12T17:08:36.024995+0000","last_peered":"2024-09-12T17:08:36.024995+0000","last_clean":"2024-09-12T17:08:36.024995+0000","last_became_active":"2024-09-12T17:08:18.445415+0000","last_became_peered":"2024-09-12T17:08:18.445415+0000","last_unstale":"2024-09-12T17:08:36.024995+0000","last_undegraded":"2024-09-12T17:08:36.024995+0000","last_fullsized":"2024-09-12T17:08:36.024995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:17.325226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"84'14","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601797+0000","last_change":"2024-09-12T17:05:47.546051+0000","last_active":"2024-09-12T17:08:33.601797+0000","last_peered":"2024-09-12T17:08:33.601797+0000","last_clean":"2024-09-12T17:08:33.601797+0000","last_became_active":"2024-09-12T17:05:47.545466+0000","last_became_peered":"2024-09-12T17:05:47.545466+0000","last_unstale":"2024-09-12T17:08:33.601797+0000","last_undegraded":"2024-09-12T17:08:33.601797+0000","last_fullsized":"2024-09-12T17:08:33.601797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":40966,"num_write":30,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114773+0000","last_change":"2024-09-12T17:08:18.457478+0000","last_active":"2024-09-12T17:08:35.114773+0000","last_peered":"2024-09-12T17:08:35.114773+0000","last_clean":"2024-09-12T17:08:35.114773+0000","last_became_active":"2024-09-12T17:08:18.457099+0000","last_became_peered":"2024-09-12T17:08:18.457099+0000","last_unstale":"2024-09-12T17:08:35.114773+0000","last_undegraded":"2024-09-12T17:08:35.114773+0000","last_fullsized":"2024-09-12T17:08:35.114773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:30.371124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"86'12","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212137+0000","last_change":"2024-09-12T17:05:53.561278+0000","last_active":"2024-09-12T17:08:35.212137+0000","last_peered":"2024-09-12T17:08:35.212137+0000","last_clean":"2024-09-12T17:08:35.212137+0000","last_became_active":"2024-09-12T17:05:53.559688+0000","last_became_peered":"2024-09-12T17:05:53.559688+0000","last_unstale":"2024-09-12T17:08:35.212137+0000","last_undegraded":"2024-09-12T17:08:35.212137+0000","last_fullsized":"2024-09-12T17:08:35.212137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:37.392549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":16,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"103'15","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.760513+0000","last_change":"2024-09-12T17:05:55.576227+0000","last_active":"2024-09-12T17:08:36.760513+0000","last_peered":"2024-09-12T17:08:36.760513+0000","last_clean":"2024-09-12T17:08:36.760513+0000","last_became_active":"2024-09-12T17:05:55.571966+0000","last_became_peered":"2024-09-12T17:05:55.571966+0000","last_unstale":"2024-09-12T17:08:36.760513+0000","last_undegraded":"2024-09-12T17:08:36.760513+0000","last_fullsized":"2024-09-12T17:08:36.760513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:24.680106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601043+0000","last_change":"2024-09-12T17:05:57.595153+0000","last_active":"2024-09-12T17:08:33.601043+0000","last_peered":"2024-09-12T17:08:33.601043+0000","last_clean":"2024-09-12T17:08:33.601043+0000","last_became_active":"2024-09-12T17:05:57.594396+0000","last_became_peered":"2024-09-12T17:05:57.594396+0000","last_unstale":"2024-09-12T17:08:33.601043+0000","last_undegraded":"2024-09-12T17:08:33.601043+0000","last_fullsized":"2024-09-12T17:08:33.601043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:27.040243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211051+0000","last_change":"2024-09-12T17:05:49.543269+0000","last_active":"2024-09-12T17:08:35.211051+0000","last_peered":"2024-09-12T17:08:35.211051+0000","last_clean":"2024-09-12T17:08:35.211051+0000","last_became_active":"2024-09-12T17:05:49.542414+0000","last_became_peered":"2024-09-12T17:05:49.542414+0000","last_unstale":"2024-09-12T17:08:35.211051+0000","last_undegraded":"2024-09-12T17:08:35.211051+0000","last_fullsized":"2024-09-12T17:08:35.211051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:00.645399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"84'14","reported_seq":154,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020515+0000","last_change":"2024-09-12T17:06:27.785226+0000","last_active":"2024-09-12T17:08:36.020515+0000","last_peered":"2024-09-12T17:08:36.020515+0000","last_clean":"2024-09-12T17:08:36.020515+0000","last_became_active":"2024-09-12T17:06:27.784897+0000","last_became_peered":"2024-09-12T17:06:27.784897+0000","last_unstale":"2024-09-12T17:08:36.020515+0000","last_undegraded":"2024-09-12T17:08:36.020515+0000","last_fullsized":"2024-09-12T17:08:36.020515+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:25.368283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":49158,"num_write":30,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604574+0000","last_change":"2024-09-12T17:05:51.528322+0000","last_active":"2024-09-12T17:08:33.604574+0000","last_peered":"2024-09-12T17:08:33.604574+0000","last_clean":"2024-09-12T17:08:33.604574+0000","last_became_active":"2024-09-12T17:05:51.527501+0000","last_became_peered":"2024-09-12T17:05:51.527501+0000","last_unstale":"2024-09-12T17:08:33.604574+0000","last_undegraded":"2024-09-12T17:08:33.604574+0000","last_fullsized":"2024-09-12T17:08:33.604574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"84'20","reported_seq":228,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602423+0000","last_change":"2024-09-12T17:08:18.786022+0000","last_active":"2024-09-12T17:08:33.602423+0000","last_peered":"2024-09-12T17:08:33.602423+0000","last_clean":"2024-09-12T17:08:33.602423+0000","last_became_active":"2024-09-12T17:08:18.474969+0000","last_became_peered":"2024-09-12T17:08:18.474969+0000","last_unstale":"2024-09-12T17:08:33.602423+0000","last_undegraded":"2024-09-12T17:08:33.602423+0000","last_fullsized":"2024-09-12T17:08:33.602423+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1889,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.599911+0000","last_change":"2024-09-12T17:05:55.567202+0000","last_active":"2024-09-12T17:08:33.599911+0000","last_peered":"2024-09-12T17:08:33.599911+0000","last_clean":"2024-09-12T17:08:33.599911+0000","last_became_active":"2024-09-12T17:05:55.564710+0000","last_became_peered":"2024-09-12T17:05:55.564710+0000","last_unstale":"2024-09-12T17:08:33.599911+0000","last_undegraded":"2024-09-12T17:08:33.599911+0000","last_fullsized":"2024-09-12T17:08:33.599911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608195+0000","last_change":"2024-09-12T17:05:57.604052+0000","last_active":"2024-09-12T17:08:33.608195+0000","last_peered":"2024-09-12T17:08:33.608195+0000","last_clean":"2024-09-12T17:08:33.608195+0000","last_became_active":"2024-09-12T17:05:57.603285+0000","last_became_peered":"2024-09-12T17:05:57.603285+0000","last_unstale":"2024-09-12T17:08:33.608195+0000","last_undegraded":"2024-09-12T17:08:33.608195+0000","last_fullsized":"2024-09-12T17:08:33.608195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:31.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'6","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211495+0000","last_change":"2024-09-12T17:05:49.548224+0000","last_active":"2024-09-12T17:08:35.211495+0000","last_peered":"2024-09-12T17:08:35.211495+0000","last_clean":"2024-09-12T17:08:35.211495+0000","last_became_active":"2024-09-12T17:05:49.541007+0000","last_became_peered":"2024-09-12T17:05:49.541007+0000","last_unstale":"2024-09-12T17:08:35.211495+0000","last_undegraded":"2024-09-12T17:08:35.211495+0000","last_fullsized":"2024-09-12T17:08:35.211495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:59.768842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"75'4","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606348+0000","last_change":"2024-09-12T17:05:47.543197+0000","last_active":"2024-09-12T17:08:33.606348+0000","last_peered":"2024-09-12T17:08:33.606348+0000","last_clean":"2024-09-12T17:08:33.606348+0000","last_became_active":"2024-09-12T17:05:47.542345+0000","last_became_peered":"2024-09-12T17:05:47.542345+0000","last_unstale":"2024-09-12T17:08:33.606348+0000","last_undegraded":"2024-09-12T17:08:33.606348+0000","last_fullsized":"2024-09-12T17:08:33.606348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.858635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":14336,"num_write":4,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602461+0000","last_change":"2024-09-12T17:05:51.556256+0000","last_active":"2024-09-12T17:08:33.602461+0000","last_peered":"2024-09-12T17:08:33.602461+0000","last_clean":"2024-09-12T17:08:33.602461+0000","last_became_active":"2024-09-12T17:05:51.554248+0000","last_became_peered":"2024-09-12T17:05:51.554248+0000","last_unstale":"2024-09-12T17:08:33.602461+0000","last_undegraded":"2024-09-12T17:08:33.602461+0000","last_fullsized":"2024-09-12T17:08:33.602461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"84'13","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.599922+0000","last_change":"2024-09-12T17:08:18.486637+0000","last_active":"2024-09-12T17:08:33.599922+0000","last_peered":"2024-09-12T17:08:33.599922+0000","last_clean":"2024-09-12T17:08:33.599922+0000","last_became_active":"2024-09-12T17:08:18.450594+0000","last_became_peered":"2024-09-12T17:08:18.450594+0000","last_unstale":"2024-09-12T17:08:33.599922+0000","last_undegraded":"2024-09-12T17:08:33.599922+0000","last_fullsized":"2024-09-12T17:08:33.599922+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352748+0000","last_change":"2024-09-12T17:05:55.567605+0000","last_active":"2024-09-12T17:08:35.352748+0000","last_peered":"2024-09-12T17:08:35.352748+0000","last_clean":"2024-09-12T17:08:35.352748+0000","last_became_active":"2024-09-12T17:05:55.566774+0000","last_became_peered":"2024-09-12T17:05:55.566774+0000","last_unstale":"2024-09-12T17:08:35.352748+0000","last_undegraded":"2024-09-12T17:08:35.352748+0000","last_fullsized":"2024-09-12T17:08:35.352748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:25.935376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025423+0000","last_change":"2024-09-12T17:05:58.121216+0000","last_active":"2024-09-12T17:08:36.025423+0000","last_peered":"2024-09-12T17:08:36.025423+0000","last_clean":"2024-09-12T17:08:36.025423+0000","last_became_active":"2024-09-12T17:05:58.120364+0000","last_became_peered":"2024-09-12T17:05:58.120364+0000","last_unstale":"2024-09-12T17:08:36.025423+0000","last_undegraded":"2024-09-12T17:08:36.025423+0000","last_fullsized":"2024-09-12T17:08:36.025423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021393+0000","last_change":"2024-09-12T17:05:49.549956+0000","last_active":"2024-09-12T17:08:36.021393+0000","last_peered":"2024-09-12T17:08:36.021393+0000","last_clean":"2024-09-12T17:08:36.021393+0000","last_became_active":"2024-09-12T17:05:49.549481+0000","last_became_peered":"2024-09-12T17:05:49.549481+0000","last_unstale":"2024-09-12T17:08:36.021393+0000","last_undegraded":"2024-09-12T17:08:36.021393+0000","last_fullsized":"2024-09-12T17:08:36.021393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'11","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019844+0000","last_change":"2024-09-12T17:05:47.510898+0000","last_active":"2024-09-12T17:08:36.019844+0000","last_peered":"2024-09-12T17:08:36.019844+0000","last_clean":"2024-09-12T17:08:36.019844+0000","last_became_active":"2024-09-12T17:05:47.510462+0000","last_became_peered":"2024-09-12T17:05:47.510462+0000","last_unstale":"2024-09-12T17:08:36.019844+0000","last_undegraded":"2024-09-12T17:08:36.019844+0000","last_fullsized":"2024-09-12T17:08:36.019844+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":30726,"num_write":27,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210191+0000","last_change":"2024-09-12T17:05:51.541454+0000","last_active":"2024-09-12T17:08:35.210191+0000","last_peered":"2024-09-12T17:08:35.210191+0000","last_clean":"2024-09-12T17:08:35.210191+0000","last_became_active":"2024-09-12T17:05:51.539938+0000","last_became_peered":"2024-09-12T17:05:51.539938+0000","last_unstale":"2024-09-12T17:08:35.210191+0000","last_undegraded":"2024-09-12T17:08:35.210191+0000","last_fullsized":"2024-09-12T17:08:35.210191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:18.328350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"84'11","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023729+0000","last_change":"2024-09-12T17:05:53.555764+0000","last_active":"2024-09-12T17:08:36.023729+0000","last_peered":"2024-09-12T17:08:36.023729+0000","last_clean":"2024-09-12T17:08:36.023729+0000","last_became_active":"2024-09-12T17:05:53.552095+0000","last_became_peered":"2024-09-12T17:05:53.552095+0000","last_unstale":"2024-09-12T17:08:36.023729+0000","last_undegraded":"2024-09-12T17:08:36.023729+0000","last_fullsized":"2024-09-12T17:08:36.023729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":24,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210403+0000","last_change":"2024-09-12T17:05:55.571520+0000","last_active":"2024-09-12T17:08:35.210403+0000","last_peered":"2024-09-12T17:08:35.210403+0000","last_clean":"2024-09-12T17:08:35.210403+0000","last_became_active":"2024-09-12T17:05:55.570863+0000","last_became_peered":"2024-09-12T17:05:55.570863+0000","last_unstale":"2024-09-12T17:08:35.210403+0000","last_undegraded":"2024-09-12T17:08:35.210403+0000","last_fullsized":"2024-09-12T17:08:35.210403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607147+0000","last_change":"2024-09-12T17:08:21.467058+0000","last_active":"2024-09-12T17:08:33.607147+0000","last_peered":"2024-09-12T17:08:33.607147+0000","last_clean":"2024-09-12T17:08:33.607147+0000","last_became_active":"2024-09-12T17:08:21.466218+0000","last_became_peered":"2024-09-12T17:08:21.466218+0000","last_unstale":"2024-09-12T17:08:33.607147+0000","last_undegraded":"2024-09-12T17:08:33.607147+0000","last_fullsized":"2024-09-12T17:08:33.607147+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.336998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"84'38","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210705+0000","last_change":"2024-09-12T17:05:49.561555+0000","last_active":"2024-09-12T17:08:35.210705+0000","last_peered":"2024-09-12T17:08:35.210705+0000","last_clean":"2024-09-12T17:08:35.210705+0000","last_became_active":"2024-09-12T17:05:49.560875+0000","last_became_peered":"2024-09-12T17:05:49.560875+0000","last_unstale":"2024-09-12T17:08:35.210705+0000","last_undegraded":"2024-09-12T17:08:35.210705+0000","last_fullsized":"2024-09-12T17:08:35.210705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.493944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"83'14","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603340+0000","last_change":"2024-09-12T17:05:47.528128+0000","last_active":"2024-09-12T17:08:33.603340+0000","last_peered":"2024-09-12T17:08:33.603340+0000","last_clean":"2024-09-12T17:08:33.603340+0000","last_became_active":"2024-09-12T17:05:47.527364+0000","last_became_peered":"2024-09-12T17:05:47.527364+0000","last_unstale":"2024-09-12T17:08:33.603340+0000","last_undegraded":"2024-09-12T17:08:33.603340+0000","last_fullsized":"2024-09-12T17:08:33.603340+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45062,"num_write":30,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":43,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111426+0000","last_change":"2024-09-12T17:08:19.007426+0000","last_active":"2024-09-12T17:08:35.111426+0000","last_peered":"2024-09-12T17:08:35.111426+0000","last_clean":"2024-09-12T17:08:35.111426+0000","last_became_active":"2024-09-12T17:08:18.463879+0000","last_became_peered":"2024-09-12T17:08:18.463879+0000","last_unstale":"2024-09-12T17:08:35.111426+0000","last_undegraded":"2024-09-12T17:08:35.111426+0000","last_fullsized":"2024-09-12T17:08:35.111426+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:10.396675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"84'16","reported_seq":179,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210474+0000","last_change":"2024-09-12T17:05:53.548391+0000","last_active":"2024-09-12T17:08:35.210474+0000","last_peered":"2024-09-12T17:08:35.210474+0000","last_clean":"2024-09-12T17:08:35.210474+0000","last_became_active":"2024-09-12T17:05:53.547202+0000","last_became_peered":"2024-09-12T17:05:53.547202+0000","last_unstale":"2024-09-12T17:08:35.210474+0000","last_undegraded":"2024-09-12T17:08:35.210474+0000","last_fullsized":"2024-09-12T17:08:35.210474+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:00.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":33,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601272+0000","last_change":"2024-09-12T17:05:55.566243+0000","last_active":"2024-09-12T17:08:33.601272+0000","last_peered":"2024-09-12T17:08:33.601272+0000","last_clean":"2024-09-12T17:08:33.601272+0000","last_became_active":"2024-09-12T17:05:55.565403+0000","last_became_peered":"2024-09-12T17:05:55.565403+0000","last_unstale":"2024-09-12T17:08:33.601272+0000","last_undegraded":"2024-09-12T17:08:33.601272+0000","last_fullsized":"2024-09-12T17:08:33.601272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212872+0000","last_change":"2024-09-12T17:05:57.589526+0000","last_active":"2024-09-12T17:08:35.212872+0000","last_peered":"2024-09-12T17:08:35.212872+0000","last_clean":"2024-09-12T17:08:35.212872+0000","last_became_active":"2024-09-12T17:05:57.588626+0000","last_became_peered":"2024-09-12T17:05:57.588626+0000","last_unstale":"2024-09-12T17:08:35.212872+0000","last_undegraded":"2024-09-12T17:08:35.212872+0000","last_fullsized":"2024-09-12T17:08:35.212872+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.472663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114540+0000","last_change":"2024-09-12T17:08:21.473957+0000","last_active":"2024-09-12T17:08:35.114540+0000","last_peered":"2024-09-12T17:08:35.114540+0000","last_clean":"2024-09-12T17:08:35.114540+0000","last_became_active":"2024-09-12T17:08:21.473677+0000","last_became_peered":"2024-09-12T17:08:21.473677+0000","last_unstale":"2024-09-12T17:08:35.114540+0000","last_undegraded":"2024-09-12T17:08:35.114540+0000","last_fullsized":"2024-09-12T17:08:35.114540+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:04.662160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"84'11","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352794+0000","last_change":"2024-09-12T17:05:47.532523+0000","last_active":"2024-09-12T17:08:35.352794+0000","last_peered":"2024-09-12T17:08:35.352794+0000","last_clean":"2024-09-12T17:08:35.352794+0000","last_became_active":"2024-09-12T17:05:47.531750+0000","last_became_peered":"2024-09-12T17:05:47.531750+0000","last_unstale":"2024-09-12T17:08:35.352794+0000","last_undegraded":"2024-09-12T17:08:35.352794+0000","last_fullsized":"2024-09-12T17:08:35.352794+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:03.075435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36867,"num_write":19,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115367+0000","last_change":"2024-09-12T17:08:21.463425+0000","last_active":"2024-09-12T17:08:35.115367+0000","last_peered":"2024-09-12T17:08:35.115367+0000","last_clean":"2024-09-12T17:08:35.115367+0000","last_became_active":"2024-09-12T17:08:21.462942+0000","last_became_peered":"2024-09-12T17:08:21.462942+0000","last_unstale":"2024-09-12T17:08:35.115367+0000","last_undegraded":"2024-09-12T17:08:35.115367+0000","last_fullsized":"2024-09-12T17:08:35.115367+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:35.256332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"84'10","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019070+0000","last_change":"2024-09-12T17:05:47.526020+0000","last_active":"2024-09-12T17:08:36.019070+0000","last_peered":"2024-09-12T17:08:36.019070+0000","last_clean":"2024-09-12T17:08:36.019070+0000","last_became_active":"2024-09-12T17:05:47.525481+0000","last_became_peered":"2024-09-12T17:05:47.525481+0000","last_unstale":"2024-09-12T17:08:36.019070+0000","last_undegraded":"2024-09-12T17:08:36.019070+0000","last_fullsized":"2024-09-12T17:08:36.019070+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:05.949135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":34819,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"84'46","reported_seq":211,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604578+0000","last_change":"2024-09-12T17:05:49.546848+0000","last_active":"2024-09-12T17:08:33.604578+0000","last_peered":"2024-09-12T17:08:33.604578+0000","last_clean":"2024-09-12T17:08:33.604578+0000","last_became_active":"2024-09-12T17:05:49.545382+0000","last_became_peered":"2024-09-12T17:05:49.545382+0000","last_unstale":"2024-09-12T17:08:33.604578+0000","last_undegraded":"2024-09-12T17:08:33.604578+0000","last_fullsized":"2024-09-12T17:08:33.604578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:42.832972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"84'10","reported_seq":99,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021810+0000","last_change":"2024-09-12T17:07:28.249892+0000","last_active":"2024-09-12T17:08:36.021810+0000","last_peered":"2024-09-12T17:08:36.021810+0000","last_clean":"2024-09-12T17:08:36.021810+0000","last_became_active":"2024-09-12T17:07:28.191632+0000","last_became_peered":"2024-09-12T17:07:28.191632+0000","last_unstale":"2024-09-12T17:08:36.021810+0000","last_undegraded":"2024-09-12T17:08:36.021810+0000","last_fullsized":"2024-09-12T17:08:36.021810+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.324862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":15,"num_read_kb":16390,"num_write":26,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114360+0000","last_change":"2024-09-12T17:08:21.460639+0000","last_active":"2024-09-12T17:08:35.114360+0000","last_peered":"2024-09-12T17:08:35.114360+0000","last_clean":"2024-09-12T17:08:35.114360+0000","last_became_active":"2024-09-12T17:08:21.457133+0000","last_became_peered":"2024-09-12T17:08:21.457133+0000","last_unstale":"2024-09-12T17:08:35.114360+0000","last_undegraded":"2024-09-12T17:08:35.114360+0000","last_fullsized":"2024-09-12T17:08:35.114360+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:58.322770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"71'10","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602312+0000","last_change":"2024-09-12T17:05:47.530275+0000","last_active":"2024-09-12T17:08:33.602312+0000","last_peered":"2024-09-12T17:08:33.602312+0000","last_clean":"2024-09-12T17:08:33.602312+0000","last_became_active":"2024-09-12T17:05:47.529857+0000","last_became_peered":"2024-09-12T17:05:47.529857+0000","last_unstale":"2024-09-12T17:08:33.602312+0000","last_undegraded":"2024-09-12T17:08:33.602312+0000","last_fullsized":"2024-09-12T17:08:33.602312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:47.999516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":32768,"num_write":10,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'42","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023289+0000","last_change":"2024-09-12T17:05:49.525070+0000","last_active":"2024-09-12T17:08:36.023289+0000","last_peered":"2024-09-12T17:08:36.023289+0000","last_clean":"2024-09-12T17:08:36.023289+0000","last_became_active":"2024-09-12T17:05:49.524567+0000","last_became_peered":"2024-09-12T17:05:49.524567+0000","last_unstale":"2024-09-12T17:08:36.023289+0000","last_undegraded":"2024-09-12T17:08:36.023289+0000","last_fullsized":"2024-09-12T17:08:36.023289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:34.320123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"84'11","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020728+0000","last_change":"2024-09-12T17:05:47.547765+0000","last_active":"2024-09-12T17:08:36.020728+0000","last_peered":"2024-09-12T17:08:36.020728+0000","last_clean":"2024-09-12T17:08:36.020728+0000","last_became_active":"2024-09-12T17:05:47.547393+0000","last_became_peered":"2024-09-12T17:05:47.547393+0000","last_unstale":"2024-09-12T17:08:36.020728+0000","last_undegraded":"2024-09-12T17:08:36.020728+0000","last_fullsized":"2024-09-12T17:08:36.020728+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:46.746261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":30729,"num_write":35,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211792+0000","last_change":"2024-09-12T17:05:49.561711+0000","last_active":"2024-09-12T17:08:35.211792+0000","last_peered":"2024-09-12T17:08:35.211792+0000","last_clean":"2024-09-12T17:08:35.211792+0000","last_became_active":"2024-09-12T17:05:49.560993+0000","last_became_peered":"2024-09-12T17:05:49.560993+0000","last_unstale":"2024-09-12T17:08:35.211792+0000","last_undegraded":"2024-09-12T17:08:35.211792+0000","last_fullsized":"2024-09-12T17:08:35.211792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:38.400338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"72'9","reported_seq":52,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114332+0000","last_change":"2024-09-12T17:08:21.614989+0000","last_active":"2024-09-12T17:08:35.114332+0000","last_peered":"2024-09-12T17:08:35.114332+0000","last_clean":"2024-09-12T17:08:35.114332+0000","last_became_active":"2024-09-12T17:08:21.461010+0000","last_became_peered":"2024-09-12T17:08:21.461010+0000","last_unstale":"2024-09-12T17:08:35.114332+0000","last_undegraded":"2024-09-12T17:08:35.114332+0000","last_fullsized":"2024-09-12T17:08:35.114332+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:52.706435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":11,"num_read_kb":24579,"num_write":17,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"68'2","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020895+0000","last_change":"2024-09-12T17:08:28.561852+0000","last_active":"2024-09-12T17:08:36.020895+0000","last_peered":"2024-09-12T17:08:36.020895+0000","last_clean":"2024-09-12T17:08:36.020895+0000","last_became_active":"2024-09-12T17:08:28.558588+0000","last_became_peered":"2024-09-12T17:08:28.558588+0000","last_unstale":"2024-09-12T17:08:36.020895+0000","last_undegraded":"2024-09-12T17:08:36.020895+0000","last_fullsized":"2024-09-12T17:08:36.020895+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:45.704667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"73'8","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354623+0000","last_change":"2024-09-12T17:05:47.541213+0000","last_active":"2024-09-12T17:08:35.354623+0000","last_peered":"2024-09-12T17:08:35.354623+0000","last_clean":"2024-09-12T17:08:35.354623+0000","last_became_active":"2024-09-12T17:05:47.540469+0000","last_became_peered":"2024-09-12T17:05:47.540469+0000","last_unstale":"2024-09-12T17:08:35.354623+0000","last_undegraded":"2024-09-12T17:08:35.354623+0000","last_fullsized":"2024-09-12T17:08:35.354623+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:26.620021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":30720,"num_write":8,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"84'42","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352596+0000","last_change":"2024-09-12T17:05:49.541113+0000","last_active":"2024-09-12T17:08:35.352596+0000","last_peered":"2024-09-12T17:08:35.352596+0000","last_clean":"2024-09-12T17:08:35.352596+0000","last_became_active":"2024-09-12T17:05:49.540395+0000","last_became_peered":"2024-09-12T17:05:49.540395+0000","last_unstale":"2024-09-12T17:08:35.352596+0000","last_undegraded":"2024-09-12T17:08:35.352596+0000","last_fullsized":"2024-09-12T17:08:35.352596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:32.506502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"84'18","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020108+0000","last_change":"2024-09-12T17:05:47.539986+0000","last_active":"2024-09-12T17:08:36.020108+0000","last_peered":"2024-09-12T17:08:36.020108+0000","last_clean":"2024-09-12T17:08:36.020108+0000","last_became_active":"2024-09-12T17:05:47.539603+0000","last_became_peered":"2024-09-12T17:05:47.539603+0000","last_unstale":"2024-09-12T17:08:36.020108+0000","last_undegraded":"2024-09-12T17:08:36.020108+0000","last_fullsized":"2024-09-12T17:08:36.020108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":26,"num_read_kb":57350,"num_write":34,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603269+0000","last_change":"2024-09-12T17:05:49.533938+0000","last_active":"2024-09-12T17:08:33.603269+0000","last_peered":"2024-09-12T17:08:33.603269+0000","last_clean":"2024-09-12T17:08:33.603269+0000","last_became_active":"2024-09-12T17:05:49.531769+0000","last_became_peered":"2024-09-12T17:05:49.531769+0000","last_unstale":"2024-09-12T17:08:33.603269+0000","last_undegraded":"2024-09-12T17:08:33.603269+0000","last_fullsized":"2024-09-12T17:08:33.603269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:33.763423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"84'11","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603444+0000","last_change":"2024-09-12T17:05:47.525739+0000","last_active":"2024-09-12T17:08:33.603444+0000","last_peered":"2024-09-12T17:08:33.603444+0000","last_clean":"2024-09-12T17:08:33.603444+0000","last_became_active":"2024-09-12T17:05:47.524922+0000","last_became_peered":"2024-09-12T17:05:47.524922+0000","last_unstale":"2024-09-12T17:08:33.603444+0000","last_undegraded":"2024-09-12T17:08:33.603444+0000","last_fullsized":"2024-09-12T17:08:33.603444+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":38915,"num_write":19,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212448+0000","last_change":"2024-09-12T17:05:49.555307+0000","last_active":"2024-09-12T17:08:35.212448+0000","last_peered":"2024-09-12T17:08:35.212448+0000","last_clean":"2024-09-12T17:08:35.212448+0000","last_became_active":"2024-09-12T17:05:49.554566+0000","last_became_peered":"2024-09-12T17:05:49.554566+0000","last_unstale":"2024-09-12T17:08:35.212448+0000","last_undegraded":"2024-09-12T17:08:35.212448+0000","last_fullsized":"2024-09-12T17:08:35.212448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:45.017623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"84'12","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019431+0000","last_change":"2024-09-12T17:05:47.543468+0000","last_active":"2024-09-12T17:08:36.019431+0000","last_peered":"2024-09-12T17:08:36.019431+0000","last_clean":"2024-09-12T17:08:36.019431+0000","last_became_active":"2024-09-12T17:05:47.542753+0000","last_became_peered":"2024-09-12T17:05:47.542753+0000","last_unstale":"2024-09-12T17:08:36.019431+0000","last_undegraded":"2024-09-12T17:08:36.019431+0000","last_fullsized":"2024-09-12T17:08:36.019431+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":34825,"num_write":36,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'34","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024298+0000","last_change":"2024-09-12T17:05:49.536693+0000","last_active":"2024-09-12T17:08:36.024298+0000","last_peered":"2024-09-12T17:08:36.024298+0000","last_clean":"2024-09-12T17:08:36.024298+0000","last_became_active":"2024-09-12T17:05:49.536385+0000","last_became_peered":"2024-09-12T17:05:49.536385+0000","last_unstale":"2024-09-12T17:08:36.024298+0000","last_undegraded":"2024-09-12T17:08:36.024298+0000","last_fullsized":"2024-09-12T17:08:36.024298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.024498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"84'6","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603760+0000","last_change":"2024-09-12T17:05:47.545251+0000","last_active":"2024-09-12T17:08:33.603760+0000","last_peered":"2024-09-12T17:08:33.603760+0000","last_clean":"2024-09-12T17:08:33.603760+0000","last_became_active":"2024-09-12T17:05:47.544406+0000","last_became_peered":"2024-09-12T17:05:47.544406+0000","last_unstale":"2024-09-12T17:08:33.603760+0000","last_undegraded":"2024-09-12T17:08:33.603760+0000","last_fullsized":"2024-09-12T17:08:33.603760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:52.167194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":20483,"num_write":14,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"84'38","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212586+0000","last_change":"2024-09-12T17:05:49.564446+0000","last_active":"2024-09-12T17:08:35.212586+0000","last_peered":"2024-09-12T17:08:35.212586+0000","last_clean":"2024-09-12T17:08:35.212586+0000","last_became_active":"2024-09-12T17:05:49.563625+0000","last_became_peered":"2024-09-12T17:05:49.563625+0000","last_unstale":"2024-09-12T17:08:35.212586+0000","last_undegraded":"2024-09-12T17:08:35.212586+0000","last_fullsized":"2024-09-12T17:08:35.212586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.324265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"72'10","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603144+0000","last_change":"2024-09-12T17:05:47.558422+0000","last_active":"2024-09-12T17:08:33.603144+0000","last_peered":"2024-09-12T17:08:33.603144+0000","last_clean":"2024-09-12T17:08:33.603144+0000","last_became_active":"2024-09-12T17:05:47.558047+0000","last_became_peered":"2024-09-12T17:05:47.558047+0000","last_unstale":"2024-09-12T17:08:33.603144+0000","last_undegraded":"2024-09-12T17:08:33.603144+0000","last_fullsized":"2024-09-12T17:08:33.603144+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:25.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":38912,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604202+0000","last_change":"2024-09-12T17:05:49.522750+0000","last_active":"2024-09-12T17:08:33.604202+0000","last_peered":"2024-09-12T17:08:33.604202+0000","last_clean":"2024-09-12T17:08:33.604202+0000","last_became_active":"2024-09-12T17:05:49.522097+0000","last_became_peered":"2024-09-12T17:05:49.522097+0000","last_unstale":"2024-09-12T17:08:33.604202+0000","last_undegraded":"2024-09-12T17:08:33.604202+0000","last_fullsized":"2024-09-12T17:08:33.604202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"84'14","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354038+0000","last_change":"2024-09-12T17:05:47.552865+0000","last_active":"2024-09-12T17:08:35.354038+0000","last_peered":"2024-09-12T17:08:35.354038+0000","last_clean":"2024-09-12T17:08:35.354038+0000","last_became_active":"2024-09-12T17:05:47.552207+0000","last_became_peered":"2024-09-12T17:05:47.552207+0000","last_unstale":"2024-09-12T17:08:35.354038+0000","last_undegraded":"2024-09-12T17:08:35.354038+0000","last_fullsized":"2024-09-12T17:08:35.354038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:00.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40969,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601066+0000","last_change":"2024-09-12T17:08:18.465159+0000","last_active":"2024-09-12T17:08:33.601066+0000","last_peered":"2024-09-12T17:08:33.601066+0000","last_clean":"2024-09-12T17:08:33.601066+0000","last_became_active":"2024-09-12T17:08:18.464823+0000","last_became_peered":"2024-09-12T17:08:18.464823+0000","last_unstale":"2024-09-12T17:08:33.601066+0000","last_undegraded":"2024-09-12T17:08:33.601066+0000","last_fullsized":"2024-09-12T17:08:33.601066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:08.427170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"74'14","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608526+0000","last_change":"2024-09-12T17:05:47.561338+0000","last_active":"2024-09-12T17:08:33.608526+0000","last_peered":"2024-09-12T17:08:33.608526+0000","last_clean":"2024-09-12T17:08:33.608526+0000","last_became_active":"2024-09-12T17:05:47.560439+0000","last_became_peered":"2024-09-12T17:05:47.560439+0000","last_unstale":"2024-09-12T17:08:33.608526+0000","last_undegraded":"2024-09-12T17:08:33.608526+0000","last_fullsized":"2024-09-12T17:08:33.608526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:58.530869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":18,"num_read_kb":51203,"num_write":22,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":124,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601674+0000","last_change":"2024-09-12T17:06:27.819106+0000","last_active":"2024-09-12T17:08:33.601674+0000","last_peered":"2024-09-12T17:08:33.601674+0000","last_clean":"2024-09-12T17:08:33.601674+0000","last_became_active":"2024-09-12T17:06:27.818761+0000","last_became_peered":"2024-09-12T17:06:27.818761+0000","last_unstale":"2024-09-12T17:08:33.601674+0000","last_undegraded":"2024-09-12T17:08:33.601674+0000","last_fullsized":"2024-09-12T17:08:33.601674+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:29.107938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"83'9","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020022+0000","last_change":"2024-09-12T17:05:47.512066+0000","last_active":"2024-09-12T17:08:36.020022+0000","last_peered":"2024-09-12T17:08:36.020022+0000","last_clean":"2024-09-12T17:08:36.020022+0000","last_became_active":"2024-09-12T17:05:47.511470+0000","last_became_peered":"2024-09-12T17:05:47.511470+0000","last_unstale":"2024-09-12T17:08:36.020022+0000","last_undegraded":"2024-09-12T17:08:36.020022+0000","last_fullsized":"2024-09-12T17:08:36.020022+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:38.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":30723,"num_write":17,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601648+0000","last_change":"2024-09-12T17:05:49.523060+0000","last_active":"2024-09-12T17:08:33.601648+0000","last_peered":"2024-09-12T17:08:33.601648+0000","last_clean":"2024-09-12T17:08:33.601648+0000","last_became_active":"2024-09-12T17:05:49.522157+0000","last_became_peered":"2024-09-12T17:05:49.522157+0000","last_unstale":"2024-09-12T17:08:33.601648+0000","last_undegraded":"2024-09-12T17:08:33.601648+0000","last_fullsized":"2024-09-12T17:08:33.601648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"71'5","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606405+0000","last_change":"2024-09-12T17:05:47.538305+0000","last_active":"2024-09-12T17:08:33.606405+0000","last_peered":"2024-09-12T17:08:33.606405+0000","last_clean":"2024-09-12T17:08:33.606405+0000","last_became_active":"2024-09-12T17:05:47.535569+0000","last_became_peered":"2024-09-12T17:05:47.535569+0000","last_unstale":"2024-09-12T17:08:33.606405+0000","last_undegraded":"2024-09-12T17:08:33.606405+0000","last_fullsized":"2024-09-12T17:08:33.606405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:24.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":18432,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"73'5","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603169+0000","last_change":"2024-09-12T17:05:47.537712+0000","last_active":"2024-09-12T17:08:33.603169+0000","last_peered":"2024-09-12T17:08:33.603169+0000","last_clean":"2024-09-12T17:08:33.603169+0000","last_became_active":"2024-09-12T17:05:47.536958+0000","last_became_peered":"2024-09-12T17:05:47.536958+0000","last_unstale":"2024-09-12T17:08:33.603169+0000","last_undegraded":"2024-09-12T17:08:33.603169+0000","last_fullsized":"2024-09-12T17:08:33.603169+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603188+0000","last_change":"2024-09-12T17:05:49.544841+0000","last_active":"2024-09-12T17:08:33.603188+0000","last_peered":"2024-09-12T17:08:33.603188+0000","last_clean":"2024-09-12T17:08:33.603188+0000","last_became_active":"2024-09-12T17:05:49.538757+0000","last_became_peered":"2024-09-12T17:05:49.538757+0000","last_unstale":"2024-09-12T17:08:33.603188+0000","last_undegraded":"2024-09-12T17:08:33.603188+0000","last_fullsized":"2024-09-12T17:08:33.603188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.976348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'9","reported_seq":55,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113825+0000","last_change":"2024-09-12T17:08:18.573927+0000","last_active":"2024-09-12T17:08:35.113825+0000","last_peered":"2024-09-12T17:08:35.113825+0000","last_clean":"2024-09-12T17:08:35.113825+0000","last_became_active":"2024-09-12T17:08:18.441161+0000","last_became_peered":"2024-09-12T17:08:18.441161+0000","last_unstale":"2024-09-12T17:08:35.113825+0000","last_undegraded":"2024-09-12T17:08:35.113825+0000","last_fullsized":"2024-09-12T17:08:35.113825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:21.365549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24582,"num_write":25,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605089+0000","last_change":"2024-09-12T17:05:49.552327+0000","last_active":"2024-09-12T17:08:33.605089+0000","last_peered":"2024-09-12T17:08:33.605089+0000","last_clean":"2024-09-12T17:08:33.605089+0000","last_became_active":"2024-09-12T17:05:49.551604+0000","last_became_peered":"2024-09-12T17:05:49.551604+0000","last_unstale":"2024-09-12T17:08:33.605089+0000","last_undegraded":"2024-09-12T17:08:33.605089+0000","last_fullsized":"2024-09-12T17:08:33.605089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:55.648527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":40,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":238929,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":924,"num_read_kb":920,"num_write":651,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":41697,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":647168,"data_stored":230726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":578,"ondisk_log_size":578,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1867,"num_read_kb":1448,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1093,"num_read_kb":2031945,"num_write":1540,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":241172480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542189,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":481652,"kb_used_data":446308,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93890188,"statfs":{"total":96636764160,"available":96143552512,"internally_reserved":0,"allocated":457019392,"data_stored":456418609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542190,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397056,"kb_used_data":361712,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93974784,"statfs":{"total":96636764160,"available":96230178816,"internally_reserved":0,"allocated":370393088,"data_stored":369832620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472932,"kb_used_data":437588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93898908,"statfs":{"total":96636764160,"available":96152481792,"internally_reserved":0,"allocated":448090112,"data_stored":447463741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542190,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":505560,"kb_used_data":470212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93866280,"statfs":{"total":96636764160,"available":96119070720,"internally_reserved":0,"allocated":481497088,"data_stored":480963304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":515856,"kb_used_data":480512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93855984,"statfs":{"total":96636764160,"available":96108527616,"internally_reserved":0,"allocated":492044288,"data_stored":491456479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542190,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347864,"kb_used_data":312520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94023976,"statfs":{"total":96636764160,"available":96280551424,"internally_reserved":0,"allocated":320020480,"data_stored":319476386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542189,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259876,"kb_used_data":224532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94111964,"statfs":{"total":96636764160,"available":96370651136,"internally_reserved":0,"allocated":229920768,"data_stored":229334328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542190,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":508228,"kb_used_data":472880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93863612,"statfs":{"total":96636764160,"available":96116338688,"internally_reserved":0,"allocated":484229120,"data_stored":483658507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":228589568,"data_stored":228589568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":318767104,"data_stored":318767104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":490733568,"data_stored":490733568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":480247808,"data_stored":480247808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":446693376,"data_stored":446693376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":369098752,"data_stored":369098752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":455081984,"data_stored":455081984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":18170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":40679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":18459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":11388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":65710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":29852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":42241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:09:03.868 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:09:04.245 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:09:04.252 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:09:04.270 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-12T17:09:03.991223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1064047377,"num_objects":480,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":480,"num_whiteouts":0,"num_read":4321,"num_read_kb":2034725,"num_write":3259,"num_write_kb":2050308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":241214307,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2199,"ondisk_log_size":2199,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3251452,"kb_used_data":2964552,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":751723268,"statfs":{"total":773094113280,"available":769764626432,"internally_reserved":0,"allocated":3035701248,"data_stored":3031105400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-572562112,"num_objects":-158,"num_object_clones":0,"num_object_copies":-316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-158,"num_whiteouts":0,"num_read":285,"num_read_kb":273,"num_write":207,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005779"},"pg_stats":[{"pgid":"3.3f","version":"103'23","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.906381+0000","last_change":"2024-09-12T17:05:47.561581+0000","last_active":"2024-09-12T17:09:02.906381+0000","last_peered":"2024-09-12T17:09:02.906381+0000","last_clean":"2024-09-12T17:09:02.906381+0000","last_became_active":"2024-09-12T17:05:47.560791+0000","last_became_peered":"2024-09-12T17:05:47.560791+0000","last_unstale":"2024-09-12T17:09:02.906381+0000","last_undegraded":"2024-09-12T17:09:02.906381+0000","last_fullsized":"2024-09-12T17:09:02.906381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:23.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":57356,"num_write":55,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"84'44","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602148+0000","last_change":"2024-09-12T17:05:49.558060+0000","last_active":"2024-09-12T17:08:33.602148+0000","last_peered":"2024-09-12T17:08:33.602148+0000","last_clean":"2024-09-12T17:08:33.602148+0000","last_became_active":"2024-09-12T17:05:49.557287+0000","last_became_peered":"2024-09-12T17:05:49.557287+0000","last_unstale":"2024-09-12T17:08:33.602148+0000","last_undegraded":"2024-09-12T17:08:33.602148+0000","last_fullsized":"2024-09-12T17:08:33.602148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":132,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"103'4","reported_seq":43,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115586+0000","last_change":"2024-09-12T17:08:21.529824+0000","last_active":"2024-09-12T17:08:35.115586+0000","last_peered":"2024-09-12T17:08:35.115586+0000","last_clean":"2024-09-12T17:08:35.115586+0000","last_became_active":"2024-09-12T17:08:21.462766+0000","last_became_peered":"2024-09-12T17:08:21.462766+0000","last_unstale":"2024-09-12T17:08:35.115586+0000","last_undegraded":"2024-09-12T17:08:35.115586+0000","last_fullsized":"2024-09-12T17:08:35.115586+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:47.442324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605094+0000","last_change":"2024-09-12T17:08:18.454422+0000","last_active":"2024-09-12T17:08:33.605094+0000","last_peered":"2024-09-12T17:08:33.605094+0000","last_clean":"2024-09-12T17:08:33.605094+0000","last_became_active":"2024-09-12T17:08:18.442986+0000","last_became_peered":"2024-09-12T17:08:18.442986+0000","last_unstale":"2024-09-12T17:08:33.605094+0000","last_undegraded":"2024-09-12T17:08:33.605094+0000","last_fullsized":"2024-09-12T17:08:33.605094+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:26.720649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"103'21","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.906983+0000","last_change":"2024-09-12T17:05:47.523052+0000","last_active":"2024-09-12T17:09:02.906983+0000","last_peered":"2024-09-12T17:09:02.906983+0000","last_clean":"2024-09-12T17:09:02.906983+0000","last_became_active":"2024-09-12T17:05:47.522544+0000","last_became_peered":"2024-09-12T17:05:47.522544+0000","last_unstale":"2024-09-12T17:09:02.906983+0000","last_undegraded":"2024-09-12T17:09:02.906983+0000","last_fullsized":"2024-09-12T17:09:02.906983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":38921,"num_write":45,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"84'34","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211197+0000","last_change":"2024-09-12T17:05:49.549990+0000","last_active":"2024-09-12T17:08:35.211197+0000","last_peered":"2024-09-12T17:08:35.211197+0000","last_clean":"2024-09-12T17:08:35.211197+0000","last_became_active":"2024-09-12T17:05:49.549241+0000","last_became_peered":"2024-09-12T17:05:49.549241+0000","last_unstale":"2024-09-12T17:08:35.211197+0000","last_undegraded":"2024-09-12T17:08:35.211197+0000","last_fullsized":"2024-09-12T17:08:35.211197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.601256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"84'12","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024742+0000","last_change":"2024-09-12T17:06:27.748679+0000","last_active":"2024-09-12T17:08:36.024742+0000","last_peered":"2024-09-12T17:08:36.024742+0000","last_clean":"2024-09-12T17:08:36.024742+0000","last_became_active":"2024-09-12T17:06:27.748390+0000","last_became_peered":"2024-09-12T17:06:27.748390+0000","last_unstale":"2024-09-12T17:08:36.024742+0000","last_undegraded":"2024-09-12T17:08:36.024742+0000","last_fullsized":"2024-09-12T17:08:36.024742+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:58.547350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":30732,"num_write":44,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602063+0000","last_change":"2024-09-12T17:05:49.542142+0000","last_active":"2024-09-12T17:08:33.602063+0000","last_peered":"2024-09-12T17:08:33.602063+0000","last_clean":"2024-09-12T17:08:33.602063+0000","last_became_active":"2024-09-12T17:05:49.541354+0000","last_became_peered":"2024-09-12T17:05:49.541354+0000","last_unstale":"2024-09-12T17:08:33.602063+0000","last_undegraded":"2024-09-12T17:08:33.602063+0000","last_fullsized":"2024-09-12T17:08:33.602063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.147865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"103'10","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.777908+0000","last_change":"2024-09-12T17:05:47.556154+0000","last_active":"2024-09-12T17:09:02.777908+0000","last_peered":"2024-09-12T17:09:02.777908+0000","last_clean":"2024-09-12T17:09:02.777908+0000","last_became_active":"2024-09-12T17:05:47.555396+0000","last_became_peered":"2024-09-12T17:05:47.555396+0000","last_unstale":"2024-09-12T17:09:02.777908+0000","last_undegraded":"2024-09-12T17:09:02.777908+0000","last_fullsized":"2024-09-12T17:09:02.777908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:27.784208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":22534,"num_write":26,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353568+0000","last_change":"2024-09-12T17:05:49.529344+0000","last_active":"2024-09-12T17:08:35.353568+0000","last_peered":"2024-09-12T17:08:35.353568+0000","last_clean":"2024-09-12T17:08:35.353568+0000","last_became_active":"2024-09-12T17:05:49.528184+0000","last_became_peered":"2024-09-12T17:05:49.528184+0000","last_unstale":"2024-09-12T17:08:35.353568+0000","last_undegraded":"2024-09-12T17:08:35.353568+0000","last_fullsized":"2024-09-12T17:08:35.353568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:18.357328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"103'14","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.802584+0000","last_change":"2024-09-12T17:05:47.532931+0000","last_active":"2024-09-12T17:09:02.802584+0000","last_peered":"2024-09-12T17:09:02.802584+0000","last_clean":"2024-09-12T17:09:02.802584+0000","last_became_active":"2024-09-12T17:05:47.531427+0000","last_became_peered":"2024-09-12T17:05:47.531427+0000","last_unstale":"2024-09-12T17:09:02.802584+0000","last_undegraded":"2024-09-12T17:09:02.802584+0000","last_fullsized":"2024-09-12T17:09:02.802584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":30,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212195+0000","last_change":"2024-09-12T17:05:49.550694+0000","last_active":"2024-09-12T17:08:35.212195+0000","last_peered":"2024-09-12T17:08:35.212195+0000","last_clean":"2024-09-12T17:08:35.212195+0000","last_became_active":"2024-09-12T17:05:49.549066+0000","last_became_peered":"2024-09-12T17:05:49.549066+0000","last_unstale":"2024-09-12T17:08:35.212195+0000","last_undegraded":"2024-09-12T17:08:35.212195+0000","last_fullsized":"2024-09-12T17:08:35.212195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:24.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"103'10","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.969636+0000","last_change":"2024-09-12T17:05:47.560085+0000","last_active":"2024-09-12T17:09:02.969636+0000","last_peered":"2024-09-12T17:09:02.969636+0000","last_clean":"2024-09-12T17:09:02.969636+0000","last_became_active":"2024-09-12T17:05:47.559160+0000","last_became_peered":"2024-09-12T17:05:47.559160+0000","last_unstale":"2024-09-12T17:09:02.969636+0000","last_undegraded":"2024-09-12T17:09:02.969636+0000","last_fullsized":"2024-09-12T17:09:02.969636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:06.664677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":20483,"num_write":18,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'2","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604685+0000","last_change":"2024-09-12T17:08:18.490456+0000","last_active":"2024-09-12T17:08:33.604685+0000","last_peered":"2024-09-12T17:08:33.604685+0000","last_clean":"2024-09-12T17:08:33.604685+0000","last_became_active":"2024-09-12T17:08:18.471124+0000","last_became_peered":"2024-09-12T17:08:18.471124+0000","last_unstale":"2024-09-12T17:08:33.604685+0000","last_undegraded":"2024-09-12T17:08:33.604685+0000","last_fullsized":"2024-09-12T17:08:33.604685+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.772819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"103'11","reported_seq":147,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:58.008482+0000","last_change":"2024-09-12T17:06:27.748750+0000","last_active":"2024-09-12T17:08:58.008482+0000","last_peered":"2024-09-12T17:08:58.008482+0000","last_clean":"2024-09-12T17:08:58.008482+0000","last_became_active":"2024-09-12T17:06:27.748329+0000","last_became_peered":"2024-09-12T17:06:27.748329+0000","last_unstale":"2024-09-12T17:08:58.008482+0000","last_undegraded":"2024-09-12T17:08:58.008482+0000","last_fullsized":"2024-09-12T17:08:58.008482+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:26.773943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":26633,"num_write":35,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024893+0000","last_change":"2024-09-12T17:07:28.190678+0000","last_active":"2024-09-12T17:08:36.024893+0000","last_peered":"2024-09-12T17:08:36.024893+0000","last_clean":"2024-09-12T17:08:36.024893+0000","last_became_active":"2024-09-12T17:07:28.190245+0000","last_became_peered":"2024-09-12T17:07:28.190245+0000","last_unstale":"2024-09-12T17:08:36.024893+0000","last_undegraded":"2024-09-12T17:08:36.024893+0000","last_fullsized":"2024-09-12T17:08:36.024893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:04.220150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210683+0000","last_change":"2024-09-12T17:05:49.549575+0000","last_active":"2024-09-12T17:08:35.210683+0000","last_peered":"2024-09-12T17:08:35.210683+0000","last_clean":"2024-09-12T17:08:35.210683+0000","last_became_active":"2024-09-12T17:05:49.548292+0000","last_became_peered":"2024-09-12T17:05:49.548292+0000","last_unstale":"2024-09-12T17:08:35.210683+0000","last_undegraded":"2024-09-12T17:08:35.210683+0000","last_fullsized":"2024-09-12T17:08:35.210683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"103'8","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.917846+0000","last_change":"2024-09-12T17:08:28.649055+0000","last_active":"2024-09-12T17:09:02.917846+0000","last_peered":"2024-09-12T17:09:02.917846+0000","last_clean":"2024-09-12T17:09:02.917846+0000","last_became_active":"2024-09-12T17:08:28.568157+0000","last_became_peered":"2024-09-12T17:08:28.568157+0000","last_unstale":"2024-09-12T17:09:02.917846+0000","last_undegraded":"2024-09-12T17:09:02.917846+0000","last_fullsized":"2024-09-12T17:09:02.917846+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:11.023137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":18434,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605305+0000","last_change":"2024-09-12T17:08:18.455416+0000","last_active":"2024-09-12T17:08:33.605305+0000","last_peered":"2024-09-12T17:08:33.605305+0000","last_clean":"2024-09-12T17:08:33.605305+0000","last_became_active":"2024-09-12T17:08:18.454062+0000","last_became_peered":"2024-09-12T17:08:18.454062+0000","last_unstale":"2024-09-12T17:08:33.605305+0000","last_undegraded":"2024-09-12T17:08:33.605305+0000","last_fullsized":"2024-09-12T17:08:33.605305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:38.260106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"103'14","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354508+0000","last_change":"2024-09-12T17:05:47.528338+0000","last_active":"2024-09-12T17:08:35.354508+0000","last_peered":"2024-09-12T17:08:35.354508+0000","last_clean":"2024-09-12T17:08:35.354508+0000","last_became_active":"2024-09-12T17:05:47.527533+0000","last_became_peered":"2024-09-12T17:05:47.527533+0000","last_unstale":"2024-09-12T17:08:35.354508+0000","last_undegraded":"2024-09-12T17:08:35.354508+0000","last_fullsized":"2024-09-12T17:08:35.354508+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.693731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":34828,"num_write":46,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"84'30","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603444+0000","last_change":"2024-09-12T17:05:49.543097+0000","last_active":"2024-09-12T17:08:33.603444+0000","last_peered":"2024-09-12T17:08:33.603444+0000","last_clean":"2024-09-12T17:08:33.603444+0000","last_became_active":"2024-09-12T17:05:49.542113+0000","last_became_peered":"2024-09-12T17:05:49.542113+0000","last_unstale":"2024-09-12T17:08:33.603444+0000","last_undegraded":"2024-09-12T17:08:33.603444+0000","last_fullsized":"2024-09-12T17:08:33.603444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":90,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"103'17","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.906813+0000","last_change":"2024-09-12T17:05:47.529868+0000","last_active":"2024-09-12T17:09:02.906813+0000","last_peered":"2024-09-12T17:09:02.906813+0000","last_clean":"2024-09-12T17:09:02.906813+0000","last_became_active":"2024-09-12T17:05:47.529083+0000","last_became_peered":"2024-09-12T17:05:47.529083+0000","last_unstale":"2024-09-12T17:09:02.906813+0000","last_undegraded":"2024-09-12T17:09:02.906813+0000","last_fullsized":"2024-09-12T17:09:02.906813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:16.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":40969,"num_write":41,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023501+0000","last_change":"2024-09-12T17:05:49.548084+0000","last_active":"2024-09-12T17:08:36.023501+0000","last_peered":"2024-09-12T17:08:36.023501+0000","last_clean":"2024-09-12T17:08:36.023501+0000","last_became_active":"2024-09-12T17:05:49.539930+0000","last_became_peered":"2024-09-12T17:05:49.539930+0000","last_unstale":"2024-09-12T17:08:36.023501+0000","last_undegraded":"2024-09-12T17:08:36.023501+0000","last_fullsized":"2024-09-12T17:08:36.023501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:11.453390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"103'10","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.939249+0000","last_change":"2024-09-12T17:05:47.548316+0000","last_active":"2024-09-12T17:09:02.939249+0000","last_peered":"2024-09-12T17:09:02.939249+0000","last_clean":"2024-09-12T17:09:02.939249+0000","last_became_active":"2024-09-12T17:05:47.547430+0000","last_became_peered":"2024-09-12T17:05:47.547430+0000","last_unstale":"2024-09-12T17:09:02.939249+0000","last_undegraded":"2024-09-12T17:09:02.939249+0000","last_fullsized":"2024-09-12T17:09:02.939249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:21.143073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":20483,"num_write":18,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024500+0000","last_change":"2024-09-12T17:05:49.556144+0000","last_active":"2024-09-12T17:08:36.024500+0000","last_peered":"2024-09-12T17:08:36.024500+0000","last_clean":"2024-09-12T17:08:36.024500+0000","last_became_active":"2024-09-12T17:05:49.555033+0000","last_became_peered":"2024-09-12T17:05:49.555033+0000","last_unstale":"2024-09-12T17:08:36.024500+0000","last_undegraded":"2024-09-12T17:08:36.024500+0000","last_fullsized":"2024-09-12T17:08:36.024500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:08.056726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"103'15","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.953662+0000","last_change":"2024-09-12T17:05:47.511375+0000","last_active":"2024-09-12T17:09:02.953662+0000","last_peered":"2024-09-12T17:09:02.953662+0000","last_clean":"2024-09-12T17:09:02.953662+0000","last_became_active":"2024-09-12T17:05:47.510364+0000","last_became_peered":"2024-09-12T17:05:47.510364+0000","last_unstale":"2024-09-12T17:09:02.953662+0000","last_undegraded":"2024-09-12T17:09:02.953662+0000","last_fullsized":"2024-09-12T17:09:02.953662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":38912,"num_write":15,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212219+0000","last_change":"2024-09-12T17:08:18.448181+0000","last_active":"2024-09-12T17:08:35.212219+0000","last_peered":"2024-09-12T17:08:35.212219+0000","last_clean":"2024-09-12T17:08:35.212219+0000","last_became_active":"2024-09-12T17:08:18.447353+0000","last_became_peered":"2024-09-12T17:08:18.447353+0000","last_unstale":"2024-09-12T17:08:35.212219+0000","last_undegraded":"2024-09-12T17:08:35.212219+0000","last_fullsized":"2024-09-12T17:08:35.212219+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:07.836287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"103'6","reported_seq":199,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601669+0000","last_change":"2024-09-12T17:08:18.831302+0000","last_active":"2024-09-12T17:08:33.601669+0000","last_peered":"2024-09-12T17:08:33.601669+0000","last_clean":"2024-09-12T17:08:33.601669+0000","last_became_active":"2024-09-12T17:08:18.467826+0000","last_became_peered":"2024-09-12T17:08:18.467826+0000","last_unstale":"2024-09-12T17:08:33.601669+0000","last_undegraded":"2024-09-12T17:08:33.601669+0000","last_fullsized":"2024-09-12T17:08:33.601669+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:24.964574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":14339,"num_write":14,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10485760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"84'2","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210149+0000","last_change":"2024-09-12T17:05:57.588515+0000","last_active":"2024-09-12T17:08:35.210149+0000","last_peered":"2024-09-12T17:08:35.210149+0000","last_clean":"2024-09-12T17:08:35.210149+0000","last_became_active":"2024-09-12T17:05:57.587891+0000","last_became_peered":"2024-09-12T17:05:57.587891+0000","last_unstale":"2024-09-12T17:08:35.210149+0000","last_undegraded":"2024-09-12T17:08:35.210149+0000","last_fullsized":"2024-09-12T17:08:35.210149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:24.257847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022681+0000","last_change":"2024-09-12T17:08:21.457874+0000","last_active":"2024-09-12T17:08:36.022681+0000","last_peered":"2024-09-12T17:08:36.022681+0000","last_clean":"2024-09-12T17:08:36.022681+0000","last_became_active":"2024-09-12T17:08:21.457526+0000","last_became_peered":"2024-09-12T17:08:21.457526+0000","last_unstale":"2024-09-12T17:08:36.022681+0000","last_undegraded":"2024-09-12T17:08:36.022681+0000","last_fullsized":"2024-09-12T17:08:36.022681+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:37.646866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"103'14","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604793+0000","last_change":"2024-09-12T17:05:47.557687+0000","last_active":"2024-09-12T17:08:33.604793+0000","last_peered":"2024-09-12T17:08:33.604793+0000","last_clean":"2024-09-12T17:08:33.604793+0000","last_became_active":"2024-09-12T17:05:47.556980+0000","last_became_peered":"2024-09-12T17:05:47.556980+0000","last_unstale":"2024-09-12T17:08:33.604793+0000","last_undegraded":"2024-09-12T17:08:33.604793+0000","last_fullsized":"2024-09-12T17:08:33.604793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.891909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":38921,"num_write":38,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606120+0000","last_change":"2024-09-12T17:08:18.472276+0000","last_active":"2024-09-12T17:08:33.606120+0000","last_peered":"2024-09-12T17:08:33.606120+0000","last_clean":"2024-09-12T17:08:33.606120+0000","last_became_active":"2024-09-12T17:08:18.471264+0000","last_became_peered":"2024-09-12T17:08:18.471264+0000","last_unstale":"2024-09-12T17:08:33.606120+0000","last_undegraded":"2024-09-12T17:08:33.606120+0000","last_fullsized":"2024-09-12T17:08:33.606120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:10.434396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"103'15","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603950+0000","last_change":"2024-09-12T17:05:53.537592+0000","last_active":"2024-09-12T17:08:33.603950+0000","last_peered":"2024-09-12T17:08:33.603950+0000","last_clean":"2024-09-12T17:08:33.603950+0000","last_became_active":"2024-09-12T17:05:53.536921+0000","last_became_peered":"2024-09-12T17:05:53.536921+0000","last_unstale":"2024-09-12T17:08:33.603950+0000","last_undegraded":"2024-09-12T17:08:33.603950+0000","last_fullsized":"2024-09-12T17:08:33.603950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:25.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607496+0000","last_change":"2024-09-12T17:05:55.559431+0000","last_active":"2024-09-12T17:08:33.607496+0000","last_peered":"2024-09-12T17:08:33.607496+0000","last_clean":"2024-09-12T17:08:33.607496+0000","last_became_active":"2024-09-12T17:05:55.558297+0000","last_became_peered":"2024-09-12T17:05:55.558297+0000","last_unstale":"2024-09-12T17:08:33.607496+0000","last_undegraded":"2024-09-12T17:08:33.607496+0000","last_fullsized":"2024-09-12T17:08:33.607496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"84'4","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601882+0000","last_change":"2024-09-12T17:05:57.592599+0000","last_active":"2024-09-12T17:08:33.601882+0000","last_peered":"2024-09-12T17:08:33.601882+0000","last_clean":"2024-09-12T17:08:33.601882+0000","last_became_active":"2024-09-12T17:05:57.591877+0000","last_became_peered":"2024-09-12T17:05:57.591877+0000","last_unstale":"2024-09-12T17:08:33.601882+0000","last_undegraded":"2024-09-12T17:08:33.601882+0000","last_fullsized":"2024-09-12T17:08:33.601882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:57.557525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"68'6","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605335+0000","last_change":"2024-09-12T17:05:49.546093+0000","last_active":"2024-09-12T17:08:33.605335+0000","last_peered":"2024-09-12T17:08:33.605335+0000","last_clean":"2024-09-12T17:08:33.605335+0000","last_became_active":"2024-09-12T17:05:49.544425+0000","last_became_peered":"2024-09-12T17:05:49.544425+0000","last_unstale":"2024-09-12T17:08:33.605335+0000","last_undegraded":"2024-09-12T17:08:33.605335+0000","last_fullsized":"2024-09-12T17:08:33.605335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.495950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"103'10","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.917328+0000","last_change":"2024-09-12T17:05:47.535295+0000","last_active":"2024-09-12T17:09:02.917328+0000","last_peered":"2024-09-12T17:09:02.917328+0000","last_clean":"2024-09-12T17:09:02.917328+0000","last_became_active":"2024-09-12T17:05:47.534833+0000","last_became_peered":"2024-09-12T17:05:47.534833+0000","last_unstale":"2024-09-12T17:09:02.917328+0000","last_undegraded":"2024-09-12T17:09:02.917328+0000","last_fullsized":"2024-09-12T17:09:02.917328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":22528,"num_write":10,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023193+0000","last_change":"2024-09-12T17:05:51.533888+0000","last_active":"2024-09-12T17:08:36.023193+0000","last_peered":"2024-09-12T17:08:36.023193+0000","last_clean":"2024-09-12T17:08:36.023193+0000","last_became_active":"2024-09-12T17:05:51.533164+0000","last_became_peered":"2024-09-12T17:05:51.533164+0000","last_unstale":"2024-09-12T17:08:36.023193+0000","last_undegraded":"2024-09-12T17:08:36.023193+0000","last_fullsized":"2024-09-12T17:08:36.023193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:33.007858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":165,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212582+0000","last_change":"2024-09-12T17:05:53.549534+0000","last_active":"2024-09-12T17:08:35.212582+0000","last_peered":"2024-09-12T17:08:35.212582+0000","last_clean":"2024-09-12T17:08:35.212582+0000","last_became_active":"2024-09-12T17:05:53.548824+0000","last_became_peered":"2024-09-12T17:05:53.548824+0000","last_unstale":"2024-09-12T17:08:35.212582+0000","last_undegraded":"2024-09-12T17:08:35.212582+0000","last_fullsized":"2024-09-12T17:08:35.212582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.765832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211657+0000","last_change":"2024-09-12T17:05:55.557468+0000","last_active":"2024-09-12T17:08:35.211657+0000","last_peered":"2024-09-12T17:08:35.211657+0000","last_clean":"2024-09-12T17:08:35.211657+0000","last_became_active":"2024-09-12T17:05:55.556689+0000","last_became_peered":"2024-09-12T17:05:55.556689+0000","last_unstale":"2024-09-12T17:08:35.211657+0000","last_undegraded":"2024-09-12T17:08:35.211657+0000","last_fullsized":"2024-09-12T17:08:35.211657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:56.879576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601144+0000","last_change":"2024-09-12T17:05:57.589569+0000","last_active":"2024-09-12T17:08:33.601144+0000","last_peered":"2024-09-12T17:08:33.601144+0000","last_clean":"2024-09-12T17:08:33.601144+0000","last_became_active":"2024-09-12T17:05:57.588649+0000","last_became_peered":"2024-09-12T17:05:57.588649+0000","last_unstale":"2024-09-12T17:08:33.601144+0000","last_undegraded":"2024-09-12T17:08:33.601144+0000","last_fullsized":"2024-09-12T17:08:33.601144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"68'10","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604412+0000","last_change":"2024-09-12T17:05:49.531436+0000","last_active":"2024-09-12T17:08:33.604412+0000","last_peered":"2024-09-12T17:08:33.604412+0000","last_clean":"2024-09-12T17:08:33.604412+0000","last_became_active":"2024-09-12T17:05:49.530687+0000","last_became_peered":"2024-09-12T17:05:49.530687+0000","last_unstale":"2024-09-12T17:08:33.604412+0000","last_undegraded":"2024-09-12T17:08:33.604412+0000","last_fullsized":"2024-09-12T17:08:33.604412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"103'14","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.756552+0000","last_change":"2024-09-12T17:05:47.564709+0000","last_active":"2024-09-12T17:09:02.756552+0000","last_peered":"2024-09-12T17:09:02.756552+0000","last_clean":"2024-09-12T17:09:02.756552+0000","last_became_active":"2024-09-12T17:05:47.564189+0000","last_became_peered":"2024-09-12T17:05:47.564189+0000","last_unstale":"2024-09-12T17:09:02.756552+0000","last_undegraded":"2024-09-12T17:09:02.756552+0000","last_fullsized":"2024-09-12T17:09:02.756552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":34825,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.026238+0000","last_change":"2024-09-12T17:08:18.465074+0000","last_active":"2024-09-12T17:08:36.026238+0000","last_peered":"2024-09-12T17:08:36.026238+0000","last_clean":"2024-09-12T17:08:36.026238+0000","last_became_active":"2024-09-12T17:08:18.464648+0000","last_became_peered":"2024-09-12T17:08:18.464648+0000","last_unstale":"2024-09-12T17:08:36.026238+0000","last_undegraded":"2024-09-12T17:08:36.026238+0000","last_fullsized":"2024-09-12T17:08:36.026238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:04.122655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023933+0000","last_change":"2024-09-12T17:05:53.549328+0000","last_active":"2024-09-12T17:08:36.023933+0000","last_peered":"2024-09-12T17:08:36.023933+0000","last_clean":"2024-09-12T17:08:36.023933+0000","last_became_active":"2024-09-12T17:05:53.548968+0000","last_became_peered":"2024-09-12T17:05:53.548968+0000","last_unstale":"2024-09-12T17:08:36.023933+0000","last_undegraded":"2024-09-12T17:08:36.023933+0000","last_fullsized":"2024-09-12T17:08:36.023933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:36.974950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"103'19","reported_seq":233,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.652838+0000","last_change":"2024-09-12T17:08:21.488239+0000","last_active":"2024-09-12T17:09:02.652838+0000","last_peered":"2024-09-12T17:09:02.652838+0000","last_clean":"2024-09-12T17:09:02.652838+0000","last_became_active":"2024-09-12T17:08:21.464957+0000","last_became_peered":"2024-09-12T17:08:21.464957+0000","last_unstale":"2024-09-12T17:09:02.652838+0000","last_undegraded":"2024-09-12T17:09:02.652838+0000","last_fullsized":"2024-09-12T17:09:02.652838+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.266320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210946+0000","last_change":"2024-09-12T17:05:58.122522+0000","last_active":"2024-09-12T17:08:35.210946+0000","last_peered":"2024-09-12T17:08:35.210946+0000","last_clean":"2024-09-12T17:08:35.210946+0000","last_became_active":"2024-09-12T17:05:58.121871+0000","last_became_peered":"2024-09-12T17:05:58.121871+0000","last_unstale":"2024-09-12T17:08:35.210946+0000","last_undegraded":"2024-09-12T17:08:35.210946+0000","last_fullsized":"2024-09-12T17:08:35.210946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:22.625236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025587+0000","last_change":"2024-09-12T17:05:49.528766+0000","last_active":"2024-09-12T17:08:36.025587+0000","last_peered":"2024-09-12T17:08:36.025587+0000","last_clean":"2024-09-12T17:08:36.025587+0000","last_became_active":"2024-09-12T17:05:49.527758+0000","last_became_peered":"2024-09-12T17:05:49.527758+0000","last_unstale":"2024-09-12T17:08:36.025587+0000","last_undegraded":"2024-09-12T17:08:36.025587+0000","last_fullsized":"2024-09-12T17:08:36.025587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:06.399711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"103'19","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.826456+0000","last_change":"2024-09-12T17:05:47.521727+0000","last_active":"2024-09-12T17:09:02.826456+0000","last_peered":"2024-09-12T17:09:02.826456+0000","last_clean":"2024-09-12T17:09:02.826456+0000","last_became_active":"2024-09-12T17:05:47.520943+0000","last_became_peered":"2024-09-12T17:05:47.520943+0000","last_unstale":"2024-09-12T17:09:02.826456+0000","last_undegraded":"2024-09-12T17:09:02.826456+0000","last_fullsized":"2024-09-12T17:09:02.826456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:24.772296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":23,"num_read_kb":51203,"num_write":27,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"29'1","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.606726+0000","last_change":"2024-09-12T17:05:51.556202+0000","last_active":"2024-09-12T17:09:02.606726+0000","last_peered":"2024-09-12T17:09:02.606726+0000","last_clean":"2024-09-12T17:09:02.606726+0000","last_became_active":"2024-09-12T17:05:51.555420+0000","last_became_peered":"2024-09-12T17:05:51.555420+0000","last_unstale":"2024-09-12T17:09:02.606726+0000","last_undegraded":"2024-09-12T17:09:02.606726+0000","last_fullsized":"2024-09-12T17:09:02.606726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:56.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"103'17","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.972638+0000","last_change":"2024-09-12T17:05:53.554159+0000","last_active":"2024-09-12T17:09:02.972638+0000","last_peered":"2024-09-12T17:09:02.972638+0000","last_clean":"2024-09-12T17:09:02.972638+0000","last_became_active":"2024-09-12T17:05:53.553333+0000","last_became_peered":"2024-09-12T17:05:53.553333+0000","last_unstale":"2024-09-12T17:09:02.972638+0000","last_undegraded":"2024-09-12T17:09:02.972638+0000","last_fullsized":"2024-09-12T17:09:02.972638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:53.266475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"103'17","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.659301+0000","last_change":"2024-09-12T17:05:55.556502+0000","last_active":"2024-09-12T17:09:02.659301+0000","last_peered":"2024-09-12T17:09:02.659301+0000","last_clean":"2024-09-12T17:09:02.659301+0000","last_became_active":"2024-09-12T17:05:55.555879+0000","last_became_peered":"2024-09-12T17:05:55.555879+0000","last_unstale":"2024-09-12T17:09:02.659301+0000","last_undegraded":"2024-09-12T17:09:02.659301+0000","last_fullsized":"2024-09-12T17:09:02.659301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:18.672296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602918+0000","last_change":"2024-09-12T17:05:49.553404+0000","last_active":"2024-09-12T17:08:33.602918+0000","last_peered":"2024-09-12T17:08:33.602918+0000","last_clean":"2024-09-12T17:08:33.602918+0000","last_became_active":"2024-09-12T17:05:49.552637+0000","last_became_peered":"2024-09-12T17:05:49.552637+0000","last_unstale":"2024-09-12T17:08:33.602918+0000","last_undegraded":"2024-09-12T17:08:33.602918+0000","last_fullsized":"2024-09-12T17:08:33.602918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607911+0000","last_change":"2024-09-12T17:05:47.562949+0000","last_active":"2024-09-12T17:08:33.607911+0000","last_peered":"2024-09-12T17:08:33.607911+0000","last_clean":"2024-09-12T17:08:33.607911+0000","last_became_active":"2024-09-12T17:05:47.562465+0000","last_became_peered":"2024-09-12T17:05:47.562465+0000","last_unstale":"2024-09-12T17:08:33.607911+0000","last_undegraded":"2024-09-12T17:08:33.607911+0000","last_fullsized":"2024-09-12T17:08:33.607911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24585,"num_write":33,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604488+0000","last_change":"2024-09-12T17:05:51.542349+0000","last_active":"2024-09-12T17:08:33.604488+0000","last_peered":"2024-09-12T17:08:33.604488+0000","last_clean":"2024-09-12T17:08:33.604488+0000","last_became_active":"2024-09-12T17:05:51.541205+0000","last_became_peered":"2024-09-12T17:05:51.541205+0000","last_unstale":"2024-09-12T17:08:33.604488+0000","last_undegraded":"2024-09-12T17:08:33.604488+0000","last_fullsized":"2024-09-12T17:08:33.604488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"103'29","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602417+0000","last_change":"2024-09-12T17:05:53.560400+0000","last_active":"2024-09-12T17:08:33.602417+0000","last_peered":"2024-09-12T17:08:33.602417+0000","last_clean":"2024-09-12T17:08:33.602417+0000","last_became_active":"2024-09-12T17:05:53.559463+0000","last_became_peered":"2024-09-12T17:05:53.559463+0000","last_unstale":"2024-09-12T17:08:33.602417+0000","last_undegraded":"2024-09-12T17:08:33.602417+0000","last_fullsized":"2024-09-12T17:08:33.602417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13033,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":46,"num_read_kb":53,"num_write":34,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114027+0000","last_change":"2024-09-12T17:08:21.463670+0000","last_active":"2024-09-12T17:08:35.114027+0000","last_peered":"2024-09-12T17:08:35.114027+0000","last_clean":"2024-09-12T17:08:35.114027+0000","last_became_active":"2024-09-12T17:08:21.463161+0000","last_became_peered":"2024-09-12T17:08:21.463161+0000","last_unstale":"2024-09-12T17:08:35.114027+0000","last_undegraded":"2024-09-12T17:08:35.114027+0000","last_fullsized":"2024-09-12T17:08:35.114027+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:03.162531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603071+0000","last_change":"2024-09-12T17:05:57.599403+0000","last_active":"2024-09-12T17:08:33.603071+0000","last_peered":"2024-09-12T17:08:33.603071+0000","last_clean":"2024-09-12T17:08:33.603071+0000","last_became_active":"2024-09-12T17:05:57.598703+0000","last_became_peered":"2024-09-12T17:05:57.598703+0000","last_unstale":"2024-09-12T17:08:33.603071+0000","last_undegraded":"2024-09-12T17:08:33.603071+0000","last_fullsized":"2024-09-12T17:08:33.603071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"84'34","reported_seq":217,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210937+0000","last_change":"2024-09-12T17:08:18.474573+0000","last_active":"2024-09-12T17:08:35.210937+0000","last_peered":"2024-09-12T17:08:35.210937+0000","last_clean":"2024-09-12T17:08:35.210937+0000","last_became_active":"2024-09-12T17:08:18.443808+0000","last_became_peered":"2024-09-12T17:08:18.443808+0000","last_unstale":"2024-09-12T17:08:35.210937+0000","last_undegraded":"2024-09-12T17:08:35.210937+0000","last_fullsized":"2024-09-12T17:08:35.210937+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:01.200485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"103'9","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607958+0000","last_change":"2024-09-12T17:05:47.563411+0000","last_active":"2024-09-12T17:08:33.607958+0000","last_peered":"2024-09-12T17:08:33.607958+0000","last_clean":"2024-09-12T17:08:33.607958+0000","last_became_active":"2024-09-12T17:05:47.562812+0000","last_became_peered":"2024-09-12T17:05:47.562812+0000","last_unstale":"2024-09-12T17:08:33.607958+0000","last_undegraded":"2024-09-12T17:08:33.607958+0000","last_fullsized":"2024-09-12T17:08:33.607958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:57.659986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":24579,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021678+0000","last_change":"2024-09-12T17:05:51.548944+0000","last_active":"2024-09-12T17:08:36.021678+0000","last_peered":"2024-09-12T17:08:36.021678+0000","last_clean":"2024-09-12T17:08:36.021678+0000","last_became_active":"2024-09-12T17:05:51.544649+0000","last_became_peered":"2024-09-12T17:05:51.544649+0000","last_unstale":"2024-09-12T17:08:36.021678+0000","last_undegraded":"2024-09-12T17:08:36.021678+0000","last_fullsized":"2024-09-12T17:08:36.021678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:01.468390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"103'13","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023597+0000","last_change":"2024-09-12T17:05:53.552838+0000","last_active":"2024-09-12T17:08:36.023597+0000","last_peered":"2024-09-12T17:08:36.023597+0000","last_clean":"2024-09-12T17:08:36.023597+0000","last_became_active":"2024-09-12T17:05:53.550042+0000","last_became_peered":"2024-09-12T17:05:53.550042+0000","last_unstale":"2024-09-12T17:08:36.023597+0000","last_undegraded":"2024-09-12T17:08:36.023597+0000","last_fullsized":"2024-09-12T17:08:36.023597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021994+0000","last_change":"2024-09-12T17:05:55.558761+0000","last_active":"2024-09-12T17:08:36.021994+0000","last_peered":"2024-09-12T17:08:36.021994+0000","last_clean":"2024-09-12T17:08:36.021994+0000","last_became_active":"2024-09-12T17:05:55.557930+0000","last_became_peered":"2024-09-12T17:05:55.557930+0000","last_unstale":"2024-09-12T17:08:36.021994+0000","last_undegraded":"2024-09-12T17:08:36.021994+0000","last_fullsized":"2024-09-12T17:08:36.021994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.015675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353619+0000","last_change":"2024-09-12T17:05:57.592611+0000","last_active":"2024-09-12T17:08:35.353619+0000","last_peered":"2024-09-12T17:08:35.353619+0000","last_clean":"2024-09-12T17:08:35.353619+0000","last_became_active":"2024-09-12T17:05:57.591855+0000","last_became_peered":"2024-09-12T17:05:57.591855+0000","last_unstale":"2024-09-12T17:08:35.353619+0000","last_undegraded":"2024-09-12T17:08:35.353619+0000","last_fullsized":"2024-09-12T17:08:35.353619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:02.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353645+0000","last_change":"2024-09-12T17:08:18.467848+0000","last_active":"2024-09-12T17:08:35.353645+0000","last_peered":"2024-09-12T17:08:35.353645+0000","last_clean":"2024-09-12T17:08:35.353645+0000","last_became_active":"2024-09-12T17:08:18.466877+0000","last_became_peered":"2024-09-12T17:08:18.466877+0000","last_unstale":"2024-09-12T17:08:35.353645+0000","last_undegraded":"2024-09-12T17:08:35.353645+0000","last_fullsized":"2024-09-12T17:08:35.353645+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:08.084076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"103'12","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.922115+0000","last_change":"2024-09-12T17:05:47.562243+0000","last_active":"2024-09-12T17:09:02.922115+0000","last_peered":"2024-09-12T17:09:02.922115+0000","last_clean":"2024-09-12T17:09:02.922115+0000","last_became_active":"2024-09-12T17:05:47.561587+0000","last_became_peered":"2024-09-12T17:05:47.561587+0000","last_unstale":"2024-09-12T17:09:02.922115+0000","last_undegraded":"2024-09-12T17:09:02.922115+0000","last_fullsized":"2024-09-12T17:09:02.922115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28672,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"29'1","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.604271+0000","last_change":"2024-09-12T17:05:51.542843+0000","last_active":"2024-09-12T17:09:02.604271+0000","last_peered":"2024-09-12T17:09:02.604271+0000","last_clean":"2024-09-12T17:09:02.604271+0000","last_became_active":"2024-09-12T17:05:51.542457+0000","last_became_peered":"2024-09-12T17:05:51.542457+0000","last_unstale":"2024-09-12T17:09:02.604271+0000","last_undegraded":"2024-09-12T17:09:02.604271+0000","last_fullsized":"2024-09-12T17:09:02.604271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.837373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"103'21","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602200+0000","last_change":"2024-09-12T17:05:53.548729+0000","last_active":"2024-09-12T17:08:33.602200+0000","last_peered":"2024-09-12T17:08:33.602200+0000","last_clean":"2024-09-12T17:08:33.602200+0000","last_became_active":"2024-09-12T17:05:53.547990+0000","last_became_peered":"2024-09-12T17:05:53.547990+0000","last_unstale":"2024-09-12T17:08:33.602200+0000","last_undegraded":"2024-09-12T17:08:33.602200+0000","last_fullsized":"2024-09-12T17:08:33.602200+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:22.845485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"103'19","reported_seq":231,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.660710+0000","last_change":"2024-09-12T17:08:21.470468+0000","last_active":"2024-09-12T17:09:02.660710+0000","last_peered":"2024-09-12T17:09:02.660710+0000","last_clean":"2024-09-12T17:09:02.660710+0000","last_became_active":"2024-09-12T17:08:21.465057+0000","last_became_peered":"2024-09-12T17:08:21.465057+0000","last_unstale":"2024-09-12T17:09:02.660710+0000","last_undegraded":"2024-09-12T17:09:02.660710+0000","last_fullsized":"2024-09-12T17:09:02.660710+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.580430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604073+0000","last_change":"2024-09-12T17:05:57.596229+0000","last_active":"2024-09-12T17:08:33.604073+0000","last_peered":"2024-09-12T17:08:33.604073+0000","last_clean":"2024-09-12T17:08:33.604073+0000","last_became_active":"2024-09-12T17:05:57.595658+0000","last_became_peered":"2024-09-12T17:05:57.595658+0000","last_unstale":"2024-09-12T17:08:33.604073+0000","last_undegraded":"2024-09-12T17:08:33.604073+0000","last_fullsized":"2024-09-12T17:08:33.604073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.644627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603857+0000","last_change":"2024-09-12T17:08:18.465360+0000","last_active":"2024-09-12T17:08:33.603857+0000","last_peered":"2024-09-12T17:08:33.603857+0000","last_clean":"2024-09-12T17:08:33.603857+0000","last_became_active":"2024-09-12T17:08:18.464976+0000","last_became_peered":"2024-09-12T17:08:18.464976+0000","last_unstale":"2024-09-12T17:08:33.603857+0000","last_undegraded":"2024-09-12T17:08:33.603857+0000","last_fullsized":"2024-09-12T17:08:33.603857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.772819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"103'15","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603788+0000","last_change":"2024-09-12T17:05:47.535946+0000","last_active":"2024-09-12T17:08:33.603788+0000","last_peered":"2024-09-12T17:08:33.603788+0000","last_clean":"2024-09-12T17:08:33.603788+0000","last_became_active":"2024-09-12T17:05:47.534607+0000","last_became_peered":"2024-09-12T17:05:47.534607+0000","last_unstale":"2024-09-12T17:08:33.603788+0000","last_undegraded":"2024-09-12T17:08:33.603788+0000","last_fullsized":"2024-09-12T17:08:33.603788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":36876,"num_write":47,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022424+0000","last_change":"2024-09-12T17:05:51.548391+0000","last_active":"2024-09-12T17:08:36.022424+0000","last_peered":"2024-09-12T17:08:36.022424+0000","last_clean":"2024-09-12T17:08:36.022424+0000","last_became_active":"2024-09-12T17:05:51.547939+0000","last_became_peered":"2024-09-12T17:05:51.547939+0000","last_unstale":"2024-09-12T17:08:36.022424+0000","last_undegraded":"2024-09-12T17:08:36.022424+0000","last_fullsized":"2024-09-12T17:08:36.022424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:08.848247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"103'28","reported_seq":197,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.843498+0000","last_change":"2024-09-12T17:05:53.535756+0000","last_active":"2024-09-12T17:09:02.843498+0000","last_peered":"2024-09-12T17:09:02.843498+0000","last_clean":"2024-09-12T17:09:02.843498+0000","last_became_active":"2024-09-12T17:05:53.535062+0000","last_became_peered":"2024-09-12T17:05:53.535062+0000","last_unstale":"2024-09-12T17:09:02.843498+0000","last_undegraded":"2024-09-12T17:09:02.843498+0000","last_fullsized":"2024-09-12T17:09:02.843498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10417,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":62,"num_write":32,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019032+0000","last_change":"2024-09-12T17:05:55.564010+0000","last_active":"2024-09-12T17:08:36.019032+0000","last_peered":"2024-09-12T17:08:36.019032+0000","last_clean":"2024-09-12T17:08:36.019032+0000","last_became_active":"2024-09-12T17:05:55.563125+0000","last_became_peered":"2024-09-12T17:05:55.563125+0000","last_unstale":"2024-09-12T17:08:36.019032+0000","last_undegraded":"2024-09-12T17:08:36.019032+0000","last_fullsized":"2024-09-12T17:08:36.019032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:00.697571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114671+0000","last_change":"2024-09-12T17:08:18.459890+0000","last_active":"2024-09-12T17:08:35.114671+0000","last_peered":"2024-09-12T17:08:35.114671+0000","last_clean":"2024-09-12T17:08:35.114671+0000","last_became_active":"2024-09-12T17:08:18.459544+0000","last_became_peered":"2024-09-12T17:08:18.459544+0000","last_unstale":"2024-09-12T17:08:35.114671+0000","last_undegraded":"2024-09-12T17:08:35.114671+0000","last_fullsized":"2024-09-12T17:08:35.114671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:05.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211812+0000","last_change":"2024-09-12T17:05:49.544092+0000","last_active":"2024-09-12T17:08:35.211812+0000","last_peered":"2024-09-12T17:08:35.211812+0000","last_clean":"2024-09-12T17:08:35.211812+0000","last_became_active":"2024-09-12T17:05:49.543307+0000","last_became_peered":"2024-09-12T17:05:49.543307+0000","last_unstale":"2024-09-12T17:08:35.211812+0000","last_undegraded":"2024-09-12T17:08:35.211812+0000","last_fullsized":"2024-09-12T17:08:35.211812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:36.286410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"103'10","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.755135+0000","last_change":"2024-09-12T17:05:47.526678+0000","last_active":"2024-09-12T17:09:02.755135+0000","last_peered":"2024-09-12T17:09:02.755135+0000","last_clean":"2024-09-12T17:09:02.755135+0000","last_became_active":"2024-09-12T17:05:47.525696+0000","last_became_peered":"2024-09-12T17:05:47.525696+0000","last_unstale":"2024-09-12T17:09:02.755135+0000","last_undegraded":"2024-09-12T17:09:02.755135+0000","last_fullsized":"2024-09-12T17:09:02.755135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:59.012258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18438,"num_write":26,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023952+0000","last_change":"2024-09-12T17:05:51.543404+0000","last_active":"2024-09-12T17:08:36.023952+0000","last_peered":"2024-09-12T17:08:36.023952+0000","last_clean":"2024-09-12T17:08:36.023952+0000","last_became_active":"2024-09-12T17:05:51.542737+0000","last_became_peered":"2024-09-12T17:05:51.542737+0000","last_unstale":"2024-09-12T17:08:36.023952+0000","last_undegraded":"2024-09-12T17:08:36.023952+0000","last_fullsized":"2024-09-12T17:08:36.023952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:30.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"103'23","reported_seq":227,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.860878+0000","last_change":"2024-09-12T17:08:21.484446+0000","last_active":"2024-09-12T17:09:02.860878+0000","last_peered":"2024-09-12T17:09:02.860878+0000","last_clean":"2024-09-12T17:09:02.860878+0000","last_became_active":"2024-09-12T17:08:21.465207+0000","last_became_peered":"2024-09-12T17:08:21.465207+0000","last_unstale":"2024-09-12T17:09:02.860878+0000","last_undegraded":"2024-09-12T17:09:02.860878+0000","last_fullsized":"2024-09-12T17:09:02.860878+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:37.839396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":61,"num_write":28,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3559,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603073+0000","last_change":"2024-09-12T17:05:55.565575+0000","last_active":"2024-09-12T17:08:33.603073+0000","last_peered":"2024-09-12T17:08:33.603073+0000","last_clean":"2024-09-12T17:08:33.603073+0000","last_became_active":"2024-09-12T17:05:55.564802+0000","last_became_peered":"2024-09-12T17:05:55.564802+0000","last_unstale":"2024-09-12T17:08:33.603073+0000","last_undegraded":"2024-09-12T17:08:33.603073+0000","last_fullsized":"2024-09-12T17:08:33.603073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022911+0000","last_change":"2024-09-12T17:05:57.592294+0000","last_active":"2024-09-12T17:08:36.022911+0000","last_peered":"2024-09-12T17:08:36.022911+0000","last_clean":"2024-09-12T17:08:36.022911+0000","last_became_active":"2024-09-12T17:05:57.591389+0000","last_became_peered":"2024-09-12T17:05:57.591389+0000","last_unstale":"2024-09-12T17:08:36.022911+0000","last_undegraded":"2024-09-12T17:08:36.022911+0000","last_fullsized":"2024-09-12T17:08:36.022911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'10","reported_seq":177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212458+0000","last_change":"2024-09-12T17:05:49.553177+0000","last_active":"2024-09-12T17:08:35.212458+0000","last_peered":"2024-09-12T17:08:35.212458+0000","last_clean":"2024-09-12T17:08:35.212458+0000","last_became_active":"2024-09-12T17:05:49.552270+0000","last_became_peered":"2024-09-12T17:05:49.552270+0000","last_unstale":"2024-09-12T17:08:35.212458+0000","last_undegraded":"2024-09-12T17:08:35.212458+0000","last_fullsized":"2024-09-12T17:08:35.212458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:34.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"103'10","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.779247+0000","last_change":"2024-09-12T17:05:47.543064+0000","last_active":"2024-09-12T17:09:02.779247+0000","last_peered":"2024-09-12T17:09:02.779247+0000","last_clean":"2024-09-12T17:09:02.779247+0000","last_became_active":"2024-09-12T17:05:47.542362+0000","last_became_peered":"2024-09-12T17:05:47.542362+0000","last_unstale":"2024-09-12T17:09:02.779247+0000","last_undegraded":"2024-09-12T17:09:02.779247+0000","last_fullsized":"2024-09-12T17:09:02.779247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":28672,"num_write":10,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114518+0000","last_change":"2024-09-12T17:08:18.456938+0000","last_active":"2024-09-12T17:08:35.114518+0000","last_peered":"2024-09-12T17:08:35.114518+0000","last_clean":"2024-09-12T17:08:35.114518+0000","last_became_active":"2024-09-12T17:08:18.452101+0000","last_became_peered":"2024-09-12T17:08:18.452101+0000","last_unstale":"2024-09-12T17:08:35.114518+0000","last_undegraded":"2024-09-12T17:08:35.114518+0000","last_fullsized":"2024-09-12T17:08:35.114518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:36.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"103'20","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024589+0000","last_change":"2024-09-12T17:05:53.554531+0000","last_active":"2024-09-12T17:08:36.024589+0000","last_peered":"2024-09-12T17:08:36.024589+0000","last_clean":"2024-09-12T17:08:36.024589+0000","last_became_active":"2024-09-12T17:05:53.554131+0000","last_became_peered":"2024-09-12T17:05:53.554131+0000","last_unstale":"2024-09-12T17:08:36.024589+0000","last_undegraded":"2024-09-12T17:08:36.024589+0000","last_fullsized":"2024-09-12T17:08:36.024589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"103'17","reported_seq":214,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.654428+0000","last_change":"2024-09-12T17:05:55.559204+0000","last_active":"2024-09-12T17:09:02.654428+0000","last_peered":"2024-09-12T17:09:02.654428+0000","last_clean":"2024-09-12T17:09:02.654428+0000","last_became_active":"2024-09-12T17:05:55.556488+0000","last_became_peered":"2024-09-12T17:05:55.556488+0000","last_unstale":"2024-09-12T17:09:02.654428+0000","last_undegraded":"2024-09-12T17:09:02.654428+0000","last_fullsized":"2024-09-12T17:09:02.654428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:15.167640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111231+0000","last_change":"2024-09-12T17:08:18.461886+0000","last_active":"2024-09-12T17:08:35.111231+0000","last_peered":"2024-09-12T17:08:35.111231+0000","last_clean":"2024-09-12T17:08:35.111231+0000","last_became_active":"2024-09-12T17:08:18.460345+0000","last_became_peered":"2024-09-12T17:08:18.460345+0000","last_unstale":"2024-09-12T17:08:35.111231+0000","last_undegraded":"2024-09-12T17:08:35.111231+0000","last_fullsized":"2024-09-12T17:08:35.111231+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:30.011702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"68'6","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212463+0000","last_change":"2024-09-12T17:05:49.562360+0000","last_active":"2024-09-12T17:08:35.212463+0000","last_peered":"2024-09-12T17:08:35.212463+0000","last_clean":"2024-09-12T17:08:35.212463+0000","last_became_active":"2024-09-12T17:05:49.561200+0000","last_became_peered":"2024-09-12T17:05:49.561200+0000","last_unstale":"2024-09-12T17:08:35.212463+0000","last_undegraded":"2024-09-12T17:08:35.212463+0000","last_fullsized":"2024-09-12T17:08:35.212463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.915600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"103'10","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210377+0000","last_change":"2024-09-12T17:05:47.542018+0000","last_active":"2024-09-12T17:08:35.210377+0000","last_peered":"2024-09-12T17:08:35.210377+0000","last_clean":"2024-09-12T17:08:35.210377+0000","last_became_active":"2024-09-12T17:05:47.540484+0000","last_became_peered":"2024-09-12T17:05:47.540484+0000","last_unstale":"2024-09-12T17:08:35.210377+0000","last_undegraded":"2024-09-12T17:08:35.210377+0000","last_fullsized":"2024-09-12T17:08:35.210377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:13.571666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":24585,"num_write":34,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.619866+0000","last_change":"2024-09-12T17:05:51.556083+0000","last_active":"2024-09-12T17:09:02.619866+0000","last_peered":"2024-09-12T17:09:02.619866+0000","last_clean":"2024-09-12T17:09:02.619866+0000","last_became_active":"2024-09-12T17:05:51.554176+0000","last_became_peered":"2024-09-12T17:05:51.554176+0000","last_unstale":"2024-09-12T17:09:02.619866+0000","last_undegraded":"2024-09-12T17:09:02.619866+0000","last_fullsized":"2024-09-12T17:09:02.619866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:02.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024529+0000","last_change":"2024-09-12T17:05:53.553304+0000","last_active":"2024-09-12T17:08:36.024529+0000","last_peered":"2024-09-12T17:08:36.024529+0000","last_clean":"2024-09-12T17:08:36.024529+0000","last_became_active":"2024-09-12T17:05:53.552545+0000","last_became_peered":"2024-09-12T17:05:53.552545+0000","last_unstale":"2024-09-12T17:08:36.024529+0000","last_undegraded":"2024-09-12T17:08:36.024529+0000","last_fullsized":"2024-09-12T17:08:36.024529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"103'19","reported_seq":233,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.657186+0000","last_change":"2024-09-12T17:08:18.628128+0000","last_active":"2024-09-12T17:09:02.657186+0000","last_peered":"2024-09-12T17:09:02.657186+0000","last_clean":"2024-09-12T17:09:02.657186+0000","last_became_active":"2024-09-12T17:08:18.471539+0000","last_became_peered":"2024-09-12T17:08:18.471539+0000","last_unstale":"2024-09-12T17:09:02.657186+0000","last_undegraded":"2024-09-12T17:09:02.657186+0000","last_fullsized":"2024-09-12T17:09:02.657186+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:47.486729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210930+0000","last_change":"2024-09-12T17:05:57.597870+0000","last_active":"2024-09-12T17:08:35.210930+0000","last_peered":"2024-09-12T17:08:35.210930+0000","last_clean":"2024-09-12T17:08:35.210930+0000","last_became_active":"2024-09-12T17:05:57.597076+0000","last_became_peered":"2024-09-12T17:05:57.597076+0000","last_unstale":"2024-09-12T17:08:35.210930+0000","last_undegraded":"2024-09-12T17:08:35.210930+0000","last_fullsized":"2024-09-12T17:08:35.210930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.648974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"68'6","reported_seq":43,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114680+0000","last_change":"2024-09-12T17:08:18.887494+0000","last_active":"2024-09-12T17:08:35.114680+0000","last_peered":"2024-09-12T17:08:35.114680+0000","last_clean":"2024-09-12T17:08:35.114680+0000","last_became_active":"2024-09-12T17:08:18.457423+0000","last_became_peered":"2024-09-12T17:08:18.457423+0000","last_unstale":"2024-09-12T17:08:35.114680+0000","last_undegraded":"2024-09-12T17:08:35.114680+0000","last_fullsized":"2024-09-12T17:08:35.114680+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:59.827727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"103'14","reported_seq":222,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.822321+0000","last_change":"2024-09-12T17:08:18.702553+0000","last_active":"2024-09-12T17:09:02.822321+0000","last_peered":"2024-09-12T17:09:02.822321+0000","last_clean":"2024-09-12T17:09:02.822321+0000","last_became_active":"2024-09-12T17:08:18.449468+0000","last_became_peered":"2024-09-12T17:08:18.449468+0000","last_unstale":"2024-09-12T17:09:02.822321+0000","last_undegraded":"2024-09-12T17:09:02.822321+0000","last_fullsized":"2024-09-12T17:09:02.822321+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:54.548414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":28678,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212218+0000","last_change":"2024-09-12T17:05:51.540047+0000","last_active":"2024-09-12T17:08:35.212218+0000","last_peered":"2024-09-12T17:08:35.212218+0000","last_clean":"2024-09-12T17:08:35.212218+0000","last_became_active":"2024-09-12T17:05:51.539302+0000","last_became_peered":"2024-09-12T17:05:51.539302+0000","last_unstale":"2024-09-12T17:08:35.212218+0000","last_undegraded":"2024-09-12T17:08:35.212218+0000","last_fullsized":"2024-09-12T17:08:35.212218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:21.253801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"103'24","reported_seq":237,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603692+0000","last_change":"2024-09-12T17:08:21.515721+0000","last_active":"2024-09-12T17:08:33.603692+0000","last_peered":"2024-09-12T17:08:33.603692+0000","last_clean":"2024-09-12T17:08:33.603692+0000","last_became_active":"2024-09-12T17:08:21.467530+0000","last_became_peered":"2024-09-12T17:08:21.467530+0000","last_unstale":"2024-09-12T17:08:33.603692+0000","last_undegraded":"2024-09-12T17:08:33.603692+0000","last_fullsized":"2024-09-12T17:08:33.603692+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:04.806432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":37,"num_read_kb":36,"num_write":26,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":12538,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353193+0000","last_change":"2024-09-12T17:05:55.566749+0000","last_active":"2024-09-12T17:08:35.353193+0000","last_peered":"2024-09-12T17:08:35.353193+0000","last_clean":"2024-09-12T17:08:35.353193+0000","last_became_active":"2024-09-12T17:05:55.565979+0000","last_became_peered":"2024-09-12T17:05:55.565979+0000","last_unstale":"2024-09-12T17:08:35.353193+0000","last_undegraded":"2024-09-12T17:08:35.353193+0000","last_fullsized":"2024-09-12T17:08:35.353193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113928+0000","last_change":"2024-09-12T17:08:21.461881+0000","last_active":"2024-09-12T17:08:35.113928+0000","last_peered":"2024-09-12T17:08:35.113928+0000","last_clean":"2024-09-12T17:08:35.113928+0000","last_became_active":"2024-09-12T17:08:21.461496+0000","last_became_peered":"2024-09-12T17:08:21.461496+0000","last_unstale":"2024-09-12T17:08:35.113928+0000","last_undegraded":"2024-09-12T17:08:35.113928+0000","last_fullsized":"2024-09-12T17:08:35.113928+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:41.000825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354192+0000","last_change":"2024-09-12T17:05:49.539487+0000","last_active":"2024-09-12T17:08:35.354192+0000","last_peered":"2024-09-12T17:08:35.354192+0000","last_clean":"2024-09-12T17:08:35.354192+0000","last_became_active":"2024-09-12T17:05:49.538713+0000","last_became_peered":"2024-09-12T17:05:49.538713+0000","last_unstale":"2024-09-12T17:08:35.354192+0000","last_undegraded":"2024-09-12T17:08:35.354192+0000","last_fullsized":"2024-09-12T17:08:35.354192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.731614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":272,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602363+0000","last_change":"2024-09-12T17:05:35.688483+0000","last_active":"2024-09-12T17:08:33.602363+0000","last_peered":"2024-09-12T17:08:33.602363+0000","last_clean":"2024-09-12T17:08:33.602363+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:08:33.602363+0000","last_undegraded":"2024-09-12T17:08:33.602363+0000","last_fullsized":"2024-09-12T17:08:33.602363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_clean_scrub_stamp":"2024-09-12T17:05:34.151079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602740+0000","last_change":"2024-09-12T17:05:42.225793+0000","last_active":"2024-09-12T17:08:33.602740+0000","last_peered":"2024-09-12T17:08:33.602740+0000","last_clean":"2024-09-12T17:08:33.602740+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:08:33.602740+0000","last_undegraded":"2024-09-12T17:08:33.602740+0000","last_fullsized":"2024-09-12T17:08:33.602740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:54.880257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"103'15","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.776822+0000","last_change":"2024-09-12T17:05:47.526243+0000","last_active":"2024-09-12T17:09:02.776822+0000","last_peered":"2024-09-12T17:09:02.776822+0000","last_clean":"2024-09-12T17:09:02.776822+0000","last_became_active":"2024-09-12T17:05:47.525694+0000","last_became_peered":"2024-09-12T17:05:47.525694+0000","last_unstale":"2024-09-12T17:09:02.776822+0000","last_undegraded":"2024-09-12T17:09:02.776822+0000","last_fullsized":"2024-09-12T17:09:02.776822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":38921,"num_write":39,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606510+0000","last_change":"2024-09-12T17:05:51.548356+0000","last_active":"2024-09-12T17:08:33.606510+0000","last_peered":"2024-09-12T17:08:33.606510+0000","last_clean":"2024-09-12T17:08:33.606510+0000","last_became_active":"2024-09-12T17:05:51.547503+0000","last_became_peered":"2024-09-12T17:05:51.547503+0000","last_unstale":"2024-09-12T17:08:33.606510+0000","last_undegraded":"2024-09-12T17:08:33.606510+0000","last_fullsized":"2024-09-12T17:08:33.606510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:47.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"103'36","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.021103+0000","last_change":"2024-09-12T17:05:53.546057+0000","last_active":"2024-09-12T17:09:03.021103+0000","last_peered":"2024-09-12T17:09:03.021103+0000","last_clean":"2024-09-12T17:09:03.021103+0000","last_became_active":"2024-09-12T17:05:53.545266+0000","last_became_peered":"2024-09-12T17:05:53.545266+0000","last_unstale":"2024-09-12T17:09:03.021103+0000","last_undegraded":"2024-09-12T17:09:03.021103+0000","last_fullsized":"2024-09-12T17:09:03.021103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17292,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":82,"num_write":42,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604135+0000","last_change":"2024-09-12T17:05:55.562246+0000","last_active":"2024-09-12T17:08:33.604135+0000","last_peered":"2024-09-12T17:08:33.604135+0000","last_clean":"2024-09-12T17:08:33.604135+0000","last_became_active":"2024-09-12T17:05:55.561410+0000","last_became_peered":"2024-09-12T17:05:55.561410+0000","last_unstale":"2024-09-12T17:08:33.604135+0000","last_undegraded":"2024-09-12T17:08:33.604135+0000","last_fullsized":"2024-09-12T17:08:33.604135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.373235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"68'2","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352549+0000","last_change":"2024-09-12T17:05:57.593095+0000","last_active":"2024-09-12T17:08:35.352549+0000","last_peered":"2024-09-12T17:08:35.352549+0000","last_clean":"2024-09-12T17:08:35.352549+0000","last_became_active":"2024-09-12T17:05:57.592287+0000","last_became_peered":"2024-09-12T17:05:57.592287+0000","last_unstale":"2024-09-12T17:08:35.352549+0000","last_undegraded":"2024-09-12T17:08:35.352549+0000","last_fullsized":"2024-09-12T17:08:35.352549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:52.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604303+0000","last_change":"2024-09-12T17:08:18.465677+0000","last_active":"2024-09-12T17:08:33.604303+0000","last_peered":"2024-09-12T17:08:33.604303+0000","last_clean":"2024-09-12T17:08:33.604303+0000","last_became_active":"2024-09-12T17:08:18.464334+0000","last_became_peered":"2024-09-12T17:08:18.464334+0000","last_unstale":"2024-09-12T17:08:33.604303+0000","last_undegraded":"2024-09-12T17:08:33.604303+0000","last_fullsized":"2024-09-12T17:08:33.604303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:26.356922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601919+0000","last_change":"2024-09-12T17:08:21.462733+0000","last_active":"2024-09-12T17:08:33.601919+0000","last_peered":"2024-09-12T17:08:33.601919+0000","last_clean":"2024-09-12T17:08:33.601919+0000","last_became_active":"2024-09-12T17:08:21.461625+0000","last_became_peered":"2024-09-12T17:08:21.461625+0000","last_unstale":"2024-09-12T17:08:33.601919+0000","last_undegraded":"2024-09-12T17:08:33.601919+0000","last_fullsized":"2024-09-12T17:08:33.601919+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:09.553944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"103'20","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.887400+0000","last_change":"2024-09-12T17:05:47.544269+0000","last_active":"2024-09-12T17:09:02.887400+0000","last_peered":"2024-09-12T17:09:02.887400+0000","last_clean":"2024-09-12T17:09:02.887400+0000","last_became_active":"2024-09-12T17:05:47.543531+0000","last_became_peered":"2024-09-12T17:05:47.543531+0000","last_unstale":"2024-09-12T17:09:02.887400+0000","last_undegraded":"2024-09-12T17:09:02.887400+0000","last_fullsized":"2024-09-12T17:09:02.887400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:55.688363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":40969,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605269+0000","last_change":"2024-09-12T17:08:18.466066+0000","last_active":"2024-09-12T17:08:33.605269+0000","last_peered":"2024-09-12T17:08:33.605269+0000","last_clean":"2024-09-12T17:08:33.605269+0000","last_became_active":"2024-09-12T17:08:18.465027+0000","last_became_peered":"2024-09-12T17:08:18.465027+0000","last_unstale":"2024-09-12T17:08:33.605269+0000","last_undegraded":"2024-09-12T17:08:33.605269+0000","last_fullsized":"2024-09-12T17:08:33.605269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"103'57","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.993286+0000","last_change":"2024-09-12T17:08:21.488130+0000","last_active":"2024-09-12T17:09:02.993286+0000","last_peered":"2024-09-12T17:09:02.993286+0000","last_clean":"2024-09-12T17:09:02.993286+0000","last_became_active":"2024-09-12T17:08:21.455260+0000","last_became_peered":"2024-09-12T17:08:21.455260+0000","last_unstale":"2024-09-12T17:09:02.993286+0000","last_undegraded":"2024-09-12T17:09:02.993286+0000","last_fullsized":"2024-09-12T17:09:02.993286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:08.863638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15100,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":89,"num_read_kb":106,"num_write":49,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":5726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606844+0000","last_change":"2024-09-12T17:05:55.556362+0000","last_active":"2024-09-12T17:08:33.606844+0000","last_peered":"2024-09-12T17:08:33.606844+0000","last_clean":"2024-09-12T17:08:33.606844+0000","last_became_active":"2024-09-12T17:05:55.555625+0000","last_became_peered":"2024-09-12T17:05:55.555625+0000","last_unstale":"2024-09-12T17:08:33.606844+0000","last_undegraded":"2024-09-12T17:08:33.606844+0000","last_fullsized":"2024-09-12T17:08:33.606844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"84'6","reported_seq":45,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114189+0000","last_change":"2024-09-12T17:08:18.577521+0000","last_active":"2024-09-12T17:08:35.114189+0000","last_peered":"2024-09-12T17:08:35.114189+0000","last_clean":"2024-09-12T17:08:35.114189+0000","last_became_active":"2024-09-12T17:08:18.446923+0000","last_became_peered":"2024-09-12T17:08:18.446923+0000","last_unstale":"2024-09-12T17:08:35.114189+0000","last_undegraded":"2024-09-12T17:08:35.114189+0000","last_fullsized":"2024-09-12T17:08:35.114189+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:00.600036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114457+0000","last_change":"2024-09-12T17:08:21.457044+0000","last_active":"2024-09-12T17:08:35.114457+0000","last_peered":"2024-09-12T17:08:35.114457+0000","last_clean":"2024-09-12T17:08:35.114457+0000","last_became_active":"2024-09-12T17:08:21.456705+0000","last_became_peered":"2024-09-12T17:08:21.456705+0000","last_unstale":"2024-09-12T17:08:35.114457+0000","last_undegraded":"2024-09-12T17:08:35.114457+0000","last_fullsized":"2024-09-12T17:08:35.114457+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:57.537595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023245+0000","last_change":"2024-09-12T17:05:42.677413+0000","last_active":"2024-09-12T17:08:36.023245+0000","last_peered":"2024-09-12T17:08:36.023245+0000","last_clean":"2024-09-12T17:08:36.023245+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:08:36.023245+0000","last_undegraded":"2024-09-12T17:08:36.023245+0000","last_fullsized":"2024-09-12T17:08:36.023245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.836885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"103'14","reported_seq":63,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.797960+0000","last_change":"2024-09-12T17:08:18.715809+0000","last_active":"2024-09-12T17:09:02.797960+0000","last_peered":"2024-09-12T17:09:02.797960+0000","last_clean":"2024-09-12T17:09:02.797960+0000","last_became_active":"2024-09-12T17:08:18.446837+0000","last_became_peered":"2024-09-12T17:08:18.446837+0000","last_unstale":"2024-09-12T17:09:02.797960+0000","last_undegraded":"2024-09-12T17:09:02.797960+0000","last_fullsized":"2024-09-12T17:09:02.797960+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:22.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":22,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":161,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025411+0000","last_change":"2024-09-12T17:05:51.557262+0000","last_active":"2024-09-12T17:08:36.025411+0000","last_peered":"2024-09-12T17:08:36.025411+0000","last_clean":"2024-09-12T17:08:36.025411+0000","last_became_active":"2024-09-12T17:05:51.556959+0000","last_became_peered":"2024-09-12T17:05:51.556959+0000","last_unstale":"2024-09-12T17:08:36.025411+0000","last_undegraded":"2024-09-12T17:08:36.025411+0000","last_fullsized":"2024-09-12T17:08:36.025411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.963181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"103'16","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.760375+0000","last_change":"2024-09-12T17:05:53.555384+0000","last_active":"2024-09-12T17:08:36.760375+0000","last_peered":"2024-09-12T17:08:36.760375+0000","last_clean":"2024-09-12T17:08:36.760375+0000","last_became_active":"2024-09-12T17:05:53.554063+0000","last_became_peered":"2024-09-12T17:05:53.554063+0000","last_unstale":"2024-09-12T17:08:36.760375+0000","last_undegraded":"2024-09-12T17:08:36.760375+0000","last_fullsized":"2024-09-12T17:08:36.760375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602091+0000","last_change":"2024-09-12T17:05:55.547595+0000","last_active":"2024-09-12T17:08:33.602091+0000","last_peered":"2024-09-12T17:08:33.602091+0000","last_clean":"2024-09-12T17:08:33.602091+0000","last_became_active":"2024-09-12T17:05:55.546700+0000","last_became_peered":"2024-09-12T17:05:55.546700+0000","last_unstale":"2024-09-12T17:08:33.602091+0000","last_undegraded":"2024-09-12T17:08:33.602091+0000","last_fullsized":"2024-09-12T17:08:33.602091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023225+0000","last_change":"2024-09-12T17:05:57.587955+0000","last_active":"2024-09-12T17:08:36.023225+0000","last_peered":"2024-09-12T17:08:36.023225+0000","last_clean":"2024-09-12T17:08:36.023225+0000","last_became_active":"2024-09-12T17:05:57.587199+0000","last_became_peered":"2024-09-12T17:05:57.587199+0000","last_unstale":"2024-09-12T17:08:36.023225+0000","last_undegraded":"2024-09-12T17:08:36.023225+0000","last_fullsized":"2024-09-12T17:08:36.023225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.422656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114194+0000","last_change":"2024-09-12T17:08:21.456185+0000","last_active":"2024-09-12T17:08:35.114194+0000","last_peered":"2024-09-12T17:08:35.114194+0000","last_clean":"2024-09-12T17:08:35.114194+0000","last_became_active":"2024-09-12T17:08:21.455573+0000","last_became_peered":"2024-09-12T17:08:21.455573+0000","last_unstale":"2024-09-12T17:08:35.114194+0000","last_undegraded":"2024-09-12T17:08:35.114194+0000","last_fullsized":"2024-09-12T17:08:35.114194+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:45.008694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604023+0000","last_change":"2024-09-12T17:08:18.708570+0000","last_active":"2024-09-12T17:08:33.604023+0000","last_peered":"2024-09-12T17:08:33.604023+0000","last_clean":"2024-09-12T17:08:33.604023+0000","last_became_active":"2024-09-12T17:08:18.474152+0000","last_became_peered":"2024-09-12T17:08:18.474152+0000","last_unstale":"2024-09-12T17:08:33.604023+0000","last_undegraded":"2024-09-12T17:08:33.604023+0000","last_fullsized":"2024-09-12T17:08:33.604023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:17.040784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"103'15","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.906836+0000","last_change":"2024-09-12T17:05:47.546543+0000","last_active":"2024-09-12T17:09:02.906836+0000","last_peered":"2024-09-12T17:09:02.906836+0000","last_clean":"2024-09-12T17:09:02.906836+0000","last_became_active":"2024-09-12T17:05:47.545554+0000","last_became_peered":"2024-09-12T17:05:47.545554+0000","last_unstale":"2024-09-12T17:09:02.906836+0000","last_undegraded":"2024-09-12T17:09:02.906836+0000","last_fullsized":"2024-09-12T17:09:02.906836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:07.148131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":32771,"num_write":23,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602766+0000","last_change":"2024-09-12T17:08:18.451242+0000","last_active":"2024-09-12T17:08:33.602766+0000","last_peered":"2024-09-12T17:08:33.602766+0000","last_clean":"2024-09-12T17:08:33.602766+0000","last_became_active":"2024-09-12T17:08:18.450835+0000","last_became_peered":"2024-09-12T17:08:18.450835+0000","last_unstale":"2024-09-12T17:08:33.602766+0000","last_undegraded":"2024-09-12T17:08:33.602766+0000","last_fullsized":"2024-09-12T17:08:33.602766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025686+0000","last_change":"2024-09-12T17:05:53.551499+0000","last_active":"2024-09-12T17:08:36.025686+0000","last_peered":"2024-09-12T17:08:36.025686+0000","last_clean":"2024-09-12T17:08:36.025686+0000","last_became_active":"2024-09-12T17:05:53.550857+0000","last_became_peered":"2024-09-12T17:05:53.550857+0000","last_unstale":"2024-09-12T17:08:36.025686+0000","last_undegraded":"2024-09-12T17:08:36.025686+0000","last_fullsized":"2024-09-12T17:08:36.025686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354430+0000","last_change":"2024-09-12T17:05:55.571619+0000","last_active":"2024-09-12T17:08:35.354430+0000","last_peered":"2024-09-12T17:08:35.354430+0000","last_clean":"2024-09-12T17:08:35.354430+0000","last_became_active":"2024-09-12T17:05:55.570991+0000","last_became_peered":"2024-09-12T17:05:55.570991+0000","last_unstale":"2024-09-12T17:08:35.354430+0000","last_undegraded":"2024-09-12T17:08:35.354430+0000","last_fullsized":"2024-09-12T17:08:35.354430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:02.401831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"84'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601534+0000","last_change":"2024-09-12T17:05:57.590482+0000","last_active":"2024-09-12T17:08:33.601534+0000","last_peered":"2024-09-12T17:08:33.601534+0000","last_clean":"2024-09-12T17:08:33.601534+0000","last_became_active":"2024-09-12T17:05:57.589542+0000","last_became_peered":"2024-09-12T17:05:57.589542+0000","last_unstale":"2024-09-12T17:08:33.601534+0000","last_undegraded":"2024-09-12T17:08:33.601534+0000","last_fullsized":"2024-09-12T17:08:33.601534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:20.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114011+0000","last_change":"2024-09-12T17:08:21.464126+0000","last_active":"2024-09-12T17:08:35.114011+0000","last_peered":"2024-09-12T17:08:35.114011+0000","last_clean":"2024-09-12T17:08:35.114011+0000","last_became_active":"2024-09-12T17:08:21.462608+0000","last_became_peered":"2024-09-12T17:08:21.462608+0000","last_unstale":"2024-09-12T17:08:35.114011+0000","last_undegraded":"2024-09-12T17:08:35.114011+0000","last_fullsized":"2024-09-12T17:08:35.114011+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:15.261389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"103'22","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.841642+0000","last_change":"2024-09-12T17:05:47.525858+0000","last_active":"2024-09-12T17:09:02.841642+0000","last_peered":"2024-09-12T17:09:02.841642+0000","last_clean":"2024-09-12T17:09:02.841642+0000","last_became_active":"2024-09-12T17:05:47.525258+0000","last_became_peered":"2024-09-12T17:05:47.525258+0000","last_unstale":"2024-09-12T17:09:02.841642+0000","last_undegraded":"2024-09-12T17:09:02.841642+0000","last_fullsized":"2024-09-12T17:09:02.841642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":59401,"num_write":46,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111334+0000","last_change":"2024-09-12T17:08:18.462079+0000","last_active":"2024-09-12T17:08:35.111334+0000","last_peered":"2024-09-12T17:08:35.111334+0000","last_clean":"2024-09-12T17:08:35.111334+0000","last_became_active":"2024-09-12T17:08:18.460435+0000","last_became_peered":"2024-09-12T17:08:18.460435+0000","last_unstale":"2024-09-12T17:08:35.111334+0000","last_undegraded":"2024-09-12T17:08:35.111334+0000","last_fullsized":"2024-09-12T17:08:35.111334+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:32.002970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602556+0000","last_change":"2024-09-12T17:05:51.544848+0000","last_active":"2024-09-12T17:08:33.602556+0000","last_peered":"2024-09-12T17:08:33.602556+0000","last_clean":"2024-09-12T17:08:33.602556+0000","last_became_active":"2024-09-12T17:05:51.544078+0000","last_became_peered":"2024-09-12T17:05:51.544078+0000","last_unstale":"2024-09-12T17:08:33.602556+0000","last_undegraded":"2024-09-12T17:08:33.602556+0000","last_fullsized":"2024-09-12T17:08:33.602556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"103'32","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.987420+0000","last_change":"2024-09-12T17:05:53.540181+0000","last_active":"2024-09-12T17:09:02.987420+0000","last_peered":"2024-09-12T17:09:02.987420+0000","last_clean":"2024-09-12T17:09:02.987420+0000","last_became_active":"2024-09-12T17:05:53.539372+0000","last_became_peered":"2024-09-12T17:05:53.539372+0000","last_unstale":"2024-09-12T17:09:02.987420+0000","last_undegraded":"2024-09-12T17:09:02.987420+0000","last_fullsized":"2024-09-12T17:09:02.987420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:58.931466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":63,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211474+0000","last_change":"2024-09-12T17:05:55.554060+0000","last_active":"2024-09-12T17:08:35.211474+0000","last_peered":"2024-09-12T17:08:35.211474+0000","last_clean":"2024-09-12T17:08:35.211474+0000","last_became_active":"2024-09-12T17:05:55.553263+0000","last_became_peered":"2024-09-12T17:05:55.553263+0000","last_unstale":"2024-09-12T17:08:35.211474+0000","last_undegraded":"2024-09-12T17:08:35.211474+0000","last_fullsized":"2024-09-12T17:08:35.211474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:44.303469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602500+0000","last_change":"2024-09-12T17:05:58.121180+0000","last_active":"2024-09-12T17:08:33.602500+0000","last_peered":"2024-09-12T17:08:33.602500+0000","last_clean":"2024-09-12T17:08:33.602500+0000","last_became_active":"2024-09-12T17:05:58.119755+0000","last_became_peered":"2024-09-12T17:05:58.119755+0000","last_unstale":"2024-09-12T17:08:33.602500+0000","last_undegraded":"2024-09-12T17:08:33.602500+0000","last_fullsized":"2024-09-12T17:08:33.602500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603740+0000","last_change":"2024-09-12T17:05:49.550213+0000","last_active":"2024-09-12T17:08:33.603740+0000","last_peered":"2024-09-12T17:08:33.603740+0000","last_clean":"2024-09-12T17:08:33.603740+0000","last_became_active":"2024-09-12T17:05:49.549583+0000","last_became_peered":"2024-09-12T17:05:49.549583+0000","last_unstale":"2024-09-12T17:08:33.603740+0000","last_undegraded":"2024-09-12T17:08:33.603740+0000","last_fullsized":"2024-09-12T17:08:33.603740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:05.085326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"103'12","reported_seq":62,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114456+0000","last_change":"2024-09-12T17:08:18.869145+0000","last_active":"2024-09-12T17:08:35.114456+0000","last_peered":"2024-09-12T17:08:35.114456+0000","last_clean":"2024-09-12T17:08:35.114456+0000","last_became_active":"2024-09-12T17:08:18.448295+0000","last_became_peered":"2024-09-12T17:08:18.448295+0000","last_unstale":"2024-09-12T17:08:35.114456+0000","last_undegraded":"2024-09-12T17:08:35.114456+0000","last_fullsized":"2024-09-12T17:08:35.114456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:20.400937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":16,"num_read_kb":36867,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608651+0000","last_change":"2024-09-12T17:05:42.218804+0000","last_active":"2024-09-12T17:08:33.608651+0000","last_peered":"2024-09-12T17:08:33.608651+0000","last_clean":"2024-09-12T17:08:33.608651+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:08:33.608651+0000","last_undegraded":"2024-09-12T17:08:33.608651+0000","last_fullsized":"2024-09-12T17:08:33.608651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:48.189931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353195+0000","last_change":"2024-09-12T17:05:51.545963+0000","last_active":"2024-09-12T17:08:35.353195+0000","last_peered":"2024-09-12T17:08:35.353195+0000","last_clean":"2024-09-12T17:08:35.353195+0000","last_became_active":"2024-09-12T17:05:51.545225+0000","last_became_peered":"2024-09-12T17:05:51.545225+0000","last_unstale":"2024-09-12T17:08:35.353195+0000","last_undegraded":"2024-09-12T17:08:35.353195+0000","last_fullsized":"2024-09-12T17:08:35.353195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:40.407563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":55,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111954+0000","last_change":"2024-09-12T17:08:18.881993+0000","last_active":"2024-09-12T17:08:35.111954+0000","last_peered":"2024-09-12T17:08:35.111954+0000","last_clean":"2024-09-12T17:08:35.111954+0000","last_became_active":"2024-09-12T17:08:18.456095+0000","last_became_peered":"2024-09-12T17:08:18.456095+0000","last_unstale":"2024-09-12T17:08:35.111954+0000","last_undegraded":"2024-09-12T17:08:35.111954+0000","last_fullsized":"2024-09-12T17:08:35.111954+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:37.132692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"103'19","reported_seq":221,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.650537+0000","last_change":"2024-09-12T17:08:21.492858+0000","last_active":"2024-09-12T17:09:02.650537+0000","last_peered":"2024-09-12T17:09:02.650537+0000","last_clean":"2024-09-12T17:09:02.650537+0000","last_became_active":"2024-09-12T17:08:21.467026+0000","last_became_peered":"2024-09-12T17:08:21.467026+0000","last_unstale":"2024-09-12T17:09:02.650537+0000","last_undegraded":"2024-09-12T17:09:02.650537+0000","last_fullsized":"2024-09-12T17:09:02.650537+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:08.135205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.026036+0000","last_change":"2024-09-12T17:05:58.118437+0000","last_active":"2024-09-12T17:08:36.026036+0000","last_peered":"2024-09-12T17:08:36.026036+0000","last_clean":"2024-09-12T17:08:36.026036+0000","last_became_active":"2024-09-12T17:05:58.117710+0000","last_became_peered":"2024-09-12T17:05:58.117710+0000","last_unstale":"2024-09-12T17:08:36.026036+0000","last_undegraded":"2024-09-12T17:08:36.026036+0000","last_fullsized":"2024-09-12T17:08:36.026036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:00.239807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":126,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019063+0000","last_change":"2024-09-12T17:06:27.817661+0000","last_active":"2024-09-12T17:08:36.019063+0000","last_peered":"2024-09-12T17:08:36.019063+0000","last_clean":"2024-09-12T17:08:36.019063+0000","last_became_active":"2024-09-12T17:06:27.817451+0000","last_became_peered":"2024-09-12T17:06:27.817451+0000","last_unstale":"2024-09-12T17:08:36.019063+0000","last_undegraded":"2024-09-12T17:08:36.019063+0000","last_fullsized":"2024-09-12T17:08:36.019063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:31.000633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"103'11","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.814159+0000","last_change":"2024-09-12T17:05:47.535321+0000","last_active":"2024-09-12T17:09:02.814159+0000","last_peered":"2024-09-12T17:09:02.814159+0000","last_clean":"2024-09-12T17:09:02.814159+0000","last_became_active":"2024-09-12T17:05:47.534790+0000","last_became_peered":"2024-09-12T17:05:47.534790+0000","last_unstale":"2024-09-12T17:09:02.814159+0000","last_undegraded":"2024-09-12T17:09:02.814159+0000","last_fullsized":"2024-09-12T17:09:02.814159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":26627,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115452+0000","last_change":"2024-09-12T17:08:21.467295+0000","last_active":"2024-09-12T17:08:35.115452+0000","last_peered":"2024-09-12T17:08:35.115452+0000","last_clean":"2024-09-12T17:08:35.115452+0000","last_became_active":"2024-09-12T17:08:21.467016+0000","last_became_peered":"2024-09-12T17:08:21.467016+0000","last_unstale":"2024-09-12T17:08:35.115452+0000","last_undegraded":"2024-09-12T17:08:35.115452+0000","last_fullsized":"2024-09-12T17:08:35.115452+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:24.509905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211005+0000","last_change":"2024-09-12T17:05:51.533668+0000","last_active":"2024-09-12T17:08:35.211005+0000","last_peered":"2024-09-12T17:08:35.211005+0000","last_clean":"2024-09-12T17:08:35.211005+0000","last_became_active":"2024-09-12T17:05:51.532795+0000","last_became_peered":"2024-09-12T17:05:51.532795+0000","last_unstale":"2024-09-12T17:08:35.211005+0000","last_undegraded":"2024-09-12T17:08:35.211005+0000","last_fullsized":"2024-09-12T17:08:35.211005+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.655645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211301+0000","last_change":"2024-09-12T17:05:53.544503+0000","last_active":"2024-09-12T17:08:35.211301+0000","last_peered":"2024-09-12T17:08:35.211301+0000","last_clean":"2024-09-12T17:08:35.211301+0000","last_became_active":"2024-09-12T17:05:53.543495+0000","last_became_peered":"2024-09-12T17:05:53.543495+0000","last_unstale":"2024-09-12T17:08:35.211301+0000","last_undegraded":"2024-09-12T17:08:35.211301+0000","last_fullsized":"2024-09-12T17:08:35.211301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.721968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"103'17","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.657864+0000","last_change":"2024-09-12T17:05:55.567580+0000","last_active":"2024-09-12T17:09:02.657864+0000","last_peered":"2024-09-12T17:09:02.657864+0000","last_clean":"2024-09-12T17:09:02.657864+0000","last_became_active":"2024-09-12T17:05:55.566652+0000","last_became_peered":"2024-09-12T17:05:55.566652+0000","last_unstale":"2024-09-12T17:09:02.657864+0000","last_undegraded":"2024-09-12T17:09:02.657864+0000","last_fullsized":"2024-09-12T17:09:02.657864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:28.904117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"68'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602357+0000","last_change":"2024-09-12T17:05:57.585098+0000","last_active":"2024-09-12T17:08:33.602357+0000","last_peered":"2024-09-12T17:08:33.602357+0000","last_clean":"2024-09-12T17:08:33.602357+0000","last_became_active":"2024-09-12T17:05:57.584326+0000","last_became_peered":"2024-09-12T17:05:57.584326+0000","last_unstale":"2024-09-12T17:08:33.602357+0000","last_undegraded":"2024-09-12T17:08:33.602357+0000","last_fullsized":"2024-09-12T17:08:33.602357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210656+0000","last_change":"2024-09-12T17:05:49.553294+0000","last_active":"2024-09-12T17:08:35.210656+0000","last_peered":"2024-09-12T17:08:35.210656+0000","last_clean":"2024-09-12T17:08:35.210656+0000","last_became_active":"2024-09-12T17:05:49.551726+0000","last_became_peered":"2024-09-12T17:05:49.551726+0000","last_unstale":"2024-09-12T17:08:35.210656+0000","last_undegraded":"2024-09-12T17:08:35.210656+0000","last_fullsized":"2024-09-12T17:08:35.210656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:50.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"103'9","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604478+0000","last_change":"2024-09-12T17:08:18.767913+0000","last_active":"2024-09-12T17:08:33.604478+0000","last_peered":"2024-09-12T17:08:33.604478+0000","last_clean":"2024-09-12T17:08:33.604478+0000","last_became_active":"2024-09-12T17:08:18.466136+0000","last_became_peered":"2024-09-12T17:08:18.466136+0000","last_unstale":"2024-09-12T17:08:33.604478+0000","last_undegraded":"2024-09-12T17:08:33.604478+0000","last_fullsized":"2024-09-12T17:08:33.604478+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:20.220833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":24582,"num_write":25,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.355006+0000","last_change":"2024-09-12T17:05:42.680975+0000","last_active":"2024-09-12T17:08:35.355006+0000","last_peered":"2024-09-12T17:08:35.355006+0000","last_clean":"2024-09-12T17:08:35.355006+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:08:35.355006+0000","last_undegraded":"2024-09-12T17:08:35.355006+0000","last_fullsized":"2024-09-12T17:08:35.355006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.660350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022223+0000","last_change":"2024-09-12T17:08:18.450093+0000","last_active":"2024-09-12T17:08:36.022223+0000","last_peered":"2024-09-12T17:08:36.022223+0000","last_clean":"2024-09-12T17:08:36.022223+0000","last_became_active":"2024-09-12T17:08:18.449746+0000","last_became_peered":"2024-09-12T17:08:18.449746+0000","last_unstale":"2024-09-12T17:08:36.022223+0000","last_undegraded":"2024-09-12T17:08:36.022223+0000","last_fullsized":"2024-09-12T17:08:36.022223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:58.736246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"103'47","reported_seq":226,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.943131+0000","last_change":"2024-09-12T17:05:53.554751+0000","last_active":"2024-09-12T17:09:02.943131+0000","last_peered":"2024-09-12T17:09:02.943131+0000","last_clean":"2024-09-12T17:09:02.943131+0000","last_became_active":"2024-09-12T17:05:53.553914+0000","last_became_peered":"2024-09-12T17:05:53.553914+0000","last_unstale":"2024-09-12T17:09:02.943131+0000","last_undegraded":"2024-09-12T17:09:02.943131+0000","last_fullsized":"2024-09-12T17:09:02.943131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13401,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":83,"num_read_kb":141,"num_write":56,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022004+0000","last_change":"2024-09-12T17:08:21.458963+0000","last_active":"2024-09-12T17:08:36.022004+0000","last_peered":"2024-09-12T17:08:36.022004+0000","last_clean":"2024-09-12T17:08:36.022004+0000","last_became_active":"2024-09-12T17:08:21.458521+0000","last_became_peered":"2024-09-12T17:08:21.458521+0000","last_unstale":"2024-09-12T17:08:36.022004+0000","last_undegraded":"2024-09-12T17:08:36.022004+0000","last_fullsized":"2024-09-12T17:08:36.022004+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:56.903898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603355+0000","last_change":"2024-09-12T17:05:57.605829+0000","last_active":"2024-09-12T17:08:33.603355+0000","last_peered":"2024-09-12T17:08:33.603355+0000","last_clean":"2024-09-12T17:08:33.603355+0000","last_became_active":"2024-09-12T17:05:57.605041+0000","last_became_peered":"2024-09-12T17:05:57.605041+0000","last_unstale":"2024-09-12T17:08:33.603355+0000","last_undegraded":"2024-09-12T17:08:33.603355+0000","last_fullsized":"2024-09-12T17:08:33.603355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602885+0000","last_change":"2024-09-12T17:05:57.594498+0000","last_active":"2024-09-12T17:08:33.602885+0000","last_peered":"2024-09-12T17:08:33.602885+0000","last_clean":"2024-09-12T17:08:33.602885+0000","last_became_active":"2024-09-12T17:05:57.590196+0000","last_became_peered":"2024-09-12T17:05:57.590196+0000","last_unstale":"2024-09-12T17:08:33.602885+0000","last_undegraded":"2024-09-12T17:08:33.602885+0000","last_fullsized":"2024-09-12T17:08:33.602885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.543735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212141+0000","last_change":"2024-09-12T17:05:49.562121+0000","last_active":"2024-09-12T17:08:35.212141+0000","last_peered":"2024-09-12T17:08:35.212141+0000","last_clean":"2024-09-12T17:08:35.212141+0000","last_became_active":"2024-09-12T17:05:49.561429+0000","last_became_peered":"2024-09-12T17:05:49.561429+0000","last_unstale":"2024-09-12T17:08:35.212141+0000","last_undegraded":"2024-09-12T17:08:35.212141+0000","last_fullsized":"2024-09-12T17:08:35.212141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:47.663366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"103'14","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.872399+0000","last_change":"2024-09-12T17:05:47.557270+0000","last_active":"2024-09-12T17:09:02.872399+0000","last_peered":"2024-09-12T17:09:02.872399+0000","last_clean":"2024-09-12T17:09:02.872399+0000","last_became_active":"2024-09-12T17:05:47.556417+0000","last_became_peered":"2024-09-12T17:05:47.556417+0000","last_unstale":"2024-09-12T17:09:02.872399+0000","last_undegraded":"2024-09-12T17:09:02.872399+0000","last_fullsized":"2024-09-12T17:09:02.872399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:00.210632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111337+0000","last_change":"2024-09-12T17:08:18.464941+0000","last_active":"2024-09-12T17:08:35.111337+0000","last_peered":"2024-09-12T17:08:35.111337+0000","last_clean":"2024-09-12T17:08:35.111337+0000","last_became_active":"2024-09-12T17:08:18.464091+0000","last_became_peered":"2024-09-12T17:08:18.464091+0000","last_unstale":"2024-09-12T17:08:35.111337+0000","last_undegraded":"2024-09-12T17:08:35.111337+0000","last_fullsized":"2024-09-12T17:08:35.111337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:15.952591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"103'17","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020620+0000","last_change":"2024-09-12T17:05:53.542230+0000","last_active":"2024-09-12T17:08:36.020620+0000","last_peered":"2024-09-12T17:08:36.020620+0000","last_clean":"2024-09-12T17:08:36.020620+0000","last_became_active":"2024-09-12T17:05:53.541653+0000","last_became_peered":"2024-09-12T17:05:53.541653+0000","last_unstale":"2024-09-12T17:08:36.020620+0000","last_undegraded":"2024-09-12T17:08:36.020620+0000","last_fullsized":"2024-09-12T17:08:36.020620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022656+0000","last_change":"2024-09-12T17:05:55.556535+0000","last_active":"2024-09-12T17:08:36.022656+0000","last_peered":"2024-09-12T17:08:36.022656+0000","last_clean":"2024-09-12T17:08:36.022656+0000","last_became_active":"2024-09-12T17:05:55.555755+0000","last_became_peered":"2024-09-12T17:05:55.555755+0000","last_unstale":"2024-09-12T17:08:36.022656+0000","last_undegraded":"2024-09-12T17:08:36.022656+0000","last_fullsized":"2024-09-12T17:08:36.022656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.707384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"84'2","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025238+0000","last_change":"2024-09-12T17:05:57.593418+0000","last_active":"2024-09-12T17:08:36.025238+0000","last_peered":"2024-09-12T17:08:36.025238+0000","last_clean":"2024-09-12T17:08:36.025238+0000","last_became_active":"2024-09-12T17:05:57.592746+0000","last_became_peered":"2024-09-12T17:05:57.592746+0000","last_unstale":"2024-09-12T17:08:36.025238+0000","last_undegraded":"2024-09-12T17:08:36.025238+0000","last_fullsized":"2024-09-12T17:08:36.025238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:24.794382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"68'6","reported_seq":38,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113920+0000","last_change":"2024-09-12T17:08:21.616789+0000","last_active":"2024-09-12T17:08:35.113920+0000","last_peered":"2024-09-12T17:08:35.113920+0000","last_clean":"2024-09-12T17:08:35.113920+0000","last_became_active":"2024-09-12T17:08:21.466328+0000","last_became_peered":"2024-09-12T17:08:21.466328+0000","last_unstale":"2024-09-12T17:08:35.113920+0000","last_undegraded":"2024-09-12T17:08:35.113920+0000","last_fullsized":"2024-09-12T17:08:35.113920+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:16.524646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"103'10","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608107+0000","last_change":"2024-09-12T17:05:47.559497+0000","last_active":"2024-09-12T17:08:33.608107+0000","last_peered":"2024-09-12T17:08:33.608107+0000","last_clean":"2024-09-12T17:08:33.608107+0000","last_became_active":"2024-09-12T17:05:47.558641+0000","last_became_peered":"2024-09-12T17:05:47.558641+0000","last_unstale":"2024-09-12T17:08:33.608107+0000","last_undegraded":"2024-09-12T17:08:33.608107+0000","last_fullsized":"2024-09-12T17:08:33.608107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:00.096304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":24585,"num_write":34,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022987+0000","last_change":"2024-09-12T17:05:51.539784+0000","last_active":"2024-09-12T17:08:36.022987+0000","last_peered":"2024-09-12T17:08:36.022987+0000","last_clean":"2024-09-12T17:08:36.022987+0000","last_became_active":"2024-09-12T17:05:51.539275+0000","last_became_peered":"2024-09-12T17:05:51.539275+0000","last_unstale":"2024-09-12T17:08:36.022987+0000","last_undegraded":"2024-09-12T17:08:36.022987+0000","last_fullsized":"2024-09-12T17:08:36.022987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"84'6","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600440+0000","last_change":"2024-09-12T17:05:53.544731+0000","last_active":"2024-09-12T17:08:33.600440+0000","last_peered":"2024-09-12T17:08:33.600440+0000","last_clean":"2024-09-12T17:08:33.600440+0000","last_became_active":"2024-09-12T17:05:53.544127+0000","last_became_peered":"2024-09-12T17:05:53.544127+0000","last_unstale":"2024-09-12T17:08:33.600440+0000","last_undegraded":"2024-09-12T17:08:33.600440+0000","last_fullsized":"2024-09-12T17:08:33.600440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:04.351698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604873+0000","last_change":"2024-09-12T17:05:55.571541+0000","last_active":"2024-09-12T17:08:33.604873+0000","last_peered":"2024-09-12T17:08:33.604873+0000","last_clean":"2024-09-12T17:08:33.604873+0000","last_became_active":"2024-09-12T17:05:55.570822+0000","last_became_peered":"2024-09-12T17:05:55.570822+0000","last_unstale":"2024-09-12T17:08:33.604873+0000","last_undegraded":"2024-09-12T17:08:33.604873+0000","last_fullsized":"2024-09-12T17:08:33.604873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'2","reported_seq":165,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602495+0000","last_change":"2024-09-12T17:08:18.704689+0000","last_active":"2024-09-12T17:08:33.602495+0000","last_peered":"2024-09-12T17:08:33.602495+0000","last_clean":"2024-09-12T17:08:33.602495+0000","last_became_active":"2024-09-12T17:08:18.450561+0000","last_became_peered":"2024-09-12T17:08:18.450561+0000","last_unstale":"2024-09-12T17:08:33.602495+0000","last_undegraded":"2024-09-12T17:08:33.602495+0000","last_fullsized":"2024-09-12T17:08:33.602495+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:43.088841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021066+0000","last_change":"2024-09-12T17:05:49.520508+0000","last_active":"2024-09-12T17:08:36.021066+0000","last_peered":"2024-09-12T17:08:36.021066+0000","last_clean":"2024-09-12T17:08:36.021066+0000","last_became_active":"2024-09-12T17:05:49.519721+0000","last_became_peered":"2024-09-12T17:05:49.519721+0000","last_unstale":"2024-09-12T17:08:36.021066+0000","last_undegraded":"2024-09-12T17:08:36.021066+0000","last_fullsized":"2024-09-12T17:08:36.021066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"103'10","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606206+0000","last_change":"2024-09-12T17:05:47.539549+0000","last_active":"2024-09-12T17:08:33.606206+0000","last_peered":"2024-09-12T17:08:33.606206+0000","last_clean":"2024-09-12T17:08:33.606206+0000","last_became_active":"2024-09-12T17:05:47.538581+0000","last_became_peered":"2024-09-12T17:05:47.538581+0000","last_unstale":"2024-09-12T17:08:33.606206+0000","last_undegraded":"2024-09-12T17:08:33.606206+0000","last_fullsized":"2024-09-12T17:08:33.606206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.448924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601093+0000","last_change":"2024-09-12T17:05:51.530541+0000","last_active":"2024-09-12T17:08:33.601093+0000","last_peered":"2024-09-12T17:08:33.601093+0000","last_clean":"2024-09-12T17:08:33.601093+0000","last_became_active":"2024-09-12T17:05:51.527515+0000","last_became_peered":"2024-09-12T17:05:51.527515+0000","last_unstale":"2024-09-12T17:08:33.601093+0000","last_undegraded":"2024-09-12T17:08:33.601093+0000","last_fullsized":"2024-09-12T17:08:33.601093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"103'20","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.957945+0000","last_change":"2024-09-12T17:05:53.555017+0000","last_active":"2024-09-12T17:09:02.957945+0000","last_peered":"2024-09-12T17:09:02.957945+0000","last_clean":"2024-09-12T17:09:02.957945+0000","last_became_active":"2024-09-12T17:05:53.551154+0000","last_became_peered":"2024-09-12T17:05:53.551154+0000","last_unstale":"2024-09-12T17:09:02.957945+0000","last_undegraded":"2024-09-12T17:09:02.957945+0000","last_fullsized":"2024-09-12T17:09:02.957945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:50.736153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":37,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353172+0000","last_change":"2024-09-12T17:05:55.570872+0000","last_active":"2024-09-12T17:08:35.353172+0000","last_peered":"2024-09-12T17:08:35.353172+0000","last_clean":"2024-09-12T17:08:35.353172+0000","last_became_active":"2024-09-12T17:05:55.570137+0000","last_became_peered":"2024-09-12T17:05:55.570137+0000","last_unstale":"2024-09-12T17:08:35.353172+0000","last_undegraded":"2024-09-12T17:08:35.353172+0000","last_fullsized":"2024-09-12T17:08:35.353172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.684868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602407+0000","last_change":"2024-09-12T17:05:57.597088+0000","last_active":"2024-09-12T17:08:33.602407+0000","last_peered":"2024-09-12T17:08:33.602407+0000","last_clean":"2024-09-12T17:08:33.602407+0000","last_became_active":"2024-09-12T17:05:57.596377+0000","last_became_peered":"2024-09-12T17:05:57.596377+0000","last_unstale":"2024-09-12T17:08:33.602407+0000","last_undegraded":"2024-09-12T17:08:33.602407+0000","last_fullsized":"2024-09-12T17:08:33.602407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"68'2","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021754+0000","last_change":"2024-09-12T17:08:18.478612+0000","last_active":"2024-09-12T17:08:36.021754+0000","last_peered":"2024-09-12T17:08:36.021754+0000","last_clean":"2024-09-12T17:08:36.021754+0000","last_became_active":"2024-09-12T17:08:18.449338+0000","last_became_peered":"2024-09-12T17:08:18.449338+0000","last_unstale":"2024-09-12T17:08:36.021754+0000","last_undegraded":"2024-09-12T17:08:36.021754+0000","last_fullsized":"2024-09-12T17:08:36.021754+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:15.864351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"103'9","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.920329+0000","last_change":"2024-09-12T17:05:47.526555+0000","last_active":"2024-09-12T17:09:02.920329+0000","last_peered":"2024-09-12T17:09:02.920329+0000","last_clean":"2024-09-12T17:09:02.920329+0000","last_became_active":"2024-09-12T17:05:47.525874+0000","last_became_peered":"2024-09-12T17:05:47.525874+0000","last_unstale":"2024-09-12T17:09:02.920329+0000","last_undegraded":"2024-09-12T17:09:02.920329+0000","last_fullsized":"2024-09-12T17:09:02.920329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":18435,"num_write":17,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353031+0000","last_change":"2024-09-12T17:05:51.540509+0000","last_active":"2024-09-12T17:08:35.353031+0000","last_peered":"2024-09-12T17:08:35.353031+0000","last_clean":"2024-09-12T17:08:35.353031+0000","last_became_active":"2024-09-12T17:05:51.539607+0000","last_became_peered":"2024-09-12T17:05:51.539607+0000","last_unstale":"2024-09-12T17:08:35.353031+0000","last_undegraded":"2024-09-12T17:08:35.353031+0000","last_fullsized":"2024-09-12T17:08:35.353031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:02.652624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"103'17","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.892143+0000","last_change":"2024-09-12T17:05:53.549324+0000","last_active":"2024-09-12T17:09:02.892143+0000","last_peered":"2024-09-12T17:09:02.892143+0000","last_clean":"2024-09-12T17:09:02.892143+0000","last_became_active":"2024-09-12T17:05:53.548561+0000","last_became_peered":"2024-09-12T17:05:53.548561+0000","last_unstale":"2024-09-12T17:09:02.892143+0000","last_undegraded":"2024-09-12T17:09:02.892143+0000","last_fullsized":"2024-09-12T17:09:02.892143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:47.932776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601440+0000","last_change":"2024-09-12T17:05:55.561467+0000","last_active":"2024-09-12T17:08:33.601440+0000","last_peered":"2024-09-12T17:08:33.601440+0000","last_clean":"2024-09-12T17:08:33.601440+0000","last_became_active":"2024-09-12T17:05:55.560708+0000","last_became_peered":"2024-09-12T17:05:55.560708+0000","last_unstale":"2024-09-12T17:08:33.601440+0000","last_undegraded":"2024-09-12T17:08:33.601440+0000","last_fullsized":"2024-09-12T17:08:33.601440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"84'46","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354839+0000","last_change":"2024-09-12T17:05:49.547097+0000","last_active":"2024-09-12T17:08:35.354839+0000","last_peered":"2024-09-12T17:08:35.354839+0000","last_clean":"2024-09-12T17:08:35.354839+0000","last_became_active":"2024-09-12T17:05:49.546232+0000","last_became_peered":"2024-09-12T17:05:49.546232+0000","last_unstale":"2024-09-12T17:08:35.354839+0000","last_undegraded":"2024-09-12T17:08:35.354839+0000","last_fullsized":"2024-09-12T17:08:35.354839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"103'13","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.908917+0000","last_change":"2024-09-12T17:05:47.521779+0000","last_active":"2024-09-12T17:09:02.908917+0000","last_peered":"2024-09-12T17:09:02.908917+0000","last_clean":"2024-09-12T17:09:02.908917+0000","last_became_active":"2024-09-12T17:05:47.521097+0000","last_became_peered":"2024-09-12T17:05:47.521097+0000","last_unstale":"2024-09-12T17:09:02.908917+0000","last_undegraded":"2024-09-12T17:09:02.908917+0000","last_fullsized":"2024-09-12T17:09:02.908917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:37.072896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":24579,"num_write":21,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604192+0000","last_change":"2024-09-12T17:05:51.525803+0000","last_active":"2024-09-12T17:08:33.604192+0000","last_peered":"2024-09-12T17:08:33.604192+0000","last_clean":"2024-09-12T17:08:33.604192+0000","last_became_active":"2024-09-12T17:05:51.525457+0000","last_became_peered":"2024-09-12T17:05:51.525457+0000","last_unstale":"2024-09-12T17:08:33.604192+0000","last_undegraded":"2024-09-12T17:08:33.604192+0000","last_fullsized":"2024-09-12T17:08:33.604192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"103'32","reported_seq":60,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.876148+0000","last_change":"2024-09-12T17:08:19.023629+0000","last_active":"2024-09-12T17:09:02.876148+0000","last_peered":"2024-09-12T17:09:02.876148+0000","last_clean":"2024-09-12T17:09:02.876148+0000","last_became_active":"2024-09-12T17:08:18.463961+0000","last_became_peered":"2024-09-12T17:08:18.463961+0000","last_unstale":"2024-09-12T17:09:02.876148+0000","last_undegraded":"2024-09-12T17:09:02.876148+0000","last_fullsized":"2024-09-12T17:09:02.876148+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:09.409031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":83,"num_write":40,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":16653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603360+0000","last_change":"2024-09-12T17:05:55.563312+0000","last_active":"2024-09-12T17:08:33.603360+0000","last_peered":"2024-09-12T17:08:33.603360+0000","last_clean":"2024-09-12T17:08:33.603360+0000","last_became_active":"2024-09-12T17:05:55.562405+0000","last_became_peered":"2024-09-12T17:05:55.562405+0000","last_unstale":"2024-09-12T17:08:33.603360+0000","last_undegraded":"2024-09-12T17:08:33.603360+0000","last_fullsized":"2024-09-12T17:08:33.603360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022413+0000","last_change":"2024-09-12T17:05:58.121110+0000","last_active":"2024-09-12T17:08:36.022413+0000","last_peered":"2024-09-12T17:08:36.022413+0000","last_clean":"2024-09-12T17:08:36.022413+0000","last_became_active":"2024-09-12T17:05:58.120367+0000","last_became_peered":"2024-09-12T17:05:58.120367+0000","last_unstale":"2024-09-12T17:08:36.022413+0000","last_undegraded":"2024-09-12T17:08:36.022413+0000","last_fullsized":"2024-09-12T17:08:36.022413+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604265+0000","last_change":"2024-09-12T17:05:49.532377+0000","last_active":"2024-09-12T17:08:33.604265+0000","last_peered":"2024-09-12T17:08:33.604265+0000","last_clean":"2024-09-12T17:08:33.604265+0000","last_became_active":"2024-09-12T17:05:49.531975+0000","last_became_peered":"2024-09-12T17:05:49.531975+0000","last_unstale":"2024-09-12T17:08:33.604265+0000","last_undegraded":"2024-09-12T17:08:33.604265+0000","last_fullsized":"2024-09-12T17:08:33.604265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"103'15","reported_seq":61,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.780301+0000","last_change":"2024-09-12T17:08:19.003420+0000","last_active":"2024-09-12T17:09:02.780301+0000","last_peered":"2024-09-12T17:09:02.780301+0000","last_clean":"2024-09-12T17:09:02.780301+0000","last_became_active":"2024-09-12T17:08:18.457074+0000","last_became_peered":"2024-09-12T17:08:18.457074+0000","last_unstale":"2024-09-12T17:09:02.780301+0000","last_undegraded":"2024-09-12T17:09:02.780301+0000","last_fullsized":"2024-09-12T17:09:02.780301+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:07.545826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":36876,"num_write":47,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354606+0000","last_change":"2024-09-12T17:05:51.546117+0000","last_active":"2024-09-12T17:08:35.354606+0000","last_peered":"2024-09-12T17:08:35.354606+0000","last_clean":"2024-09-12T17:08:35.354606+0000","last_became_active":"2024-09-12T17:05:51.545154+0000","last_became_peered":"2024-09-12T17:05:51.545154+0000","last_unstale":"2024-09-12T17:08:35.354606+0000","last_undegraded":"2024-09-12T17:08:35.354606+0000","last_fullsized":"2024-09-12T17:08:35.354606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:49.670591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"103'23","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.924701+0000","last_change":"2024-09-12T17:05:53.558834+0000","last_active":"2024-09-12T17:09:02.924701+0000","last_peered":"2024-09-12T17:09:02.924701+0000","last_clean":"2024-09-12T17:09:02.924701+0000","last_became_active":"2024-09-12T17:05:53.558086+0000","last_became_peered":"2024-09-12T17:05:53.558086+0000","last_unstale":"2024-09-12T17:09:02.924701+0000","last_undegraded":"2024-09-12T17:09:02.924701+0000","last_fullsized":"2024-09-12T17:09:02.924701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:43.690058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":51,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114479+0000","last_change":"2024-09-12T17:08:21.466904+0000","last_active":"2024-09-12T17:08:35.114479+0000","last_peered":"2024-09-12T17:08:35.114479+0000","last_clean":"2024-09-12T17:08:35.114479+0000","last_became_active":"2024-09-12T17:08:21.466295+0000","last_became_peered":"2024-09-12T17:08:21.466295+0000","last_unstale":"2024-09-12T17:08:35.114479+0000","last_undegraded":"2024-09-12T17:08:35.114479+0000","last_fullsized":"2024-09-12T17:08:35.114479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:22.041235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'2","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352817+0000","last_change":"2024-09-12T17:05:57.597468+0000","last_active":"2024-09-12T17:08:35.352817+0000","last_peered":"2024-09-12T17:08:35.352817+0000","last_clean":"2024-09-12T17:08:35.352817+0000","last_became_active":"2024-09-12T17:05:57.596651+0000","last_became_peered":"2024-09-12T17:05:57.596651+0000","last_unstale":"2024-09-12T17:08:35.352817+0000","last_undegraded":"2024-09-12T17:08:35.352817+0000","last_fullsized":"2024-09-12T17:08:35.352817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.466145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024382+0000","last_change":"2024-09-12T17:08:18.465892+0000","last_active":"2024-09-12T17:08:36.024382+0000","last_peered":"2024-09-12T17:08:36.024382+0000","last_clean":"2024-09-12T17:08:36.024382+0000","last_became_active":"2024-09-12T17:08:18.465478+0000","last_became_peered":"2024-09-12T17:08:18.465478+0000","last_unstale":"2024-09-12T17:08:36.024382+0000","last_undegraded":"2024-09-12T17:08:36.024382+0000","last_fullsized":"2024-09-12T17:08:36.024382+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:00.793079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"103'10","reported_seq":214,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.917627+0000","last_change":"2024-09-12T17:08:18.626808+0000","last_active":"2024-09-12T17:09:02.917627+0000","last_peered":"2024-09-12T17:09:02.917627+0000","last_clean":"2024-09-12T17:09:02.917627+0000","last_became_active":"2024-09-12T17:08:18.447694+0000","last_became_peered":"2024-09-12T17:08:18.447694+0000","last_unstale":"2024-09-12T17:09:02.917627+0000","last_undegraded":"2024-09-12T17:09:02.917627+0000","last_fullsized":"2024-09-12T17:09:02.917627+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:09.465286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":28675,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212636+0000","last_change":"2024-09-12T17:05:51.539916+0000","last_active":"2024-09-12T17:08:35.212636+0000","last_peered":"2024-09-12T17:08:35.212636+0000","last_clean":"2024-09-12T17:08:35.212636+0000","last_became_active":"2024-09-12T17:05:51.539054+0000","last_became_peered":"2024-09-12T17:05:51.539054+0000","last_unstale":"2024-09-12T17:08:35.212636+0000","last_undegraded":"2024-09-12T17:08:35.212636+0000","last_fullsized":"2024-09-12T17:08:35.212636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:11.640578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"103'17","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.026096+0000","last_change":"2024-09-12T17:05:53.557081+0000","last_active":"2024-09-12T17:08:36.026096+0000","last_peered":"2024-09-12T17:08:36.026096+0000","last_clean":"2024-09-12T17:08:36.026096+0000","last_became_active":"2024-09-12T17:05:53.556357+0000","last_became_peered":"2024-09-12T17:05:53.556357+0000","last_unstale":"2024-09-12T17:08:36.026096+0000","last_undegraded":"2024-09-12T17:08:36.026096+0000","last_fullsized":"2024-09-12T17:08:36.026096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:10.984649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115218+0000","last_change":"2024-09-12T17:08:21.461633+0000","last_active":"2024-09-12T17:08:35.115218+0000","last_peered":"2024-09-12T17:08:35.115218+0000","last_clean":"2024-09-12T17:08:35.115218+0000","last_became_active":"2024-09-12T17:08:21.460894+0000","last_became_peered":"2024-09-12T17:08:21.460894+0000","last_unstale":"2024-09-12T17:08:35.115218+0000","last_undegraded":"2024-09-12T17:08:35.115218+0000","last_fullsized":"2024-09-12T17:08:35.115218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:18.857770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601884+0000","last_change":"2024-09-12T17:05:57.596779+0000","last_active":"2024-09-12T17:08:33.601884+0000","last_peered":"2024-09-12T17:08:33.601884+0000","last_clean":"2024-09-12T17:08:33.601884+0000","last_became_active":"2024-09-12T17:05:57.596005+0000","last_became_peered":"2024-09-12T17:05:57.596005+0000","last_unstale":"2024-09-12T17:08:33.601884+0000","last_undegraded":"2024-09-12T17:08:33.601884+0000","last_fullsized":"2024-09-12T17:08:33.601884+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024995+0000","last_change":"2024-09-12T17:08:18.445744+0000","last_active":"2024-09-12T17:08:36.024995+0000","last_peered":"2024-09-12T17:08:36.024995+0000","last_clean":"2024-09-12T17:08:36.024995+0000","last_became_active":"2024-09-12T17:08:18.445415+0000","last_became_peered":"2024-09-12T17:08:18.445415+0000","last_unstale":"2024-09-12T17:08:36.024995+0000","last_undegraded":"2024-09-12T17:08:36.024995+0000","last_fullsized":"2024-09-12T17:08:36.024995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:17.325226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"103'16","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.790905+0000","last_change":"2024-09-12T17:05:47.546051+0000","last_active":"2024-09-12T17:09:02.790905+0000","last_peered":"2024-09-12T17:09:02.790905+0000","last_clean":"2024-09-12T17:09:02.790905+0000","last_became_active":"2024-09-12T17:05:47.545466+0000","last_became_peered":"2024-09-12T17:05:47.545466+0000","last_unstale":"2024-09-12T17:09:02.790905+0000","last_undegraded":"2024-09-12T17:09:02.790905+0000","last_fullsized":"2024-09-12T17:09:02.790905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114773+0000","last_change":"2024-09-12T17:08:18.457478+0000","last_active":"2024-09-12T17:08:35.114773+0000","last_peered":"2024-09-12T17:08:35.114773+0000","last_clean":"2024-09-12T17:08:35.114773+0000","last_became_active":"2024-09-12T17:08:18.457099+0000","last_became_peered":"2024-09-12T17:08:18.457099+0000","last_unstale":"2024-09-12T17:08:35.114773+0000","last_undegraded":"2024-09-12T17:08:35.114773+0000","last_fullsized":"2024-09-12T17:08:35.114773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:30.371124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"86'12","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212137+0000","last_change":"2024-09-12T17:05:53.561278+0000","last_active":"2024-09-12T17:08:35.212137+0000","last_peered":"2024-09-12T17:08:35.212137+0000","last_clean":"2024-09-12T17:08:35.212137+0000","last_became_active":"2024-09-12T17:05:53.559688+0000","last_became_peered":"2024-09-12T17:05:53.559688+0000","last_unstale":"2024-09-12T17:08:35.212137+0000","last_undegraded":"2024-09-12T17:08:35.212137+0000","last_fullsized":"2024-09-12T17:08:35.212137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:37.392549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":16,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"103'17","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.647816+0000","last_change":"2024-09-12T17:05:55.576227+0000","last_active":"2024-09-12T17:09:02.647816+0000","last_peered":"2024-09-12T17:09:02.647816+0000","last_clean":"2024-09-12T17:09:02.647816+0000","last_became_active":"2024-09-12T17:05:55.571966+0000","last_became_peered":"2024-09-12T17:05:55.571966+0000","last_unstale":"2024-09-12T17:09:02.647816+0000","last_undegraded":"2024-09-12T17:09:02.647816+0000","last_fullsized":"2024-09-12T17:09:02.647816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:24.680106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601043+0000","last_change":"2024-09-12T17:05:57.595153+0000","last_active":"2024-09-12T17:08:33.601043+0000","last_peered":"2024-09-12T17:08:33.601043+0000","last_clean":"2024-09-12T17:08:33.601043+0000","last_became_active":"2024-09-12T17:05:57.594396+0000","last_became_peered":"2024-09-12T17:05:57.594396+0000","last_unstale":"2024-09-12T17:08:33.601043+0000","last_undegraded":"2024-09-12T17:08:33.601043+0000","last_fullsized":"2024-09-12T17:08:33.601043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:27.040243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211051+0000","last_change":"2024-09-12T17:05:49.543269+0000","last_active":"2024-09-12T17:08:35.211051+0000","last_peered":"2024-09-12T17:08:35.211051+0000","last_clean":"2024-09-12T17:08:35.211051+0000","last_became_active":"2024-09-12T17:05:49.542414+0000","last_became_peered":"2024-09-12T17:05:49.542414+0000","last_unstale":"2024-09-12T17:08:35.211051+0000","last_undegraded":"2024-09-12T17:08:35.211051+0000","last_fullsized":"2024-09-12T17:08:35.211051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:00.645399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"103'18","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.857501+0000","last_change":"2024-09-12T17:06:27.785226+0000","last_active":"2024-09-12T17:09:02.857501+0000","last_peered":"2024-09-12T17:09:02.857501+0000","last_clean":"2024-09-12T17:09:02.857501+0000","last_became_active":"2024-09-12T17:06:27.784897+0000","last_became_peered":"2024-09-12T17:06:27.784897+0000","last_unstale":"2024-09-12T17:09:02.857501+0000","last_undegraded":"2024-09-12T17:09:02.857501+0000","last_fullsized":"2024-09-12T17:09:02.857501+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:25.368283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":49158,"num_write":34,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604574+0000","last_change":"2024-09-12T17:05:51.528322+0000","last_active":"2024-09-12T17:08:33.604574+0000","last_peered":"2024-09-12T17:08:33.604574+0000","last_clean":"2024-09-12T17:08:33.604574+0000","last_became_active":"2024-09-12T17:05:51.527501+0000","last_became_peered":"2024-09-12T17:05:51.527501+0000","last_unstale":"2024-09-12T17:08:33.604574+0000","last_undegraded":"2024-09-12T17:08:33.604574+0000","last_fullsized":"2024-09-12T17:08:33.604574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"103'21","reported_seq":229,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602555+0000","last_change":"2024-09-12T17:08:18.786022+0000","last_active":"2024-09-12T17:08:33.602555+0000","last_peered":"2024-09-12T17:08:33.602555+0000","last_clean":"2024-09-12T17:08:33.602555+0000","last_became_active":"2024-09-12T17:08:18.474969+0000","last_became_peered":"2024-09-12T17:08:18.474969+0000","last_unstale":"2024-09-12T17:08:33.602555+0000","last_undegraded":"2024-09-12T17:08:33.602555+0000","last_fullsized":"2024-09-12T17:08:33.602555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1889,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.599911+0000","last_change":"2024-09-12T17:05:55.567202+0000","last_active":"2024-09-12T17:08:33.599911+0000","last_peered":"2024-09-12T17:08:33.599911+0000","last_clean":"2024-09-12T17:08:33.599911+0000","last_became_active":"2024-09-12T17:05:55.564710+0000","last_became_peered":"2024-09-12T17:05:55.564710+0000","last_unstale":"2024-09-12T17:08:33.599911+0000","last_undegraded":"2024-09-12T17:08:33.599911+0000","last_fullsized":"2024-09-12T17:08:33.599911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608195+0000","last_change":"2024-09-12T17:05:57.604052+0000","last_active":"2024-09-12T17:08:33.608195+0000","last_peered":"2024-09-12T17:08:33.608195+0000","last_clean":"2024-09-12T17:08:33.608195+0000","last_became_active":"2024-09-12T17:05:57.603285+0000","last_became_peered":"2024-09-12T17:05:57.603285+0000","last_unstale":"2024-09-12T17:08:33.608195+0000","last_undegraded":"2024-09-12T17:08:33.608195+0000","last_fullsized":"2024-09-12T17:08:33.608195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:31.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'6","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211495+0000","last_change":"2024-09-12T17:05:49.548224+0000","last_active":"2024-09-12T17:08:35.211495+0000","last_peered":"2024-09-12T17:08:35.211495+0000","last_clean":"2024-09-12T17:08:35.211495+0000","last_became_active":"2024-09-12T17:05:49.541007+0000","last_became_peered":"2024-09-12T17:05:49.541007+0000","last_unstale":"2024-09-12T17:08:35.211495+0000","last_undegraded":"2024-09-12T17:08:35.211495+0000","last_fullsized":"2024-09-12T17:08:35.211495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:59.768842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"103'5","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606468+0000","last_change":"2024-09-12T17:05:47.543197+0000","last_active":"2024-09-12T17:08:33.606468+0000","last_peered":"2024-09-12T17:08:33.606468+0000","last_clean":"2024-09-12T17:08:33.606468+0000","last_became_active":"2024-09-12T17:05:47.542345+0000","last_became_peered":"2024-09-12T17:05:47.542345+0000","last_unstale":"2024-09-12T17:08:33.606468+0000","last_undegraded":"2024-09-12T17:08:33.606468+0000","last_fullsized":"2024-09-12T17:08:33.606468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.858635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":14336,"num_write":5,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602461+0000","last_change":"2024-09-12T17:05:51.556256+0000","last_active":"2024-09-12T17:08:33.602461+0000","last_peered":"2024-09-12T17:08:33.602461+0000","last_clean":"2024-09-12T17:08:33.602461+0000","last_became_active":"2024-09-12T17:05:51.554248+0000","last_became_peered":"2024-09-12T17:05:51.554248+0000","last_unstale":"2024-09-12T17:08:33.602461+0000","last_undegraded":"2024-09-12T17:08:33.602461+0000","last_fullsized":"2024-09-12T17:08:33.602461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"103'14","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600059+0000","last_change":"2024-09-12T17:08:18.486637+0000","last_active":"2024-09-12T17:08:33.600059+0000","last_peered":"2024-09-12T17:08:33.600059+0000","last_clean":"2024-09-12T17:08:33.600059+0000","last_became_active":"2024-09-12T17:08:18.450594+0000","last_became_peered":"2024-09-12T17:08:18.450594+0000","last_unstale":"2024-09-12T17:08:33.600059+0000","last_undegraded":"2024-09-12T17:08:33.600059+0000","last_fullsized":"2024-09-12T17:08:33.600059+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352748+0000","last_change":"2024-09-12T17:05:55.567605+0000","last_active":"2024-09-12T17:08:35.352748+0000","last_peered":"2024-09-12T17:08:35.352748+0000","last_clean":"2024-09-12T17:08:35.352748+0000","last_became_active":"2024-09-12T17:05:55.566774+0000","last_became_peered":"2024-09-12T17:05:55.566774+0000","last_unstale":"2024-09-12T17:08:35.352748+0000","last_undegraded":"2024-09-12T17:08:35.352748+0000","last_fullsized":"2024-09-12T17:08:35.352748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:25.935376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025423+0000","last_change":"2024-09-12T17:05:58.121216+0000","last_active":"2024-09-12T17:08:36.025423+0000","last_peered":"2024-09-12T17:08:36.025423+0000","last_clean":"2024-09-12T17:08:36.025423+0000","last_became_active":"2024-09-12T17:05:58.120364+0000","last_became_peered":"2024-09-12T17:05:58.120364+0000","last_unstale":"2024-09-12T17:08:36.025423+0000","last_undegraded":"2024-09-12T17:08:36.025423+0000","last_fullsized":"2024-09-12T17:08:36.025423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021393+0000","last_change":"2024-09-12T17:05:49.549956+0000","last_active":"2024-09-12T17:08:36.021393+0000","last_peered":"2024-09-12T17:08:36.021393+0000","last_clean":"2024-09-12T17:08:36.021393+0000","last_became_active":"2024-09-12T17:05:49.549481+0000","last_became_peered":"2024-09-12T17:05:49.549481+0000","last_unstale":"2024-09-12T17:08:36.021393+0000","last_undegraded":"2024-09-12T17:08:36.021393+0000","last_fullsized":"2024-09-12T17:08:36.021393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"103'15","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.906950+0000","last_change":"2024-09-12T17:05:47.510898+0000","last_active":"2024-09-12T17:09:02.906950+0000","last_peered":"2024-09-12T17:09:02.906950+0000","last_clean":"2024-09-12T17:09:02.906950+0000","last_became_active":"2024-09-12T17:05:47.510462+0000","last_became_peered":"2024-09-12T17:05:47.510462+0000","last_unstale":"2024-09-12T17:09:02.906950+0000","last_undegraded":"2024-09-12T17:09:02.906950+0000","last_fullsized":"2024-09-12T17:09:02.906950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":30726,"num_write":31,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210191+0000","last_change":"2024-09-12T17:05:51.541454+0000","last_active":"2024-09-12T17:08:35.210191+0000","last_peered":"2024-09-12T17:08:35.210191+0000","last_clean":"2024-09-12T17:08:35.210191+0000","last_became_active":"2024-09-12T17:05:51.539938+0000","last_became_peered":"2024-09-12T17:05:51.539938+0000","last_unstale":"2024-09-12T17:08:35.210191+0000","last_undegraded":"2024-09-12T17:08:35.210191+0000","last_fullsized":"2024-09-12T17:08:35.210191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:18.328350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"103'12","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023900+0000","last_change":"2024-09-12T17:05:53.555764+0000","last_active":"2024-09-12T17:08:36.023900+0000","last_peered":"2024-09-12T17:08:36.023900+0000","last_clean":"2024-09-12T17:08:36.023900+0000","last_became_active":"2024-09-12T17:05:53.552095+0000","last_became_peered":"2024-09-12T17:05:53.552095+0000","last_unstale":"2024-09-12T17:08:36.023900+0000","last_undegraded":"2024-09-12T17:08:36.023900+0000","last_fullsized":"2024-09-12T17:08:36.023900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":24,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210403+0000","last_change":"2024-09-12T17:05:55.571520+0000","last_active":"2024-09-12T17:08:35.210403+0000","last_peered":"2024-09-12T17:08:35.210403+0000","last_clean":"2024-09-12T17:08:35.210403+0000","last_became_active":"2024-09-12T17:05:55.570863+0000","last_became_peered":"2024-09-12T17:05:55.570863+0000","last_unstale":"2024-09-12T17:08:35.210403+0000","last_undegraded":"2024-09-12T17:08:35.210403+0000","last_fullsized":"2024-09-12T17:08:35.210403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607147+0000","last_change":"2024-09-12T17:08:21.467058+0000","last_active":"2024-09-12T17:08:33.607147+0000","last_peered":"2024-09-12T17:08:33.607147+0000","last_clean":"2024-09-12T17:08:33.607147+0000","last_became_active":"2024-09-12T17:08:21.466218+0000","last_became_peered":"2024-09-12T17:08:21.466218+0000","last_unstale":"2024-09-12T17:08:33.607147+0000","last_undegraded":"2024-09-12T17:08:33.607147+0000","last_fullsized":"2024-09-12T17:08:33.607147+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.336998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"84'38","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210705+0000","last_change":"2024-09-12T17:05:49.561555+0000","last_active":"2024-09-12T17:08:35.210705+0000","last_peered":"2024-09-12T17:08:35.210705+0000","last_clean":"2024-09-12T17:08:35.210705+0000","last_became_active":"2024-09-12T17:05:49.560875+0000","last_became_peered":"2024-09-12T17:05:49.560875+0000","last_unstale":"2024-09-12T17:08:35.210705+0000","last_undegraded":"2024-09-12T17:08:35.210705+0000","last_fullsized":"2024-09-12T17:08:35.210705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.493944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"103'17","reported_seq":197,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.778867+0000","last_change":"2024-09-12T17:05:47.528128+0000","last_active":"2024-09-12T17:09:02.778867+0000","last_peered":"2024-09-12T17:09:02.778867+0000","last_clean":"2024-09-12T17:09:02.778867+0000","last_became_active":"2024-09-12T17:05:47.527364+0000","last_became_peered":"2024-09-12T17:05:47.527364+0000","last_unstale":"2024-09-12T17:09:02.778867+0000","last_undegraded":"2024-09-12T17:09:02.778867+0000","last_fullsized":"2024-09-12T17:09:02.778867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":45062,"num_write":33,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":43,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111426+0000","last_change":"2024-09-12T17:08:19.007426+0000","last_active":"2024-09-12T17:08:35.111426+0000","last_peered":"2024-09-12T17:08:35.111426+0000","last_clean":"2024-09-12T17:08:35.111426+0000","last_became_active":"2024-09-12T17:08:18.463879+0000","last_became_peered":"2024-09-12T17:08:18.463879+0000","last_unstale":"2024-09-12T17:08:35.111426+0000","last_undegraded":"2024-09-12T17:08:35.111426+0000","last_fullsized":"2024-09-12T17:08:35.111426+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:10.396675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"103'17","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210611+0000","last_change":"2024-09-12T17:05:53.548391+0000","last_active":"2024-09-12T17:08:35.210611+0000","last_peered":"2024-09-12T17:08:35.210611+0000","last_clean":"2024-09-12T17:08:35.210611+0000","last_became_active":"2024-09-12T17:05:53.547202+0000","last_became_peered":"2024-09-12T17:05:53.547202+0000","last_unstale":"2024-09-12T17:08:35.210611+0000","last_undegraded":"2024-09-12T17:08:35.210611+0000","last_fullsized":"2024-09-12T17:08:35.210611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:00.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":33,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601272+0000","last_change":"2024-09-12T17:05:55.566243+0000","last_active":"2024-09-12T17:08:33.601272+0000","last_peered":"2024-09-12T17:08:33.601272+0000","last_clean":"2024-09-12T17:08:33.601272+0000","last_became_active":"2024-09-12T17:05:55.565403+0000","last_became_peered":"2024-09-12T17:05:55.565403+0000","last_unstale":"2024-09-12T17:08:33.601272+0000","last_undegraded":"2024-09-12T17:08:33.601272+0000","last_fullsized":"2024-09-12T17:08:33.601272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212872+0000","last_change":"2024-09-12T17:05:57.589526+0000","last_active":"2024-09-12T17:08:35.212872+0000","last_peered":"2024-09-12T17:08:35.212872+0000","last_clean":"2024-09-12T17:08:35.212872+0000","last_became_active":"2024-09-12T17:05:57.588626+0000","last_became_peered":"2024-09-12T17:05:57.588626+0000","last_unstale":"2024-09-12T17:08:35.212872+0000","last_undegraded":"2024-09-12T17:08:35.212872+0000","last_fullsized":"2024-09-12T17:08:35.212872+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.472663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114540+0000","last_change":"2024-09-12T17:08:21.473957+0000","last_active":"2024-09-12T17:08:35.114540+0000","last_peered":"2024-09-12T17:08:35.114540+0000","last_clean":"2024-09-12T17:08:35.114540+0000","last_became_active":"2024-09-12T17:08:21.473677+0000","last_became_peered":"2024-09-12T17:08:21.473677+0000","last_unstale":"2024-09-12T17:08:35.114540+0000","last_undegraded":"2024-09-12T17:08:35.114540+0000","last_fullsized":"2024-09-12T17:08:35.114540+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:04.662160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"103'14","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.873429+0000","last_change":"2024-09-12T17:05:47.532523+0000","last_active":"2024-09-12T17:09:02.873429+0000","last_peered":"2024-09-12T17:09:02.873429+0000","last_clean":"2024-09-12T17:09:02.873429+0000","last_became_active":"2024-09-12T17:05:47.531750+0000","last_became_peered":"2024-09-12T17:05:47.531750+0000","last_unstale":"2024-09-12T17:09:02.873429+0000","last_undegraded":"2024-09-12T17:09:02.873429+0000","last_fullsized":"2024-09-12T17:09:02.873429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:03.075435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":36867,"num_write":22,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115367+0000","last_change":"2024-09-12T17:08:21.463425+0000","last_active":"2024-09-12T17:08:35.115367+0000","last_peered":"2024-09-12T17:08:35.115367+0000","last_clean":"2024-09-12T17:08:35.115367+0000","last_became_active":"2024-09-12T17:08:21.462942+0000","last_became_peered":"2024-09-12T17:08:21.462942+0000","last_unstale":"2024-09-12T17:08:35.115367+0000","last_undegraded":"2024-09-12T17:08:35.115367+0000","last_fullsized":"2024-09-12T17:08:35.115367+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:35.256332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"103'14","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.822807+0000","last_change":"2024-09-12T17:05:47.526020+0000","last_active":"2024-09-12T17:09:02.822807+0000","last_peered":"2024-09-12T17:09:02.822807+0000","last_clean":"2024-09-12T17:09:02.822807+0000","last_became_active":"2024-09-12T17:05:47.525481+0000","last_became_peered":"2024-09-12T17:05:47.525481+0000","last_unstale":"2024-09-12T17:09:02.822807+0000","last_undegraded":"2024-09-12T17:09:02.822807+0000","last_fullsized":"2024-09-12T17:09:02.822807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:05.949135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":34819,"num_write":22,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"84'46","reported_seq":211,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604578+0000","last_change":"2024-09-12T17:05:49.546848+0000","last_active":"2024-09-12T17:08:33.604578+0000","last_peered":"2024-09-12T17:08:33.604578+0000","last_clean":"2024-09-12T17:08:33.604578+0000","last_became_active":"2024-09-12T17:05:49.545382+0000","last_became_peered":"2024-09-12T17:05:49.545382+0000","last_unstale":"2024-09-12T17:08:33.604578+0000","last_undegraded":"2024-09-12T17:08:33.604578+0000","last_fullsized":"2024-09-12T17:08:33.604578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:42.832972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"103'11","reported_seq":100,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021943+0000","last_change":"2024-09-12T17:07:28.249892+0000","last_active":"2024-09-12T17:08:36.021943+0000","last_peered":"2024-09-12T17:08:36.021943+0000","last_clean":"2024-09-12T17:08:36.021943+0000","last_became_active":"2024-09-12T17:07:28.191632+0000","last_became_peered":"2024-09-12T17:07:28.191632+0000","last_unstale":"2024-09-12T17:08:36.021943+0000","last_undegraded":"2024-09-12T17:08:36.021943+0000","last_fullsized":"2024-09-12T17:08:36.021943+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.324862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":16390,"num_write":27,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114360+0000","last_change":"2024-09-12T17:08:21.460639+0000","last_active":"2024-09-12T17:08:35.114360+0000","last_peered":"2024-09-12T17:08:35.114360+0000","last_clean":"2024-09-12T17:08:35.114360+0000","last_became_active":"2024-09-12T17:08:21.457133+0000","last_became_peered":"2024-09-12T17:08:21.457133+0000","last_unstale":"2024-09-12T17:08:35.114360+0000","last_undegraded":"2024-09-12T17:08:35.114360+0000","last_fullsized":"2024-09-12T17:08:35.114360+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:58.322770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"103'12","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.857796+0000","last_change":"2024-09-12T17:05:47.530275+0000","last_active":"2024-09-12T17:09:02.857796+0000","last_peered":"2024-09-12T17:09:02.857796+0000","last_clean":"2024-09-12T17:09:02.857796+0000","last_became_active":"2024-09-12T17:05:47.529857+0000","last_became_peered":"2024-09-12T17:05:47.529857+0000","last_unstale":"2024-09-12T17:09:02.857796+0000","last_undegraded":"2024-09-12T17:09:02.857796+0000","last_fullsized":"2024-09-12T17:09:02.857796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:47.999516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":12,"num_read_kb":32768,"num_write":12,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'42","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023289+0000","last_change":"2024-09-12T17:05:49.525070+0000","last_active":"2024-09-12T17:08:36.023289+0000","last_peered":"2024-09-12T17:08:36.023289+0000","last_clean":"2024-09-12T17:08:36.023289+0000","last_became_active":"2024-09-12T17:05:49.524567+0000","last_became_peered":"2024-09-12T17:05:49.524567+0000","last_unstale":"2024-09-12T17:08:36.023289+0000","last_undegraded":"2024-09-12T17:08:36.023289+0000","last_fullsized":"2024-09-12T17:08:36.023289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:34.320123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"103'14","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.841536+0000","last_change":"2024-09-12T17:05:47.547765+0000","last_active":"2024-09-12T17:09:02.841536+0000","last_peered":"2024-09-12T17:09:02.841536+0000","last_clean":"2024-09-12T17:09:02.841536+0000","last_became_active":"2024-09-12T17:05:47.547393+0000","last_became_peered":"2024-09-12T17:05:47.547393+0000","last_unstale":"2024-09-12T17:09:02.841536+0000","last_undegraded":"2024-09-12T17:09:02.841536+0000","last_fullsized":"2024-09-12T17:09:02.841536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:46.746261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":30729,"num_write":38,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211792+0000","last_change":"2024-09-12T17:05:49.561711+0000","last_active":"2024-09-12T17:08:35.211792+0000","last_peered":"2024-09-12T17:08:35.211792+0000","last_clean":"2024-09-12T17:08:35.211792+0000","last_became_active":"2024-09-12T17:05:49.560993+0000","last_became_peered":"2024-09-12T17:05:49.560993+0000","last_unstale":"2024-09-12T17:08:35.211792+0000","last_undegraded":"2024-09-12T17:08:35.211792+0000","last_fullsized":"2024-09-12T17:08:35.211792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:38.400338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"103'11","reported_seq":54,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.754459+0000","last_change":"2024-09-12T17:08:21.614989+0000","last_active":"2024-09-12T17:09:02.754459+0000","last_peered":"2024-09-12T17:09:02.754459+0000","last_clean":"2024-09-12T17:09:02.754459+0000","last_became_active":"2024-09-12T17:08:21.461010+0000","last_became_peered":"2024-09-12T17:08:21.461010+0000","last_unstale":"2024-09-12T17:09:02.754459+0000","last_undegraded":"2024-09-12T17:09:02.754459+0000","last_fullsized":"2024-09-12T17:09:02.754459+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:52.706435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":24579,"num_write":19,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"68'2","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020895+0000","last_change":"2024-09-12T17:08:28.561852+0000","last_active":"2024-09-12T17:08:36.020895+0000","last_peered":"2024-09-12T17:08:36.020895+0000","last_clean":"2024-09-12T17:08:36.020895+0000","last_became_active":"2024-09-12T17:08:28.558588+0000","last_became_peered":"2024-09-12T17:08:28.558588+0000","last_unstale":"2024-09-12T17:08:36.020895+0000","last_undegraded":"2024-09-12T17:08:36.020895+0000","last_fullsized":"2024-09-12T17:08:36.020895+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:45.704667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"103'11","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.817699+0000","last_change":"2024-09-12T17:05:47.541213+0000","last_active":"2024-09-12T17:09:02.817699+0000","last_peered":"2024-09-12T17:09:02.817699+0000","last_clean":"2024-09-12T17:09:02.817699+0000","last_became_active":"2024-09-12T17:05:47.540469+0000","last_became_peered":"2024-09-12T17:05:47.540469+0000","last_unstale":"2024-09-12T17:09:02.817699+0000","last_undegraded":"2024-09-12T17:09:02.817699+0000","last_fullsized":"2024-09-12T17:09:02.817699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:26.620021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":30720,"num_write":11,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"84'42","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352596+0000","last_change":"2024-09-12T17:05:49.541113+0000","last_active":"2024-09-12T17:08:35.352596+0000","last_peered":"2024-09-12T17:08:35.352596+0000","last_clean":"2024-09-12T17:08:35.352596+0000","last_became_active":"2024-09-12T17:05:49.540395+0000","last_became_peered":"2024-09-12T17:05:49.540395+0000","last_unstale":"2024-09-12T17:08:35.352596+0000","last_undegraded":"2024-09-12T17:08:35.352596+0000","last_fullsized":"2024-09-12T17:08:35.352596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:32.506502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"103'22","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.840254+0000","last_change":"2024-09-12T17:05:47.539986+0000","last_active":"2024-09-12T17:09:02.840254+0000","last_peered":"2024-09-12T17:09:02.840254+0000","last_clean":"2024-09-12T17:09:02.840254+0000","last_became_active":"2024-09-12T17:05:47.539603+0000","last_became_peered":"2024-09-12T17:05:47.539603+0000","last_unstale":"2024-09-12T17:09:02.840254+0000","last_undegraded":"2024-09-12T17:09:02.840254+0000","last_fullsized":"2024-09-12T17:09:02.840254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":57350,"num_write":38,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603269+0000","last_change":"2024-09-12T17:05:49.533938+0000","last_active":"2024-09-12T17:08:33.603269+0000","last_peered":"2024-09-12T17:08:33.603269+0000","last_clean":"2024-09-12T17:08:33.603269+0000","last_became_active":"2024-09-12T17:05:49.531769+0000","last_became_peered":"2024-09-12T17:05:49.531769+0000","last_unstale":"2024-09-12T17:08:33.603269+0000","last_undegraded":"2024-09-12T17:08:33.603269+0000","last_fullsized":"2024-09-12T17:08:33.603269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:33.763423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"103'16","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.917037+0000","last_change":"2024-09-12T17:05:47.525739+0000","last_active":"2024-09-12T17:09:02.917037+0000","last_peered":"2024-09-12T17:09:02.917037+0000","last_clean":"2024-09-12T17:09:02.917037+0000","last_became_active":"2024-09-12T17:05:47.524922+0000","last_became_peered":"2024-09-12T17:05:47.524922+0000","last_unstale":"2024-09-12T17:09:02.917037+0000","last_undegraded":"2024-09-12T17:09:02.917037+0000","last_fullsized":"2024-09-12T17:09:02.917037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":38915,"num_write":24,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212448+0000","last_change":"2024-09-12T17:05:49.555307+0000","last_active":"2024-09-12T17:08:35.212448+0000","last_peered":"2024-09-12T17:08:35.212448+0000","last_clean":"2024-09-12T17:08:35.212448+0000","last_became_active":"2024-09-12T17:05:49.554566+0000","last_became_peered":"2024-09-12T17:05:49.554566+0000","last_unstale":"2024-09-12T17:08:35.212448+0000","last_undegraded":"2024-09-12T17:08:35.212448+0000","last_fullsized":"2024-09-12T17:08:35.212448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:45.017623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"103'15","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.857358+0000","last_change":"2024-09-12T17:05:47.543468+0000","last_active":"2024-09-12T17:09:02.857358+0000","last_peered":"2024-09-12T17:09:02.857358+0000","last_clean":"2024-09-12T17:09:02.857358+0000","last_became_active":"2024-09-12T17:05:47.542753+0000","last_became_peered":"2024-09-12T17:05:47.542753+0000","last_unstale":"2024-09-12T17:09:02.857358+0000","last_undegraded":"2024-09-12T17:09:02.857358+0000","last_fullsized":"2024-09-12T17:09:02.857358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":34825,"num_write":39,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'34","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024298+0000","last_change":"2024-09-12T17:05:49.536693+0000","last_active":"2024-09-12T17:08:36.024298+0000","last_peered":"2024-09-12T17:08:36.024298+0000","last_clean":"2024-09-12T17:08:36.024298+0000","last_became_active":"2024-09-12T17:05:49.536385+0000","last_became_peered":"2024-09-12T17:05:49.536385+0000","last_unstale":"2024-09-12T17:08:36.024298+0000","last_undegraded":"2024-09-12T17:08:36.024298+0000","last_fullsized":"2024-09-12T17:08:36.024298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.024498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"103'8","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.786570+0000","last_change":"2024-09-12T17:05:47.545251+0000","last_active":"2024-09-12T17:09:02.786570+0000","last_peered":"2024-09-12T17:09:02.786570+0000","last_clean":"2024-09-12T17:09:02.786570+0000","last_became_active":"2024-09-12T17:05:47.544406+0000","last_became_peered":"2024-09-12T17:05:47.544406+0000","last_unstale":"2024-09-12T17:09:02.786570+0000","last_undegraded":"2024-09-12T17:09:02.786570+0000","last_fullsized":"2024-09-12T17:09:02.786570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:52.167194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":20483,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"84'38","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212586+0000","last_change":"2024-09-12T17:05:49.564446+0000","last_active":"2024-09-12T17:08:35.212586+0000","last_peered":"2024-09-12T17:08:35.212586+0000","last_clean":"2024-09-12T17:08:35.212586+0000","last_became_active":"2024-09-12T17:05:49.563625+0000","last_became_peered":"2024-09-12T17:05:49.563625+0000","last_unstale":"2024-09-12T17:08:35.212586+0000","last_undegraded":"2024-09-12T17:08:35.212586+0000","last_fullsized":"2024-09-12T17:08:35.212586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.324265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"103'14","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.914550+0000","last_change":"2024-09-12T17:05:47.558422+0000","last_active":"2024-09-12T17:09:02.914550+0000","last_peered":"2024-09-12T17:09:02.914550+0000","last_clean":"2024-09-12T17:09:02.914550+0000","last_became_active":"2024-09-12T17:05:47.558047+0000","last_became_peered":"2024-09-12T17:05:47.558047+0000","last_unstale":"2024-09-12T17:09:02.914550+0000","last_undegraded":"2024-09-12T17:09:02.914550+0000","last_fullsized":"2024-09-12T17:09:02.914550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:25.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":38912,"num_write":14,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604202+0000","last_change":"2024-09-12T17:05:49.522750+0000","last_active":"2024-09-12T17:08:33.604202+0000","last_peered":"2024-09-12T17:08:33.604202+0000","last_clean":"2024-09-12T17:08:33.604202+0000","last_became_active":"2024-09-12T17:05:49.522097+0000","last_became_peered":"2024-09-12T17:05:49.522097+0000","last_unstale":"2024-09-12T17:08:33.604202+0000","last_undegraded":"2024-09-12T17:08:33.604202+0000","last_fullsized":"2024-09-12T17:08:33.604202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"84'14","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354038+0000","last_change":"2024-09-12T17:05:47.552865+0000","last_active":"2024-09-12T17:08:35.354038+0000","last_peered":"2024-09-12T17:08:35.354038+0000","last_clean":"2024-09-12T17:08:35.354038+0000","last_became_active":"2024-09-12T17:05:47.552207+0000","last_became_peered":"2024-09-12T17:05:47.552207+0000","last_unstale":"2024-09-12T17:08:35.354038+0000","last_undegraded":"2024-09-12T17:08:35.354038+0000","last_fullsized":"2024-09-12T17:08:35.354038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:00.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40969,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601066+0000","last_change":"2024-09-12T17:08:18.465159+0000","last_active":"2024-09-12T17:08:33.601066+0000","last_peered":"2024-09-12T17:08:33.601066+0000","last_clean":"2024-09-12T17:08:33.601066+0000","last_became_active":"2024-09-12T17:08:18.464823+0000","last_became_peered":"2024-09-12T17:08:18.464823+0000","last_unstale":"2024-09-12T17:08:33.601066+0000","last_undegraded":"2024-09-12T17:08:33.601066+0000","last_fullsized":"2024-09-12T17:08:33.601066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:08.427170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"103'19","reported_seq":199,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.857170+0000","last_change":"2024-09-12T17:05:47.561338+0000","last_active":"2024-09-12T17:09:02.857170+0000","last_peered":"2024-09-12T17:09:02.857170+0000","last_clean":"2024-09-12T17:09:02.857170+0000","last_became_active":"2024-09-12T17:05:47.560439+0000","last_became_peered":"2024-09-12T17:05:47.560439+0000","last_unstale":"2024-09-12T17:09:02.857170+0000","last_undegraded":"2024-09-12T17:09:02.857170+0000","last_fullsized":"2024-09-12T17:09:02.857170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:58.530869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":23,"num_read_kb":51203,"num_write":27,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":124,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601674+0000","last_change":"2024-09-12T17:06:27.819106+0000","last_active":"2024-09-12T17:08:33.601674+0000","last_peered":"2024-09-12T17:08:33.601674+0000","last_clean":"2024-09-12T17:08:33.601674+0000","last_became_active":"2024-09-12T17:06:27.818761+0000","last_became_peered":"2024-09-12T17:06:27.818761+0000","last_unstale":"2024-09-12T17:08:33.601674+0000","last_undegraded":"2024-09-12T17:08:33.601674+0000","last_fullsized":"2024-09-12T17:08:33.601674+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:29.107938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"103'10","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020147+0000","last_change":"2024-09-12T17:05:47.512066+0000","last_active":"2024-09-12T17:08:36.020147+0000","last_peered":"2024-09-12T17:08:36.020147+0000","last_clean":"2024-09-12T17:08:36.020147+0000","last_became_active":"2024-09-12T17:05:47.511470+0000","last_became_peered":"2024-09-12T17:05:47.511470+0000","last_unstale":"2024-09-12T17:08:36.020147+0000","last_undegraded":"2024-09-12T17:08:36.020147+0000","last_fullsized":"2024-09-12T17:08:36.020147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:38.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":30723,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601648+0000","last_change":"2024-09-12T17:05:49.523060+0000","last_active":"2024-09-12T17:08:33.601648+0000","last_peered":"2024-09-12T17:08:33.601648+0000","last_clean":"2024-09-12T17:08:33.601648+0000","last_became_active":"2024-09-12T17:05:49.522157+0000","last_became_peered":"2024-09-12T17:05:49.522157+0000","last_unstale":"2024-09-12T17:08:33.601648+0000","last_undegraded":"2024-09-12T17:08:33.601648+0000","last_fullsized":"2024-09-12T17:08:33.601648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"103'7","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.917317+0000","last_change":"2024-09-12T17:05:47.538305+0000","last_active":"2024-09-12T17:09:02.917317+0000","last_peered":"2024-09-12T17:09:02.917317+0000","last_clean":"2024-09-12T17:09:02.917317+0000","last_became_active":"2024-09-12T17:05:47.535569+0000","last_became_peered":"2024-09-12T17:05:47.535569+0000","last_unstale":"2024-09-12T17:09:02.917317+0000","last_undegraded":"2024-09-12T17:09:02.917317+0000","last_fullsized":"2024-09-12T17:09:02.917317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:24.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":18432,"num_write":7,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"103'6","reported_seq":177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603301+0000","last_change":"2024-09-12T17:05:47.537712+0000","last_active":"2024-09-12T17:08:33.603301+0000","last_peered":"2024-09-12T17:08:33.603301+0000","last_clean":"2024-09-12T17:08:33.603301+0000","last_became_active":"2024-09-12T17:05:47.536958+0000","last_became_peered":"2024-09-12T17:05:47.536958+0000","last_unstale":"2024-09-12T17:08:33.603301+0000","last_undegraded":"2024-09-12T17:08:33.603301+0000","last_fullsized":"2024-09-12T17:08:33.603301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603188+0000","last_change":"2024-09-12T17:05:49.544841+0000","last_active":"2024-09-12T17:08:33.603188+0000","last_peered":"2024-09-12T17:08:33.603188+0000","last_clean":"2024-09-12T17:08:33.603188+0000","last_became_active":"2024-09-12T17:05:49.538757+0000","last_became_peered":"2024-09-12T17:05:49.538757+0000","last_unstale":"2024-09-12T17:08:33.603188+0000","last_undegraded":"2024-09-12T17:08:33.603188+0000","last_fullsized":"2024-09-12T17:08:33.603188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.976348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'9","reported_seq":55,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113825+0000","last_change":"2024-09-12T17:08:18.573927+0000","last_active":"2024-09-12T17:08:35.113825+0000","last_peered":"2024-09-12T17:08:35.113825+0000","last_clean":"2024-09-12T17:08:35.113825+0000","last_became_active":"2024-09-12T17:08:18.441161+0000","last_became_peered":"2024-09-12T17:08:18.441161+0000","last_unstale":"2024-09-12T17:08:35.113825+0000","last_undegraded":"2024-09-12T17:08:35.113825+0000","last_fullsized":"2024-09-12T17:08:35.113825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:21.365549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24582,"num_write":25,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605089+0000","last_change":"2024-09-12T17:05:49.552327+0000","last_active":"2024-09-12T17:08:33.605089+0000","last_peered":"2024-09-12T17:08:33.605089+0000","last_clean":"2024-09-12T17:08:33.605089+0000","last_became_active":"2024-09-12T17:05:49.551604+0000","last_became_peered":"2024-09-12T17:05:49.551604+0000","last_unstale":"2024-09-12T17:08:33.605089+0000","last_undegraded":"2024-09-12T17:08:33.605089+0000","last_fullsized":"2024-09-12T17:08:33.605089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:55.648527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":40,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":199313,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":1041,"num_read_kb":1183,"num_write":700,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":41697,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":149266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":648,"ondisk_log_size":648,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1867,"num_read_kb":1448,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1063256064,"num_objects":282,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":1251,"num_read_kb":2031945,"num_write":1698,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":241172480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2130706432,"data_stored":2130706432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":818,"ondisk_log_size":818,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373108,"kb_used_data":333644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93998732,"statfs":{"total":96636764160,"available":96254701568,"internally_reserved":0,"allocated":341651456,"data_stored":341057930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282368,"kb_used_data":247000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94089472,"statfs":{"total":96636764160,"available":96347619328,"internally_reserved":0,"allocated":252928000,"data_stored":252374789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542191,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472932,"kb_used_data":437588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93898908,"statfs":{"total":96636764160,"available":96152481792,"internally_reserved":0,"allocated":448090112,"data_stored":447463741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542191,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":491220,"kb_used_data":455876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93880620,"statfs":{"total":96636764160,"available":96133754880,"internally_reserved":0,"allocated":466817024,"data_stored":466283240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542191,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":515856,"kb_used_data":480512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93855984,"statfs":{"total":96636764160,"available":96108527616,"internally_reserved":0,"allocated":492044288,"data_stored":491456479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347864,"kb_used_data":312520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94023976,"statfs":{"total":96636764160,"available":96280551424,"internally_reserved":0,"allocated":320020480,"data_stored":319476386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259876,"kb_used_data":224532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94111964,"statfs":{"total":96636764160,"available":96370651136,"internally_reserved":0,"allocated":229920768,"data_stored":229334328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":508228,"kb_used_data":472880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93863612,"statfs":{"total":96636764160,"available":96116338688,"internally_reserved":0,"allocated":484229120,"data_stored":483658507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":291504128,"data_stored":291504128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167772160,"data_stored":167772160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":213909504,"data_stored":213909504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":308281344,"data_stored":308281344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":325058560,"data_stored":325058560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":289406976,"data_stored":289406976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":245366784,"data_stored":245366784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":289406976,"data_stored":289406976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":12604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":31219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":8049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":52317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":12533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":15981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:09:04.285 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T17:09:04.285 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:09:04.665 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:09:04.671 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:09:04.692 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-12T17:09:03.991223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1064047377,"num_objects":480,"num_object_clones":0,"num_object_copies":960,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":480,"num_whiteouts":0,"num_read":4321,"num_read_kb":2034725,"num_write":3259,"num_write_kb":2050308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":241214307,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2199,"ondisk_log_size":2199,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3251452,"kb_used_data":2964552,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":751723268,"statfs":{"total":773094113280,"available":769764626432,"internally_reserved":0,"allocated":3035701248,"data_stored":3031105400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":289394224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-572562112,"num_objects":-158,"num_object_clones":0,"num_object_copies":-316,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-158,"num_whiteouts":0,"num_read":285,"num_read_kb":273,"num_write":207,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005779"},"pg_stats":[{"pgid":"3.3f","version":"103'23","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.906381+0000","last_change":"2024-09-12T17:05:47.561581+0000","last_active":"2024-09-12T17:09:02.906381+0000","last_peered":"2024-09-12T17:09:02.906381+0000","last_clean":"2024-09-12T17:09:02.906381+0000","last_became_active":"2024-09-12T17:05:47.560791+0000","last_became_peered":"2024-09-12T17:05:47.560791+0000","last_unstale":"2024-09-12T17:09:02.906381+0000","last_undegraded":"2024-09-12T17:09:02.906381+0000","last_fullsized":"2024-09-12T17:09:02.906381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:23.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":57356,"num_write":55,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"84'44","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602148+0000","last_change":"2024-09-12T17:05:49.558060+0000","last_active":"2024-09-12T17:08:33.602148+0000","last_peered":"2024-09-12T17:08:33.602148+0000","last_clean":"2024-09-12T17:08:33.602148+0000","last_became_active":"2024-09-12T17:05:49.557287+0000","last_became_peered":"2024-09-12T17:05:49.557287+0000","last_unstale":"2024-09-12T17:08:33.602148+0000","last_undegraded":"2024-09-12T17:08:33.602148+0000","last_fullsized":"2024-09-12T17:08:33.602148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":132,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"103'4","reported_seq":43,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115586+0000","last_change":"2024-09-12T17:08:21.529824+0000","last_active":"2024-09-12T17:08:35.115586+0000","last_peered":"2024-09-12T17:08:35.115586+0000","last_clean":"2024-09-12T17:08:35.115586+0000","last_became_active":"2024-09-12T17:08:21.462766+0000","last_became_peered":"2024-09-12T17:08:21.462766+0000","last_unstale":"2024-09-12T17:08:35.115586+0000","last_undegraded":"2024-09-12T17:08:35.115586+0000","last_fullsized":"2024-09-12T17:08:35.115586+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:47.442324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605094+0000","last_change":"2024-09-12T17:08:18.454422+0000","last_active":"2024-09-12T17:08:33.605094+0000","last_peered":"2024-09-12T17:08:33.605094+0000","last_clean":"2024-09-12T17:08:33.605094+0000","last_became_active":"2024-09-12T17:08:18.442986+0000","last_became_peered":"2024-09-12T17:08:18.442986+0000","last_unstale":"2024-09-12T17:08:33.605094+0000","last_undegraded":"2024-09-12T17:08:33.605094+0000","last_fullsized":"2024-09-12T17:08:33.605094+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:26.720649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"103'21","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.906983+0000","last_change":"2024-09-12T17:05:47.523052+0000","last_active":"2024-09-12T17:09:02.906983+0000","last_peered":"2024-09-12T17:09:02.906983+0000","last_clean":"2024-09-12T17:09:02.906983+0000","last_became_active":"2024-09-12T17:05:47.522544+0000","last_became_peered":"2024-09-12T17:05:47.522544+0000","last_unstale":"2024-09-12T17:09:02.906983+0000","last_undegraded":"2024-09-12T17:09:02.906983+0000","last_fullsized":"2024-09-12T17:09:02.906983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":38921,"num_write":45,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"84'34","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211197+0000","last_change":"2024-09-12T17:05:49.549990+0000","last_active":"2024-09-12T17:08:35.211197+0000","last_peered":"2024-09-12T17:08:35.211197+0000","last_clean":"2024-09-12T17:08:35.211197+0000","last_became_active":"2024-09-12T17:05:49.549241+0000","last_became_peered":"2024-09-12T17:05:49.549241+0000","last_unstale":"2024-09-12T17:08:35.211197+0000","last_undegraded":"2024-09-12T17:08:35.211197+0000","last_fullsized":"2024-09-12T17:08:35.211197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.601256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"84'12","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024742+0000","last_change":"2024-09-12T17:06:27.748679+0000","last_active":"2024-09-12T17:08:36.024742+0000","last_peered":"2024-09-12T17:08:36.024742+0000","last_clean":"2024-09-12T17:08:36.024742+0000","last_became_active":"2024-09-12T17:06:27.748390+0000","last_became_peered":"2024-09-12T17:06:27.748390+0000","last_unstale":"2024-09-12T17:08:36.024742+0000","last_undegraded":"2024-09-12T17:08:36.024742+0000","last_fullsized":"2024-09-12T17:08:36.024742+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:58.547350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":30732,"num_write":44,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602063+0000","last_change":"2024-09-12T17:05:49.542142+0000","last_active":"2024-09-12T17:08:33.602063+0000","last_peered":"2024-09-12T17:08:33.602063+0000","last_clean":"2024-09-12T17:08:33.602063+0000","last_became_active":"2024-09-12T17:05:49.541354+0000","last_became_peered":"2024-09-12T17:05:49.541354+0000","last_unstale":"2024-09-12T17:08:33.602063+0000","last_undegraded":"2024-09-12T17:08:33.602063+0000","last_fullsized":"2024-09-12T17:08:33.602063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.147865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"103'10","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.777908+0000","last_change":"2024-09-12T17:05:47.556154+0000","last_active":"2024-09-12T17:09:02.777908+0000","last_peered":"2024-09-12T17:09:02.777908+0000","last_clean":"2024-09-12T17:09:02.777908+0000","last_became_active":"2024-09-12T17:05:47.555396+0000","last_became_peered":"2024-09-12T17:05:47.555396+0000","last_unstale":"2024-09-12T17:09:02.777908+0000","last_undegraded":"2024-09-12T17:09:02.777908+0000","last_fullsized":"2024-09-12T17:09:02.777908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:27.784208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":22534,"num_write":26,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353568+0000","last_change":"2024-09-12T17:05:49.529344+0000","last_active":"2024-09-12T17:08:35.353568+0000","last_peered":"2024-09-12T17:08:35.353568+0000","last_clean":"2024-09-12T17:08:35.353568+0000","last_became_active":"2024-09-12T17:05:49.528184+0000","last_became_peered":"2024-09-12T17:05:49.528184+0000","last_unstale":"2024-09-12T17:08:35.353568+0000","last_undegraded":"2024-09-12T17:08:35.353568+0000","last_fullsized":"2024-09-12T17:08:35.353568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:18.357328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"103'14","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.802584+0000","last_change":"2024-09-12T17:05:47.532931+0000","last_active":"2024-09-12T17:09:02.802584+0000","last_peered":"2024-09-12T17:09:02.802584+0000","last_clean":"2024-09-12T17:09:02.802584+0000","last_became_active":"2024-09-12T17:05:47.531427+0000","last_became_peered":"2024-09-12T17:05:47.531427+0000","last_unstale":"2024-09-12T17:09:02.802584+0000","last_undegraded":"2024-09-12T17:09:02.802584+0000","last_fullsized":"2024-09-12T17:09:02.802584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":34822,"num_write":30,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212195+0000","last_change":"2024-09-12T17:05:49.550694+0000","last_active":"2024-09-12T17:08:35.212195+0000","last_peered":"2024-09-12T17:08:35.212195+0000","last_clean":"2024-09-12T17:08:35.212195+0000","last_became_active":"2024-09-12T17:05:49.549066+0000","last_became_peered":"2024-09-12T17:05:49.549066+0000","last_unstale":"2024-09-12T17:08:35.212195+0000","last_undegraded":"2024-09-12T17:08:35.212195+0000","last_fullsized":"2024-09-12T17:08:35.212195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:24.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"103'10","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.969636+0000","last_change":"2024-09-12T17:05:47.560085+0000","last_active":"2024-09-12T17:09:02.969636+0000","last_peered":"2024-09-12T17:09:02.969636+0000","last_clean":"2024-09-12T17:09:02.969636+0000","last_became_active":"2024-09-12T17:05:47.559160+0000","last_became_peered":"2024-09-12T17:05:47.559160+0000","last_unstale":"2024-09-12T17:09:02.969636+0000","last_undegraded":"2024-09-12T17:09:02.969636+0000","last_fullsized":"2024-09-12T17:09:02.969636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:06.664677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":20483,"num_write":18,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'2","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604685+0000","last_change":"2024-09-12T17:08:18.490456+0000","last_active":"2024-09-12T17:08:33.604685+0000","last_peered":"2024-09-12T17:08:33.604685+0000","last_clean":"2024-09-12T17:08:33.604685+0000","last_became_active":"2024-09-12T17:08:18.471124+0000","last_became_peered":"2024-09-12T17:08:18.471124+0000","last_unstale":"2024-09-12T17:08:33.604685+0000","last_undegraded":"2024-09-12T17:08:33.604685+0000","last_fullsized":"2024-09-12T17:08:33.604685+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.772819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"103'11","reported_seq":147,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:58.008482+0000","last_change":"2024-09-12T17:06:27.748750+0000","last_active":"2024-09-12T17:08:58.008482+0000","last_peered":"2024-09-12T17:08:58.008482+0000","last_clean":"2024-09-12T17:08:58.008482+0000","last_became_active":"2024-09-12T17:06:27.748329+0000","last_became_peered":"2024-09-12T17:06:27.748329+0000","last_unstale":"2024-09-12T17:08:58.008482+0000","last_undegraded":"2024-09-12T17:08:58.008482+0000","last_fullsized":"2024-09-12T17:08:58.008482+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:26.773943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":26633,"num_write":35,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024893+0000","last_change":"2024-09-12T17:07:28.190678+0000","last_active":"2024-09-12T17:08:36.024893+0000","last_peered":"2024-09-12T17:08:36.024893+0000","last_clean":"2024-09-12T17:08:36.024893+0000","last_became_active":"2024-09-12T17:07:28.190245+0000","last_became_peered":"2024-09-12T17:07:28.190245+0000","last_unstale":"2024-09-12T17:08:36.024893+0000","last_undegraded":"2024-09-12T17:08:36.024893+0000","last_fullsized":"2024-09-12T17:08:36.024893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:04.220150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210683+0000","last_change":"2024-09-12T17:05:49.549575+0000","last_active":"2024-09-12T17:08:35.210683+0000","last_peered":"2024-09-12T17:08:35.210683+0000","last_clean":"2024-09-12T17:08:35.210683+0000","last_became_active":"2024-09-12T17:05:49.548292+0000","last_became_peered":"2024-09-12T17:05:49.548292+0000","last_unstale":"2024-09-12T17:08:35.210683+0000","last_undegraded":"2024-09-12T17:08:35.210683+0000","last_fullsized":"2024-09-12T17:08:35.210683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"103'8","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.917846+0000","last_change":"2024-09-12T17:08:28.649055+0000","last_active":"2024-09-12T17:09:02.917846+0000","last_peered":"2024-09-12T17:09:02.917846+0000","last_clean":"2024-09-12T17:09:02.917846+0000","last_became_active":"2024-09-12T17:08:28.568157+0000","last_became_peered":"2024-09-12T17:08:28.568157+0000","last_unstale":"2024-09-12T17:09:02.917846+0000","last_undegraded":"2024-09-12T17:09:02.917846+0000","last_fullsized":"2024-09-12T17:09:02.917846+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:11.023137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":18434,"num_write":16,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605305+0000","last_change":"2024-09-12T17:08:18.455416+0000","last_active":"2024-09-12T17:08:33.605305+0000","last_peered":"2024-09-12T17:08:33.605305+0000","last_clean":"2024-09-12T17:08:33.605305+0000","last_became_active":"2024-09-12T17:08:18.454062+0000","last_became_peered":"2024-09-12T17:08:18.454062+0000","last_unstale":"2024-09-12T17:08:33.605305+0000","last_undegraded":"2024-09-12T17:08:33.605305+0000","last_fullsized":"2024-09-12T17:08:33.605305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:38.260106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"103'14","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354508+0000","last_change":"2024-09-12T17:05:47.528338+0000","last_active":"2024-09-12T17:08:35.354508+0000","last_peered":"2024-09-12T17:08:35.354508+0000","last_clean":"2024-09-12T17:08:35.354508+0000","last_became_active":"2024-09-12T17:05:47.527533+0000","last_became_peered":"2024-09-12T17:05:47.527533+0000","last_unstale":"2024-09-12T17:08:35.354508+0000","last_undegraded":"2024-09-12T17:08:35.354508+0000","last_fullsized":"2024-09-12T17:08:35.354508+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.693731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":34828,"num_write":46,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"84'30","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603444+0000","last_change":"2024-09-12T17:05:49.543097+0000","last_active":"2024-09-12T17:08:33.603444+0000","last_peered":"2024-09-12T17:08:33.603444+0000","last_clean":"2024-09-12T17:08:33.603444+0000","last_became_active":"2024-09-12T17:05:49.542113+0000","last_became_peered":"2024-09-12T17:05:49.542113+0000","last_unstale":"2024-09-12T17:08:33.603444+0000","last_undegraded":"2024-09-12T17:08:33.603444+0000","last_fullsized":"2024-09-12T17:08:33.603444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":90,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"103'17","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.906813+0000","last_change":"2024-09-12T17:05:47.529868+0000","last_active":"2024-09-12T17:09:02.906813+0000","last_peered":"2024-09-12T17:09:02.906813+0000","last_clean":"2024-09-12T17:09:02.906813+0000","last_became_active":"2024-09-12T17:05:47.529083+0000","last_became_peered":"2024-09-12T17:05:47.529083+0000","last_unstale":"2024-09-12T17:09:02.906813+0000","last_undegraded":"2024-09-12T17:09:02.906813+0000","last_fullsized":"2024-09-12T17:09:02.906813+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:16.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":40969,"num_write":41,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023501+0000","last_change":"2024-09-12T17:05:49.548084+0000","last_active":"2024-09-12T17:08:36.023501+0000","last_peered":"2024-09-12T17:08:36.023501+0000","last_clean":"2024-09-12T17:08:36.023501+0000","last_became_active":"2024-09-12T17:05:49.539930+0000","last_became_peered":"2024-09-12T17:05:49.539930+0000","last_unstale":"2024-09-12T17:08:36.023501+0000","last_undegraded":"2024-09-12T17:08:36.023501+0000","last_fullsized":"2024-09-12T17:08:36.023501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:11.453390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"103'10","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.939249+0000","last_change":"2024-09-12T17:05:47.548316+0000","last_active":"2024-09-12T17:09:02.939249+0000","last_peered":"2024-09-12T17:09:02.939249+0000","last_clean":"2024-09-12T17:09:02.939249+0000","last_became_active":"2024-09-12T17:05:47.547430+0000","last_became_peered":"2024-09-12T17:05:47.547430+0000","last_unstale":"2024-09-12T17:09:02.939249+0000","last_undegraded":"2024-09-12T17:09:02.939249+0000","last_fullsized":"2024-09-12T17:09:02.939249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:21.143073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":20483,"num_write":18,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024500+0000","last_change":"2024-09-12T17:05:49.556144+0000","last_active":"2024-09-12T17:08:36.024500+0000","last_peered":"2024-09-12T17:08:36.024500+0000","last_clean":"2024-09-12T17:08:36.024500+0000","last_became_active":"2024-09-12T17:05:49.555033+0000","last_became_peered":"2024-09-12T17:05:49.555033+0000","last_unstale":"2024-09-12T17:08:36.024500+0000","last_undegraded":"2024-09-12T17:08:36.024500+0000","last_fullsized":"2024-09-12T17:08:36.024500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:08.056726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"103'15","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.953662+0000","last_change":"2024-09-12T17:05:47.511375+0000","last_active":"2024-09-12T17:09:02.953662+0000","last_peered":"2024-09-12T17:09:02.953662+0000","last_clean":"2024-09-12T17:09:02.953662+0000","last_became_active":"2024-09-12T17:05:47.510364+0000","last_became_peered":"2024-09-12T17:05:47.510364+0000","last_unstale":"2024-09-12T17:09:02.953662+0000","last_undegraded":"2024-09-12T17:09:02.953662+0000","last_fullsized":"2024-09-12T17:09:02.953662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":38912,"num_write":15,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212219+0000","last_change":"2024-09-12T17:08:18.448181+0000","last_active":"2024-09-12T17:08:35.212219+0000","last_peered":"2024-09-12T17:08:35.212219+0000","last_clean":"2024-09-12T17:08:35.212219+0000","last_became_active":"2024-09-12T17:08:18.447353+0000","last_became_peered":"2024-09-12T17:08:18.447353+0000","last_unstale":"2024-09-12T17:08:35.212219+0000","last_undegraded":"2024-09-12T17:08:35.212219+0000","last_fullsized":"2024-09-12T17:08:35.212219+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:07.836287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"103'6","reported_seq":199,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601669+0000","last_change":"2024-09-12T17:08:18.831302+0000","last_active":"2024-09-12T17:08:33.601669+0000","last_peered":"2024-09-12T17:08:33.601669+0000","last_clean":"2024-09-12T17:08:33.601669+0000","last_became_active":"2024-09-12T17:08:18.467826+0000","last_became_peered":"2024-09-12T17:08:18.467826+0000","last_unstale":"2024-09-12T17:08:33.601669+0000","last_undegraded":"2024-09-12T17:08:33.601669+0000","last_fullsized":"2024-09-12T17:08:33.601669+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:24.964574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":14339,"num_write":14,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10485760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"84'2","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210149+0000","last_change":"2024-09-12T17:05:57.588515+0000","last_active":"2024-09-12T17:08:35.210149+0000","last_peered":"2024-09-12T17:08:35.210149+0000","last_clean":"2024-09-12T17:08:35.210149+0000","last_became_active":"2024-09-12T17:05:57.587891+0000","last_became_peered":"2024-09-12T17:05:57.587891+0000","last_unstale":"2024-09-12T17:08:35.210149+0000","last_undegraded":"2024-09-12T17:08:35.210149+0000","last_fullsized":"2024-09-12T17:08:35.210149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:24.257847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022681+0000","last_change":"2024-09-12T17:08:21.457874+0000","last_active":"2024-09-12T17:08:36.022681+0000","last_peered":"2024-09-12T17:08:36.022681+0000","last_clean":"2024-09-12T17:08:36.022681+0000","last_became_active":"2024-09-12T17:08:21.457526+0000","last_became_peered":"2024-09-12T17:08:21.457526+0000","last_unstale":"2024-09-12T17:08:36.022681+0000","last_undegraded":"2024-09-12T17:08:36.022681+0000","last_fullsized":"2024-09-12T17:08:36.022681+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:37.646866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"103'14","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604793+0000","last_change":"2024-09-12T17:05:47.557687+0000","last_active":"2024-09-12T17:08:33.604793+0000","last_peered":"2024-09-12T17:08:33.604793+0000","last_clean":"2024-09-12T17:08:33.604793+0000","last_became_active":"2024-09-12T17:05:47.556980+0000","last_became_peered":"2024-09-12T17:05:47.556980+0000","last_unstale":"2024-09-12T17:08:33.604793+0000","last_undegraded":"2024-09-12T17:08:33.604793+0000","last_fullsized":"2024-09-12T17:08:33.604793+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.891909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":38921,"num_write":38,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606120+0000","last_change":"2024-09-12T17:08:18.472276+0000","last_active":"2024-09-12T17:08:33.606120+0000","last_peered":"2024-09-12T17:08:33.606120+0000","last_clean":"2024-09-12T17:08:33.606120+0000","last_became_active":"2024-09-12T17:08:18.471264+0000","last_became_peered":"2024-09-12T17:08:18.471264+0000","last_unstale":"2024-09-12T17:08:33.606120+0000","last_undegraded":"2024-09-12T17:08:33.606120+0000","last_fullsized":"2024-09-12T17:08:33.606120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:10.434396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"103'15","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603950+0000","last_change":"2024-09-12T17:05:53.537592+0000","last_active":"2024-09-12T17:08:33.603950+0000","last_peered":"2024-09-12T17:08:33.603950+0000","last_clean":"2024-09-12T17:08:33.603950+0000","last_became_active":"2024-09-12T17:05:53.536921+0000","last_became_peered":"2024-09-12T17:05:53.536921+0000","last_unstale":"2024-09-12T17:08:33.603950+0000","last_undegraded":"2024-09-12T17:08:33.603950+0000","last_fullsized":"2024-09-12T17:08:33.603950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:25.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":16,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607496+0000","last_change":"2024-09-12T17:05:55.559431+0000","last_active":"2024-09-12T17:08:33.607496+0000","last_peered":"2024-09-12T17:08:33.607496+0000","last_clean":"2024-09-12T17:08:33.607496+0000","last_became_active":"2024-09-12T17:05:55.558297+0000","last_became_peered":"2024-09-12T17:05:55.558297+0000","last_unstale":"2024-09-12T17:08:33.607496+0000","last_undegraded":"2024-09-12T17:08:33.607496+0000","last_fullsized":"2024-09-12T17:08:33.607496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"84'4","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601882+0000","last_change":"2024-09-12T17:05:57.592599+0000","last_active":"2024-09-12T17:08:33.601882+0000","last_peered":"2024-09-12T17:08:33.601882+0000","last_clean":"2024-09-12T17:08:33.601882+0000","last_became_active":"2024-09-12T17:05:57.591877+0000","last_became_peered":"2024-09-12T17:05:57.591877+0000","last_unstale":"2024-09-12T17:08:33.601882+0000","last_undegraded":"2024-09-12T17:08:33.601882+0000","last_fullsized":"2024-09-12T17:08:33.601882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:57.557525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"68'6","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605335+0000","last_change":"2024-09-12T17:05:49.546093+0000","last_active":"2024-09-12T17:08:33.605335+0000","last_peered":"2024-09-12T17:08:33.605335+0000","last_clean":"2024-09-12T17:08:33.605335+0000","last_became_active":"2024-09-12T17:05:49.544425+0000","last_became_peered":"2024-09-12T17:05:49.544425+0000","last_unstale":"2024-09-12T17:08:33.605335+0000","last_undegraded":"2024-09-12T17:08:33.605335+0000","last_fullsized":"2024-09-12T17:08:33.605335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.495950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"103'10","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.917328+0000","last_change":"2024-09-12T17:05:47.535295+0000","last_active":"2024-09-12T17:09:02.917328+0000","last_peered":"2024-09-12T17:09:02.917328+0000","last_clean":"2024-09-12T17:09:02.917328+0000","last_became_active":"2024-09-12T17:05:47.534833+0000","last_became_peered":"2024-09-12T17:05:47.534833+0000","last_unstale":"2024-09-12T17:09:02.917328+0000","last_undegraded":"2024-09-12T17:09:02.917328+0000","last_fullsized":"2024-09-12T17:09:02.917328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":22528,"num_write":10,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023193+0000","last_change":"2024-09-12T17:05:51.533888+0000","last_active":"2024-09-12T17:08:36.023193+0000","last_peered":"2024-09-12T17:08:36.023193+0000","last_clean":"2024-09-12T17:08:36.023193+0000","last_became_active":"2024-09-12T17:05:51.533164+0000","last_became_peered":"2024-09-12T17:05:51.533164+0000","last_unstale":"2024-09-12T17:08:36.023193+0000","last_undegraded":"2024-09-12T17:08:36.023193+0000","last_fullsized":"2024-09-12T17:08:36.023193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:33.007858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":165,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212582+0000","last_change":"2024-09-12T17:05:53.549534+0000","last_active":"2024-09-12T17:08:35.212582+0000","last_peered":"2024-09-12T17:08:35.212582+0000","last_clean":"2024-09-12T17:08:35.212582+0000","last_became_active":"2024-09-12T17:05:53.548824+0000","last_became_peered":"2024-09-12T17:05:53.548824+0000","last_unstale":"2024-09-12T17:08:35.212582+0000","last_undegraded":"2024-09-12T17:08:35.212582+0000","last_fullsized":"2024-09-12T17:08:35.212582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.765832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211657+0000","last_change":"2024-09-12T17:05:55.557468+0000","last_active":"2024-09-12T17:08:35.211657+0000","last_peered":"2024-09-12T17:08:35.211657+0000","last_clean":"2024-09-12T17:08:35.211657+0000","last_became_active":"2024-09-12T17:05:55.556689+0000","last_became_peered":"2024-09-12T17:05:55.556689+0000","last_unstale":"2024-09-12T17:08:35.211657+0000","last_undegraded":"2024-09-12T17:08:35.211657+0000","last_fullsized":"2024-09-12T17:08:35.211657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:56.879576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601144+0000","last_change":"2024-09-12T17:05:57.589569+0000","last_active":"2024-09-12T17:08:33.601144+0000","last_peered":"2024-09-12T17:08:33.601144+0000","last_clean":"2024-09-12T17:08:33.601144+0000","last_became_active":"2024-09-12T17:05:57.588649+0000","last_became_peered":"2024-09-12T17:05:57.588649+0000","last_unstale":"2024-09-12T17:08:33.601144+0000","last_undegraded":"2024-09-12T17:08:33.601144+0000","last_fullsized":"2024-09-12T17:08:33.601144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"68'10","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604412+0000","last_change":"2024-09-12T17:05:49.531436+0000","last_active":"2024-09-12T17:08:33.604412+0000","last_peered":"2024-09-12T17:08:33.604412+0000","last_clean":"2024-09-12T17:08:33.604412+0000","last_became_active":"2024-09-12T17:05:49.530687+0000","last_became_peered":"2024-09-12T17:05:49.530687+0000","last_unstale":"2024-09-12T17:08:33.604412+0000","last_undegraded":"2024-09-12T17:08:33.604412+0000","last_fullsized":"2024-09-12T17:08:33.604412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"103'14","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.756552+0000","last_change":"2024-09-12T17:05:47.564709+0000","last_active":"2024-09-12T17:09:02.756552+0000","last_peered":"2024-09-12T17:09:02.756552+0000","last_clean":"2024-09-12T17:09:02.756552+0000","last_became_active":"2024-09-12T17:05:47.564189+0000","last_became_peered":"2024-09-12T17:05:47.564189+0000","last_unstale":"2024-09-12T17:09:02.756552+0000","last_undegraded":"2024-09-12T17:09:02.756552+0000","last_fullsized":"2024-09-12T17:09:02.756552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":34825,"num_write":38,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.026238+0000","last_change":"2024-09-12T17:08:18.465074+0000","last_active":"2024-09-12T17:08:36.026238+0000","last_peered":"2024-09-12T17:08:36.026238+0000","last_clean":"2024-09-12T17:08:36.026238+0000","last_became_active":"2024-09-12T17:08:18.464648+0000","last_became_peered":"2024-09-12T17:08:18.464648+0000","last_unstale":"2024-09-12T17:08:36.026238+0000","last_undegraded":"2024-09-12T17:08:36.026238+0000","last_fullsized":"2024-09-12T17:08:36.026238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:04.122655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023933+0000","last_change":"2024-09-12T17:05:53.549328+0000","last_active":"2024-09-12T17:08:36.023933+0000","last_peered":"2024-09-12T17:08:36.023933+0000","last_clean":"2024-09-12T17:08:36.023933+0000","last_became_active":"2024-09-12T17:05:53.548968+0000","last_became_peered":"2024-09-12T17:05:53.548968+0000","last_unstale":"2024-09-12T17:08:36.023933+0000","last_undegraded":"2024-09-12T17:08:36.023933+0000","last_fullsized":"2024-09-12T17:08:36.023933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:36.974950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"103'19","reported_seq":233,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.652838+0000","last_change":"2024-09-12T17:08:21.488239+0000","last_active":"2024-09-12T17:09:02.652838+0000","last_peered":"2024-09-12T17:09:02.652838+0000","last_clean":"2024-09-12T17:09:02.652838+0000","last_became_active":"2024-09-12T17:08:21.464957+0000","last_became_peered":"2024-09-12T17:08:21.464957+0000","last_unstale":"2024-09-12T17:09:02.652838+0000","last_undegraded":"2024-09-12T17:09:02.652838+0000","last_fullsized":"2024-09-12T17:09:02.652838+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.266320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210946+0000","last_change":"2024-09-12T17:05:58.122522+0000","last_active":"2024-09-12T17:08:35.210946+0000","last_peered":"2024-09-12T17:08:35.210946+0000","last_clean":"2024-09-12T17:08:35.210946+0000","last_became_active":"2024-09-12T17:05:58.121871+0000","last_became_peered":"2024-09-12T17:05:58.121871+0000","last_unstale":"2024-09-12T17:08:35.210946+0000","last_undegraded":"2024-09-12T17:08:35.210946+0000","last_fullsized":"2024-09-12T17:08:35.210946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:22.625236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025587+0000","last_change":"2024-09-12T17:05:49.528766+0000","last_active":"2024-09-12T17:08:36.025587+0000","last_peered":"2024-09-12T17:08:36.025587+0000","last_clean":"2024-09-12T17:08:36.025587+0000","last_became_active":"2024-09-12T17:05:49.527758+0000","last_became_peered":"2024-09-12T17:05:49.527758+0000","last_unstale":"2024-09-12T17:08:36.025587+0000","last_undegraded":"2024-09-12T17:08:36.025587+0000","last_fullsized":"2024-09-12T17:08:36.025587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:06.399711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"103'19","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.826456+0000","last_change":"2024-09-12T17:05:47.521727+0000","last_active":"2024-09-12T17:09:02.826456+0000","last_peered":"2024-09-12T17:09:02.826456+0000","last_clean":"2024-09-12T17:09:02.826456+0000","last_became_active":"2024-09-12T17:05:47.520943+0000","last_became_peered":"2024-09-12T17:05:47.520943+0000","last_unstale":"2024-09-12T17:09:02.826456+0000","last_undegraded":"2024-09-12T17:09:02.826456+0000","last_fullsized":"2024-09-12T17:09:02.826456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:24.772296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":23,"num_read_kb":51203,"num_write":27,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"29'1","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.606726+0000","last_change":"2024-09-12T17:05:51.556202+0000","last_active":"2024-09-12T17:09:02.606726+0000","last_peered":"2024-09-12T17:09:02.606726+0000","last_clean":"2024-09-12T17:09:02.606726+0000","last_became_active":"2024-09-12T17:05:51.555420+0000","last_became_peered":"2024-09-12T17:05:51.555420+0000","last_unstale":"2024-09-12T17:09:02.606726+0000","last_undegraded":"2024-09-12T17:09:02.606726+0000","last_fullsized":"2024-09-12T17:09:02.606726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:56.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"103'17","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.972638+0000","last_change":"2024-09-12T17:05:53.554159+0000","last_active":"2024-09-12T17:09:02.972638+0000","last_peered":"2024-09-12T17:09:02.972638+0000","last_clean":"2024-09-12T17:09:02.972638+0000","last_became_active":"2024-09-12T17:05:53.553333+0000","last_became_peered":"2024-09-12T17:05:53.553333+0000","last_unstale":"2024-09-12T17:09:02.972638+0000","last_undegraded":"2024-09-12T17:09:02.972638+0000","last_fullsized":"2024-09-12T17:09:02.972638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:53.266475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"103'17","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.659301+0000","last_change":"2024-09-12T17:05:55.556502+0000","last_active":"2024-09-12T17:09:02.659301+0000","last_peered":"2024-09-12T17:09:02.659301+0000","last_clean":"2024-09-12T17:09:02.659301+0000","last_became_active":"2024-09-12T17:05:55.555879+0000","last_became_peered":"2024-09-12T17:05:55.555879+0000","last_unstale":"2024-09-12T17:09:02.659301+0000","last_undegraded":"2024-09-12T17:09:02.659301+0000","last_fullsized":"2024-09-12T17:09:02.659301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:18.672296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602918+0000","last_change":"2024-09-12T17:05:49.553404+0000","last_active":"2024-09-12T17:08:33.602918+0000","last_peered":"2024-09-12T17:08:33.602918+0000","last_clean":"2024-09-12T17:08:33.602918+0000","last_became_active":"2024-09-12T17:05:49.552637+0000","last_became_peered":"2024-09-12T17:05:49.552637+0000","last_unstale":"2024-09-12T17:08:33.602918+0000","last_undegraded":"2024-09-12T17:08:33.602918+0000","last_fullsized":"2024-09-12T17:08:33.602918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607911+0000","last_change":"2024-09-12T17:05:47.562949+0000","last_active":"2024-09-12T17:08:33.607911+0000","last_peered":"2024-09-12T17:08:33.607911+0000","last_clean":"2024-09-12T17:08:33.607911+0000","last_became_active":"2024-09-12T17:05:47.562465+0000","last_became_peered":"2024-09-12T17:05:47.562465+0000","last_unstale":"2024-09-12T17:08:33.607911+0000","last_undegraded":"2024-09-12T17:08:33.607911+0000","last_fullsized":"2024-09-12T17:08:33.607911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":24585,"num_write":33,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604488+0000","last_change":"2024-09-12T17:05:51.542349+0000","last_active":"2024-09-12T17:08:33.604488+0000","last_peered":"2024-09-12T17:08:33.604488+0000","last_clean":"2024-09-12T17:08:33.604488+0000","last_became_active":"2024-09-12T17:05:51.541205+0000","last_became_peered":"2024-09-12T17:05:51.541205+0000","last_unstale":"2024-09-12T17:08:33.604488+0000","last_undegraded":"2024-09-12T17:08:33.604488+0000","last_fullsized":"2024-09-12T17:08:33.604488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"103'29","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602417+0000","last_change":"2024-09-12T17:05:53.560400+0000","last_active":"2024-09-12T17:08:33.602417+0000","last_peered":"2024-09-12T17:08:33.602417+0000","last_clean":"2024-09-12T17:08:33.602417+0000","last_became_active":"2024-09-12T17:05:53.559463+0000","last_became_peered":"2024-09-12T17:05:53.559463+0000","last_unstale":"2024-09-12T17:08:33.602417+0000","last_undegraded":"2024-09-12T17:08:33.602417+0000","last_fullsized":"2024-09-12T17:08:33.602417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13033,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":46,"num_read_kb":53,"num_write":34,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114027+0000","last_change":"2024-09-12T17:08:21.463670+0000","last_active":"2024-09-12T17:08:35.114027+0000","last_peered":"2024-09-12T17:08:35.114027+0000","last_clean":"2024-09-12T17:08:35.114027+0000","last_became_active":"2024-09-12T17:08:21.463161+0000","last_became_peered":"2024-09-12T17:08:21.463161+0000","last_unstale":"2024-09-12T17:08:35.114027+0000","last_undegraded":"2024-09-12T17:08:35.114027+0000","last_fullsized":"2024-09-12T17:08:35.114027+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:03.162531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603071+0000","last_change":"2024-09-12T17:05:57.599403+0000","last_active":"2024-09-12T17:08:33.603071+0000","last_peered":"2024-09-12T17:08:33.603071+0000","last_clean":"2024-09-12T17:08:33.603071+0000","last_became_active":"2024-09-12T17:05:57.598703+0000","last_became_peered":"2024-09-12T17:05:57.598703+0000","last_unstale":"2024-09-12T17:08:33.603071+0000","last_undegraded":"2024-09-12T17:08:33.603071+0000","last_fullsized":"2024-09-12T17:08:33.603071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"84'34","reported_seq":217,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210937+0000","last_change":"2024-09-12T17:08:18.474573+0000","last_active":"2024-09-12T17:08:35.210937+0000","last_peered":"2024-09-12T17:08:35.210937+0000","last_clean":"2024-09-12T17:08:35.210937+0000","last_became_active":"2024-09-12T17:08:18.443808+0000","last_became_peered":"2024-09-12T17:08:18.443808+0000","last_unstale":"2024-09-12T17:08:35.210937+0000","last_undegraded":"2024-09-12T17:08:35.210937+0000","last_fullsized":"2024-09-12T17:08:35.210937+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:01.200485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"103'9","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607958+0000","last_change":"2024-09-12T17:05:47.563411+0000","last_active":"2024-09-12T17:08:33.607958+0000","last_peered":"2024-09-12T17:08:33.607958+0000","last_clean":"2024-09-12T17:08:33.607958+0000","last_became_active":"2024-09-12T17:05:47.562812+0000","last_became_peered":"2024-09-12T17:05:47.562812+0000","last_unstale":"2024-09-12T17:08:33.607958+0000","last_undegraded":"2024-09-12T17:08:33.607958+0000","last_fullsized":"2024-09-12T17:08:33.607958+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:57.659986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":24579,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021678+0000","last_change":"2024-09-12T17:05:51.548944+0000","last_active":"2024-09-12T17:08:36.021678+0000","last_peered":"2024-09-12T17:08:36.021678+0000","last_clean":"2024-09-12T17:08:36.021678+0000","last_became_active":"2024-09-12T17:05:51.544649+0000","last_became_peered":"2024-09-12T17:05:51.544649+0000","last_unstale":"2024-09-12T17:08:36.021678+0000","last_undegraded":"2024-09-12T17:08:36.021678+0000","last_fullsized":"2024-09-12T17:08:36.021678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:01.468390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"103'13","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023597+0000","last_change":"2024-09-12T17:05:53.552838+0000","last_active":"2024-09-12T17:08:36.023597+0000","last_peered":"2024-09-12T17:08:36.023597+0000","last_clean":"2024-09-12T17:08:36.023597+0000","last_became_active":"2024-09-12T17:05:53.550042+0000","last_became_peered":"2024-09-12T17:05:53.550042+0000","last_unstale":"2024-09-12T17:08:36.023597+0000","last_undegraded":"2024-09-12T17:08:36.023597+0000","last_fullsized":"2024-09-12T17:08:36.023597+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4652,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021994+0000","last_change":"2024-09-12T17:05:55.558761+0000","last_active":"2024-09-12T17:08:36.021994+0000","last_peered":"2024-09-12T17:08:36.021994+0000","last_clean":"2024-09-12T17:08:36.021994+0000","last_became_active":"2024-09-12T17:05:55.557930+0000","last_became_peered":"2024-09-12T17:05:55.557930+0000","last_unstale":"2024-09-12T17:08:36.021994+0000","last_undegraded":"2024-09-12T17:08:36.021994+0000","last_fullsized":"2024-09-12T17:08:36.021994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.015675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353619+0000","last_change":"2024-09-12T17:05:57.592611+0000","last_active":"2024-09-12T17:08:35.353619+0000","last_peered":"2024-09-12T17:08:35.353619+0000","last_clean":"2024-09-12T17:08:35.353619+0000","last_became_active":"2024-09-12T17:05:57.591855+0000","last_became_peered":"2024-09-12T17:05:57.591855+0000","last_unstale":"2024-09-12T17:08:35.353619+0000","last_undegraded":"2024-09-12T17:08:35.353619+0000","last_fullsized":"2024-09-12T17:08:35.353619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:02.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353645+0000","last_change":"2024-09-12T17:08:18.467848+0000","last_active":"2024-09-12T17:08:35.353645+0000","last_peered":"2024-09-12T17:08:35.353645+0000","last_clean":"2024-09-12T17:08:35.353645+0000","last_became_active":"2024-09-12T17:08:18.466877+0000","last_became_peered":"2024-09-12T17:08:18.466877+0000","last_unstale":"2024-09-12T17:08:35.353645+0000","last_undegraded":"2024-09-12T17:08:35.353645+0000","last_fullsized":"2024-09-12T17:08:35.353645+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:08.084076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"103'12","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.922115+0000","last_change":"2024-09-12T17:05:47.562243+0000","last_active":"2024-09-12T17:09:02.922115+0000","last_peered":"2024-09-12T17:09:02.922115+0000","last_clean":"2024-09-12T17:09:02.922115+0000","last_became_active":"2024-09-12T17:05:47.561587+0000","last_became_peered":"2024-09-12T17:05:47.561587+0000","last_unstale":"2024-09-12T17:09:02.922115+0000","last_undegraded":"2024-09-12T17:09:02.922115+0000","last_fullsized":"2024-09-12T17:09:02.922115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":28672,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"29'1","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.604271+0000","last_change":"2024-09-12T17:05:51.542843+0000","last_active":"2024-09-12T17:09:02.604271+0000","last_peered":"2024-09-12T17:09:02.604271+0000","last_clean":"2024-09-12T17:09:02.604271+0000","last_became_active":"2024-09-12T17:05:51.542457+0000","last_became_peered":"2024-09-12T17:05:51.542457+0000","last_unstale":"2024-09-12T17:09:02.604271+0000","last_undegraded":"2024-09-12T17:09:02.604271+0000","last_fullsized":"2024-09-12T17:09:02.604271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.837373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"103'21","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602200+0000","last_change":"2024-09-12T17:05:53.548729+0000","last_active":"2024-09-12T17:08:33.602200+0000","last_peered":"2024-09-12T17:08:33.602200+0000","last_clean":"2024-09-12T17:08:33.602200+0000","last_became_active":"2024-09-12T17:05:53.547990+0000","last_became_peered":"2024-09-12T17:05:53.547990+0000","last_unstale":"2024-09-12T17:08:33.602200+0000","last_undegraded":"2024-09-12T17:08:33.602200+0000","last_fullsized":"2024-09-12T17:08:33.602200+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:22.845485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"103'19","reported_seq":231,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.660710+0000","last_change":"2024-09-12T17:08:21.470468+0000","last_active":"2024-09-12T17:09:02.660710+0000","last_peered":"2024-09-12T17:09:02.660710+0000","last_clean":"2024-09-12T17:09:02.660710+0000","last_became_active":"2024-09-12T17:08:21.465057+0000","last_became_peered":"2024-09-12T17:08:21.465057+0000","last_unstale":"2024-09-12T17:09:02.660710+0000","last_undegraded":"2024-09-12T17:09:02.660710+0000","last_fullsized":"2024-09-12T17:09:02.660710+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.580430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604073+0000","last_change":"2024-09-12T17:05:57.596229+0000","last_active":"2024-09-12T17:08:33.604073+0000","last_peered":"2024-09-12T17:08:33.604073+0000","last_clean":"2024-09-12T17:08:33.604073+0000","last_became_active":"2024-09-12T17:05:57.595658+0000","last_became_peered":"2024-09-12T17:05:57.595658+0000","last_unstale":"2024-09-12T17:08:33.604073+0000","last_undegraded":"2024-09-12T17:08:33.604073+0000","last_fullsized":"2024-09-12T17:08:33.604073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.644627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603857+0000","last_change":"2024-09-12T17:08:18.465360+0000","last_active":"2024-09-12T17:08:33.603857+0000","last_peered":"2024-09-12T17:08:33.603857+0000","last_clean":"2024-09-12T17:08:33.603857+0000","last_became_active":"2024-09-12T17:08:18.464976+0000","last_became_peered":"2024-09-12T17:08:18.464976+0000","last_unstale":"2024-09-12T17:08:33.603857+0000","last_undegraded":"2024-09-12T17:08:33.603857+0000","last_fullsized":"2024-09-12T17:08:33.603857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.772819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"103'15","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603788+0000","last_change":"2024-09-12T17:05:47.535946+0000","last_active":"2024-09-12T17:08:33.603788+0000","last_peered":"2024-09-12T17:08:33.603788+0000","last_clean":"2024-09-12T17:08:33.603788+0000","last_became_active":"2024-09-12T17:05:47.534607+0000","last_became_peered":"2024-09-12T17:05:47.534607+0000","last_unstale":"2024-09-12T17:08:33.603788+0000","last_undegraded":"2024-09-12T17:08:33.603788+0000","last_fullsized":"2024-09-12T17:08:33.603788+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":36876,"num_write":47,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022424+0000","last_change":"2024-09-12T17:05:51.548391+0000","last_active":"2024-09-12T17:08:36.022424+0000","last_peered":"2024-09-12T17:08:36.022424+0000","last_clean":"2024-09-12T17:08:36.022424+0000","last_became_active":"2024-09-12T17:05:51.547939+0000","last_became_peered":"2024-09-12T17:05:51.547939+0000","last_unstale":"2024-09-12T17:08:36.022424+0000","last_undegraded":"2024-09-12T17:08:36.022424+0000","last_fullsized":"2024-09-12T17:08:36.022424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:08.848247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"103'28","reported_seq":197,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.843498+0000","last_change":"2024-09-12T17:05:53.535756+0000","last_active":"2024-09-12T17:09:02.843498+0000","last_peered":"2024-09-12T17:09:02.843498+0000","last_clean":"2024-09-12T17:09:02.843498+0000","last_became_active":"2024-09-12T17:05:53.535062+0000","last_became_peered":"2024-09-12T17:05:53.535062+0000","last_unstale":"2024-09-12T17:09:02.843498+0000","last_undegraded":"2024-09-12T17:09:02.843498+0000","last_fullsized":"2024-09-12T17:09:02.843498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10417,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":48,"num_read_kb":62,"num_write":32,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019032+0000","last_change":"2024-09-12T17:05:55.564010+0000","last_active":"2024-09-12T17:08:36.019032+0000","last_peered":"2024-09-12T17:08:36.019032+0000","last_clean":"2024-09-12T17:08:36.019032+0000","last_became_active":"2024-09-12T17:05:55.563125+0000","last_became_peered":"2024-09-12T17:05:55.563125+0000","last_unstale":"2024-09-12T17:08:36.019032+0000","last_undegraded":"2024-09-12T17:08:36.019032+0000","last_fullsized":"2024-09-12T17:08:36.019032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:00.697571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114671+0000","last_change":"2024-09-12T17:08:18.459890+0000","last_active":"2024-09-12T17:08:35.114671+0000","last_peered":"2024-09-12T17:08:35.114671+0000","last_clean":"2024-09-12T17:08:35.114671+0000","last_became_active":"2024-09-12T17:08:18.459544+0000","last_became_peered":"2024-09-12T17:08:18.459544+0000","last_unstale":"2024-09-12T17:08:35.114671+0000","last_undegraded":"2024-09-12T17:08:35.114671+0000","last_fullsized":"2024-09-12T17:08:35.114671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:05.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211812+0000","last_change":"2024-09-12T17:05:49.544092+0000","last_active":"2024-09-12T17:08:35.211812+0000","last_peered":"2024-09-12T17:08:35.211812+0000","last_clean":"2024-09-12T17:08:35.211812+0000","last_became_active":"2024-09-12T17:05:49.543307+0000","last_became_peered":"2024-09-12T17:05:49.543307+0000","last_unstale":"2024-09-12T17:08:35.211812+0000","last_undegraded":"2024-09-12T17:08:35.211812+0000","last_fullsized":"2024-09-12T17:08:35.211812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:36.286410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"103'10","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.755135+0000","last_change":"2024-09-12T17:05:47.526678+0000","last_active":"2024-09-12T17:09:02.755135+0000","last_peered":"2024-09-12T17:09:02.755135+0000","last_clean":"2024-09-12T17:09:02.755135+0000","last_became_active":"2024-09-12T17:05:47.525696+0000","last_became_peered":"2024-09-12T17:05:47.525696+0000","last_unstale":"2024-09-12T17:09:02.755135+0000","last_undegraded":"2024-09-12T17:09:02.755135+0000","last_fullsized":"2024-09-12T17:09:02.755135+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:59.012258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18438,"num_write":26,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023952+0000","last_change":"2024-09-12T17:05:51.543404+0000","last_active":"2024-09-12T17:08:36.023952+0000","last_peered":"2024-09-12T17:08:36.023952+0000","last_clean":"2024-09-12T17:08:36.023952+0000","last_became_active":"2024-09-12T17:05:51.542737+0000","last_became_peered":"2024-09-12T17:05:51.542737+0000","last_unstale":"2024-09-12T17:08:36.023952+0000","last_undegraded":"2024-09-12T17:08:36.023952+0000","last_fullsized":"2024-09-12T17:08:36.023952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:30.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"103'23","reported_seq":227,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.860878+0000","last_change":"2024-09-12T17:08:21.484446+0000","last_active":"2024-09-12T17:09:02.860878+0000","last_peered":"2024-09-12T17:09:02.860878+0000","last_clean":"2024-09-12T17:09:02.860878+0000","last_became_active":"2024-09-12T17:08:21.465207+0000","last_became_peered":"2024-09-12T17:08:21.465207+0000","last_unstale":"2024-09-12T17:09:02.860878+0000","last_undegraded":"2024-09-12T17:09:02.860878+0000","last_fullsized":"2024-09-12T17:09:02.860878+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:37.839396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":61,"num_write":28,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3559,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603073+0000","last_change":"2024-09-12T17:05:55.565575+0000","last_active":"2024-09-12T17:08:33.603073+0000","last_peered":"2024-09-12T17:08:33.603073+0000","last_clean":"2024-09-12T17:08:33.603073+0000","last_became_active":"2024-09-12T17:05:55.564802+0000","last_became_peered":"2024-09-12T17:05:55.564802+0000","last_unstale":"2024-09-12T17:08:33.603073+0000","last_undegraded":"2024-09-12T17:08:33.603073+0000","last_fullsized":"2024-09-12T17:08:33.603073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022911+0000","last_change":"2024-09-12T17:05:57.592294+0000","last_active":"2024-09-12T17:08:36.022911+0000","last_peered":"2024-09-12T17:08:36.022911+0000","last_clean":"2024-09-12T17:08:36.022911+0000","last_became_active":"2024-09-12T17:05:57.591389+0000","last_became_peered":"2024-09-12T17:05:57.591389+0000","last_unstale":"2024-09-12T17:08:36.022911+0000","last_undegraded":"2024-09-12T17:08:36.022911+0000","last_fullsized":"2024-09-12T17:08:36.022911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'10","reported_seq":177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212458+0000","last_change":"2024-09-12T17:05:49.553177+0000","last_active":"2024-09-12T17:08:35.212458+0000","last_peered":"2024-09-12T17:08:35.212458+0000","last_clean":"2024-09-12T17:08:35.212458+0000","last_became_active":"2024-09-12T17:05:49.552270+0000","last_became_peered":"2024-09-12T17:05:49.552270+0000","last_unstale":"2024-09-12T17:08:35.212458+0000","last_undegraded":"2024-09-12T17:08:35.212458+0000","last_fullsized":"2024-09-12T17:08:35.212458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:34.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"103'10","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.779247+0000","last_change":"2024-09-12T17:05:47.543064+0000","last_active":"2024-09-12T17:09:02.779247+0000","last_peered":"2024-09-12T17:09:02.779247+0000","last_clean":"2024-09-12T17:09:02.779247+0000","last_became_active":"2024-09-12T17:05:47.542362+0000","last_became_peered":"2024-09-12T17:05:47.542362+0000","last_unstale":"2024-09-12T17:09:02.779247+0000","last_undegraded":"2024-09-12T17:09:02.779247+0000","last_fullsized":"2024-09-12T17:09:02.779247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":10,"num_read_kb":28672,"num_write":10,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114518+0000","last_change":"2024-09-12T17:08:18.456938+0000","last_active":"2024-09-12T17:08:35.114518+0000","last_peered":"2024-09-12T17:08:35.114518+0000","last_clean":"2024-09-12T17:08:35.114518+0000","last_became_active":"2024-09-12T17:08:18.452101+0000","last_became_peered":"2024-09-12T17:08:18.452101+0000","last_unstale":"2024-09-12T17:08:35.114518+0000","last_undegraded":"2024-09-12T17:08:35.114518+0000","last_fullsized":"2024-09-12T17:08:35.114518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:36.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"103'20","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024589+0000","last_change":"2024-09-12T17:05:53.554531+0000","last_active":"2024-09-12T17:08:36.024589+0000","last_peered":"2024-09-12T17:08:36.024589+0000","last_clean":"2024-09-12T17:08:36.024589+0000","last_became_active":"2024-09-12T17:05:53.554131+0000","last_became_peered":"2024-09-12T17:05:53.554131+0000","last_unstale":"2024-09-12T17:08:36.024589+0000","last_undegraded":"2024-09-12T17:08:36.024589+0000","last_fullsized":"2024-09-12T17:08:36.024589+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"103'17","reported_seq":214,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.654428+0000","last_change":"2024-09-12T17:05:55.559204+0000","last_active":"2024-09-12T17:09:02.654428+0000","last_peered":"2024-09-12T17:09:02.654428+0000","last_clean":"2024-09-12T17:09:02.654428+0000","last_became_active":"2024-09-12T17:05:55.556488+0000","last_became_peered":"2024-09-12T17:05:55.556488+0000","last_unstale":"2024-09-12T17:09:02.654428+0000","last_undegraded":"2024-09-12T17:09:02.654428+0000","last_fullsized":"2024-09-12T17:09:02.654428+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:15.167640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111231+0000","last_change":"2024-09-12T17:08:18.461886+0000","last_active":"2024-09-12T17:08:35.111231+0000","last_peered":"2024-09-12T17:08:35.111231+0000","last_clean":"2024-09-12T17:08:35.111231+0000","last_became_active":"2024-09-12T17:08:18.460345+0000","last_became_peered":"2024-09-12T17:08:18.460345+0000","last_unstale":"2024-09-12T17:08:35.111231+0000","last_undegraded":"2024-09-12T17:08:35.111231+0000","last_fullsized":"2024-09-12T17:08:35.111231+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:30.011702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"68'6","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212463+0000","last_change":"2024-09-12T17:05:49.562360+0000","last_active":"2024-09-12T17:08:35.212463+0000","last_peered":"2024-09-12T17:08:35.212463+0000","last_clean":"2024-09-12T17:08:35.212463+0000","last_became_active":"2024-09-12T17:05:49.561200+0000","last_became_peered":"2024-09-12T17:05:49.561200+0000","last_unstale":"2024-09-12T17:08:35.212463+0000","last_undegraded":"2024-09-12T17:08:35.212463+0000","last_fullsized":"2024-09-12T17:08:35.212463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.915600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"103'10","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210377+0000","last_change":"2024-09-12T17:05:47.542018+0000","last_active":"2024-09-12T17:08:35.210377+0000","last_peered":"2024-09-12T17:08:35.210377+0000","last_clean":"2024-09-12T17:08:35.210377+0000","last_became_active":"2024-09-12T17:05:47.540484+0000","last_became_peered":"2024-09-12T17:05:47.540484+0000","last_unstale":"2024-09-12T17:08:35.210377+0000","last_undegraded":"2024-09-12T17:08:35.210377+0000","last_fullsized":"2024-09-12T17:08:35.210377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:13.571666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":24585,"num_write":34,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.619866+0000","last_change":"2024-09-12T17:05:51.556083+0000","last_active":"2024-09-12T17:09:02.619866+0000","last_peered":"2024-09-12T17:09:02.619866+0000","last_clean":"2024-09-12T17:09:02.619866+0000","last_became_active":"2024-09-12T17:05:51.554176+0000","last_became_peered":"2024-09-12T17:05:51.554176+0000","last_unstale":"2024-09-12T17:09:02.619866+0000","last_undegraded":"2024-09-12T17:09:02.619866+0000","last_fullsized":"2024-09-12T17:09:02.619866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:02.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024529+0000","last_change":"2024-09-12T17:05:53.553304+0000","last_active":"2024-09-12T17:08:36.024529+0000","last_peered":"2024-09-12T17:08:36.024529+0000","last_clean":"2024-09-12T17:08:36.024529+0000","last_became_active":"2024-09-12T17:05:53.552545+0000","last_became_peered":"2024-09-12T17:05:53.552545+0000","last_unstale":"2024-09-12T17:08:36.024529+0000","last_undegraded":"2024-09-12T17:08:36.024529+0000","last_fullsized":"2024-09-12T17:08:36.024529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"103'19","reported_seq":233,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.657186+0000","last_change":"2024-09-12T17:08:18.628128+0000","last_active":"2024-09-12T17:09:02.657186+0000","last_peered":"2024-09-12T17:09:02.657186+0000","last_clean":"2024-09-12T17:09:02.657186+0000","last_became_active":"2024-09-12T17:08:18.471539+0000","last_became_peered":"2024-09-12T17:08:18.471539+0000","last_unstale":"2024-09-12T17:09:02.657186+0000","last_undegraded":"2024-09-12T17:09:02.657186+0000","last_fullsized":"2024-09-12T17:09:02.657186+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:47.486729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210930+0000","last_change":"2024-09-12T17:05:57.597870+0000","last_active":"2024-09-12T17:08:35.210930+0000","last_peered":"2024-09-12T17:08:35.210930+0000","last_clean":"2024-09-12T17:08:35.210930+0000","last_became_active":"2024-09-12T17:05:57.597076+0000","last_became_peered":"2024-09-12T17:05:57.597076+0000","last_unstale":"2024-09-12T17:08:35.210930+0000","last_undegraded":"2024-09-12T17:08:35.210930+0000","last_fullsized":"2024-09-12T17:08:35.210930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.648974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"68'6","reported_seq":43,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114680+0000","last_change":"2024-09-12T17:08:18.887494+0000","last_active":"2024-09-12T17:08:35.114680+0000","last_peered":"2024-09-12T17:08:35.114680+0000","last_clean":"2024-09-12T17:08:35.114680+0000","last_became_active":"2024-09-12T17:08:18.457423+0000","last_became_peered":"2024-09-12T17:08:18.457423+0000","last_unstale":"2024-09-12T17:08:35.114680+0000","last_undegraded":"2024-09-12T17:08:35.114680+0000","last_fullsized":"2024-09-12T17:08:35.114680+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:59.827727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"103'14","reported_seq":222,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.822321+0000","last_change":"2024-09-12T17:08:18.702553+0000","last_active":"2024-09-12T17:09:02.822321+0000","last_peered":"2024-09-12T17:09:02.822321+0000","last_clean":"2024-09-12T17:09:02.822321+0000","last_became_active":"2024-09-12T17:08:18.449468+0000","last_became_peered":"2024-09-12T17:08:18.449468+0000","last_unstale":"2024-09-12T17:09:02.822321+0000","last_undegraded":"2024-09-12T17:09:02.822321+0000","last_fullsized":"2024-09-12T17:09:02.822321+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:54.548414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":28678,"num_write":30,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212218+0000","last_change":"2024-09-12T17:05:51.540047+0000","last_active":"2024-09-12T17:08:35.212218+0000","last_peered":"2024-09-12T17:08:35.212218+0000","last_clean":"2024-09-12T17:08:35.212218+0000","last_became_active":"2024-09-12T17:05:51.539302+0000","last_became_peered":"2024-09-12T17:05:51.539302+0000","last_unstale":"2024-09-12T17:08:35.212218+0000","last_undegraded":"2024-09-12T17:08:35.212218+0000","last_fullsized":"2024-09-12T17:08:35.212218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:21.253801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"103'24","reported_seq":237,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603692+0000","last_change":"2024-09-12T17:08:21.515721+0000","last_active":"2024-09-12T17:08:33.603692+0000","last_peered":"2024-09-12T17:08:33.603692+0000","last_clean":"2024-09-12T17:08:33.603692+0000","last_became_active":"2024-09-12T17:08:21.467530+0000","last_became_peered":"2024-09-12T17:08:21.467530+0000","last_unstale":"2024-09-12T17:08:33.603692+0000","last_undegraded":"2024-09-12T17:08:33.603692+0000","last_fullsized":"2024-09-12T17:08:33.603692+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:04.806432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16414,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":37,"num_read_kb":36,"num_write":26,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":12538,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353193+0000","last_change":"2024-09-12T17:05:55.566749+0000","last_active":"2024-09-12T17:08:35.353193+0000","last_peered":"2024-09-12T17:08:35.353193+0000","last_clean":"2024-09-12T17:08:35.353193+0000","last_became_active":"2024-09-12T17:05:55.565979+0000","last_became_peered":"2024-09-12T17:05:55.565979+0000","last_unstale":"2024-09-12T17:08:35.353193+0000","last_undegraded":"2024-09-12T17:08:35.353193+0000","last_fullsized":"2024-09-12T17:08:35.353193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113928+0000","last_change":"2024-09-12T17:08:21.461881+0000","last_active":"2024-09-12T17:08:35.113928+0000","last_peered":"2024-09-12T17:08:35.113928+0000","last_clean":"2024-09-12T17:08:35.113928+0000","last_became_active":"2024-09-12T17:08:21.461496+0000","last_became_peered":"2024-09-12T17:08:21.461496+0000","last_unstale":"2024-09-12T17:08:35.113928+0000","last_undegraded":"2024-09-12T17:08:35.113928+0000","last_fullsized":"2024-09-12T17:08:35.113928+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:41.000825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354192+0000","last_change":"2024-09-12T17:05:49.539487+0000","last_active":"2024-09-12T17:08:35.354192+0000","last_peered":"2024-09-12T17:08:35.354192+0000","last_clean":"2024-09-12T17:08:35.354192+0000","last_became_active":"2024-09-12T17:05:49.538713+0000","last_became_peered":"2024-09-12T17:05:49.538713+0000","last_unstale":"2024-09-12T17:08:35.354192+0000","last_undegraded":"2024-09-12T17:08:35.354192+0000","last_fullsized":"2024-09-12T17:08:35.354192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.731614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":272,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602363+0000","last_change":"2024-09-12T17:05:35.688483+0000","last_active":"2024-09-12T17:08:33.602363+0000","last_peered":"2024-09-12T17:08:33.602363+0000","last_clean":"2024-09-12T17:08:33.602363+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:08:33.602363+0000","last_undegraded":"2024-09-12T17:08:33.602363+0000","last_fullsized":"2024-09-12T17:08:33.602363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_clean_scrub_stamp":"2024-09-12T17:05:34.151079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602740+0000","last_change":"2024-09-12T17:05:42.225793+0000","last_active":"2024-09-12T17:08:33.602740+0000","last_peered":"2024-09-12T17:08:33.602740+0000","last_clean":"2024-09-12T17:08:33.602740+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:08:33.602740+0000","last_undegraded":"2024-09-12T17:08:33.602740+0000","last_fullsized":"2024-09-12T17:08:33.602740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:54.880257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"103'15","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.776822+0000","last_change":"2024-09-12T17:05:47.526243+0000","last_active":"2024-09-12T17:09:02.776822+0000","last_peered":"2024-09-12T17:09:02.776822+0000","last_clean":"2024-09-12T17:09:02.776822+0000","last_became_active":"2024-09-12T17:05:47.525694+0000","last_became_peered":"2024-09-12T17:05:47.525694+0000","last_unstale":"2024-09-12T17:09:02.776822+0000","last_undegraded":"2024-09-12T17:09:02.776822+0000","last_fullsized":"2024-09-12T17:09:02.776822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":38921,"num_write":39,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606510+0000","last_change":"2024-09-12T17:05:51.548356+0000","last_active":"2024-09-12T17:08:33.606510+0000","last_peered":"2024-09-12T17:08:33.606510+0000","last_clean":"2024-09-12T17:08:33.606510+0000","last_became_active":"2024-09-12T17:05:51.547503+0000","last_became_peered":"2024-09-12T17:05:51.547503+0000","last_unstale":"2024-09-12T17:08:33.606510+0000","last_undegraded":"2024-09-12T17:08:33.606510+0000","last_fullsized":"2024-09-12T17:08:33.606510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:47.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"103'36","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.021103+0000","last_change":"2024-09-12T17:05:53.546057+0000","last_active":"2024-09-12T17:09:03.021103+0000","last_peered":"2024-09-12T17:09:03.021103+0000","last_clean":"2024-09-12T17:09:03.021103+0000","last_became_active":"2024-09-12T17:05:53.545266+0000","last_became_peered":"2024-09-12T17:05:53.545266+0000","last_unstale":"2024-09-12T17:09:03.021103+0000","last_undegraded":"2024-09-12T17:09:03.021103+0000","last_fullsized":"2024-09-12T17:09:03.021103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17292,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":82,"num_write":42,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604135+0000","last_change":"2024-09-12T17:05:55.562246+0000","last_active":"2024-09-12T17:08:33.604135+0000","last_peered":"2024-09-12T17:08:33.604135+0000","last_clean":"2024-09-12T17:08:33.604135+0000","last_became_active":"2024-09-12T17:05:55.561410+0000","last_became_peered":"2024-09-12T17:05:55.561410+0000","last_unstale":"2024-09-12T17:08:33.604135+0000","last_undegraded":"2024-09-12T17:08:33.604135+0000","last_fullsized":"2024-09-12T17:08:33.604135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.373235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"68'2","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352549+0000","last_change":"2024-09-12T17:05:57.593095+0000","last_active":"2024-09-12T17:08:35.352549+0000","last_peered":"2024-09-12T17:08:35.352549+0000","last_clean":"2024-09-12T17:08:35.352549+0000","last_became_active":"2024-09-12T17:05:57.592287+0000","last_became_peered":"2024-09-12T17:05:57.592287+0000","last_unstale":"2024-09-12T17:08:35.352549+0000","last_undegraded":"2024-09-12T17:08:35.352549+0000","last_fullsized":"2024-09-12T17:08:35.352549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:52.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604303+0000","last_change":"2024-09-12T17:08:18.465677+0000","last_active":"2024-09-12T17:08:33.604303+0000","last_peered":"2024-09-12T17:08:33.604303+0000","last_clean":"2024-09-12T17:08:33.604303+0000","last_became_active":"2024-09-12T17:08:18.464334+0000","last_became_peered":"2024-09-12T17:08:18.464334+0000","last_unstale":"2024-09-12T17:08:33.604303+0000","last_undegraded":"2024-09-12T17:08:33.604303+0000","last_fullsized":"2024-09-12T17:08:33.604303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:26.356922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601919+0000","last_change":"2024-09-12T17:08:21.462733+0000","last_active":"2024-09-12T17:08:33.601919+0000","last_peered":"2024-09-12T17:08:33.601919+0000","last_clean":"2024-09-12T17:08:33.601919+0000","last_became_active":"2024-09-12T17:08:21.461625+0000","last_became_peered":"2024-09-12T17:08:21.461625+0000","last_unstale":"2024-09-12T17:08:33.601919+0000","last_undegraded":"2024-09-12T17:08:33.601919+0000","last_fullsized":"2024-09-12T17:08:33.601919+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:09.553944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"103'20","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.887400+0000","last_change":"2024-09-12T17:05:47.544269+0000","last_active":"2024-09-12T17:09:02.887400+0000","last_peered":"2024-09-12T17:09:02.887400+0000","last_clean":"2024-09-12T17:09:02.887400+0000","last_became_active":"2024-09-12T17:05:47.543531+0000","last_became_peered":"2024-09-12T17:05:47.543531+0000","last_unstale":"2024-09-12T17:09:02.887400+0000","last_undegraded":"2024-09-12T17:09:02.887400+0000","last_fullsized":"2024-09-12T17:09:02.887400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:55.688363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":40969,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605269+0000","last_change":"2024-09-12T17:08:18.466066+0000","last_active":"2024-09-12T17:08:33.605269+0000","last_peered":"2024-09-12T17:08:33.605269+0000","last_clean":"2024-09-12T17:08:33.605269+0000","last_became_active":"2024-09-12T17:08:18.465027+0000","last_became_peered":"2024-09-12T17:08:18.465027+0000","last_unstale":"2024-09-12T17:08:33.605269+0000","last_undegraded":"2024-09-12T17:08:33.605269+0000","last_fullsized":"2024-09-12T17:08:33.605269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"103'57","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.993286+0000","last_change":"2024-09-12T17:08:21.488130+0000","last_active":"2024-09-12T17:09:02.993286+0000","last_peered":"2024-09-12T17:09:02.993286+0000","last_clean":"2024-09-12T17:09:02.993286+0000","last_became_active":"2024-09-12T17:08:21.455260+0000","last_became_peered":"2024-09-12T17:08:21.455260+0000","last_unstale":"2024-09-12T17:09:02.993286+0000","last_undegraded":"2024-09-12T17:09:02.993286+0000","last_fullsized":"2024-09-12T17:09:02.993286+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:08.863638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15100,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":89,"num_read_kb":106,"num_write":49,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":5726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606844+0000","last_change":"2024-09-12T17:05:55.556362+0000","last_active":"2024-09-12T17:08:33.606844+0000","last_peered":"2024-09-12T17:08:33.606844+0000","last_clean":"2024-09-12T17:08:33.606844+0000","last_became_active":"2024-09-12T17:05:55.555625+0000","last_became_peered":"2024-09-12T17:05:55.555625+0000","last_unstale":"2024-09-12T17:08:33.606844+0000","last_undegraded":"2024-09-12T17:08:33.606844+0000","last_fullsized":"2024-09-12T17:08:33.606844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"84'6","reported_seq":45,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114189+0000","last_change":"2024-09-12T17:08:18.577521+0000","last_active":"2024-09-12T17:08:35.114189+0000","last_peered":"2024-09-12T17:08:35.114189+0000","last_clean":"2024-09-12T17:08:35.114189+0000","last_became_active":"2024-09-12T17:08:18.446923+0000","last_became_peered":"2024-09-12T17:08:18.446923+0000","last_unstale":"2024-09-12T17:08:35.114189+0000","last_undegraded":"2024-09-12T17:08:35.114189+0000","last_fullsized":"2024-09-12T17:08:35.114189+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:00.600036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114457+0000","last_change":"2024-09-12T17:08:21.457044+0000","last_active":"2024-09-12T17:08:35.114457+0000","last_peered":"2024-09-12T17:08:35.114457+0000","last_clean":"2024-09-12T17:08:35.114457+0000","last_became_active":"2024-09-12T17:08:21.456705+0000","last_became_peered":"2024-09-12T17:08:21.456705+0000","last_unstale":"2024-09-12T17:08:35.114457+0000","last_undegraded":"2024-09-12T17:08:35.114457+0000","last_fullsized":"2024-09-12T17:08:35.114457+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:57.537595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023245+0000","last_change":"2024-09-12T17:05:42.677413+0000","last_active":"2024-09-12T17:08:36.023245+0000","last_peered":"2024-09-12T17:08:36.023245+0000","last_clean":"2024-09-12T17:08:36.023245+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:08:36.023245+0000","last_undegraded":"2024-09-12T17:08:36.023245+0000","last_fullsized":"2024-09-12T17:08:36.023245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.836885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"103'14","reported_seq":63,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.797960+0000","last_change":"2024-09-12T17:08:18.715809+0000","last_active":"2024-09-12T17:09:02.797960+0000","last_peered":"2024-09-12T17:09:02.797960+0000","last_clean":"2024-09-12T17:09:02.797960+0000","last_became_active":"2024-09-12T17:08:18.446837+0000","last_became_peered":"2024-09-12T17:08:18.446837+0000","last_unstale":"2024-09-12T17:09:02.797960+0000","last_undegraded":"2024-09-12T17:09:02.797960+0000","last_fullsized":"2024-09-12T17:09:02.797960+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:22.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":22,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":161,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025411+0000","last_change":"2024-09-12T17:05:51.557262+0000","last_active":"2024-09-12T17:08:36.025411+0000","last_peered":"2024-09-12T17:08:36.025411+0000","last_clean":"2024-09-12T17:08:36.025411+0000","last_became_active":"2024-09-12T17:05:51.556959+0000","last_became_peered":"2024-09-12T17:05:51.556959+0000","last_unstale":"2024-09-12T17:08:36.025411+0000","last_undegraded":"2024-09-12T17:08:36.025411+0000","last_fullsized":"2024-09-12T17:08:36.025411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.963181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"103'16","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.760375+0000","last_change":"2024-09-12T17:05:53.555384+0000","last_active":"2024-09-12T17:08:36.760375+0000","last_peered":"2024-09-12T17:08:36.760375+0000","last_clean":"2024-09-12T17:08:36.760375+0000","last_became_active":"2024-09-12T17:05:53.554063+0000","last_became_peered":"2024-09-12T17:05:53.554063+0000","last_unstale":"2024-09-12T17:08:36.760375+0000","last_undegraded":"2024-09-12T17:08:36.760375+0000","last_fullsized":"2024-09-12T17:08:36.760375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602091+0000","last_change":"2024-09-12T17:05:55.547595+0000","last_active":"2024-09-12T17:08:33.602091+0000","last_peered":"2024-09-12T17:08:33.602091+0000","last_clean":"2024-09-12T17:08:33.602091+0000","last_became_active":"2024-09-12T17:05:55.546700+0000","last_became_peered":"2024-09-12T17:05:55.546700+0000","last_unstale":"2024-09-12T17:08:33.602091+0000","last_undegraded":"2024-09-12T17:08:33.602091+0000","last_fullsized":"2024-09-12T17:08:33.602091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023225+0000","last_change":"2024-09-12T17:05:57.587955+0000","last_active":"2024-09-12T17:08:36.023225+0000","last_peered":"2024-09-12T17:08:36.023225+0000","last_clean":"2024-09-12T17:08:36.023225+0000","last_became_active":"2024-09-12T17:05:57.587199+0000","last_became_peered":"2024-09-12T17:05:57.587199+0000","last_unstale":"2024-09-12T17:08:36.023225+0000","last_undegraded":"2024-09-12T17:08:36.023225+0000","last_fullsized":"2024-09-12T17:08:36.023225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.422656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114194+0000","last_change":"2024-09-12T17:08:21.456185+0000","last_active":"2024-09-12T17:08:35.114194+0000","last_peered":"2024-09-12T17:08:35.114194+0000","last_clean":"2024-09-12T17:08:35.114194+0000","last_became_active":"2024-09-12T17:08:21.455573+0000","last_became_peered":"2024-09-12T17:08:21.455573+0000","last_unstale":"2024-09-12T17:08:35.114194+0000","last_undegraded":"2024-09-12T17:08:35.114194+0000","last_fullsized":"2024-09-12T17:08:35.114194+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:45.008694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604023+0000","last_change":"2024-09-12T17:08:18.708570+0000","last_active":"2024-09-12T17:08:33.604023+0000","last_peered":"2024-09-12T17:08:33.604023+0000","last_clean":"2024-09-12T17:08:33.604023+0000","last_became_active":"2024-09-12T17:08:18.474152+0000","last_became_peered":"2024-09-12T17:08:18.474152+0000","last_unstale":"2024-09-12T17:08:33.604023+0000","last_undegraded":"2024-09-12T17:08:33.604023+0000","last_fullsized":"2024-09-12T17:08:33.604023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:17.040784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"103'15","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.906836+0000","last_change":"2024-09-12T17:05:47.546543+0000","last_active":"2024-09-12T17:09:02.906836+0000","last_peered":"2024-09-12T17:09:02.906836+0000","last_clean":"2024-09-12T17:09:02.906836+0000","last_became_active":"2024-09-12T17:05:47.545554+0000","last_became_peered":"2024-09-12T17:05:47.545554+0000","last_unstale":"2024-09-12T17:09:02.906836+0000","last_undegraded":"2024-09-12T17:09:02.906836+0000","last_fullsized":"2024-09-12T17:09:02.906836+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:07.148131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":32771,"num_write":23,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602766+0000","last_change":"2024-09-12T17:08:18.451242+0000","last_active":"2024-09-12T17:08:33.602766+0000","last_peered":"2024-09-12T17:08:33.602766+0000","last_clean":"2024-09-12T17:08:33.602766+0000","last_became_active":"2024-09-12T17:08:18.450835+0000","last_became_peered":"2024-09-12T17:08:18.450835+0000","last_unstale":"2024-09-12T17:08:33.602766+0000","last_undegraded":"2024-09-12T17:08:33.602766+0000","last_fullsized":"2024-09-12T17:08:33.602766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025686+0000","last_change":"2024-09-12T17:05:53.551499+0000","last_active":"2024-09-12T17:08:36.025686+0000","last_peered":"2024-09-12T17:08:36.025686+0000","last_clean":"2024-09-12T17:08:36.025686+0000","last_became_active":"2024-09-12T17:05:53.550857+0000","last_became_peered":"2024-09-12T17:05:53.550857+0000","last_unstale":"2024-09-12T17:08:36.025686+0000","last_undegraded":"2024-09-12T17:08:36.025686+0000","last_fullsized":"2024-09-12T17:08:36.025686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354430+0000","last_change":"2024-09-12T17:05:55.571619+0000","last_active":"2024-09-12T17:08:35.354430+0000","last_peered":"2024-09-12T17:08:35.354430+0000","last_clean":"2024-09-12T17:08:35.354430+0000","last_became_active":"2024-09-12T17:05:55.570991+0000","last_became_peered":"2024-09-12T17:05:55.570991+0000","last_unstale":"2024-09-12T17:08:35.354430+0000","last_undegraded":"2024-09-12T17:08:35.354430+0000","last_fullsized":"2024-09-12T17:08:35.354430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:02.401831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"84'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601534+0000","last_change":"2024-09-12T17:05:57.590482+0000","last_active":"2024-09-12T17:08:33.601534+0000","last_peered":"2024-09-12T17:08:33.601534+0000","last_clean":"2024-09-12T17:08:33.601534+0000","last_became_active":"2024-09-12T17:05:57.589542+0000","last_became_peered":"2024-09-12T17:05:57.589542+0000","last_unstale":"2024-09-12T17:08:33.601534+0000","last_undegraded":"2024-09-12T17:08:33.601534+0000","last_fullsized":"2024-09-12T17:08:33.601534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:20.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114011+0000","last_change":"2024-09-12T17:08:21.464126+0000","last_active":"2024-09-12T17:08:35.114011+0000","last_peered":"2024-09-12T17:08:35.114011+0000","last_clean":"2024-09-12T17:08:35.114011+0000","last_became_active":"2024-09-12T17:08:21.462608+0000","last_became_peered":"2024-09-12T17:08:21.462608+0000","last_unstale":"2024-09-12T17:08:35.114011+0000","last_undegraded":"2024-09-12T17:08:35.114011+0000","last_fullsized":"2024-09-12T17:08:35.114011+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:15.261389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"103'22","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.841642+0000","last_change":"2024-09-12T17:05:47.525858+0000","last_active":"2024-09-12T17:09:02.841642+0000","last_peered":"2024-09-12T17:09:02.841642+0000","last_clean":"2024-09-12T17:09:02.841642+0000","last_became_active":"2024-09-12T17:05:47.525258+0000","last_became_peered":"2024-09-12T17:05:47.525258+0000","last_unstale":"2024-09-12T17:09:02.841642+0000","last_undegraded":"2024-09-12T17:09:02.841642+0000","last_fullsized":"2024-09-12T17:09:02.841642+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":59401,"num_write":46,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111334+0000","last_change":"2024-09-12T17:08:18.462079+0000","last_active":"2024-09-12T17:08:35.111334+0000","last_peered":"2024-09-12T17:08:35.111334+0000","last_clean":"2024-09-12T17:08:35.111334+0000","last_became_active":"2024-09-12T17:08:18.460435+0000","last_became_peered":"2024-09-12T17:08:18.460435+0000","last_unstale":"2024-09-12T17:08:35.111334+0000","last_undegraded":"2024-09-12T17:08:35.111334+0000","last_fullsized":"2024-09-12T17:08:35.111334+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:11:32.002970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602556+0000","last_change":"2024-09-12T17:05:51.544848+0000","last_active":"2024-09-12T17:08:33.602556+0000","last_peered":"2024-09-12T17:08:33.602556+0000","last_clean":"2024-09-12T17:08:33.602556+0000","last_became_active":"2024-09-12T17:05:51.544078+0000","last_became_peered":"2024-09-12T17:05:51.544078+0000","last_unstale":"2024-09-12T17:08:33.602556+0000","last_undegraded":"2024-09-12T17:08:33.602556+0000","last_fullsized":"2024-09-12T17:08:33.602556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"103'32","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.987420+0000","last_change":"2024-09-12T17:05:53.540181+0000","last_active":"2024-09-12T17:09:02.987420+0000","last_peered":"2024-09-12T17:09:02.987420+0000","last_clean":"2024-09-12T17:09:02.987420+0000","last_became_active":"2024-09-12T17:05:53.539372+0000","last_became_peered":"2024-09-12T17:05:53.539372+0000","last_unstale":"2024-09-12T17:09:02.987420+0000","last_undegraded":"2024-09-12T17:09:02.987420+0000","last_fullsized":"2024-09-12T17:09:02.987420+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:58.931466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":53,"num_read_kb":63,"num_write":34,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211474+0000","last_change":"2024-09-12T17:05:55.554060+0000","last_active":"2024-09-12T17:08:35.211474+0000","last_peered":"2024-09-12T17:08:35.211474+0000","last_clean":"2024-09-12T17:08:35.211474+0000","last_became_active":"2024-09-12T17:05:55.553263+0000","last_became_peered":"2024-09-12T17:05:55.553263+0000","last_unstale":"2024-09-12T17:08:35.211474+0000","last_undegraded":"2024-09-12T17:08:35.211474+0000","last_fullsized":"2024-09-12T17:08:35.211474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:44.303469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602500+0000","last_change":"2024-09-12T17:05:58.121180+0000","last_active":"2024-09-12T17:08:33.602500+0000","last_peered":"2024-09-12T17:08:33.602500+0000","last_clean":"2024-09-12T17:08:33.602500+0000","last_became_active":"2024-09-12T17:05:58.119755+0000","last_became_peered":"2024-09-12T17:05:58.119755+0000","last_unstale":"2024-09-12T17:08:33.602500+0000","last_undegraded":"2024-09-12T17:08:33.602500+0000","last_fullsized":"2024-09-12T17:08:33.602500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603740+0000","last_change":"2024-09-12T17:05:49.550213+0000","last_active":"2024-09-12T17:08:33.603740+0000","last_peered":"2024-09-12T17:08:33.603740+0000","last_clean":"2024-09-12T17:08:33.603740+0000","last_became_active":"2024-09-12T17:05:49.549583+0000","last_became_peered":"2024-09-12T17:05:49.549583+0000","last_unstale":"2024-09-12T17:08:33.603740+0000","last_undegraded":"2024-09-12T17:08:33.603740+0000","last_fullsized":"2024-09-12T17:08:33.603740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:05.085326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"103'12","reported_seq":62,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114456+0000","last_change":"2024-09-12T17:08:18.869145+0000","last_active":"2024-09-12T17:08:35.114456+0000","last_peered":"2024-09-12T17:08:35.114456+0000","last_clean":"2024-09-12T17:08:35.114456+0000","last_became_active":"2024-09-12T17:08:18.448295+0000","last_became_peered":"2024-09-12T17:08:18.448295+0000","last_unstale":"2024-09-12T17:08:35.114456+0000","last_undegraded":"2024-09-12T17:08:35.114456+0000","last_fullsized":"2024-09-12T17:08:35.114456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:20.400937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":16,"num_read_kb":36867,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608651+0000","last_change":"2024-09-12T17:05:42.218804+0000","last_active":"2024-09-12T17:08:33.608651+0000","last_peered":"2024-09-12T17:08:33.608651+0000","last_clean":"2024-09-12T17:08:33.608651+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:08:33.608651+0000","last_undegraded":"2024-09-12T17:08:33.608651+0000","last_fullsized":"2024-09-12T17:08:33.608651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:48.189931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353195+0000","last_change":"2024-09-12T17:05:51.545963+0000","last_active":"2024-09-12T17:08:35.353195+0000","last_peered":"2024-09-12T17:08:35.353195+0000","last_clean":"2024-09-12T17:08:35.353195+0000","last_became_active":"2024-09-12T17:05:51.545225+0000","last_became_peered":"2024-09-12T17:05:51.545225+0000","last_unstale":"2024-09-12T17:08:35.353195+0000","last_undegraded":"2024-09-12T17:08:35.353195+0000","last_fullsized":"2024-09-12T17:08:35.353195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:40.407563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":55,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111954+0000","last_change":"2024-09-12T17:08:18.881993+0000","last_active":"2024-09-12T17:08:35.111954+0000","last_peered":"2024-09-12T17:08:35.111954+0000","last_clean":"2024-09-12T17:08:35.111954+0000","last_became_active":"2024-09-12T17:08:18.456095+0000","last_became_peered":"2024-09-12T17:08:18.456095+0000","last_unstale":"2024-09-12T17:08:35.111954+0000","last_undegraded":"2024-09-12T17:08:35.111954+0000","last_fullsized":"2024-09-12T17:08:35.111954+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:37.132692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"103'19","reported_seq":221,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.650537+0000","last_change":"2024-09-12T17:08:21.492858+0000","last_active":"2024-09-12T17:09:02.650537+0000","last_peered":"2024-09-12T17:09:02.650537+0000","last_clean":"2024-09-12T17:09:02.650537+0000","last_became_active":"2024-09-12T17:08:21.467026+0000","last_became_peered":"2024-09-12T17:08:21.467026+0000","last_unstale":"2024-09-12T17:09:02.650537+0000","last_undegraded":"2024-09-12T17:09:02.650537+0000","last_fullsized":"2024-09-12T17:09:02.650537+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:08.135205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.026036+0000","last_change":"2024-09-12T17:05:58.118437+0000","last_active":"2024-09-12T17:08:36.026036+0000","last_peered":"2024-09-12T17:08:36.026036+0000","last_clean":"2024-09-12T17:08:36.026036+0000","last_became_active":"2024-09-12T17:05:58.117710+0000","last_became_peered":"2024-09-12T17:05:58.117710+0000","last_unstale":"2024-09-12T17:08:36.026036+0000","last_undegraded":"2024-09-12T17:08:36.026036+0000","last_fullsized":"2024-09-12T17:08:36.026036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:00.239807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":126,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019063+0000","last_change":"2024-09-12T17:06:27.817661+0000","last_active":"2024-09-12T17:08:36.019063+0000","last_peered":"2024-09-12T17:08:36.019063+0000","last_clean":"2024-09-12T17:08:36.019063+0000","last_became_active":"2024-09-12T17:06:27.817451+0000","last_became_peered":"2024-09-12T17:06:27.817451+0000","last_unstale":"2024-09-12T17:08:36.019063+0000","last_undegraded":"2024-09-12T17:08:36.019063+0000","last_fullsized":"2024-09-12T17:08:36.019063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:31.000633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"103'11","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.814159+0000","last_change":"2024-09-12T17:05:47.535321+0000","last_active":"2024-09-12T17:09:02.814159+0000","last_peered":"2024-09-12T17:09:02.814159+0000","last_clean":"2024-09-12T17:09:02.814159+0000","last_became_active":"2024-09-12T17:05:47.534790+0000","last_became_peered":"2024-09-12T17:05:47.534790+0000","last_unstale":"2024-09-12T17:09:02.814159+0000","last_undegraded":"2024-09-12T17:09:02.814159+0000","last_fullsized":"2024-09-12T17:09:02.814159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":26627,"num_write":19,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115452+0000","last_change":"2024-09-12T17:08:21.467295+0000","last_active":"2024-09-12T17:08:35.115452+0000","last_peered":"2024-09-12T17:08:35.115452+0000","last_clean":"2024-09-12T17:08:35.115452+0000","last_became_active":"2024-09-12T17:08:21.467016+0000","last_became_peered":"2024-09-12T17:08:21.467016+0000","last_unstale":"2024-09-12T17:08:35.115452+0000","last_undegraded":"2024-09-12T17:08:35.115452+0000","last_fullsized":"2024-09-12T17:08:35.115452+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:24.509905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211005+0000","last_change":"2024-09-12T17:05:51.533668+0000","last_active":"2024-09-12T17:08:35.211005+0000","last_peered":"2024-09-12T17:08:35.211005+0000","last_clean":"2024-09-12T17:08:35.211005+0000","last_became_active":"2024-09-12T17:05:51.532795+0000","last_became_peered":"2024-09-12T17:05:51.532795+0000","last_unstale":"2024-09-12T17:08:35.211005+0000","last_undegraded":"2024-09-12T17:08:35.211005+0000","last_fullsized":"2024-09-12T17:08:35.211005+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.655645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211301+0000","last_change":"2024-09-12T17:05:53.544503+0000","last_active":"2024-09-12T17:08:35.211301+0000","last_peered":"2024-09-12T17:08:35.211301+0000","last_clean":"2024-09-12T17:08:35.211301+0000","last_became_active":"2024-09-12T17:05:53.543495+0000","last_became_peered":"2024-09-12T17:05:53.543495+0000","last_unstale":"2024-09-12T17:08:35.211301+0000","last_undegraded":"2024-09-12T17:08:35.211301+0000","last_fullsized":"2024-09-12T17:08:35.211301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.721968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"103'17","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.657864+0000","last_change":"2024-09-12T17:05:55.567580+0000","last_active":"2024-09-12T17:09:02.657864+0000","last_peered":"2024-09-12T17:09:02.657864+0000","last_clean":"2024-09-12T17:09:02.657864+0000","last_became_active":"2024-09-12T17:05:55.566652+0000","last_became_peered":"2024-09-12T17:05:55.566652+0000","last_unstale":"2024-09-12T17:09:02.657864+0000","last_undegraded":"2024-09-12T17:09:02.657864+0000","last_fullsized":"2024-09-12T17:09:02.657864+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:28.904117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"68'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602357+0000","last_change":"2024-09-12T17:05:57.585098+0000","last_active":"2024-09-12T17:08:33.602357+0000","last_peered":"2024-09-12T17:08:33.602357+0000","last_clean":"2024-09-12T17:08:33.602357+0000","last_became_active":"2024-09-12T17:05:57.584326+0000","last_became_peered":"2024-09-12T17:05:57.584326+0000","last_unstale":"2024-09-12T17:08:33.602357+0000","last_undegraded":"2024-09-12T17:08:33.602357+0000","last_fullsized":"2024-09-12T17:08:33.602357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210656+0000","last_change":"2024-09-12T17:05:49.553294+0000","last_active":"2024-09-12T17:08:35.210656+0000","last_peered":"2024-09-12T17:08:35.210656+0000","last_clean":"2024-09-12T17:08:35.210656+0000","last_became_active":"2024-09-12T17:05:49.551726+0000","last_became_peered":"2024-09-12T17:05:49.551726+0000","last_unstale":"2024-09-12T17:08:35.210656+0000","last_undegraded":"2024-09-12T17:08:35.210656+0000","last_fullsized":"2024-09-12T17:08:35.210656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:50.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"103'9","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604478+0000","last_change":"2024-09-12T17:08:18.767913+0000","last_active":"2024-09-12T17:08:33.604478+0000","last_peered":"2024-09-12T17:08:33.604478+0000","last_clean":"2024-09-12T17:08:33.604478+0000","last_became_active":"2024-09-12T17:08:18.466136+0000","last_became_peered":"2024-09-12T17:08:18.466136+0000","last_unstale":"2024-09-12T17:08:33.604478+0000","last_undegraded":"2024-09-12T17:08:33.604478+0000","last_fullsized":"2024-09-12T17:08:33.604478+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:20.220833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":24582,"num_write":25,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.355006+0000","last_change":"2024-09-12T17:05:42.680975+0000","last_active":"2024-09-12T17:08:35.355006+0000","last_peered":"2024-09-12T17:08:35.355006+0000","last_clean":"2024-09-12T17:08:35.355006+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:08:35.355006+0000","last_undegraded":"2024-09-12T17:08:35.355006+0000","last_fullsized":"2024-09-12T17:08:35.355006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.660350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022223+0000","last_change":"2024-09-12T17:08:18.450093+0000","last_active":"2024-09-12T17:08:36.022223+0000","last_peered":"2024-09-12T17:08:36.022223+0000","last_clean":"2024-09-12T17:08:36.022223+0000","last_became_active":"2024-09-12T17:08:18.449746+0000","last_became_peered":"2024-09-12T17:08:18.449746+0000","last_unstale":"2024-09-12T17:08:36.022223+0000","last_undegraded":"2024-09-12T17:08:36.022223+0000","last_fullsized":"2024-09-12T17:08:36.022223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:58.736246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"103'47","reported_seq":226,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.943131+0000","last_change":"2024-09-12T17:05:53.554751+0000","last_active":"2024-09-12T17:09:02.943131+0000","last_peered":"2024-09-12T17:09:02.943131+0000","last_clean":"2024-09-12T17:09:02.943131+0000","last_became_active":"2024-09-12T17:05:53.553914+0000","last_became_peered":"2024-09-12T17:05:53.553914+0000","last_unstale":"2024-09-12T17:09:02.943131+0000","last_undegraded":"2024-09-12T17:09:02.943131+0000","last_fullsized":"2024-09-12T17:09:02.943131+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13401,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":83,"num_read_kb":141,"num_write":56,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022004+0000","last_change":"2024-09-12T17:08:21.458963+0000","last_active":"2024-09-12T17:08:36.022004+0000","last_peered":"2024-09-12T17:08:36.022004+0000","last_clean":"2024-09-12T17:08:36.022004+0000","last_became_active":"2024-09-12T17:08:21.458521+0000","last_became_peered":"2024-09-12T17:08:21.458521+0000","last_unstale":"2024-09-12T17:08:36.022004+0000","last_undegraded":"2024-09-12T17:08:36.022004+0000","last_fullsized":"2024-09-12T17:08:36.022004+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:56.903898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603355+0000","last_change":"2024-09-12T17:05:57.605829+0000","last_active":"2024-09-12T17:08:33.603355+0000","last_peered":"2024-09-12T17:08:33.603355+0000","last_clean":"2024-09-12T17:08:33.603355+0000","last_became_active":"2024-09-12T17:05:57.605041+0000","last_became_peered":"2024-09-12T17:05:57.605041+0000","last_unstale":"2024-09-12T17:08:33.603355+0000","last_undegraded":"2024-09-12T17:08:33.603355+0000","last_fullsized":"2024-09-12T17:08:33.603355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602885+0000","last_change":"2024-09-12T17:05:57.594498+0000","last_active":"2024-09-12T17:08:33.602885+0000","last_peered":"2024-09-12T17:08:33.602885+0000","last_clean":"2024-09-12T17:08:33.602885+0000","last_became_active":"2024-09-12T17:05:57.590196+0000","last_became_peered":"2024-09-12T17:05:57.590196+0000","last_unstale":"2024-09-12T17:08:33.602885+0000","last_undegraded":"2024-09-12T17:08:33.602885+0000","last_fullsized":"2024-09-12T17:08:33.602885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.543735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212141+0000","last_change":"2024-09-12T17:05:49.562121+0000","last_active":"2024-09-12T17:08:35.212141+0000","last_peered":"2024-09-12T17:08:35.212141+0000","last_clean":"2024-09-12T17:08:35.212141+0000","last_became_active":"2024-09-12T17:05:49.561429+0000","last_became_peered":"2024-09-12T17:05:49.561429+0000","last_unstale":"2024-09-12T17:08:35.212141+0000","last_undegraded":"2024-09-12T17:08:35.212141+0000","last_fullsized":"2024-09-12T17:08:35.212141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:47.663366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"103'14","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.872399+0000","last_change":"2024-09-12T17:05:47.557270+0000","last_active":"2024-09-12T17:09:02.872399+0000","last_peered":"2024-09-12T17:09:02.872399+0000","last_clean":"2024-09-12T17:09:02.872399+0000","last_became_active":"2024-09-12T17:05:47.556417+0000","last_became_peered":"2024-09-12T17:05:47.556417+0000","last_unstale":"2024-09-12T17:09:02.872399+0000","last_undegraded":"2024-09-12T17:09:02.872399+0000","last_fullsized":"2024-09-12T17:09:02.872399+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:00.210632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":32774,"num_write":30,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111337+0000","last_change":"2024-09-12T17:08:18.464941+0000","last_active":"2024-09-12T17:08:35.111337+0000","last_peered":"2024-09-12T17:08:35.111337+0000","last_clean":"2024-09-12T17:08:35.111337+0000","last_became_active":"2024-09-12T17:08:18.464091+0000","last_became_peered":"2024-09-12T17:08:18.464091+0000","last_unstale":"2024-09-12T17:08:35.111337+0000","last_undegraded":"2024-09-12T17:08:35.111337+0000","last_fullsized":"2024-09-12T17:08:35.111337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:15.952591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"103'17","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020620+0000","last_change":"2024-09-12T17:05:53.542230+0000","last_active":"2024-09-12T17:08:36.020620+0000","last_peered":"2024-09-12T17:08:36.020620+0000","last_clean":"2024-09-12T17:08:36.020620+0000","last_became_active":"2024-09-12T17:05:53.541653+0000","last_became_peered":"2024-09-12T17:05:53.541653+0000","last_unstale":"2024-09-12T17:08:36.020620+0000","last_undegraded":"2024-09-12T17:08:36.020620+0000","last_fullsized":"2024-09-12T17:08:36.020620+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5767,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022656+0000","last_change":"2024-09-12T17:05:55.556535+0000","last_active":"2024-09-12T17:08:36.022656+0000","last_peered":"2024-09-12T17:08:36.022656+0000","last_clean":"2024-09-12T17:08:36.022656+0000","last_became_active":"2024-09-12T17:05:55.555755+0000","last_became_peered":"2024-09-12T17:05:55.555755+0000","last_unstale":"2024-09-12T17:08:36.022656+0000","last_undegraded":"2024-09-12T17:08:36.022656+0000","last_fullsized":"2024-09-12T17:08:36.022656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.707384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"84'2","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025238+0000","last_change":"2024-09-12T17:05:57.593418+0000","last_active":"2024-09-12T17:08:36.025238+0000","last_peered":"2024-09-12T17:08:36.025238+0000","last_clean":"2024-09-12T17:08:36.025238+0000","last_became_active":"2024-09-12T17:05:57.592746+0000","last_became_peered":"2024-09-12T17:05:57.592746+0000","last_unstale":"2024-09-12T17:08:36.025238+0000","last_undegraded":"2024-09-12T17:08:36.025238+0000","last_fullsized":"2024-09-12T17:08:36.025238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:24.794382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"68'6","reported_seq":38,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113920+0000","last_change":"2024-09-12T17:08:21.616789+0000","last_active":"2024-09-12T17:08:35.113920+0000","last_peered":"2024-09-12T17:08:35.113920+0000","last_clean":"2024-09-12T17:08:35.113920+0000","last_became_active":"2024-09-12T17:08:21.466328+0000","last_became_peered":"2024-09-12T17:08:21.466328+0000","last_unstale":"2024-09-12T17:08:35.113920+0000","last_undegraded":"2024-09-12T17:08:35.113920+0000","last_fullsized":"2024-09-12T17:08:35.113920+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:16.524646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"103'10","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608107+0000","last_change":"2024-09-12T17:05:47.559497+0000","last_active":"2024-09-12T17:08:33.608107+0000","last_peered":"2024-09-12T17:08:33.608107+0000","last_clean":"2024-09-12T17:08:33.608107+0000","last_became_active":"2024-09-12T17:05:47.558641+0000","last_became_peered":"2024-09-12T17:05:47.558641+0000","last_unstale":"2024-09-12T17:08:33.608107+0000","last_undegraded":"2024-09-12T17:08:33.608107+0000","last_fullsized":"2024-09-12T17:08:33.608107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:00.096304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":24585,"num_write":34,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022987+0000","last_change":"2024-09-12T17:05:51.539784+0000","last_active":"2024-09-12T17:08:36.022987+0000","last_peered":"2024-09-12T17:08:36.022987+0000","last_clean":"2024-09-12T17:08:36.022987+0000","last_became_active":"2024-09-12T17:05:51.539275+0000","last_became_peered":"2024-09-12T17:05:51.539275+0000","last_unstale":"2024-09-12T17:08:36.022987+0000","last_undegraded":"2024-09-12T17:08:36.022987+0000","last_fullsized":"2024-09-12T17:08:36.022987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"84'6","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600440+0000","last_change":"2024-09-12T17:05:53.544731+0000","last_active":"2024-09-12T17:08:33.600440+0000","last_peered":"2024-09-12T17:08:33.600440+0000","last_clean":"2024-09-12T17:08:33.600440+0000","last_became_active":"2024-09-12T17:05:53.544127+0000","last_became_peered":"2024-09-12T17:05:53.544127+0000","last_unstale":"2024-09-12T17:08:33.600440+0000","last_undegraded":"2024-09-12T17:08:33.600440+0000","last_fullsized":"2024-09-12T17:08:33.600440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:04.351698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604873+0000","last_change":"2024-09-12T17:05:55.571541+0000","last_active":"2024-09-12T17:08:33.604873+0000","last_peered":"2024-09-12T17:08:33.604873+0000","last_clean":"2024-09-12T17:08:33.604873+0000","last_became_active":"2024-09-12T17:05:55.570822+0000","last_became_peered":"2024-09-12T17:05:55.570822+0000","last_unstale":"2024-09-12T17:08:33.604873+0000","last_undegraded":"2024-09-12T17:08:33.604873+0000","last_fullsized":"2024-09-12T17:08:33.604873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'2","reported_seq":165,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602495+0000","last_change":"2024-09-12T17:08:18.704689+0000","last_active":"2024-09-12T17:08:33.602495+0000","last_peered":"2024-09-12T17:08:33.602495+0000","last_clean":"2024-09-12T17:08:33.602495+0000","last_became_active":"2024-09-12T17:08:18.450561+0000","last_became_peered":"2024-09-12T17:08:18.450561+0000","last_unstale":"2024-09-12T17:08:33.602495+0000","last_undegraded":"2024-09-12T17:08:33.602495+0000","last_fullsized":"2024-09-12T17:08:33.602495+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:43.088841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021066+0000","last_change":"2024-09-12T17:05:49.520508+0000","last_active":"2024-09-12T17:08:36.021066+0000","last_peered":"2024-09-12T17:08:36.021066+0000","last_clean":"2024-09-12T17:08:36.021066+0000","last_became_active":"2024-09-12T17:05:49.519721+0000","last_became_peered":"2024-09-12T17:05:49.519721+0000","last_unstale":"2024-09-12T17:08:36.021066+0000","last_undegraded":"2024-09-12T17:08:36.021066+0000","last_fullsized":"2024-09-12T17:08:36.021066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"103'10","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606206+0000","last_change":"2024-09-12T17:05:47.539549+0000","last_active":"2024-09-12T17:08:33.606206+0000","last_peered":"2024-09-12T17:08:33.606206+0000","last_clean":"2024-09-12T17:08:33.606206+0000","last_became_active":"2024-09-12T17:05:47.538581+0000","last_became_peered":"2024-09-12T17:05:47.538581+0000","last_unstale":"2024-09-12T17:08:33.606206+0000","last_undegraded":"2024-09-12T17:08:33.606206+0000","last_fullsized":"2024-09-12T17:08:33.606206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.448924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601093+0000","last_change":"2024-09-12T17:05:51.530541+0000","last_active":"2024-09-12T17:08:33.601093+0000","last_peered":"2024-09-12T17:08:33.601093+0000","last_clean":"2024-09-12T17:08:33.601093+0000","last_became_active":"2024-09-12T17:05:51.527515+0000","last_became_peered":"2024-09-12T17:05:51.527515+0000","last_unstale":"2024-09-12T17:08:33.601093+0000","last_undegraded":"2024-09-12T17:08:33.601093+0000","last_fullsized":"2024-09-12T17:08:33.601093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"103'20","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.957945+0000","last_change":"2024-09-12T17:05:53.555017+0000","last_active":"2024-09-12T17:09:02.957945+0000","last_peered":"2024-09-12T17:09:02.957945+0000","last_clean":"2024-09-12T17:09:02.957945+0000","last_became_active":"2024-09-12T17:05:53.551154+0000","last_became_peered":"2024-09-12T17:05:53.551154+0000","last_unstale":"2024-09-12T17:09:02.957945+0000","last_undegraded":"2024-09-12T17:09:02.957945+0000","last_fullsized":"2024-09-12T17:09:02.957945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:50.736153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":37,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353172+0000","last_change":"2024-09-12T17:05:55.570872+0000","last_active":"2024-09-12T17:08:35.353172+0000","last_peered":"2024-09-12T17:08:35.353172+0000","last_clean":"2024-09-12T17:08:35.353172+0000","last_became_active":"2024-09-12T17:05:55.570137+0000","last_became_peered":"2024-09-12T17:05:55.570137+0000","last_unstale":"2024-09-12T17:08:35.353172+0000","last_undegraded":"2024-09-12T17:08:35.353172+0000","last_fullsized":"2024-09-12T17:08:35.353172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.684868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602407+0000","last_change":"2024-09-12T17:05:57.597088+0000","last_active":"2024-09-12T17:08:33.602407+0000","last_peered":"2024-09-12T17:08:33.602407+0000","last_clean":"2024-09-12T17:08:33.602407+0000","last_became_active":"2024-09-12T17:05:57.596377+0000","last_became_peered":"2024-09-12T17:05:57.596377+0000","last_unstale":"2024-09-12T17:08:33.602407+0000","last_undegraded":"2024-09-12T17:08:33.602407+0000","last_fullsized":"2024-09-12T17:08:33.602407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"68'2","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021754+0000","last_change":"2024-09-12T17:08:18.478612+0000","last_active":"2024-09-12T17:08:36.021754+0000","last_peered":"2024-09-12T17:08:36.021754+0000","last_clean":"2024-09-12T17:08:36.021754+0000","last_became_active":"2024-09-12T17:08:18.449338+0000","last_became_peered":"2024-09-12T17:08:18.449338+0000","last_unstale":"2024-09-12T17:08:36.021754+0000","last_undegraded":"2024-09-12T17:08:36.021754+0000","last_fullsized":"2024-09-12T17:08:36.021754+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:15.864351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"103'9","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.920329+0000","last_change":"2024-09-12T17:05:47.526555+0000","last_active":"2024-09-12T17:09:02.920329+0000","last_peered":"2024-09-12T17:09:02.920329+0000","last_clean":"2024-09-12T17:09:02.920329+0000","last_became_active":"2024-09-12T17:05:47.525874+0000","last_became_peered":"2024-09-12T17:05:47.525874+0000","last_unstale":"2024-09-12T17:09:02.920329+0000","last_undegraded":"2024-09-12T17:09:02.920329+0000","last_fullsized":"2024-09-12T17:09:02.920329+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":18435,"num_write":17,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353031+0000","last_change":"2024-09-12T17:05:51.540509+0000","last_active":"2024-09-12T17:08:35.353031+0000","last_peered":"2024-09-12T17:08:35.353031+0000","last_clean":"2024-09-12T17:08:35.353031+0000","last_became_active":"2024-09-12T17:05:51.539607+0000","last_became_peered":"2024-09-12T17:05:51.539607+0000","last_unstale":"2024-09-12T17:08:35.353031+0000","last_undegraded":"2024-09-12T17:08:35.353031+0000","last_fullsized":"2024-09-12T17:08:35.353031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:02.652624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"103'17","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.892143+0000","last_change":"2024-09-12T17:05:53.549324+0000","last_active":"2024-09-12T17:09:02.892143+0000","last_peered":"2024-09-12T17:09:02.892143+0000","last_clean":"2024-09-12T17:09:02.892143+0000","last_became_active":"2024-09-12T17:05:53.548561+0000","last_became_peered":"2024-09-12T17:05:53.548561+0000","last_unstale":"2024-09-12T17:09:02.892143+0000","last_undegraded":"2024-09-12T17:09:02.892143+0000","last_fullsized":"2024-09-12T17:09:02.892143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:47.932776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601440+0000","last_change":"2024-09-12T17:05:55.561467+0000","last_active":"2024-09-12T17:08:33.601440+0000","last_peered":"2024-09-12T17:08:33.601440+0000","last_clean":"2024-09-12T17:08:33.601440+0000","last_became_active":"2024-09-12T17:05:55.560708+0000","last_became_peered":"2024-09-12T17:05:55.560708+0000","last_unstale":"2024-09-12T17:08:33.601440+0000","last_undegraded":"2024-09-12T17:08:33.601440+0000","last_fullsized":"2024-09-12T17:08:33.601440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"84'46","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354839+0000","last_change":"2024-09-12T17:05:49.547097+0000","last_active":"2024-09-12T17:08:35.354839+0000","last_peered":"2024-09-12T17:08:35.354839+0000","last_clean":"2024-09-12T17:08:35.354839+0000","last_became_active":"2024-09-12T17:05:49.546232+0000","last_became_peered":"2024-09-12T17:05:49.546232+0000","last_unstale":"2024-09-12T17:08:35.354839+0000","last_undegraded":"2024-09-12T17:08:35.354839+0000","last_fullsized":"2024-09-12T17:08:35.354839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"103'13","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.908917+0000","last_change":"2024-09-12T17:05:47.521779+0000","last_active":"2024-09-12T17:09:02.908917+0000","last_peered":"2024-09-12T17:09:02.908917+0000","last_clean":"2024-09-12T17:09:02.908917+0000","last_became_active":"2024-09-12T17:05:47.521097+0000","last_became_peered":"2024-09-12T17:05:47.521097+0000","last_unstale":"2024-09-12T17:09:02.908917+0000","last_undegraded":"2024-09-12T17:09:02.908917+0000","last_fullsized":"2024-09-12T17:09:02.908917+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:37.072896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":17,"num_read_kb":24579,"num_write":21,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604192+0000","last_change":"2024-09-12T17:05:51.525803+0000","last_active":"2024-09-12T17:08:33.604192+0000","last_peered":"2024-09-12T17:08:33.604192+0000","last_clean":"2024-09-12T17:08:33.604192+0000","last_became_active":"2024-09-12T17:05:51.525457+0000","last_became_peered":"2024-09-12T17:05:51.525457+0000","last_unstale":"2024-09-12T17:08:33.604192+0000","last_undegraded":"2024-09-12T17:08:33.604192+0000","last_fullsized":"2024-09-12T17:08:33.604192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"103'32","reported_seq":60,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.876148+0000","last_change":"2024-09-12T17:08:19.023629+0000","last_active":"2024-09-12T17:09:02.876148+0000","last_peered":"2024-09-12T17:09:02.876148+0000","last_clean":"2024-09-12T17:09:02.876148+0000","last_became_active":"2024-09-12T17:08:18.463961+0000","last_became_peered":"2024-09-12T17:08:18.463961+0000","last_unstale":"2024-09-12T17:09:02.876148+0000","last_undegraded":"2024-09-12T17:09:02.876148+0000","last_fullsized":"2024-09-12T17:09:02.876148+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:09.409031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21624,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":83,"num_write":40,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":16653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603360+0000","last_change":"2024-09-12T17:05:55.563312+0000","last_active":"2024-09-12T17:08:33.603360+0000","last_peered":"2024-09-12T17:08:33.603360+0000","last_clean":"2024-09-12T17:08:33.603360+0000","last_became_active":"2024-09-12T17:05:55.562405+0000","last_became_peered":"2024-09-12T17:05:55.562405+0000","last_unstale":"2024-09-12T17:08:33.603360+0000","last_undegraded":"2024-09-12T17:08:33.603360+0000","last_fullsized":"2024-09-12T17:08:33.603360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022413+0000","last_change":"2024-09-12T17:05:58.121110+0000","last_active":"2024-09-12T17:08:36.022413+0000","last_peered":"2024-09-12T17:08:36.022413+0000","last_clean":"2024-09-12T17:08:36.022413+0000","last_became_active":"2024-09-12T17:05:58.120367+0000","last_became_peered":"2024-09-12T17:05:58.120367+0000","last_unstale":"2024-09-12T17:08:36.022413+0000","last_undegraded":"2024-09-12T17:08:36.022413+0000","last_fullsized":"2024-09-12T17:08:36.022413+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604265+0000","last_change":"2024-09-12T17:05:49.532377+0000","last_active":"2024-09-12T17:08:33.604265+0000","last_peered":"2024-09-12T17:08:33.604265+0000","last_clean":"2024-09-12T17:08:33.604265+0000","last_became_active":"2024-09-12T17:05:49.531975+0000","last_became_peered":"2024-09-12T17:05:49.531975+0000","last_unstale":"2024-09-12T17:08:33.604265+0000","last_undegraded":"2024-09-12T17:08:33.604265+0000","last_fullsized":"2024-09-12T17:08:33.604265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"103'15","reported_seq":61,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.780301+0000","last_change":"2024-09-12T17:08:19.003420+0000","last_active":"2024-09-12T17:09:02.780301+0000","last_peered":"2024-09-12T17:09:02.780301+0000","last_clean":"2024-09-12T17:09:02.780301+0000","last_became_active":"2024-09-12T17:08:18.457074+0000","last_became_peered":"2024-09-12T17:08:18.457074+0000","last_unstale":"2024-09-12T17:09:02.780301+0000","last_undegraded":"2024-09-12T17:09:02.780301+0000","last_fullsized":"2024-09-12T17:09:02.780301+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:07.545826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":36876,"num_write":47,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354606+0000","last_change":"2024-09-12T17:05:51.546117+0000","last_active":"2024-09-12T17:08:35.354606+0000","last_peered":"2024-09-12T17:08:35.354606+0000","last_clean":"2024-09-12T17:08:35.354606+0000","last_became_active":"2024-09-12T17:05:51.545154+0000","last_became_peered":"2024-09-12T17:05:51.545154+0000","last_unstale":"2024-09-12T17:08:35.354606+0000","last_undegraded":"2024-09-12T17:08:35.354606+0000","last_fullsized":"2024-09-12T17:08:35.354606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:49.670591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"103'23","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.924701+0000","last_change":"2024-09-12T17:05:53.558834+0000","last_active":"2024-09-12T17:09:02.924701+0000","last_peered":"2024-09-12T17:09:02.924701+0000","last_clean":"2024-09-12T17:09:02.924701+0000","last_became_active":"2024-09-12T17:05:53.558086+0000","last_became_peered":"2024-09-12T17:05:53.558086+0000","last_unstale":"2024-09-12T17:09:02.924701+0000","last_undegraded":"2024-09-12T17:09:02.924701+0000","last_fullsized":"2024-09-12T17:09:02.924701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:43.690058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":51,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114479+0000","last_change":"2024-09-12T17:08:21.466904+0000","last_active":"2024-09-12T17:08:35.114479+0000","last_peered":"2024-09-12T17:08:35.114479+0000","last_clean":"2024-09-12T17:08:35.114479+0000","last_became_active":"2024-09-12T17:08:21.466295+0000","last_became_peered":"2024-09-12T17:08:21.466295+0000","last_unstale":"2024-09-12T17:08:35.114479+0000","last_undegraded":"2024-09-12T17:08:35.114479+0000","last_fullsized":"2024-09-12T17:08:35.114479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:22.041235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'2","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352817+0000","last_change":"2024-09-12T17:05:57.597468+0000","last_active":"2024-09-12T17:08:35.352817+0000","last_peered":"2024-09-12T17:08:35.352817+0000","last_clean":"2024-09-12T17:08:35.352817+0000","last_became_active":"2024-09-12T17:05:57.596651+0000","last_became_peered":"2024-09-12T17:05:57.596651+0000","last_unstale":"2024-09-12T17:08:35.352817+0000","last_undegraded":"2024-09-12T17:08:35.352817+0000","last_fullsized":"2024-09-12T17:08:35.352817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.466145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024382+0000","last_change":"2024-09-12T17:08:18.465892+0000","last_active":"2024-09-12T17:08:36.024382+0000","last_peered":"2024-09-12T17:08:36.024382+0000","last_clean":"2024-09-12T17:08:36.024382+0000","last_became_active":"2024-09-12T17:08:18.465478+0000","last_became_peered":"2024-09-12T17:08:18.465478+0000","last_unstale":"2024-09-12T17:08:36.024382+0000","last_undegraded":"2024-09-12T17:08:36.024382+0000","last_fullsized":"2024-09-12T17:08:36.024382+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:00.793079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"103'10","reported_seq":214,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.917627+0000","last_change":"2024-09-12T17:08:18.626808+0000","last_active":"2024-09-12T17:09:02.917627+0000","last_peered":"2024-09-12T17:09:02.917627+0000","last_clean":"2024-09-12T17:09:02.917627+0000","last_became_active":"2024-09-12T17:08:18.447694+0000","last_became_peered":"2024-09-12T17:08:18.447694+0000","last_unstale":"2024-09-12T17:09:02.917627+0000","last_undegraded":"2024-09-12T17:09:02.917627+0000","last_fullsized":"2024-09-12T17:09:02.917627+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:09.465286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":14,"num_read_kb":28675,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212636+0000","last_change":"2024-09-12T17:05:51.539916+0000","last_active":"2024-09-12T17:08:35.212636+0000","last_peered":"2024-09-12T17:08:35.212636+0000","last_clean":"2024-09-12T17:08:35.212636+0000","last_became_active":"2024-09-12T17:05:51.539054+0000","last_became_peered":"2024-09-12T17:05:51.539054+0000","last_unstale":"2024-09-12T17:08:35.212636+0000","last_undegraded":"2024-09-12T17:08:35.212636+0000","last_fullsized":"2024-09-12T17:08:35.212636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:11.640578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"103'17","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.026096+0000","last_change":"2024-09-12T17:05:53.557081+0000","last_active":"2024-09-12T17:08:36.026096+0000","last_peered":"2024-09-12T17:08:36.026096+0000","last_clean":"2024-09-12T17:08:36.026096+0000","last_became_active":"2024-09-12T17:05:53.556357+0000","last_became_peered":"2024-09-12T17:05:53.556357+0000","last_unstale":"2024-09-12T17:08:36.026096+0000","last_undegraded":"2024-09-12T17:08:36.026096+0000","last_fullsized":"2024-09-12T17:08:36.026096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:10.984649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":25,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115218+0000","last_change":"2024-09-12T17:08:21.461633+0000","last_active":"2024-09-12T17:08:35.115218+0000","last_peered":"2024-09-12T17:08:35.115218+0000","last_clean":"2024-09-12T17:08:35.115218+0000","last_became_active":"2024-09-12T17:08:21.460894+0000","last_became_peered":"2024-09-12T17:08:21.460894+0000","last_unstale":"2024-09-12T17:08:35.115218+0000","last_undegraded":"2024-09-12T17:08:35.115218+0000","last_fullsized":"2024-09-12T17:08:35.115218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:18.857770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601884+0000","last_change":"2024-09-12T17:05:57.596779+0000","last_active":"2024-09-12T17:08:33.601884+0000","last_peered":"2024-09-12T17:08:33.601884+0000","last_clean":"2024-09-12T17:08:33.601884+0000","last_became_active":"2024-09-12T17:05:57.596005+0000","last_became_peered":"2024-09-12T17:05:57.596005+0000","last_unstale":"2024-09-12T17:08:33.601884+0000","last_undegraded":"2024-09-12T17:08:33.601884+0000","last_fullsized":"2024-09-12T17:08:33.601884+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024995+0000","last_change":"2024-09-12T17:08:18.445744+0000","last_active":"2024-09-12T17:08:36.024995+0000","last_peered":"2024-09-12T17:08:36.024995+0000","last_clean":"2024-09-12T17:08:36.024995+0000","last_became_active":"2024-09-12T17:08:18.445415+0000","last_became_peered":"2024-09-12T17:08:18.445415+0000","last_unstale":"2024-09-12T17:08:36.024995+0000","last_undegraded":"2024-09-12T17:08:36.024995+0000","last_fullsized":"2024-09-12T17:08:36.024995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:17.325226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"103'16","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.790905+0000","last_change":"2024-09-12T17:05:47.546051+0000","last_active":"2024-09-12T17:09:02.790905+0000","last_peered":"2024-09-12T17:09:02.790905+0000","last_clean":"2024-09-12T17:09:02.790905+0000","last_became_active":"2024-09-12T17:05:47.545466+0000","last_became_peered":"2024-09-12T17:05:47.545466+0000","last_unstale":"2024-09-12T17:09:02.790905+0000","last_undegraded":"2024-09-12T17:09:02.790905+0000","last_fullsized":"2024-09-12T17:09:02.790905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":40966,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114773+0000","last_change":"2024-09-12T17:08:18.457478+0000","last_active":"2024-09-12T17:08:35.114773+0000","last_peered":"2024-09-12T17:08:35.114773+0000","last_clean":"2024-09-12T17:08:35.114773+0000","last_became_active":"2024-09-12T17:08:18.457099+0000","last_became_peered":"2024-09-12T17:08:18.457099+0000","last_unstale":"2024-09-12T17:08:35.114773+0000","last_undegraded":"2024-09-12T17:08:35.114773+0000","last_fullsized":"2024-09-12T17:08:35.114773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:30.371124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"86'12","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212137+0000","last_change":"2024-09-12T17:05:53.561278+0000","last_active":"2024-09-12T17:08:35.212137+0000","last_peered":"2024-09-12T17:08:35.212137+0000","last_clean":"2024-09-12T17:08:35.212137+0000","last_became_active":"2024-09-12T17:05:53.559688+0000","last_became_peered":"2024-09-12T17:05:53.559688+0000","last_unstale":"2024-09-12T17:08:35.212137+0000","last_undegraded":"2024-09-12T17:08:35.212137+0000","last_fullsized":"2024-09-12T17:08:35.212137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:37.392549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":16,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"103'17","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.647816+0000","last_change":"2024-09-12T17:05:55.576227+0000","last_active":"2024-09-12T17:09:02.647816+0000","last_peered":"2024-09-12T17:09:02.647816+0000","last_clean":"2024-09-12T17:09:02.647816+0000","last_became_active":"2024-09-12T17:05:55.571966+0000","last_became_peered":"2024-09-12T17:05:55.571966+0000","last_unstale":"2024-09-12T17:09:02.647816+0000","last_undegraded":"2024-09-12T17:09:02.647816+0000","last_fullsized":"2024-09-12T17:09:02.647816+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:24.680106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601043+0000","last_change":"2024-09-12T17:05:57.595153+0000","last_active":"2024-09-12T17:08:33.601043+0000","last_peered":"2024-09-12T17:08:33.601043+0000","last_clean":"2024-09-12T17:08:33.601043+0000","last_became_active":"2024-09-12T17:05:57.594396+0000","last_became_peered":"2024-09-12T17:05:57.594396+0000","last_unstale":"2024-09-12T17:08:33.601043+0000","last_undegraded":"2024-09-12T17:08:33.601043+0000","last_fullsized":"2024-09-12T17:08:33.601043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:27.040243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211051+0000","last_change":"2024-09-12T17:05:49.543269+0000","last_active":"2024-09-12T17:08:35.211051+0000","last_peered":"2024-09-12T17:08:35.211051+0000","last_clean":"2024-09-12T17:08:35.211051+0000","last_became_active":"2024-09-12T17:05:49.542414+0000","last_became_peered":"2024-09-12T17:05:49.542414+0000","last_unstale":"2024-09-12T17:08:35.211051+0000","last_undegraded":"2024-09-12T17:08:35.211051+0000","last_fullsized":"2024-09-12T17:08:35.211051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:00.645399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"103'18","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.857501+0000","last_change":"2024-09-12T17:06:27.785226+0000","last_active":"2024-09-12T17:09:02.857501+0000","last_peered":"2024-09-12T17:09:02.857501+0000","last_clean":"2024-09-12T17:09:02.857501+0000","last_became_active":"2024-09-12T17:06:27.784897+0000","last_became_peered":"2024-09-12T17:06:27.784897+0000","last_unstale":"2024-09-12T17:09:02.857501+0000","last_undegraded":"2024-09-12T17:09:02.857501+0000","last_fullsized":"2024-09-12T17:09:02.857501+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:25.368283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":26,"num_read_kb":49158,"num_write":34,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604574+0000","last_change":"2024-09-12T17:05:51.528322+0000","last_active":"2024-09-12T17:08:33.604574+0000","last_peered":"2024-09-12T17:08:33.604574+0000","last_clean":"2024-09-12T17:08:33.604574+0000","last_became_active":"2024-09-12T17:05:51.527501+0000","last_became_peered":"2024-09-12T17:05:51.527501+0000","last_unstale":"2024-09-12T17:08:33.604574+0000","last_undegraded":"2024-09-12T17:08:33.604574+0000","last_fullsized":"2024-09-12T17:08:33.604574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"103'21","reported_seq":229,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602555+0000","last_change":"2024-09-12T17:08:18.786022+0000","last_active":"2024-09-12T17:08:33.602555+0000","last_peered":"2024-09-12T17:08:33.602555+0000","last_clean":"2024-09-12T17:08:33.602555+0000","last_became_active":"2024-09-12T17:08:18.474969+0000","last_became_peered":"2024-09-12T17:08:18.474969+0000","last_unstale":"2024-09-12T17:08:33.602555+0000","last_undegraded":"2024-09-12T17:08:33.602555+0000","last_fullsized":"2024-09-12T17:08:33.602555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1889,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.599911+0000","last_change":"2024-09-12T17:05:55.567202+0000","last_active":"2024-09-12T17:08:33.599911+0000","last_peered":"2024-09-12T17:08:33.599911+0000","last_clean":"2024-09-12T17:08:33.599911+0000","last_became_active":"2024-09-12T17:05:55.564710+0000","last_became_peered":"2024-09-12T17:05:55.564710+0000","last_unstale":"2024-09-12T17:08:33.599911+0000","last_undegraded":"2024-09-12T17:08:33.599911+0000","last_fullsized":"2024-09-12T17:08:33.599911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608195+0000","last_change":"2024-09-12T17:05:57.604052+0000","last_active":"2024-09-12T17:08:33.608195+0000","last_peered":"2024-09-12T17:08:33.608195+0000","last_clean":"2024-09-12T17:08:33.608195+0000","last_became_active":"2024-09-12T17:05:57.603285+0000","last_became_peered":"2024-09-12T17:05:57.603285+0000","last_unstale":"2024-09-12T17:08:33.608195+0000","last_undegraded":"2024-09-12T17:08:33.608195+0000","last_fullsized":"2024-09-12T17:08:33.608195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:31.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'6","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211495+0000","last_change":"2024-09-12T17:05:49.548224+0000","last_active":"2024-09-12T17:08:35.211495+0000","last_peered":"2024-09-12T17:08:35.211495+0000","last_clean":"2024-09-12T17:08:35.211495+0000","last_became_active":"2024-09-12T17:05:49.541007+0000","last_became_peered":"2024-09-12T17:05:49.541007+0000","last_unstale":"2024-09-12T17:08:35.211495+0000","last_undegraded":"2024-09-12T17:08:35.211495+0000","last_fullsized":"2024-09-12T17:08:35.211495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:59.768842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"103'5","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606468+0000","last_change":"2024-09-12T17:05:47.543197+0000","last_active":"2024-09-12T17:08:33.606468+0000","last_peered":"2024-09-12T17:08:33.606468+0000","last_clean":"2024-09-12T17:08:33.606468+0000","last_became_active":"2024-09-12T17:05:47.542345+0000","last_became_peered":"2024-09-12T17:05:47.542345+0000","last_unstale":"2024-09-12T17:08:33.606468+0000","last_undegraded":"2024-09-12T17:08:33.606468+0000","last_fullsized":"2024-09-12T17:08:33.606468+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.858635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":14336,"num_write":5,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602461+0000","last_change":"2024-09-12T17:05:51.556256+0000","last_active":"2024-09-12T17:08:33.602461+0000","last_peered":"2024-09-12T17:08:33.602461+0000","last_clean":"2024-09-12T17:08:33.602461+0000","last_became_active":"2024-09-12T17:05:51.554248+0000","last_became_peered":"2024-09-12T17:05:51.554248+0000","last_unstale":"2024-09-12T17:08:33.602461+0000","last_undegraded":"2024-09-12T17:08:33.602461+0000","last_fullsized":"2024-09-12T17:08:33.602461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"103'14","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600059+0000","last_change":"2024-09-12T17:08:18.486637+0000","last_active":"2024-09-12T17:08:33.600059+0000","last_peered":"2024-09-12T17:08:33.600059+0000","last_clean":"2024-09-12T17:08:33.600059+0000","last_became_active":"2024-09-12T17:08:18.450594+0000","last_became_peered":"2024-09-12T17:08:18.450594+0000","last_unstale":"2024-09-12T17:08:33.600059+0000","last_undegraded":"2024-09-12T17:08:33.600059+0000","last_fullsized":"2024-09-12T17:08:33.600059+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5208,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":21,"num_read_kb":18,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352748+0000","last_change":"2024-09-12T17:05:55.567605+0000","last_active":"2024-09-12T17:08:35.352748+0000","last_peered":"2024-09-12T17:08:35.352748+0000","last_clean":"2024-09-12T17:08:35.352748+0000","last_became_active":"2024-09-12T17:05:55.566774+0000","last_became_peered":"2024-09-12T17:05:55.566774+0000","last_unstale":"2024-09-12T17:08:35.352748+0000","last_undegraded":"2024-09-12T17:08:35.352748+0000","last_fullsized":"2024-09-12T17:08:35.352748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:25.935376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025423+0000","last_change":"2024-09-12T17:05:58.121216+0000","last_active":"2024-09-12T17:08:36.025423+0000","last_peered":"2024-09-12T17:08:36.025423+0000","last_clean":"2024-09-12T17:08:36.025423+0000","last_became_active":"2024-09-12T17:05:58.120364+0000","last_became_peered":"2024-09-12T17:05:58.120364+0000","last_unstale":"2024-09-12T17:08:36.025423+0000","last_undegraded":"2024-09-12T17:08:36.025423+0000","last_fullsized":"2024-09-12T17:08:36.025423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021393+0000","last_change":"2024-09-12T17:05:49.549956+0000","last_active":"2024-09-12T17:08:36.021393+0000","last_peered":"2024-09-12T17:08:36.021393+0000","last_clean":"2024-09-12T17:08:36.021393+0000","last_became_active":"2024-09-12T17:05:49.549481+0000","last_became_peered":"2024-09-12T17:05:49.549481+0000","last_unstale":"2024-09-12T17:08:36.021393+0000","last_undegraded":"2024-09-12T17:08:36.021393+0000","last_fullsized":"2024-09-12T17:08:36.021393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"103'15","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.906950+0000","last_change":"2024-09-12T17:05:47.510898+0000","last_active":"2024-09-12T17:09:02.906950+0000","last_peered":"2024-09-12T17:09:02.906950+0000","last_clean":"2024-09-12T17:09:02.906950+0000","last_became_active":"2024-09-12T17:05:47.510462+0000","last_became_peered":"2024-09-12T17:05:47.510462+0000","last_unstale":"2024-09-12T17:09:02.906950+0000","last_undegraded":"2024-09-12T17:09:02.906950+0000","last_fullsized":"2024-09-12T17:09:02.906950+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":23,"num_read_kb":30726,"num_write":31,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210191+0000","last_change":"2024-09-12T17:05:51.541454+0000","last_active":"2024-09-12T17:08:35.210191+0000","last_peered":"2024-09-12T17:08:35.210191+0000","last_clean":"2024-09-12T17:08:35.210191+0000","last_became_active":"2024-09-12T17:05:51.539938+0000","last_became_peered":"2024-09-12T17:05:51.539938+0000","last_unstale":"2024-09-12T17:08:35.210191+0000","last_undegraded":"2024-09-12T17:08:35.210191+0000","last_fullsized":"2024-09-12T17:08:35.210191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:18.328350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"103'12","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023900+0000","last_change":"2024-09-12T17:05:53.555764+0000","last_active":"2024-09-12T17:08:36.023900+0000","last_peered":"2024-09-12T17:08:36.023900+0000","last_clean":"2024-09-12T17:08:36.023900+0000","last_became_active":"2024-09-12T17:05:53.552095+0000","last_became_peered":"2024-09-12T17:05:53.552095+0000","last_unstale":"2024-09-12T17:08:36.023900+0000","last_undegraded":"2024-09-12T17:08:36.023900+0000","last_fullsized":"2024-09-12T17:08:36.023900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":24,"num_write":14,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210403+0000","last_change":"2024-09-12T17:05:55.571520+0000","last_active":"2024-09-12T17:08:35.210403+0000","last_peered":"2024-09-12T17:08:35.210403+0000","last_clean":"2024-09-12T17:08:35.210403+0000","last_became_active":"2024-09-12T17:05:55.570863+0000","last_became_peered":"2024-09-12T17:05:55.570863+0000","last_unstale":"2024-09-12T17:08:35.210403+0000","last_undegraded":"2024-09-12T17:08:35.210403+0000","last_fullsized":"2024-09-12T17:08:35.210403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607147+0000","last_change":"2024-09-12T17:08:21.467058+0000","last_active":"2024-09-12T17:08:33.607147+0000","last_peered":"2024-09-12T17:08:33.607147+0000","last_clean":"2024-09-12T17:08:33.607147+0000","last_became_active":"2024-09-12T17:08:21.466218+0000","last_became_peered":"2024-09-12T17:08:21.466218+0000","last_unstale":"2024-09-12T17:08:33.607147+0000","last_undegraded":"2024-09-12T17:08:33.607147+0000","last_fullsized":"2024-09-12T17:08:33.607147+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.336998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"84'38","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210705+0000","last_change":"2024-09-12T17:05:49.561555+0000","last_active":"2024-09-12T17:08:35.210705+0000","last_peered":"2024-09-12T17:08:35.210705+0000","last_clean":"2024-09-12T17:08:35.210705+0000","last_became_active":"2024-09-12T17:05:49.560875+0000","last_became_peered":"2024-09-12T17:05:49.560875+0000","last_unstale":"2024-09-12T17:08:35.210705+0000","last_undegraded":"2024-09-12T17:08:35.210705+0000","last_fullsized":"2024-09-12T17:08:35.210705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.493944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"103'17","reported_seq":197,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.778867+0000","last_change":"2024-09-12T17:05:47.528128+0000","last_active":"2024-09-12T17:09:02.778867+0000","last_peered":"2024-09-12T17:09:02.778867+0000","last_clean":"2024-09-12T17:09:02.778867+0000","last_became_active":"2024-09-12T17:05:47.527364+0000","last_became_peered":"2024-09-12T17:05:47.527364+0000","last_unstale":"2024-09-12T17:09:02.778867+0000","last_undegraded":"2024-09-12T17:09:02.778867+0000","last_fullsized":"2024-09-12T17:09:02.778867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":45062,"num_write":33,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":43,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111426+0000","last_change":"2024-09-12T17:08:19.007426+0000","last_active":"2024-09-12T17:08:35.111426+0000","last_peered":"2024-09-12T17:08:35.111426+0000","last_clean":"2024-09-12T17:08:35.111426+0000","last_became_active":"2024-09-12T17:08:18.463879+0000","last_became_peered":"2024-09-12T17:08:18.463879+0000","last_unstale":"2024-09-12T17:08:35.111426+0000","last_undegraded":"2024-09-12T17:08:35.111426+0000","last_fullsized":"2024-09-12T17:08:35.111426+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:10.396675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"103'17","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210611+0000","last_change":"2024-09-12T17:05:53.548391+0000","last_active":"2024-09-12T17:08:35.210611+0000","last_peered":"2024-09-12T17:08:35.210611+0000","last_clean":"2024-09-12T17:08:35.210611+0000","last_became_active":"2024-09-12T17:05:53.547202+0000","last_became_peered":"2024-09-12T17:05:53.547202+0000","last_unstale":"2024-09-12T17:08:35.210611+0000","last_undegraded":"2024-09-12T17:08:35.210611+0000","last_fullsized":"2024-09-12T17:08:35.210611+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:00.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11925,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":27,"num_read_kb":33,"num_write":20,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601272+0000","last_change":"2024-09-12T17:05:55.566243+0000","last_active":"2024-09-12T17:08:33.601272+0000","last_peered":"2024-09-12T17:08:33.601272+0000","last_clean":"2024-09-12T17:08:33.601272+0000","last_became_active":"2024-09-12T17:05:55.565403+0000","last_became_peered":"2024-09-12T17:05:55.565403+0000","last_unstale":"2024-09-12T17:08:33.601272+0000","last_undegraded":"2024-09-12T17:08:33.601272+0000","last_fullsized":"2024-09-12T17:08:33.601272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212872+0000","last_change":"2024-09-12T17:05:57.589526+0000","last_active":"2024-09-12T17:08:35.212872+0000","last_peered":"2024-09-12T17:08:35.212872+0000","last_clean":"2024-09-12T17:08:35.212872+0000","last_became_active":"2024-09-12T17:05:57.588626+0000","last_became_peered":"2024-09-12T17:05:57.588626+0000","last_unstale":"2024-09-12T17:08:35.212872+0000","last_undegraded":"2024-09-12T17:08:35.212872+0000","last_fullsized":"2024-09-12T17:08:35.212872+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.472663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114540+0000","last_change":"2024-09-12T17:08:21.473957+0000","last_active":"2024-09-12T17:08:35.114540+0000","last_peered":"2024-09-12T17:08:35.114540+0000","last_clean":"2024-09-12T17:08:35.114540+0000","last_became_active":"2024-09-12T17:08:21.473677+0000","last_became_peered":"2024-09-12T17:08:21.473677+0000","last_unstale":"2024-09-12T17:08:35.114540+0000","last_undegraded":"2024-09-12T17:08:35.114540+0000","last_fullsized":"2024-09-12T17:08:35.114540+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:04.662160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"103'14","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.873429+0000","last_change":"2024-09-12T17:05:47.532523+0000","last_active":"2024-09-12T17:09:02.873429+0000","last_peered":"2024-09-12T17:09:02.873429+0000","last_clean":"2024-09-12T17:09:02.873429+0000","last_became_active":"2024-09-12T17:05:47.531750+0000","last_became_peered":"2024-09-12T17:05:47.531750+0000","last_unstale":"2024-09-12T17:09:02.873429+0000","last_undegraded":"2024-09-12T17:09:02.873429+0000","last_fullsized":"2024-09-12T17:09:02.873429+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:03.075435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":36867,"num_write":22,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115367+0000","last_change":"2024-09-12T17:08:21.463425+0000","last_active":"2024-09-12T17:08:35.115367+0000","last_peered":"2024-09-12T17:08:35.115367+0000","last_clean":"2024-09-12T17:08:35.115367+0000","last_became_active":"2024-09-12T17:08:21.462942+0000","last_became_peered":"2024-09-12T17:08:21.462942+0000","last_unstale":"2024-09-12T17:08:35.115367+0000","last_undegraded":"2024-09-12T17:08:35.115367+0000","last_fullsized":"2024-09-12T17:08:35.115367+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:35.256332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"103'14","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.822807+0000","last_change":"2024-09-12T17:05:47.526020+0000","last_active":"2024-09-12T17:09:02.822807+0000","last_peered":"2024-09-12T17:09:02.822807+0000","last_clean":"2024-09-12T17:09:02.822807+0000","last_became_active":"2024-09-12T17:05:47.525481+0000","last_became_peered":"2024-09-12T17:05:47.525481+0000","last_unstale":"2024-09-12T17:09:02.822807+0000","last_undegraded":"2024-09-12T17:09:02.822807+0000","last_fullsized":"2024-09-12T17:09:02.822807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:05.949135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":34819,"num_write":22,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"84'46","reported_seq":211,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604578+0000","last_change":"2024-09-12T17:05:49.546848+0000","last_active":"2024-09-12T17:08:33.604578+0000","last_peered":"2024-09-12T17:08:33.604578+0000","last_clean":"2024-09-12T17:08:33.604578+0000","last_became_active":"2024-09-12T17:05:49.545382+0000","last_became_peered":"2024-09-12T17:05:49.545382+0000","last_unstale":"2024-09-12T17:08:33.604578+0000","last_undegraded":"2024-09-12T17:08:33.604578+0000","last_fullsized":"2024-09-12T17:08:33.604578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:42.832972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"103'11","reported_seq":100,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021943+0000","last_change":"2024-09-12T17:07:28.249892+0000","last_active":"2024-09-12T17:08:36.021943+0000","last_peered":"2024-09-12T17:08:36.021943+0000","last_clean":"2024-09-12T17:08:36.021943+0000","last_became_active":"2024-09-12T17:07:28.191632+0000","last_became_peered":"2024-09-12T17:07:28.191632+0000","last_unstale":"2024-09-12T17:08:36.021943+0000","last_undegraded":"2024-09-12T17:08:36.021943+0000","last_fullsized":"2024-09-12T17:08:36.021943+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.324862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":16,"num_read_kb":16390,"num_write":27,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114360+0000","last_change":"2024-09-12T17:08:21.460639+0000","last_active":"2024-09-12T17:08:35.114360+0000","last_peered":"2024-09-12T17:08:35.114360+0000","last_clean":"2024-09-12T17:08:35.114360+0000","last_became_active":"2024-09-12T17:08:21.457133+0000","last_became_peered":"2024-09-12T17:08:21.457133+0000","last_unstale":"2024-09-12T17:08:35.114360+0000","last_undegraded":"2024-09-12T17:08:35.114360+0000","last_fullsized":"2024-09-12T17:08:35.114360+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:58.322770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"103'12","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.857796+0000","last_change":"2024-09-12T17:05:47.530275+0000","last_active":"2024-09-12T17:09:02.857796+0000","last_peered":"2024-09-12T17:09:02.857796+0000","last_clean":"2024-09-12T17:09:02.857796+0000","last_became_active":"2024-09-12T17:05:47.529857+0000","last_became_peered":"2024-09-12T17:05:47.529857+0000","last_unstale":"2024-09-12T17:09:02.857796+0000","last_undegraded":"2024-09-12T17:09:02.857796+0000","last_fullsized":"2024-09-12T17:09:02.857796+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:47.999516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":12,"num_read_kb":32768,"num_write":12,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'42","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023289+0000","last_change":"2024-09-12T17:05:49.525070+0000","last_active":"2024-09-12T17:08:36.023289+0000","last_peered":"2024-09-12T17:08:36.023289+0000","last_clean":"2024-09-12T17:08:36.023289+0000","last_became_active":"2024-09-12T17:05:49.524567+0000","last_became_peered":"2024-09-12T17:05:49.524567+0000","last_unstale":"2024-09-12T17:08:36.023289+0000","last_undegraded":"2024-09-12T17:08:36.023289+0000","last_fullsized":"2024-09-12T17:08:36.023289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:34.320123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"103'14","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.841536+0000","last_change":"2024-09-12T17:05:47.547765+0000","last_active":"2024-09-12T17:09:02.841536+0000","last_peered":"2024-09-12T17:09:02.841536+0000","last_clean":"2024-09-12T17:09:02.841536+0000","last_became_active":"2024-09-12T17:05:47.547393+0000","last_became_peered":"2024-09-12T17:05:47.547393+0000","last_unstale":"2024-09-12T17:09:02.841536+0000","last_undegraded":"2024-09-12T17:09:02.841536+0000","last_fullsized":"2024-09-12T17:09:02.841536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:46.746261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":30729,"num_write":38,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211792+0000","last_change":"2024-09-12T17:05:49.561711+0000","last_active":"2024-09-12T17:08:35.211792+0000","last_peered":"2024-09-12T17:08:35.211792+0000","last_clean":"2024-09-12T17:08:35.211792+0000","last_became_active":"2024-09-12T17:05:49.560993+0000","last_became_peered":"2024-09-12T17:05:49.560993+0000","last_unstale":"2024-09-12T17:08:35.211792+0000","last_undegraded":"2024-09-12T17:08:35.211792+0000","last_fullsized":"2024-09-12T17:08:35.211792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:38.400338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"103'11","reported_seq":54,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.754459+0000","last_change":"2024-09-12T17:08:21.614989+0000","last_active":"2024-09-12T17:09:02.754459+0000","last_peered":"2024-09-12T17:09:02.754459+0000","last_clean":"2024-09-12T17:09:02.754459+0000","last_became_active":"2024-09-12T17:08:21.461010+0000","last_became_peered":"2024-09-12T17:08:21.461010+0000","last_unstale":"2024-09-12T17:09:02.754459+0000","last_undegraded":"2024-09-12T17:09:02.754459+0000","last_fullsized":"2024-09-12T17:09:02.754459+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:52.706435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":13,"num_read_kb":24579,"num_write":19,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"68'2","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020895+0000","last_change":"2024-09-12T17:08:28.561852+0000","last_active":"2024-09-12T17:08:36.020895+0000","last_peered":"2024-09-12T17:08:36.020895+0000","last_clean":"2024-09-12T17:08:36.020895+0000","last_became_active":"2024-09-12T17:08:28.558588+0000","last_became_peered":"2024-09-12T17:08:28.558588+0000","last_unstale":"2024-09-12T17:08:36.020895+0000","last_undegraded":"2024-09-12T17:08:36.020895+0000","last_fullsized":"2024-09-12T17:08:36.020895+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:45.704667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"103'11","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.817699+0000","last_change":"2024-09-12T17:05:47.541213+0000","last_active":"2024-09-12T17:09:02.817699+0000","last_peered":"2024-09-12T17:09:02.817699+0000","last_clean":"2024-09-12T17:09:02.817699+0000","last_became_active":"2024-09-12T17:05:47.540469+0000","last_became_peered":"2024-09-12T17:05:47.540469+0000","last_unstale":"2024-09-12T17:09:02.817699+0000","last_undegraded":"2024-09-12T17:09:02.817699+0000","last_fullsized":"2024-09-12T17:09:02.817699+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:26.620021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":30720,"num_write":11,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"84'42","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352596+0000","last_change":"2024-09-12T17:05:49.541113+0000","last_active":"2024-09-12T17:08:35.352596+0000","last_peered":"2024-09-12T17:08:35.352596+0000","last_clean":"2024-09-12T17:08:35.352596+0000","last_became_active":"2024-09-12T17:05:49.540395+0000","last_became_peered":"2024-09-12T17:05:49.540395+0000","last_unstale":"2024-09-12T17:08:35.352596+0000","last_undegraded":"2024-09-12T17:08:35.352596+0000","last_fullsized":"2024-09-12T17:08:35.352596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:32.506502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"103'22","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.840254+0000","last_change":"2024-09-12T17:05:47.539986+0000","last_active":"2024-09-12T17:09:02.840254+0000","last_peered":"2024-09-12T17:09:02.840254+0000","last_clean":"2024-09-12T17:09:02.840254+0000","last_became_active":"2024-09-12T17:05:47.539603+0000","last_became_peered":"2024-09-12T17:05:47.539603+0000","last_unstale":"2024-09-12T17:09:02.840254+0000","last_undegraded":"2024-09-12T17:09:02.840254+0000","last_fullsized":"2024-09-12T17:09:02.840254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":57350,"num_write":38,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603269+0000","last_change":"2024-09-12T17:05:49.533938+0000","last_active":"2024-09-12T17:08:33.603269+0000","last_peered":"2024-09-12T17:08:33.603269+0000","last_clean":"2024-09-12T17:08:33.603269+0000","last_became_active":"2024-09-12T17:05:49.531769+0000","last_became_peered":"2024-09-12T17:05:49.531769+0000","last_unstale":"2024-09-12T17:08:33.603269+0000","last_undegraded":"2024-09-12T17:08:33.603269+0000","last_fullsized":"2024-09-12T17:08:33.603269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:33.763423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"103'16","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.917037+0000","last_change":"2024-09-12T17:05:47.525739+0000","last_active":"2024-09-12T17:09:02.917037+0000","last_peered":"2024-09-12T17:09:02.917037+0000","last_clean":"2024-09-12T17:09:02.917037+0000","last_became_active":"2024-09-12T17:05:47.524922+0000","last_became_peered":"2024-09-12T17:05:47.524922+0000","last_unstale":"2024-09-12T17:09:02.917037+0000","last_undegraded":"2024-09-12T17:09:02.917037+0000","last_fullsized":"2024-09-12T17:09:02.917037+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":20,"num_read_kb":38915,"num_write":24,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212448+0000","last_change":"2024-09-12T17:05:49.555307+0000","last_active":"2024-09-12T17:08:35.212448+0000","last_peered":"2024-09-12T17:08:35.212448+0000","last_clean":"2024-09-12T17:08:35.212448+0000","last_became_active":"2024-09-12T17:05:49.554566+0000","last_became_peered":"2024-09-12T17:05:49.554566+0000","last_unstale":"2024-09-12T17:08:35.212448+0000","last_undegraded":"2024-09-12T17:08:35.212448+0000","last_fullsized":"2024-09-12T17:08:35.212448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:45.017623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"103'15","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.857358+0000","last_change":"2024-09-12T17:05:47.543468+0000","last_active":"2024-09-12T17:09:02.857358+0000","last_peered":"2024-09-12T17:09:02.857358+0000","last_clean":"2024-09-12T17:09:02.857358+0000","last_became_active":"2024-09-12T17:05:47.542753+0000","last_became_peered":"2024-09-12T17:05:47.542753+0000","last_unstale":"2024-09-12T17:09:02.857358+0000","last_undegraded":"2024-09-12T17:09:02.857358+0000","last_fullsized":"2024-09-12T17:09:02.857358+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":34825,"num_write":39,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'34","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024298+0000","last_change":"2024-09-12T17:05:49.536693+0000","last_active":"2024-09-12T17:08:36.024298+0000","last_peered":"2024-09-12T17:08:36.024298+0000","last_clean":"2024-09-12T17:08:36.024298+0000","last_became_active":"2024-09-12T17:05:49.536385+0000","last_became_peered":"2024-09-12T17:05:49.536385+0000","last_unstale":"2024-09-12T17:08:36.024298+0000","last_undegraded":"2024-09-12T17:08:36.024298+0000","last_fullsized":"2024-09-12T17:08:36.024298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.024498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"103'8","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.786570+0000","last_change":"2024-09-12T17:05:47.545251+0000","last_active":"2024-09-12T17:09:02.786570+0000","last_peered":"2024-09-12T17:09:02.786570+0000","last_clean":"2024-09-12T17:09:02.786570+0000","last_became_active":"2024-09-12T17:05:47.544406+0000","last_became_peered":"2024-09-12T17:05:47.544406+0000","last_unstale":"2024-09-12T17:09:02.786570+0000","last_undegraded":"2024-09-12T17:09:02.786570+0000","last_fullsized":"2024-09-12T17:09:02.786570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:52.167194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":20483,"num_write":16,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"84'38","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212586+0000","last_change":"2024-09-12T17:05:49.564446+0000","last_active":"2024-09-12T17:08:35.212586+0000","last_peered":"2024-09-12T17:08:35.212586+0000","last_clean":"2024-09-12T17:08:35.212586+0000","last_became_active":"2024-09-12T17:05:49.563625+0000","last_became_peered":"2024-09-12T17:05:49.563625+0000","last_unstale":"2024-09-12T17:08:35.212586+0000","last_undegraded":"2024-09-12T17:08:35.212586+0000","last_fullsized":"2024-09-12T17:08:35.212586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.324265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"103'14","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.914550+0000","last_change":"2024-09-12T17:05:47.558422+0000","last_active":"2024-09-12T17:09:02.914550+0000","last_peered":"2024-09-12T17:09:02.914550+0000","last_clean":"2024-09-12T17:09:02.914550+0000","last_became_active":"2024-09-12T17:05:47.558047+0000","last_became_peered":"2024-09-12T17:05:47.558047+0000","last_unstale":"2024-09-12T17:09:02.914550+0000","last_undegraded":"2024-09-12T17:09:02.914550+0000","last_fullsized":"2024-09-12T17:09:02.914550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:25.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":38912,"num_write":14,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604202+0000","last_change":"2024-09-12T17:05:49.522750+0000","last_active":"2024-09-12T17:08:33.604202+0000","last_peered":"2024-09-12T17:08:33.604202+0000","last_clean":"2024-09-12T17:08:33.604202+0000","last_became_active":"2024-09-12T17:05:49.522097+0000","last_became_peered":"2024-09-12T17:05:49.522097+0000","last_unstale":"2024-09-12T17:08:33.604202+0000","last_undegraded":"2024-09-12T17:08:33.604202+0000","last_fullsized":"2024-09-12T17:08:33.604202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"84'14","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354038+0000","last_change":"2024-09-12T17:05:47.552865+0000","last_active":"2024-09-12T17:08:35.354038+0000","last_peered":"2024-09-12T17:08:35.354038+0000","last_clean":"2024-09-12T17:08:35.354038+0000","last_became_active":"2024-09-12T17:05:47.552207+0000","last_became_peered":"2024-09-12T17:05:47.552207+0000","last_unstale":"2024-09-12T17:08:35.354038+0000","last_undegraded":"2024-09-12T17:08:35.354038+0000","last_fullsized":"2024-09-12T17:08:35.354038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:00.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40969,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601066+0000","last_change":"2024-09-12T17:08:18.465159+0000","last_active":"2024-09-12T17:08:33.601066+0000","last_peered":"2024-09-12T17:08:33.601066+0000","last_clean":"2024-09-12T17:08:33.601066+0000","last_became_active":"2024-09-12T17:08:18.464823+0000","last_became_peered":"2024-09-12T17:08:18.464823+0000","last_unstale":"2024-09-12T17:08:33.601066+0000","last_undegraded":"2024-09-12T17:08:33.601066+0000","last_fullsized":"2024-09-12T17:08:33.601066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:08.427170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"103'19","reported_seq":199,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.857170+0000","last_change":"2024-09-12T17:05:47.561338+0000","last_active":"2024-09-12T17:09:02.857170+0000","last_peered":"2024-09-12T17:09:02.857170+0000","last_clean":"2024-09-12T17:09:02.857170+0000","last_became_active":"2024-09-12T17:05:47.560439+0000","last_became_peered":"2024-09-12T17:05:47.560439+0000","last_unstale":"2024-09-12T17:09:02.857170+0000","last_undegraded":"2024-09-12T17:09:02.857170+0000","last_fullsized":"2024-09-12T17:09:02.857170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:58.530869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":23,"num_read_kb":51203,"num_write":27,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":124,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601674+0000","last_change":"2024-09-12T17:06:27.819106+0000","last_active":"2024-09-12T17:08:33.601674+0000","last_peered":"2024-09-12T17:08:33.601674+0000","last_clean":"2024-09-12T17:08:33.601674+0000","last_became_active":"2024-09-12T17:06:27.818761+0000","last_became_peered":"2024-09-12T17:06:27.818761+0000","last_unstale":"2024-09-12T17:08:33.601674+0000","last_undegraded":"2024-09-12T17:08:33.601674+0000","last_fullsized":"2024-09-12T17:08:33.601674+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:29.107938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"103'10","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020147+0000","last_change":"2024-09-12T17:05:47.512066+0000","last_active":"2024-09-12T17:08:36.020147+0000","last_peered":"2024-09-12T17:08:36.020147+0000","last_clean":"2024-09-12T17:08:36.020147+0000","last_became_active":"2024-09-12T17:05:47.511470+0000","last_became_peered":"2024-09-12T17:05:47.511470+0000","last_unstale":"2024-09-12T17:08:36.020147+0000","last_undegraded":"2024-09-12T17:08:36.020147+0000","last_fullsized":"2024-09-12T17:08:36.020147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:38.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":14,"num_read_kb":30723,"num_write":18,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601648+0000","last_change":"2024-09-12T17:05:49.523060+0000","last_active":"2024-09-12T17:08:33.601648+0000","last_peered":"2024-09-12T17:08:33.601648+0000","last_clean":"2024-09-12T17:08:33.601648+0000","last_became_active":"2024-09-12T17:05:49.522157+0000","last_became_peered":"2024-09-12T17:05:49.522157+0000","last_unstale":"2024-09-12T17:08:33.601648+0000","last_undegraded":"2024-09-12T17:08:33.601648+0000","last_fullsized":"2024-09-12T17:08:33.601648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"103'7","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.917317+0000","last_change":"2024-09-12T17:05:47.538305+0000","last_active":"2024-09-12T17:09:02.917317+0000","last_peered":"2024-09-12T17:09:02.917317+0000","last_clean":"2024-09-12T17:09:02.917317+0000","last_became_active":"2024-09-12T17:05:47.535569+0000","last_became_peered":"2024-09-12T17:05:47.535569+0000","last_unstale":"2024-09-12T17:09:02.917317+0000","last_undegraded":"2024-09-12T17:09:02.917317+0000","last_fullsized":"2024-09-12T17:09:02.917317+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:24.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":18432,"num_write":7,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"103'6","reported_seq":177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603301+0000","last_change":"2024-09-12T17:05:47.537712+0000","last_active":"2024-09-12T17:08:33.603301+0000","last_peered":"2024-09-12T17:08:33.603301+0000","last_clean":"2024-09-12T17:08:33.603301+0000","last_became_active":"2024-09-12T17:05:47.536958+0000","last_became_peered":"2024-09-12T17:05:47.536958+0000","last_unstale":"2024-09-12T17:08:33.603301+0000","last_undegraded":"2024-09-12T17:08:33.603301+0000","last_fullsized":"2024-09-12T17:08:33.603301+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603188+0000","last_change":"2024-09-12T17:05:49.544841+0000","last_active":"2024-09-12T17:08:33.603188+0000","last_peered":"2024-09-12T17:08:33.603188+0000","last_clean":"2024-09-12T17:08:33.603188+0000","last_became_active":"2024-09-12T17:05:49.538757+0000","last_became_peered":"2024-09-12T17:05:49.538757+0000","last_unstale":"2024-09-12T17:08:33.603188+0000","last_undegraded":"2024-09-12T17:08:33.603188+0000","last_fullsized":"2024-09-12T17:08:33.603188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.976348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"83'9","reported_seq":55,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113825+0000","last_change":"2024-09-12T17:08:18.573927+0000","last_active":"2024-09-12T17:08:35.113825+0000","last_peered":"2024-09-12T17:08:35.113825+0000","last_clean":"2024-09-12T17:08:35.113825+0000","last_became_active":"2024-09-12T17:08:18.441161+0000","last_became_peered":"2024-09-12T17:08:18.441161+0000","last_unstale":"2024-09-12T17:08:35.113825+0000","last_undegraded":"2024-09-12T17:08:35.113825+0000","last_fullsized":"2024-09-12T17:08:35.113825+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:21.365549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24582,"num_write":25,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605089+0000","last_change":"2024-09-12T17:05:49.552327+0000","last_active":"2024-09-12T17:08:33.605089+0000","last_peered":"2024-09-12T17:08:33.605089+0000","last_clean":"2024-09-12T17:08:33.605089+0000","last_became_active":"2024-09-12T17:05:49.551604+0000","last_became_peered":"2024-09-12T17:05:49.551604+0000","last_unstale":"2024-09-12T17:08:33.605089+0000","last_undegraded":"2024-09-12T17:08:33.605089+0000","last_fullsized":"2024-09-12T17:08:33.605089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:55.648527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":40,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":199313,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":1041,"num_read_kb":1183,"num_write":700,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":41697,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":507904,"data_stored":149266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":648,"ondisk_log_size":648,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1867,"num_read_kb":1448,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1063256064,"num_objects":282,"num_object_clones":0,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":282,"num_whiteouts":0,"num_read":1251,"num_read_kb":2031945,"num_write":1698,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":241172480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2130706432,"data_stored":2130706432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":818,"ondisk_log_size":818,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542190,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":373108,"kb_used_data":333644,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93998732,"statfs":{"total":96636764160,"available":96254701568,"internally_reserved":0,"allocated":341651456,"data_stored":341057930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542191,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":282368,"kb_used_data":247000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94089472,"statfs":{"total":96636764160,"available":96347619328,"internally_reserved":0,"allocated":252928000,"data_stored":252374789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542191,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":472932,"kb_used_data":437588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93898908,"statfs":{"total":96636764160,"available":96152481792,"internally_reserved":0,"allocated":448090112,"data_stored":447463741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542191,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":491220,"kb_used_data":455876,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93880620,"statfs":{"total":96636764160,"available":96133754880,"internally_reserved":0,"allocated":466817024,"data_stored":466283240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542191,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":515856,"kb_used_data":480512,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93855984,"statfs":{"total":96636764160,"available":96108527616,"internally_reserved":0,"allocated":492044288,"data_stored":491456479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542191,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347864,"kb_used_data":312520,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94023976,"statfs":{"total":96636764160,"available":96280551424,"internally_reserved":0,"allocated":320020480,"data_stored":319476386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259876,"kb_used_data":224532,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94111964,"statfs":{"total":96636764160,"available":96370651136,"internally_reserved":0,"allocated":229920768,"data_stored":229334328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542191,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":508228,"kb_used_data":472880,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93863612,"statfs":{"total":96636764160,"available":96116338688,"internally_reserved":0,"allocated":484229120,"data_stored":483658507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":291504128,"data_stored":291504128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167772160,"data_stored":167772160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":213909504,"data_stored":213909504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":308281344,"data_stored":308281344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":325058560,"data_stored":325058560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":289406976,"data_stored":289406976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":245366784,"data_stored":245366784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":289406976,"data_stored":289406976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":12604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":31219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":13449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":8049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":52317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":12533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":15981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:09:04.755 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T17:09:05.078 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:09:05.078 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":103,"fsid":"505f0ddb-af61-4cad-802f-747b5bdb41a8","created":"2024-09-12T17:05:20.776084+0000","modified":"2024-09-12T17:08:33.592782+0000","last_up_change":"2024-09-12T17:05:32.139689+0000","last_in_change":"2024-09-12T17:08:17.404564+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T17:05:33.945154+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T17:05:39.084260+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T17:05:45.863238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T17:05:47.870247+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T17:05:49.759077+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T17:05:51.664893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T17:05:53.564403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T17:05:55.697439+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"cf0f0496-2732-4649-9792-6f2117afe076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6817","nonce":2182669987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6818","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6819","nonce":2182669987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6822","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6823","nonce":2182669987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":2182669987},{"type":"v1","addr":"172.21.15.17:6821","nonce":2182669987}]},"public_addr":"172.21.15.17:6817/2182669987","cluster_addr":"172.21.15.17:6819/2182669987","heartbeat_back_addr":"172.21.15.17:6823/2182669987","heartbeat_front_addr":"172.21.15.17:6821/2182669987","state":["exists","up"]},{"osd":1,"uuid":"931ecda0-1894-411b-a2f8-843472ad493c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6825","nonce":3677250778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6826","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6827","nonce":3677250778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6831","nonce":3677250778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":3677250778},{"type":"v1","addr":"172.21.15.17:6829","nonce":3677250778}]},"public_addr":"172.21.15.17:6825/3677250778","cluster_addr":"172.21.15.17:6827/3677250778","heartbeat_back_addr":"172.21.15.17:6831/3677250778","heartbeat_front_addr":"172.21.15.17:6829/3677250778","state":["exists","up"]},{"osd":2,"uuid":"e1cc4a34-80dd-42e2-afb1-babce54de8cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6801","nonce":2449755532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6803","nonce":2449755532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6807","nonce":2449755532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":2449755532},{"type":"v1","addr":"172.21.15.17:6805","nonce":2449755532}]},"public_addr":"172.21.15.17:6801/2449755532","cluster_addr":"172.21.15.17:6803/2449755532","heartbeat_back_addr":"172.21.15.17:6807/2449755532","heartbeat_front_addr":"172.21.15.17:6805/2449755532","state":["exists","up"]},{"osd":3,"uuid":"48424313-1b8e-41ba-b322-d37b813552da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6809","nonce":1410973648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6811","nonce":1410973648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6814","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6815","nonce":1410973648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":1410973648},{"type":"v1","addr":"172.21.15.17:6813","nonce":1410973648}]},"public_addr":"172.21.15.17:6809/1410973648","cluster_addr":"172.21.15.17:6811/1410973648","heartbeat_back_addr":"172.21.15.17:6815/1410973648","heartbeat_front_addr":"172.21.15.17:6813/1410973648","state":["exists","up"]},{"osd":4,"uuid":"ba035b82-db0e-4e9a-a45e-fd111aebaea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6825","nonce":3279960414}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6827","nonce":3279960414}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6831","nonce":3279960414}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":3279960414},{"type":"v1","addr":"172.21.15.47:6829","nonce":3279960414}]},"public_addr":"172.21.15.47:6825/3279960414","cluster_addr":"172.21.15.47:6827/3279960414","heartbeat_back_addr":"172.21.15.47:6831/3279960414","heartbeat_front_addr":"172.21.15.47:6829/3279960414","state":["exists","up"]},{"osd":5,"uuid":"3bad8071-4d77-4ec3-a85f-9648cb1d9c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6801","nonce":2093714552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6803","nonce":2093714552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6807","nonce":2093714552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":2093714552},{"type":"v1","addr":"172.21.15.47:6805","nonce":2093714552}]},"public_addr":"172.21.15.47:6801/2093714552","cluster_addr":"172.21.15.47:6803/2093714552","heartbeat_back_addr":"172.21.15.47:6807/2093714552","heartbeat_front_addr":"172.21.15.47:6805/2093714552","state":["exists","up"]},{"osd":6,"uuid":"cef01590-aa71-4356-bd81-0629172de3b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6817","nonce":2759913072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6819","nonce":2759913072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6823","nonce":2759913072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":2759913072},{"type":"v1","addr":"172.21.15.47:6821","nonce":2759913072}]},"public_addr":"172.21.15.47:6817/2759913072","cluster_addr":"172.21.15.47:6819/2759913072","heartbeat_back_addr":"172.21.15.47:6823/2759913072","heartbeat_front_addr":"172.21.15.47:6821/2759913072","state":["exists","up"]},{"osd":7,"uuid":"39b07acd-56a6-47ad-86ec-cb330c7647b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6809","nonce":1836347584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6811","nonce":1836347584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6815","nonce":1836347584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":1836347584},{"type":"v1","addr":"172.21.15.47:6813","nonce":1836347584}]},"public_addr":"172.21.15.47:6809/1836347584","cluster_addr":"172.21.15.47:6811/1836347584","heartbeat_back_addr":"172.21.15.47:6815/1836347584","heartbeat_front_addr":"172.21.15.47:6813/1836347584","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.587047+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:30.238668+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.152914+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.921710+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:30.271565+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.589211+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.997198+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T17:05:29.558519+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":2}]},{"pgid":"4.29","mappings":[{"from":3,"to":5}]},{"pgid":"4.3f","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T17:09:06.100 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T17:09:06.100 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:09:06.267 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:09:06.267 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:09:06.267 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:09:06.284 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T17:09:06.590 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T17:09:06.610 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T17:09:06.610 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:09:06.766 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:09:06.766 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:09:06.766 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:09:06.783 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T17:09:07.085 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T17:09:07.103 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T17:09:07.103 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:09:07.244 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:09:07.244 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:09:07.244 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:09:07.259 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T17:09:07.549 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T17:09:07.567 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T17:09:07.567 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:09:07.719 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:09:07.719 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:09:07.719 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:09:07.735 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T17:09:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T17:09:08.061 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T17:09:08.061 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:09:08.206 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:09:08.206 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:09:08.207 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:09:08.222 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T17:09:08.517 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T17:09:08.537 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T17:09:08.538 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:09:08.683 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:09:08.683 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:09:08.683 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:09:08.699 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T17:09:08.991 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T17:09:09.009 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T17:09:09.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:09:09.161 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:09:09.161 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:09:09.161 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:09:09.178 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T17:09:09.482 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T17:09:09.500 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T17:09:09.500 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T17:09:09.645 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-09-12T17:09:09.645 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T17:09:09.645 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-09-12T17:09:09.660 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T17:09:09.959 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T17:09:09.980 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:09:10.318 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:09:10.326 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:09:10.332 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":205,"stamp":"2024-09-12T17:09:09.994192+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":719268,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4774,"num_read_kb":2035132,"num_write":3618,"num_write_kb":2050327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":241214307,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2548,"ondisk_log_size":2548,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302296,"kb_used_data":11024,"kb_used_omap":12,"kb_used_meta":290931,"kb_avail":754672424,"statfs":{"total":773094113280,"available":772784562176,"internally_reserved":0,"allocated":11288576,"data_stored":6823532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":297913904},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1635890221,"num_objects":-440,"num_object_clones":0,"num_object_copies":-880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-440,"num_whiteouts":0,"num_read":738,"num_read_kb":680,"num_write":566,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005988"},"pg_stats":[{"pgid":"3.3f","version":"103'30","reported_seq":215,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.238289+0000","last_change":"2024-09-12T17:05:47.561581+0000","last_active":"2024-09-12T17:09:03.238289+0000","last_peered":"2024-09-12T17:09:03.238289+0000","last_clean":"2024-09-12T17:09:03.238289+0000","last_became_active":"2024-09-12T17:05:47.560791+0000","last_became_peered":"2024-09-12T17:05:47.560791+0000","last_unstale":"2024-09-12T17:09:03.238289+0000","last_undegraded":"2024-09-12T17:09:03.238289+0000","last_fullsized":"2024-09-12T17:09:03.238289+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:23.021035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":57356,"num_write":62,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"84'44","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602148+0000","last_change":"2024-09-12T17:05:49.558060+0000","last_active":"2024-09-12T17:08:33.602148+0000","last_peered":"2024-09-12T17:08:33.602148+0000","last_clean":"2024-09-12T17:08:33.602148+0000","last_became_active":"2024-09-12T17:05:49.557287+0000","last_became_peered":"2024-09-12T17:05:49.557287+0000","last_unstale":"2024-09-12T17:08:33.602148+0000","last_undegraded":"2024-09-12T17:08:33.602148+0000","last_fullsized":"2024-09-12T17:08:33.602148+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":132,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"103'6","reported_seq":45,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.183635+0000","last_change":"2024-09-12T17:08:21.529824+0000","last_active":"2024-09-12T17:09:03.183635+0000","last_peered":"2024-09-12T17:09:03.183635+0000","last_clean":"2024-09-12T17:09:03.183635+0000","last_became_active":"2024-09-12T17:08:21.462766+0000","last_became_peered":"2024-09-12T17:08:21.462766+0000","last_unstale":"2024-09-12T17:09:03.183635+0000","last_undegraded":"2024-09-12T17:09:03.183635+0000","last_fullsized":"2024-09-12T17:09:03.183635+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:13:47.442324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605094+0000","last_change":"2024-09-12T17:08:18.454422+0000","last_active":"2024-09-12T17:08:33.605094+0000","last_peered":"2024-09-12T17:08:33.605094+0000","last_clean":"2024-09-12T17:08:33.605094+0000","last_became_active":"2024-09-12T17:08:18.442986+0000","last_became_peered":"2024-09-12T17:08:18.442986+0000","last_unstale":"2024-09-12T17:08:33.605094+0000","last_undegraded":"2024-09-12T17:08:33.605094+0000","last_fullsized":"2024-09-12T17:08:33.605094+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:41:26.720649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"103'24","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.157094+0000","last_change":"2024-09-12T17:05:47.523052+0000","last_active":"2024-09-12T17:09:03.157094+0000","last_peered":"2024-09-12T17:09:03.157094+0000","last_clean":"2024-09-12T17:09:03.157094+0000","last_became_active":"2024-09-12T17:05:47.522544+0000","last_became_peered":"2024-09-12T17:05:47.522544+0000","last_unstale":"2024-09-12T17:09:03.157094+0000","last_undegraded":"2024-09-12T17:09:03.157094+0000","last_fullsized":"2024-09-12T17:09:03.157094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":38921,"num_write":48,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"84'34","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211197+0000","last_change":"2024-09-12T17:05:49.549990+0000","last_active":"2024-09-12T17:08:35.211197+0000","last_peered":"2024-09-12T17:08:35.211197+0000","last_clean":"2024-09-12T17:08:35.211197+0000","last_became_active":"2024-09-12T17:05:49.549241+0000","last_became_peered":"2024-09-12T17:05:49.549241+0000","last_unstale":"2024-09-12T17:08:35.211197+0000","last_undegraded":"2024-09-12T17:08:35.211197+0000","last_fullsized":"2024-09-12T17:08:35.211197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.601256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"103'16","reported_seq":154,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.356799+0000","last_change":"2024-09-12T17:06:27.748679+0000","last_active":"2024-09-12T17:09:03.356799+0000","last_peered":"2024-09-12T17:09:03.356799+0000","last_clean":"2024-09-12T17:09:03.356799+0000","last_became_active":"2024-09-12T17:06:27.748390+0000","last_became_peered":"2024-09-12T17:06:27.748390+0000","last_unstale":"2024-09-12T17:09:03.356799+0000","last_undegraded":"2024-09-12T17:09:03.356799+0000","last_fullsized":"2024-09-12T17:09:03.356799+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:34:58.547350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":30732,"num_write":48,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602063+0000","last_change":"2024-09-12T17:05:49.542142+0000","last_active":"2024-09-12T17:08:33.602063+0000","last_peered":"2024-09-12T17:08:33.602063+0000","last_clean":"2024-09-12T17:08:33.602063+0000","last_became_active":"2024-09-12T17:05:49.541354+0000","last_became_peered":"2024-09-12T17:05:49.541354+0000","last_unstale":"2024-09-12T17:08:33.602063+0000","last_undegraded":"2024-09-12T17:08:33.602063+0000","last_fullsized":"2024-09-12T17:08:33.602063+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:09.147865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"103'12","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.208726+0000","last_change":"2024-09-12T17:05:47.556154+0000","last_active":"2024-09-12T17:09:03.208726+0000","last_peered":"2024-09-12T17:09:03.208726+0000","last_clean":"2024-09-12T17:09:03.208726+0000","last_became_active":"2024-09-12T17:05:47.555396+0000","last_became_peered":"2024-09-12T17:05:47.555396+0000","last_unstale":"2024-09-12T17:09:03.208726+0000","last_undegraded":"2024-09-12T17:09:03.208726+0000","last_fullsized":"2024-09-12T17:09:03.208726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:27.784208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22534,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353568+0000","last_change":"2024-09-12T17:05:49.529344+0000","last_active":"2024-09-12T17:08:35.353568+0000","last_peered":"2024-09-12T17:08:35.353568+0000","last_clean":"2024-09-12T17:08:35.353568+0000","last_became_active":"2024-09-12T17:05:49.528184+0000","last_became_peered":"2024-09-12T17:05:49.528184+0000","last_unstale":"2024-09-12T17:08:35.353568+0000","last_undegraded":"2024-09-12T17:08:35.353568+0000","last_fullsized":"2024-09-12T17:08:35.353568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:47:18.357328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"103'18","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.106056+0000","last_change":"2024-09-12T17:05:47.532931+0000","last_active":"2024-09-12T17:09:03.106056+0000","last_peered":"2024-09-12T17:09:03.106056+0000","last_clean":"2024-09-12T17:09:03.106056+0000","last_became_active":"2024-09-12T17:05:47.531427+0000","last_became_peered":"2024-09-12T17:05:47.531427+0000","last_unstale":"2024-09-12T17:09:03.106056+0000","last_undegraded":"2024-09-12T17:09:03.106056+0000","last_fullsized":"2024-09-12T17:09:03.106056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34822,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212195+0000","last_change":"2024-09-12T17:05:49.550694+0000","last_active":"2024-09-12T17:08:35.212195+0000","last_peered":"2024-09-12T17:08:35.212195+0000","last_clean":"2024-09-12T17:08:35.212195+0000","last_became_active":"2024-09-12T17:05:49.549066+0000","last_became_peered":"2024-09-12T17:05:49.549066+0000","last_unstale":"2024-09-12T17:08:35.212195+0000","last_undegraded":"2024-09-12T17:08:35.212195+0000","last_fullsized":"2024-09-12T17:08:35.212195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:46:24.061562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"103'12","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.209585+0000","last_change":"2024-09-12T17:05:47.560085+0000","last_active":"2024-09-12T17:09:03.209585+0000","last_peered":"2024-09-12T17:09:03.209585+0000","last_clean":"2024-09-12T17:09:03.209585+0000","last_became_active":"2024-09-12T17:05:47.559160+0000","last_became_peered":"2024-09-12T17:05:47.559160+0000","last_unstale":"2024-09-12T17:09:03.209585+0000","last_undegraded":"2024-09-12T17:09:03.209585+0000","last_fullsized":"2024-09-12T17:09:03.209585+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:54:06.664677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'2","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604685+0000","last_change":"2024-09-12T17:08:18.490456+0000","last_active":"2024-09-12T17:08:33.604685+0000","last_peered":"2024-09-12T17:08:33.604685+0000","last_clean":"2024-09-12T17:08:33.604685+0000","last_became_active":"2024-09-12T17:08:18.471124+0000","last_became_peered":"2024-09-12T17:08:18.471124+0000","last_unstale":"2024-09-12T17:08:33.604685+0000","last_undegraded":"2024-09-12T17:08:33.604685+0000","last_fullsized":"2024-09-12T17:08:33.604685+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.772819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"103'14","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.269351+0000","last_change":"2024-09-12T17:06:27.748750+0000","last_active":"2024-09-12T17:09:03.269351+0000","last_peered":"2024-09-12T17:09:03.269351+0000","last_clean":"2024-09-12T17:09:03.269351+0000","last_became_active":"2024-09-12T17:06:27.748329+0000","last_became_peered":"2024-09-12T17:06:27.748329+0000","last_unstale":"2024-09-12T17:09:03.269351+0000","last_undegraded":"2024-09-12T17:09:03.269351+0000","last_fullsized":"2024-09-12T17:09:03.269351+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:00:26.773943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26633,"num_write":38,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024893+0000","last_change":"2024-09-12T17:07:28.190678+0000","last_active":"2024-09-12T17:08:36.024893+0000","last_peered":"2024-09-12T17:08:36.024893+0000","last_clean":"2024-09-12T17:08:36.024893+0000","last_became_active":"2024-09-12T17:07:28.190245+0000","last_became_peered":"2024-09-12T17:07:28.190245+0000","last_unstale":"2024-09-12T17:08:36.024893+0000","last_undegraded":"2024-09-12T17:08:36.024893+0000","last_fullsized":"2024-09-12T17:08:36.024893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:04.220150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210683+0000","last_change":"2024-09-12T17:05:49.549575+0000","last_active":"2024-09-12T17:08:35.210683+0000","last_peered":"2024-09-12T17:08:35.210683+0000","last_clean":"2024-09-12T17:08:35.210683+0000","last_became_active":"2024-09-12T17:05:49.548292+0000","last_became_peered":"2024-09-12T17:05:49.548292+0000","last_unstale":"2024-09-12T17:08:35.210683+0000","last_undegraded":"2024-09-12T17:08:35.210683+0000","last_fullsized":"2024-09-12T17:08:35.210683+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"103'10","reported_seq":36,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.191284+0000","last_change":"2024-09-12T17:08:28.649055+0000","last_active":"2024-09-12T17:09:03.191284+0000","last_peered":"2024-09-12T17:09:03.191284+0000","last_clean":"2024-09-12T17:09:03.191284+0000","last_became_active":"2024-09-12T17:08:28.568157+0000","last_became_peered":"2024-09-12T17:08:28.568157+0000","last_unstale":"2024-09-12T17:09:03.191284+0000","last_undegraded":"2024-09-12T17:09:03.191284+0000","last_fullsized":"2024-09-12T17:09:03.191284+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:14:11.023137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":18,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605305+0000","last_change":"2024-09-12T17:08:18.455416+0000","last_active":"2024-09-12T17:08:33.605305+0000","last_peered":"2024-09-12T17:08:33.605305+0000","last_clean":"2024-09-12T17:08:33.605305+0000","last_became_active":"2024-09-12T17:08:18.454062+0000","last_became_peered":"2024-09-12T17:08:18.454062+0000","last_unstale":"2024-09-12T17:08:33.605305+0000","last_undegraded":"2024-09-12T17:08:33.605305+0000","last_fullsized":"2024-09-12T17:08:33.605305+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:08:38.260106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"103'18","reported_seq":199,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.191914+0000","last_change":"2024-09-12T17:05:47.528338+0000","last_active":"2024-09-12T17:09:03.191914+0000","last_peered":"2024-09-12T17:09:03.191914+0000","last_clean":"2024-09-12T17:09:03.191914+0000","last_became_active":"2024-09-12T17:05:47.527533+0000","last_became_peered":"2024-09-12T17:05:47.527533+0000","last_unstale":"2024-09-12T17:09:03.191914+0000","last_undegraded":"2024-09-12T17:09:03.191914+0000","last_fullsized":"2024-09-12T17:09:03.191914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:26.693731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34828,"num_write":50,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"84'30","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603444+0000","last_change":"2024-09-12T17:05:49.543097+0000","last_active":"2024-09-12T17:08:33.603444+0000","last_peered":"2024-09-12T17:08:33.603444+0000","last_clean":"2024-09-12T17:08:33.603444+0000","last_became_active":"2024-09-12T17:05:49.542113+0000","last_became_peered":"2024-09-12T17:05:49.542113+0000","last_unstale":"2024-09-12T17:08:33.603444+0000","last_undegraded":"2024-09-12T17:08:33.603444+0000","last_fullsized":"2024-09-12T17:08:33.603444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":90,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"103'20","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.324894+0000","last_change":"2024-09-12T17:05:47.529868+0000","last_active":"2024-09-12T17:09:03.324894+0000","last_peered":"2024-09-12T17:09:03.324894+0000","last_clean":"2024-09-12T17:09:03.324894+0000","last_became_active":"2024-09-12T17:05:47.529083+0000","last_became_peered":"2024-09-12T17:05:47.529083+0000","last_unstale":"2024-09-12T17:09:03.324894+0000","last_undegraded":"2024-09-12T17:09:03.324894+0000","last_fullsized":"2024-09-12T17:09:03.324894+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:18:16.489015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":40969,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023501+0000","last_change":"2024-09-12T17:05:49.548084+0000","last_active":"2024-09-12T17:08:36.023501+0000","last_peered":"2024-09-12T17:08:36.023501+0000","last_clean":"2024-09-12T17:08:36.023501+0000","last_became_active":"2024-09-12T17:05:49.539930+0000","last_became_peered":"2024-09-12T17:05:49.539930+0000","last_unstale":"2024-09-12T17:08:36.023501+0000","last_undegraded":"2024-09-12T17:08:36.023501+0000","last_fullsized":"2024-09-12T17:08:36.023501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:11.453390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"103'12","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.054237+0000","last_change":"2024-09-12T17:05:47.548316+0000","last_active":"2024-09-12T17:09:03.054237+0000","last_peered":"2024-09-12T17:09:03.054237+0000","last_clean":"2024-09-12T17:09:03.054237+0000","last_became_active":"2024-09-12T17:05:47.547430+0000","last_became_peered":"2024-09-12T17:05:47.547430+0000","last_unstale":"2024-09-12T17:09:03.054237+0000","last_undegraded":"2024-09-12T17:09:03.054237+0000","last_fullsized":"2024-09-12T17:09:03.054237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:06:21.143073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024500+0000","last_change":"2024-09-12T17:05:49.556144+0000","last_active":"2024-09-12T17:08:36.024500+0000","last_peered":"2024-09-12T17:08:36.024500+0000","last_clean":"2024-09-12T17:08:36.024500+0000","last_became_active":"2024-09-12T17:05:49.555033+0000","last_became_peered":"2024-09-12T17:05:49.555033+0000","last_unstale":"2024-09-12T17:08:36.024500+0000","last_undegraded":"2024-09-12T17:08:36.024500+0000","last_fullsized":"2024-09-12T17:08:36.024500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:08.056726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"103'20","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.251417+0000","last_change":"2024-09-12T17:05:47.511375+0000","last_active":"2024-09-12T17:09:03.251417+0000","last_peered":"2024-09-12T17:09:03.251417+0000","last_clean":"2024-09-12T17:09:03.251417+0000","last_became_active":"2024-09-12T17:05:47.510364+0000","last_became_peered":"2024-09-12T17:05:47.510364+0000","last_unstale":"2024-09-12T17:09:03.251417+0000","last_undegraded":"2024-09-12T17:09:03.251417+0000","last_fullsized":"2024-09-12T17:09:03.251417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:48:06.044486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":38912,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212219+0000","last_change":"2024-09-12T17:08:18.448181+0000","last_active":"2024-09-12T17:08:35.212219+0000","last_peered":"2024-09-12T17:08:35.212219+0000","last_clean":"2024-09-12T17:08:35.212219+0000","last_became_active":"2024-09-12T17:08:18.447353+0000","last_became_peered":"2024-09-12T17:08:18.447353+0000","last_unstale":"2024-09-12T17:08:35.212219+0000","last_undegraded":"2024-09-12T17:08:35.212219+0000","last_fullsized":"2024-09-12T17:08:35.212219+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:21:07.836287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"103'8","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.110351+0000","last_change":"2024-09-12T17:08:18.831302+0000","last_active":"2024-09-12T17:09:03.110351+0000","last_peered":"2024-09-12T17:09:03.110351+0000","last_clean":"2024-09-12T17:09:03.110351+0000","last_became_active":"2024-09-12T17:08:18.467826+0000","last_became_peered":"2024-09-12T17:08:18.467826+0000","last_unstale":"2024-09-12T17:09:03.110351+0000","last_undegraded":"2024-09-12T17:09:03.110351+0000","last_fullsized":"2024-09-12T17:09:03.110351+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:24.964574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14339,"num_write":16,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10485760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"84'2","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210149+0000","last_change":"2024-09-12T17:05:57.588515+0000","last_active":"2024-09-12T17:08:35.210149+0000","last_peered":"2024-09-12T17:08:35.210149+0000","last_clean":"2024-09-12T17:08:35.210149+0000","last_became_active":"2024-09-12T17:05:57.587891+0000","last_became_peered":"2024-09-12T17:05:57.587891+0000","last_unstale":"2024-09-12T17:08:35.210149+0000","last_undegraded":"2024-09-12T17:08:35.210149+0000","last_fullsized":"2024-09-12T17:08:35.210149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:24.257847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022681+0000","last_change":"2024-09-12T17:08:21.457874+0000","last_active":"2024-09-12T17:08:36.022681+0000","last_peered":"2024-09-12T17:08:36.022681+0000","last_clean":"2024-09-12T17:08:36.022681+0000","last_became_active":"2024-09-12T17:08:21.457526+0000","last_became_peered":"2024-09-12T17:08:21.457526+0000","last_unstale":"2024-09-12T17:08:36.022681+0000","last_undegraded":"2024-09-12T17:08:36.022681+0000","last_fullsized":"2024-09-12T17:08:36.022681+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:50:37.646866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"103'20","reported_seq":199,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.297752+0000","last_change":"2024-09-12T17:05:47.557687+0000","last_active":"2024-09-12T17:09:03.297752+0000","last_peered":"2024-09-12T17:09:03.297752+0000","last_clean":"2024-09-12T17:09:03.297752+0000","last_became_active":"2024-09-12T17:05:47.556980+0000","last_became_peered":"2024-09-12T17:05:47.556980+0000","last_unstale":"2024-09-12T17:09:03.297752+0000","last_undegraded":"2024-09-12T17:09:03.297752+0000","last_fullsized":"2024-09-12T17:09:03.297752+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:55.891909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38921,"num_write":44,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606120+0000","last_change":"2024-09-12T17:08:18.472276+0000","last_active":"2024-09-12T17:08:33.606120+0000","last_peered":"2024-09-12T17:08:33.606120+0000","last_clean":"2024-09-12T17:08:33.606120+0000","last_became_active":"2024-09-12T17:08:18.471264+0000","last_became_peered":"2024-09-12T17:08:18.471264+0000","last_unstale":"2024-09-12T17:08:33.606120+0000","last_undegraded":"2024-09-12T17:08:33.606120+0000","last_fullsized":"2024-09-12T17:08:33.606120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:10.434396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"103'18","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.076371+0000","last_change":"2024-09-12T17:05:53.537592+0000","last_active":"2024-09-12T17:09:03.076371+0000","last_peered":"2024-09-12T17:09:03.076371+0000","last_clean":"2024-09-12T17:09:03.076371+0000","last_became_active":"2024-09-12T17:05:53.536921+0000","last_became_peered":"2024-09-12T17:05:53.536921+0000","last_unstale":"2024-09-12T17:09:03.076371+0000","last_undegraded":"2024-09-12T17:09:03.076371+0000","last_fullsized":"2024-09-12T17:09:03.076371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:25.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":50,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607496+0000","last_change":"2024-09-12T17:05:55.559431+0000","last_active":"2024-09-12T17:08:33.607496+0000","last_peered":"2024-09-12T17:08:33.607496+0000","last_clean":"2024-09-12T17:08:33.607496+0000","last_became_active":"2024-09-12T17:05:55.558297+0000","last_became_peered":"2024-09-12T17:05:55.558297+0000","last_unstale":"2024-09-12T17:08:33.607496+0000","last_undegraded":"2024-09-12T17:08:33.607496+0000","last_fullsized":"2024-09-12T17:08:33.607496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"84'4","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601882+0000","last_change":"2024-09-12T17:05:57.592599+0000","last_active":"2024-09-12T17:08:33.601882+0000","last_peered":"2024-09-12T17:08:33.601882+0000","last_clean":"2024-09-12T17:08:33.601882+0000","last_became_active":"2024-09-12T17:05:57.591877+0000","last_became_peered":"2024-09-12T17:05:57.591877+0000","last_unstale":"2024-09-12T17:08:33.601882+0000","last_undegraded":"2024-09-12T17:08:33.601882+0000","last_fullsized":"2024-09-12T17:08:33.601882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:57.557525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"68'6","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605335+0000","last_change":"2024-09-12T17:05:49.546093+0000","last_active":"2024-09-12T17:08:33.605335+0000","last_peered":"2024-09-12T17:08:33.605335+0000","last_clean":"2024-09-12T17:08:33.605335+0000","last_became_active":"2024-09-12T17:05:49.544425+0000","last_became_peered":"2024-09-12T17:05:49.544425+0000","last_unstale":"2024-09-12T17:08:33.605335+0000","last_undegraded":"2024-09-12T17:08:33.605335+0000","last_fullsized":"2024-09-12T17:08:33.605335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:14:45.495950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"103'12","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:06.631792+0000","last_change":"2024-09-12T17:09:06.631792+0000","last_active":"2024-09-12T17:09:06.631792+0000","last_peered":"2024-09-12T17:09:06.631792+0000","last_clean":"2024-09-12T17:09:06.631792+0000","last_became_active":"2024-09-12T17:05:47.534833+0000","last_became_peered":"2024-09-12T17:05:47.534833+0000","last_unstale":"2024-09-12T17:09:06.631792+0000","last_undegraded":"2024-09-12T17:09:06.631792+0000","last_fullsized":"2024-09-12T17:09:06.631792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:06.631723+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:06.631723+0000","last_clean_scrub_stamp":"2024-09-12T17:09:06.631723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:39.456148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023193+0000","last_change":"2024-09-12T17:05:51.533888+0000","last_active":"2024-09-12T17:08:36.023193+0000","last_peered":"2024-09-12T17:08:36.023193+0000","last_clean":"2024-09-12T17:08:36.023193+0000","last_became_active":"2024-09-12T17:05:51.533164+0000","last_became_peered":"2024-09-12T17:05:51.533164+0000","last_unstale":"2024-09-12T17:08:36.023193+0000","last_undegraded":"2024-09-12T17:08:36.023193+0000","last_fullsized":"2024-09-12T17:08:36.023193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:33.007858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":165,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212582+0000","last_change":"2024-09-12T17:05:53.549534+0000","last_active":"2024-09-12T17:08:35.212582+0000","last_peered":"2024-09-12T17:08:35.212582+0000","last_clean":"2024-09-12T17:08:35.212582+0000","last_became_active":"2024-09-12T17:05:53.548824+0000","last_became_peered":"2024-09-12T17:05:53.548824+0000","last_unstale":"2024-09-12T17:08:35.212582+0000","last_undegraded":"2024-09-12T17:08:35.212582+0000","last_fullsized":"2024-09-12T17:08:35.212582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.765832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211657+0000","last_change":"2024-09-12T17:05:55.557468+0000","last_active":"2024-09-12T17:08:35.211657+0000","last_peered":"2024-09-12T17:08:35.211657+0000","last_clean":"2024-09-12T17:08:35.211657+0000","last_became_active":"2024-09-12T17:05:55.556689+0000","last_became_peered":"2024-09-12T17:05:55.556689+0000","last_unstale":"2024-09-12T17:08:35.211657+0000","last_undegraded":"2024-09-12T17:08:35.211657+0000","last_fullsized":"2024-09-12T17:08:35.211657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:56.879576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601144+0000","last_change":"2024-09-12T17:05:57.589569+0000","last_active":"2024-09-12T17:08:33.601144+0000","last_peered":"2024-09-12T17:08:33.601144+0000","last_clean":"2024-09-12T17:08:33.601144+0000","last_became_active":"2024-09-12T17:05:57.588649+0000","last_became_peered":"2024-09-12T17:05:57.588649+0000","last_unstale":"2024-09-12T17:08:33.601144+0000","last_undegraded":"2024-09-12T17:08:33.601144+0000","last_fullsized":"2024-09-12T17:08:33.601144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"68'10","reported_seq":175,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604412+0000","last_change":"2024-09-12T17:05:49.531436+0000","last_active":"2024-09-12T17:08:33.604412+0000","last_peered":"2024-09-12T17:08:33.604412+0000","last_clean":"2024-09-12T17:08:33.604412+0000","last_became_active":"2024-09-12T17:05:49.530687+0000","last_became_peered":"2024-09-12T17:05:49.530687+0000","last_unstale":"2024-09-12T17:08:33.604412+0000","last_undegraded":"2024-09-12T17:08:33.604412+0000","last_fullsized":"2024-09-12T17:08:33.604412+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"103'18","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.288208+0000","last_change":"2024-09-12T17:05:47.564709+0000","last_active":"2024-09-12T17:09:03.288208+0000","last_peered":"2024-09-12T17:09:03.288208+0000","last_clean":"2024-09-12T17:09:03.288208+0000","last_became_active":"2024-09-12T17:05:47.564189+0000","last_became_peered":"2024-09-12T17:05:47.564189+0000","last_unstale":"2024-09-12T17:09:03.288208+0000","last_undegraded":"2024-09-12T17:09:03.288208+0000","last_fullsized":"2024-09-12T17:09:03.288208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":34825,"num_write":42,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.026238+0000","last_change":"2024-09-12T17:08:18.465074+0000","last_active":"2024-09-12T17:08:36.026238+0000","last_peered":"2024-09-12T17:08:36.026238+0000","last_clean":"2024-09-12T17:08:36.026238+0000","last_became_active":"2024-09-12T17:08:18.464648+0000","last_became_peered":"2024-09-12T17:08:18.464648+0000","last_unstale":"2024-09-12T17:08:36.026238+0000","last_undegraded":"2024-09-12T17:08:36.026238+0000","last_fullsized":"2024-09-12T17:08:36.026238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:04.122655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023933+0000","last_change":"2024-09-12T17:05:53.549328+0000","last_active":"2024-09-12T17:08:36.023933+0000","last_peered":"2024-09-12T17:08:36.023933+0000","last_clean":"2024-09-12T17:08:36.023933+0000","last_became_active":"2024-09-12T17:05:53.548968+0000","last_became_peered":"2024-09-12T17:05:53.548968+0000","last_unstale":"2024-09-12T17:08:36.023933+0000","last_undegraded":"2024-09-12T17:08:36.023933+0000","last_fullsized":"2024-09-12T17:08:36.023933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:36.974950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"103'20","reported_seq":234,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.654674+0000","last_change":"2024-09-12T17:08:21.488239+0000","last_active":"2024-09-12T17:09:02.654674+0000","last_peered":"2024-09-12T17:09:02.654674+0000","last_clean":"2024-09-12T17:09:02.654674+0000","last_became_active":"2024-09-12T17:08:21.464957+0000","last_became_peered":"2024-09-12T17:08:21.464957+0000","last_unstale":"2024-09-12T17:09:02.654674+0000","last_undegraded":"2024-09-12T17:09:02.654674+0000","last_fullsized":"2024-09-12T17:09:02.654674+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.266320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210946+0000","last_change":"2024-09-12T17:05:58.122522+0000","last_active":"2024-09-12T17:08:35.210946+0000","last_peered":"2024-09-12T17:08:35.210946+0000","last_clean":"2024-09-12T17:08:35.210946+0000","last_became_active":"2024-09-12T17:05:58.121871+0000","last_became_peered":"2024-09-12T17:05:58.121871+0000","last_unstale":"2024-09-12T17:08:35.210946+0000","last_undegraded":"2024-09-12T17:08:35.210946+0000","last_fullsized":"2024-09-12T17:08:35.210946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:22.625236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025587+0000","last_change":"2024-09-12T17:05:49.528766+0000","last_active":"2024-09-12T17:08:36.025587+0000","last_peered":"2024-09-12T17:08:36.025587+0000","last_clean":"2024-09-12T17:08:36.025587+0000","last_became_active":"2024-09-12T17:05:49.527758+0000","last_became_peered":"2024-09-12T17:05:49.527758+0000","last_unstale":"2024-09-12T17:08:36.025587+0000","last_undegraded":"2024-09-12T17:08:36.025587+0000","last_fullsized":"2024-09-12T17:08:36.025587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:57:06.399711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"103'28","reported_seq":211,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.359200+0000","last_change":"2024-09-12T17:05:47.521727+0000","last_active":"2024-09-12T17:09:03.359200+0000","last_peered":"2024-09-12T17:09:03.359200+0000","last_clean":"2024-09-12T17:09:03.359200+0000","last_became_active":"2024-09-12T17:05:47.520943+0000","last_became_peered":"2024-09-12T17:05:47.520943+0000","last_unstale":"2024-09-12T17:09:03.359200+0000","last_undegraded":"2024-09-12T17:09:03.359200+0000","last_fullsized":"2024-09-12T17:09:03.359200+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:23:24.772296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":51203,"num_write":36,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"29'1","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.606726+0000","last_change":"2024-09-12T17:05:51.556202+0000","last_active":"2024-09-12T17:09:02.606726+0000","last_peered":"2024-09-12T17:09:02.606726+0000","last_clean":"2024-09-12T17:09:02.606726+0000","last_became_active":"2024-09-12T17:05:51.555420+0000","last_became_peered":"2024-09-12T17:05:51.555420+0000","last_unstale":"2024-09-12T17:09:02.606726+0000","last_undegraded":"2024-09-12T17:09:02.606726+0000","last_fullsized":"2024-09-12T17:09:02.606726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:56.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"103'17","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.972638+0000","last_change":"2024-09-12T17:05:53.554159+0000","last_active":"2024-09-12T17:09:02.972638+0000","last_peered":"2024-09-12T17:09:02.972638+0000","last_clean":"2024-09-12T17:09:02.972638+0000","last_became_active":"2024-09-12T17:05:53.553333+0000","last_became_peered":"2024-09-12T17:05:53.553333+0000","last_unstale":"2024-09-12T17:09:02.972638+0000","last_undegraded":"2024-09-12T17:09:02.972638+0000","last_fullsized":"2024-09-12T17:09:02.972638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:53.266475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"103'18","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.660606+0000","last_change":"2024-09-12T17:05:55.556502+0000","last_active":"2024-09-12T17:09:02.660606+0000","last_peered":"2024-09-12T17:09:02.660606+0000","last_clean":"2024-09-12T17:09:02.660606+0000","last_became_active":"2024-09-12T17:05:55.555879+0000","last_became_peered":"2024-09-12T17:05:55.555879+0000","last_unstale":"2024-09-12T17:09:02.660606+0000","last_undegraded":"2024-09-12T17:09:02.660606+0000","last_fullsized":"2024-09-12T17:09:02.660606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:18.672296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602918+0000","last_change":"2024-09-12T17:05:49.553404+0000","last_active":"2024-09-12T17:08:33.602918+0000","last_peered":"2024-09-12T17:08:33.602918+0000","last_clean":"2024-09-12T17:08:33.602918+0000","last_became_active":"2024-09-12T17:05:49.552637+0000","last_became_peered":"2024-09-12T17:05:49.552637+0000","last_unstale":"2024-09-12T17:08:33.602918+0000","last_undegraded":"2024-09-12T17:08:33.602918+0000","last_fullsized":"2024-09-12T17:08:33.602918+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:10.200734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"103'12","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.184993+0000","last_change":"2024-09-12T17:05:47.562949+0000","last_active":"2024-09-12T17:09:03.184993+0000","last_peered":"2024-09-12T17:09:03.184993+0000","last_clean":"2024-09-12T17:09:03.184993+0000","last_became_active":"2024-09-12T17:05:47.562465+0000","last_became_peered":"2024-09-12T17:05:47.562465+0000","last_unstale":"2024-09-12T17:09:03.184993+0000","last_undegraded":"2024-09-12T17:09:03.184993+0000","last_fullsized":"2024-09-12T17:09:03.184993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24585,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604488+0000","last_change":"2024-09-12T17:05:51.542349+0000","last_active":"2024-09-12T17:08:33.604488+0000","last_peered":"2024-09-12T17:08:33.604488+0000","last_clean":"2024-09-12T17:08:33.604488+0000","last_became_active":"2024-09-12T17:05:51.541205+0000","last_became_peered":"2024-09-12T17:05:51.541205+0000","last_unstale":"2024-09-12T17:08:33.604488+0000","last_undegraded":"2024-09-12T17:08:33.604488+0000","last_fullsized":"2024-09-12T17:08:33.604488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"103'32","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.198917+0000","last_change":"2024-09-12T17:05:53.560400+0000","last_active":"2024-09-12T17:09:03.198917+0000","last_peered":"2024-09-12T17:09:03.198917+0000","last_clean":"2024-09-12T17:09:03.198917+0000","last_became_active":"2024-09-12T17:05:53.559463+0000","last_became_peered":"2024-09-12T17:05:53.559463+0000","last_unstale":"2024-09-12T17:09:03.198917+0000","last_undegraded":"2024-09-12T17:09:03.198917+0000","last_fullsized":"2024-09-12T17:09:03.198917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":84,"num_write":38,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114027+0000","last_change":"2024-09-12T17:08:21.463670+0000","last_active":"2024-09-12T17:08:35.114027+0000","last_peered":"2024-09-12T17:08:35.114027+0000","last_clean":"2024-09-12T17:08:35.114027+0000","last_became_active":"2024-09-12T17:08:21.463161+0000","last_became_peered":"2024-09-12T17:08:21.463161+0000","last_unstale":"2024-09-12T17:08:35.114027+0000","last_undegraded":"2024-09-12T17:08:35.114027+0000","last_fullsized":"2024-09-12T17:08:35.114027+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:03.162531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603071+0000","last_change":"2024-09-12T17:05:57.599403+0000","last_active":"2024-09-12T17:08:33.603071+0000","last_peered":"2024-09-12T17:08:33.603071+0000","last_clean":"2024-09-12T17:08:33.603071+0000","last_became_active":"2024-09-12T17:05:57.598703+0000","last_became_peered":"2024-09-12T17:05:57.598703+0000","last_unstale":"2024-09-12T17:08:33.603071+0000","last_undegraded":"2024-09-12T17:08:33.603071+0000","last_fullsized":"2024-09-12T17:08:33.603071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"84'34","reported_seq":217,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210937+0000","last_change":"2024-09-12T17:08:18.474573+0000","last_active":"2024-09-12T17:08:35.210937+0000","last_peered":"2024-09-12T17:08:35.210937+0000","last_clean":"2024-09-12T17:08:35.210937+0000","last_became_active":"2024-09-12T17:08:18.443808+0000","last_became_peered":"2024-09-12T17:08:18.443808+0000","last_unstale":"2024-09-12T17:08:35.210937+0000","last_undegraded":"2024-09-12T17:08:35.210937+0000","last_fullsized":"2024-09-12T17:08:35.210937+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:01.200485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"103'14","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.343481+0000","last_change":"2024-09-12T17:05:47.563411+0000","last_active":"2024-09-12T17:09:03.343481+0000","last_peered":"2024-09-12T17:09:03.343481+0000","last_clean":"2024-09-12T17:09:03.343481+0000","last_became_active":"2024-09-12T17:05:47.562812+0000","last_became_peered":"2024-09-12T17:05:47.562812+0000","last_unstale":"2024-09-12T17:09:03.343481+0000","last_undegraded":"2024-09-12T17:09:03.343481+0000","last_fullsized":"2024-09-12T17:09:03.343481+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:57.659986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24579,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021678+0000","last_change":"2024-09-12T17:05:51.548944+0000","last_active":"2024-09-12T17:08:36.021678+0000","last_peered":"2024-09-12T17:08:36.021678+0000","last_clean":"2024-09-12T17:08:36.021678+0000","last_became_active":"2024-09-12T17:05:51.544649+0000","last_became_peered":"2024-09-12T17:05:51.544649+0000","last_unstale":"2024-09-12T17:08:36.021678+0000","last_undegraded":"2024-09-12T17:08:36.021678+0000","last_fullsized":"2024-09-12T17:08:36.021678+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:33:01.468390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"103'16","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.428796+0000","last_change":"2024-09-12T17:05:53.552838+0000","last_active":"2024-09-12T17:09:03.428796+0000","last_peered":"2024-09-12T17:09:03.428796+0000","last_clean":"2024-09-12T17:09:03.428796+0000","last_became_active":"2024-09-12T17:05:53.550042+0000","last_became_peered":"2024-09-12T17:05:53.550042+0000","last_unstale":"2024-09-12T17:09:03.428796+0000","last_undegraded":"2024-09-12T17:09:03.428796+0000","last_fullsized":"2024-09-12T17:09:03.428796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021994+0000","last_change":"2024-09-12T17:05:55.558761+0000","last_active":"2024-09-12T17:08:36.021994+0000","last_peered":"2024-09-12T17:08:36.021994+0000","last_clean":"2024-09-12T17:08:36.021994+0000","last_became_active":"2024-09-12T17:05:55.557930+0000","last_became_peered":"2024-09-12T17:05:55.557930+0000","last_unstale":"2024-09-12T17:08:36.021994+0000","last_undegraded":"2024-09-12T17:08:36.021994+0000","last_fullsized":"2024-09-12T17:08:36.021994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.015675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353619+0000","last_change":"2024-09-12T17:05:57.592611+0000","last_active":"2024-09-12T17:08:35.353619+0000","last_peered":"2024-09-12T17:08:35.353619+0000","last_clean":"2024-09-12T17:08:35.353619+0000","last_became_active":"2024-09-12T17:05:57.591855+0000","last_became_peered":"2024-09-12T17:05:57.591855+0000","last_unstale":"2024-09-12T17:08:35.353619+0000","last_undegraded":"2024-09-12T17:08:35.353619+0000","last_fullsized":"2024-09-12T17:08:35.353619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:02.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353645+0000","last_change":"2024-09-12T17:08:18.467848+0000","last_active":"2024-09-12T17:08:35.353645+0000","last_peered":"2024-09-12T17:08:35.353645+0000","last_clean":"2024-09-12T17:08:35.353645+0000","last_became_active":"2024-09-12T17:08:18.466877+0000","last_became_peered":"2024-09-12T17:08:18.466877+0000","last_unstale":"2024-09-12T17:08:35.353645+0000","last_undegraded":"2024-09-12T17:08:35.353645+0000","last_fullsized":"2024-09-12T17:08:35.353645+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:08.084076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"103'18","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.270474+0000","last_change":"2024-09-12T17:05:47.562243+0000","last_active":"2024-09-12T17:09:03.270474+0000","last_peered":"2024-09-12T17:09:03.270474+0000","last_clean":"2024-09-12T17:09:03.270474+0000","last_became_active":"2024-09-12T17:05:47.561587+0000","last_became_peered":"2024-09-12T17:05:47.561587+0000","last_unstale":"2024-09-12T17:09:03.270474+0000","last_undegraded":"2024-09-12T17:09:03.270474+0000","last_fullsized":"2024-09-12T17:09:03.270474+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28672,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"29'1","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.604271+0000","last_change":"2024-09-12T17:05:51.542843+0000","last_active":"2024-09-12T17:09:02.604271+0000","last_peered":"2024-09-12T17:09:02.604271+0000","last_clean":"2024-09-12T17:09:02.604271+0000","last_became_active":"2024-09-12T17:05:51.542457+0000","last_became_peered":"2024-09-12T17:05:51.542457+0000","last_unstale":"2024-09-12T17:09:02.604271+0000","last_undegraded":"2024-09-12T17:09:02.604271+0000","last_fullsized":"2024-09-12T17:09:02.604271+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:28.837373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"103'24","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.226396+0000","last_change":"2024-09-12T17:05:53.548729+0000","last_active":"2024-09-12T17:09:03.226396+0000","last_peered":"2024-09-12T17:09:03.226396+0000","last_clean":"2024-09-12T17:09:03.226396+0000","last_became_active":"2024-09-12T17:05:53.547990+0000","last_became_peered":"2024-09-12T17:05:53.547990+0000","last_unstale":"2024-09-12T17:09:03.226396+0000","last_undegraded":"2024-09-12T17:09:03.226396+0000","last_fullsized":"2024-09-12T17:09:03.226396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:22.845485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"103'20","reported_seq":232,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.661863+0000","last_change":"2024-09-12T17:08:21.470468+0000","last_active":"2024-09-12T17:09:02.661863+0000","last_peered":"2024-09-12T17:09:02.661863+0000","last_clean":"2024-09-12T17:09:02.661863+0000","last_became_active":"2024-09-12T17:08:21.465057+0000","last_became_peered":"2024-09-12T17:08:21.465057+0000","last_unstale":"2024-09-12T17:09:02.661863+0000","last_undegraded":"2024-09-12T17:09:02.661863+0000","last_fullsized":"2024-09-12T17:09:02.661863+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.580430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604073+0000","last_change":"2024-09-12T17:05:57.596229+0000","last_active":"2024-09-12T17:08:33.604073+0000","last_peered":"2024-09-12T17:08:33.604073+0000","last_clean":"2024-09-12T17:08:33.604073+0000","last_became_active":"2024-09-12T17:05:57.595658+0000","last_became_peered":"2024-09-12T17:05:57.595658+0000","last_unstale":"2024-09-12T17:08:33.604073+0000","last_undegraded":"2024-09-12T17:08:33.604073+0000","last_fullsized":"2024-09-12T17:08:33.604073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.644627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603857+0000","last_change":"2024-09-12T17:08:18.465360+0000","last_active":"2024-09-12T17:08:33.603857+0000","last_peered":"2024-09-12T17:08:33.603857+0000","last_clean":"2024-09-12T17:08:33.603857+0000","last_became_active":"2024-09-12T17:08:18.464976+0000","last_became_peered":"2024-09-12T17:08:18.464976+0000","last_unstale":"2024-09-12T17:08:33.603857+0000","last_undegraded":"2024-09-12T17:08:33.603857+0000","last_fullsized":"2024-09-12T17:08:33.603857+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:02.772819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"103'20","reported_seq":200,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.372940+0000","last_change":"2024-09-12T17:05:47.535946+0000","last_active":"2024-09-12T17:09:03.372940+0000","last_peered":"2024-09-12T17:09:03.372940+0000","last_clean":"2024-09-12T17:09:03.372940+0000","last_became_active":"2024-09-12T17:05:47.534607+0000","last_became_peered":"2024-09-12T17:05:47.534607+0000","last_unstale":"2024-09-12T17:09:03.372940+0000","last_undegraded":"2024-09-12T17:09:03.372940+0000","last_fullsized":"2024-09-12T17:09:03.372940+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36876,"num_write":52,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022424+0000","last_change":"2024-09-12T17:05:51.548391+0000","last_active":"2024-09-12T17:08:36.022424+0000","last_peered":"2024-09-12T17:08:36.022424+0000","last_clean":"2024-09-12T17:08:36.022424+0000","last_became_active":"2024-09-12T17:05:51.547939+0000","last_became_peered":"2024-09-12T17:05:51.547939+0000","last_unstale":"2024-09-12T17:08:36.022424+0000","last_undegraded":"2024-09-12T17:08:36.022424+0000","last_fullsized":"2024-09-12T17:08:36.022424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:08.848247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"103'31","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.259212+0000","last_change":"2024-09-12T17:05:53.535756+0000","last_active":"2024-09-12T17:09:03.259212+0000","last_peered":"2024-09-12T17:09:03.259212+0000","last_clean":"2024-09-12T17:09:03.259212+0000","last_became_active":"2024-09-12T17:05:53.535062+0000","last_became_peered":"2024-09-12T17:05:53.535062+0000","last_unstale":"2024-09-12T17:09:03.259212+0000","last_undegraded":"2024-09-12T17:09:03.259212+0000","last_fullsized":"2024-09-12T17:09:03.259212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":57,"num_read_kb":81,"num_write":36,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019032+0000","last_change":"2024-09-12T17:05:55.564010+0000","last_active":"2024-09-12T17:08:36.019032+0000","last_peered":"2024-09-12T17:08:36.019032+0000","last_clean":"2024-09-12T17:08:36.019032+0000","last_became_active":"2024-09-12T17:05:55.563125+0000","last_became_peered":"2024-09-12T17:05:55.563125+0000","last_unstale":"2024-09-12T17:08:36.019032+0000","last_undegraded":"2024-09-12T17:08:36.019032+0000","last_fullsized":"2024-09-12T17:08:36.019032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:00.697571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114671+0000","last_change":"2024-09-12T17:08:18.459890+0000","last_active":"2024-09-12T17:08:35.114671+0000","last_peered":"2024-09-12T17:08:35.114671+0000","last_clean":"2024-09-12T17:08:35.114671+0000","last_became_active":"2024-09-12T17:08:18.459544+0000","last_became_peered":"2024-09-12T17:08:18.459544+0000","last_unstale":"2024-09-12T17:08:35.114671+0000","last_undegraded":"2024-09-12T17:08:35.114671+0000","last_fullsized":"2024-09-12T17:08:35.114671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:05.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211812+0000","last_change":"2024-09-12T17:05:49.544092+0000","last_active":"2024-09-12T17:08:35.211812+0000","last_peered":"2024-09-12T17:08:35.211812+0000","last_clean":"2024-09-12T17:08:35.211812+0000","last_became_active":"2024-09-12T17:05:49.543307+0000","last_became_peered":"2024-09-12T17:05:49.543307+0000","last_unstale":"2024-09-12T17:08:35.211812+0000","last_undegraded":"2024-09-12T17:08:35.211812+0000","last_fullsized":"2024-09-12T17:08:35.211812+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:36.286410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"103'12","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.195922+0000","last_change":"2024-09-12T17:05:47.526678+0000","last_active":"2024-09-12T17:09:03.195922+0000","last_peered":"2024-09-12T17:09:03.195922+0000","last_clean":"2024-09-12T17:09:03.195922+0000","last_became_active":"2024-09-12T17:05:47.525696+0000","last_became_peered":"2024-09-12T17:05:47.525696+0000","last_unstale":"2024-09-12T17:09:03.195922+0000","last_undegraded":"2024-09-12T17:09:03.195922+0000","last_fullsized":"2024-09-12T17:09:03.195922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:26:59.012258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":18438,"num_write":28,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023952+0000","last_change":"2024-09-12T17:05:51.543404+0000","last_active":"2024-09-12T17:08:36.023952+0000","last_peered":"2024-09-12T17:08:36.023952+0000","last_clean":"2024-09-12T17:08:36.023952+0000","last_became_active":"2024-09-12T17:05:51.542737+0000","last_became_peered":"2024-09-12T17:05:51.542737+0000","last_unstale":"2024-09-12T17:08:36.023952+0000","last_undegraded":"2024-09-12T17:08:36.023952+0000","last_fullsized":"2024-09-12T17:08:36.023952+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:58:30.551403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"103'23","reported_seq":227,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.860878+0000","last_change":"2024-09-12T17:08:21.484446+0000","last_active":"2024-09-12T17:09:02.860878+0000","last_peered":"2024-09-12T17:09:02.860878+0000","last_clean":"2024-09-12T17:09:02.860878+0000","last_became_active":"2024-09-12T17:08:21.465207+0000","last_became_peered":"2024-09-12T17:08:21.465207+0000","last_unstale":"2024-09-12T17:09:02.860878+0000","last_undegraded":"2024-09-12T17:09:02.860878+0000","last_fullsized":"2024-09-12T17:09:02.860878+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:37.839396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":61,"num_write":28,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3559,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603073+0000","last_change":"2024-09-12T17:05:55.565575+0000","last_active":"2024-09-12T17:08:33.603073+0000","last_peered":"2024-09-12T17:08:33.603073+0000","last_clean":"2024-09-12T17:08:33.603073+0000","last_became_active":"2024-09-12T17:05:55.564802+0000","last_became_peered":"2024-09-12T17:05:55.564802+0000","last_unstale":"2024-09-12T17:08:33.603073+0000","last_undegraded":"2024-09-12T17:08:33.603073+0000","last_fullsized":"2024-09-12T17:08:33.603073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022911+0000","last_change":"2024-09-12T17:05:57.592294+0000","last_active":"2024-09-12T17:08:36.022911+0000","last_peered":"2024-09-12T17:08:36.022911+0000","last_clean":"2024-09-12T17:08:36.022911+0000","last_became_active":"2024-09-12T17:05:57.591389+0000","last_became_peered":"2024-09-12T17:05:57.591389+0000","last_unstale":"2024-09-12T17:08:36.022911+0000","last_undegraded":"2024-09-12T17:08:36.022911+0000","last_fullsized":"2024-09-12T17:08:36.022911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'10","reported_seq":177,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212458+0000","last_change":"2024-09-12T17:05:49.553177+0000","last_active":"2024-09-12T17:08:35.212458+0000","last_peered":"2024-09-12T17:08:35.212458+0000","last_clean":"2024-09-12T17:08:35.212458+0000","last_became_active":"2024-09-12T17:05:49.552270+0000","last_became_peered":"2024-09-12T17:05:49.552270+0000","last_unstale":"2024-09-12T17:08:35.212458+0000","last_undegraded":"2024-09-12T17:08:35.212458+0000","last_fullsized":"2024-09-12T17:08:35.212458+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:17:34.066311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"103'16","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.334863+0000","last_change":"2024-09-12T17:05:47.543064+0000","last_active":"2024-09-12T17:09:03.334863+0000","last_peered":"2024-09-12T17:09:03.334863+0000","last_clean":"2024-09-12T17:09:03.334863+0000","last_became_active":"2024-09-12T17:05:47.542362+0000","last_became_peered":"2024-09-12T17:05:47.542362+0000","last_unstale":"2024-09-12T17:09:03.334863+0000","last_undegraded":"2024-09-12T17:09:03.334863+0000","last_fullsized":"2024-09-12T17:09:03.334863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:22:50.582074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114518+0000","last_change":"2024-09-12T17:08:18.456938+0000","last_active":"2024-09-12T17:08:35.114518+0000","last_peered":"2024-09-12T17:08:35.114518+0000","last_clean":"2024-09-12T17:08:35.114518+0000","last_became_active":"2024-09-12T17:08:18.452101+0000","last_became_peered":"2024-09-12T17:08:18.452101+0000","last_unstale":"2024-09-12T17:08:35.114518+0000","last_undegraded":"2024-09-12T17:08:35.114518+0000","last_fullsized":"2024-09-12T17:08:35.114518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:36.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"103'23","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.390632+0000","last_change":"2024-09-12T17:05:53.554531+0000","last_active":"2024-09-12T17:09:03.390632+0000","last_peered":"2024-09-12T17:09:03.390632+0000","last_clean":"2024-09-12T17:09:03.390632+0000","last_became_active":"2024-09-12T17:05:53.554131+0000","last_became_peered":"2024-09-12T17:05:53.554131+0000","last_unstale":"2024-09-12T17:09:03.390632+0000","last_undegraded":"2024-09-12T17:09:03.390632+0000","last_fullsized":"2024-09-12T17:09:03.390632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:57.269905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"103'18","reported_seq":215,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.656279+0000","last_change":"2024-09-12T17:05:55.559204+0000","last_active":"2024-09-12T17:09:02.656279+0000","last_peered":"2024-09-12T17:09:02.656279+0000","last_clean":"2024-09-12T17:09:02.656279+0000","last_became_active":"2024-09-12T17:05:55.556488+0000","last_became_peered":"2024-09-12T17:05:55.556488+0000","last_unstale":"2024-09-12T17:09:02.656279+0000","last_undegraded":"2024-09-12T17:09:02.656279+0000","last_fullsized":"2024-09-12T17:09:02.656279+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:19:15.167640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111231+0000","last_change":"2024-09-12T17:08:18.461886+0000","last_active":"2024-09-12T17:08:35.111231+0000","last_peered":"2024-09-12T17:08:35.111231+0000","last_clean":"2024-09-12T17:08:35.111231+0000","last_became_active":"2024-09-12T17:08:18.460345+0000","last_became_peered":"2024-09-12T17:08:18.460345+0000","last_unstale":"2024-09-12T17:08:35.111231+0000","last_undegraded":"2024-09-12T17:08:35.111231+0000","last_fullsized":"2024-09-12T17:08:35.111231+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:13:30.011702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"68'6","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212463+0000","last_change":"2024-09-12T17:05:49.562360+0000","last_active":"2024-09-12T17:08:35.212463+0000","last_peered":"2024-09-12T17:08:35.212463+0000","last_clean":"2024-09-12T17:08:35.212463+0000","last_became_active":"2024-09-12T17:05:49.561200+0000","last_became_peered":"2024-09-12T17:05:49.561200+0000","last_unstale":"2024-09-12T17:08:35.212463+0000","last_undegraded":"2024-09-12T17:08:35.212463+0000","last_fullsized":"2024-09-12T17:08:35.212463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:19.915600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"103'12","reported_seq":189,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.111824+0000","last_change":"2024-09-12T17:05:47.542018+0000","last_active":"2024-09-12T17:09:03.111824+0000","last_peered":"2024-09-12T17:09:03.111824+0000","last_clean":"2024-09-12T17:09:03.111824+0000","last_became_active":"2024-09-12T17:05:47.540484+0000","last_became_peered":"2024-09-12T17:05:47.540484+0000","last_unstale":"2024-09-12T17:09:03.111824+0000","last_undegraded":"2024-09-12T17:09:03.111824+0000","last_fullsized":"2024-09-12T17:09:03.111824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:13.571666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24585,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.619866+0000","last_change":"2024-09-12T17:05:51.556083+0000","last_active":"2024-09-12T17:09:02.619866+0000","last_peered":"2024-09-12T17:09:02.619866+0000","last_clean":"2024-09-12T17:09:02.619866+0000","last_became_active":"2024-09-12T17:05:51.554176+0000","last_became_peered":"2024-09-12T17:05:51.554176+0000","last_unstale":"2024-09-12T17:09:02.619866+0000","last_undegraded":"2024-09-12T17:09:02.619866+0000","last_fullsized":"2024-09-12T17:09:02.619866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:02.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024529+0000","last_change":"2024-09-12T17:05:53.553304+0000","last_active":"2024-09-12T17:08:36.024529+0000","last_peered":"2024-09-12T17:08:36.024529+0000","last_clean":"2024-09-12T17:08:36.024529+0000","last_became_active":"2024-09-12T17:05:53.552545+0000","last_became_peered":"2024-09-12T17:05:53.552545+0000","last_unstale":"2024-09-12T17:08:36.024529+0000","last_undegraded":"2024-09-12T17:08:36.024529+0000","last_fullsized":"2024-09-12T17:08:36.024529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"103'20","reported_seq":234,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.659114+0000","last_change":"2024-09-12T17:08:18.628128+0000","last_active":"2024-09-12T17:09:02.659114+0000","last_peered":"2024-09-12T17:09:02.659114+0000","last_clean":"2024-09-12T17:09:02.659114+0000","last_became_active":"2024-09-12T17:08:18.471539+0000","last_became_peered":"2024-09-12T17:08:18.471539+0000","last_unstale":"2024-09-12T17:09:02.659114+0000","last_undegraded":"2024-09-12T17:09:02.659114+0000","last_fullsized":"2024-09-12T17:09:02.659114+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:47.486729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210930+0000","last_change":"2024-09-12T17:05:57.597870+0000","last_active":"2024-09-12T17:08:35.210930+0000","last_peered":"2024-09-12T17:08:35.210930+0000","last_clean":"2024-09-12T17:08:35.210930+0000","last_became_active":"2024-09-12T17:05:57.597076+0000","last_became_peered":"2024-09-12T17:05:57.597076+0000","last_unstale":"2024-09-12T17:08:35.210930+0000","last_undegraded":"2024-09-12T17:08:35.210930+0000","last_fullsized":"2024-09-12T17:08:35.210930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.648974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"68'6","reported_seq":43,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114680+0000","last_change":"2024-09-12T17:08:18.887494+0000","last_active":"2024-09-12T17:08:35.114680+0000","last_peered":"2024-09-12T17:08:35.114680+0000","last_clean":"2024-09-12T17:08:35.114680+0000","last_became_active":"2024-09-12T17:08:18.457423+0000","last_became_peered":"2024-09-12T17:08:18.457423+0000","last_unstale":"2024-09-12T17:08:35.114680+0000","last_undegraded":"2024-09-12T17:08:35.114680+0000","last_fullsized":"2024-09-12T17:08:35.114680+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:59.827727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"103'16","reported_seq":224,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.034251+0000","last_change":"2024-09-12T17:08:18.702553+0000","last_active":"2024-09-12T17:09:03.034251+0000","last_peered":"2024-09-12T17:09:03.034251+0000","last_clean":"2024-09-12T17:09:03.034251+0000","last_became_active":"2024-09-12T17:08:18.449468+0000","last_became_peered":"2024-09-12T17:08:18.449468+0000","last_unstale":"2024-09-12T17:09:03.034251+0000","last_undegraded":"2024-09-12T17:09:03.034251+0000","last_fullsized":"2024-09-12T17:09:03.034251+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:11:54.548414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":28678,"num_write":32,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212218+0000","last_change":"2024-09-12T17:05:51.540047+0000","last_active":"2024-09-12T17:08:35.212218+0000","last_peered":"2024-09-12T17:08:35.212218+0000","last_clean":"2024-09-12T17:08:35.212218+0000","last_became_active":"2024-09-12T17:05:51.539302+0000","last_became_peered":"2024-09-12T17:05:51.539302+0000","last_unstale":"2024-09-12T17:08:35.212218+0000","last_undegraded":"2024-09-12T17:08:35.212218+0000","last_fullsized":"2024-09-12T17:08:35.212218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:21.253801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"103'27","reported_seq":244,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.129426+0000","last_change":"2024-09-12T17:08:21.515721+0000","last_active":"2024-09-12T17:09:03.129426+0000","last_peered":"2024-09-12T17:09:03.129426+0000","last_clean":"2024-09-12T17:09:03.129426+0000","last_became_active":"2024-09-12T17:08:21.467530+0000","last_became_peered":"2024-09-12T17:08:21.467530+0000","last_unstale":"2024-09-12T17:09:03.129426+0000","last_undegraded":"2024-09-12T17:09:03.129426+0000","last_fullsized":"2024-09-12T17:09:03.129426+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:04.806432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":75,"num_write":30,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":12538,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353193+0000","last_change":"2024-09-12T17:05:55.566749+0000","last_active":"2024-09-12T17:08:35.353193+0000","last_peered":"2024-09-12T17:08:35.353193+0000","last_clean":"2024-09-12T17:08:35.353193+0000","last_became_active":"2024-09-12T17:05:55.565979+0000","last_became_peered":"2024-09-12T17:05:55.565979+0000","last_unstale":"2024-09-12T17:08:35.353193+0000","last_undegraded":"2024-09-12T17:08:35.353193+0000","last_fullsized":"2024-09-12T17:08:35.353193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.394530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113928+0000","last_change":"2024-09-12T17:08:21.461881+0000","last_active":"2024-09-12T17:08:35.113928+0000","last_peered":"2024-09-12T17:08:35.113928+0000","last_clean":"2024-09-12T17:08:35.113928+0000","last_became_active":"2024-09-12T17:08:21.461496+0000","last_became_peered":"2024-09-12T17:08:21.461496+0000","last_unstale":"2024-09-12T17:08:35.113928+0000","last_undegraded":"2024-09-12T17:08:35.113928+0000","last_fullsized":"2024-09-12T17:08:35.113928+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:41.000825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354192+0000","last_change":"2024-09-12T17:05:49.539487+0000","last_active":"2024-09-12T17:08:35.354192+0000","last_peered":"2024-09-12T17:08:35.354192+0000","last_clean":"2024-09-12T17:08:35.354192+0000","last_became_active":"2024-09-12T17:05:49.538713+0000","last_became_peered":"2024-09-12T17:05:49.538713+0000","last_unstale":"2024-09-12T17:08:35.354192+0000","last_undegraded":"2024-09-12T17:08:35.354192+0000","last_fullsized":"2024-09-12T17:08:35.354192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:29:26.731614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":272,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602363+0000","last_change":"2024-09-12T17:05:35.688483+0000","last_active":"2024-09-12T17:08:33.602363+0000","last_peered":"2024-09-12T17:08:33.602363+0000","last_clean":"2024-09-12T17:08:33.602363+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:08:33.602363+0000","last_undegraded":"2024-09-12T17:08:33.602363+0000","last_fullsized":"2024-09-12T17:08:33.602363+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:34.151079+0000","last_clean_scrub_stamp":"2024-09-12T17:05:34.151079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:19.296916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602740+0000","last_change":"2024-09-12T17:05:42.225793+0000","last_active":"2024-09-12T17:08:33.602740+0000","last_peered":"2024-09-12T17:08:33.602740+0000","last_clean":"2024-09-12T17:08:33.602740+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:08:33.602740+0000","last_undegraded":"2024-09-12T17:08:33.602740+0000","last_fullsized":"2024-09-12T17:08:33.602740+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:25:54.880257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"103'20","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.351183+0000","last_change":"2024-09-12T17:05:47.526243+0000","last_active":"2024-09-12T17:09:03.351183+0000","last_peered":"2024-09-12T17:09:03.351183+0000","last_clean":"2024-09-12T17:09:03.351183+0000","last_became_active":"2024-09-12T17:05:47.525694+0000","last_became_peered":"2024-09-12T17:05:47.525694+0000","last_unstale":"2024-09-12T17:09:03.351183+0000","last_undegraded":"2024-09-12T17:09:03.351183+0000","last_fullsized":"2024-09-12T17:09:03.351183+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:08:09.441149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38921,"num_write":44,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606510+0000","last_change":"2024-09-12T17:05:51.548356+0000","last_active":"2024-09-12T17:08:33.606510+0000","last_peered":"2024-09-12T17:08:33.606510+0000","last_clean":"2024-09-12T17:08:33.606510+0000","last_became_active":"2024-09-12T17:05:51.547503+0000","last_became_peered":"2024-09-12T17:05:51.547503+0000","last_unstale":"2024-09-12T17:08:33.606510+0000","last_undegraded":"2024-09-12T17:08:33.606510+0000","last_fullsized":"2024-09-12T17:08:33.606510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:47.030450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"103'42","reported_seq":222,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.376712+0000","last_change":"2024-09-12T17:05:53.546057+0000","last_active":"2024-09-12T17:09:03.376712+0000","last_peered":"2024-09-12T17:09:03.376712+0000","last_clean":"2024-09-12T17:09:03.376712+0000","last_became_active":"2024-09-12T17:05:53.545266+0000","last_became_peered":"2024-09-12T17:05:53.545266+0000","last_unstale":"2024-09-12T17:09:03.376712+0000","last_undegraded":"2024-09-12T17:09:03.376712+0000","last_fullsized":"2024-09-12T17:09:03.376712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":120,"num_write":50,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604135+0000","last_change":"2024-09-12T17:05:55.562246+0000","last_active":"2024-09-12T17:08:33.604135+0000","last_peered":"2024-09-12T17:08:33.604135+0000","last_clean":"2024-09-12T17:08:33.604135+0000","last_became_active":"2024-09-12T17:05:55.561410+0000","last_became_peered":"2024-09-12T17:05:55.561410+0000","last_unstale":"2024-09-12T17:08:33.604135+0000","last_undegraded":"2024-09-12T17:08:33.604135+0000","last_fullsized":"2024-09-12T17:08:33.604135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.373235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"68'2","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352549+0000","last_change":"2024-09-12T17:05:57.593095+0000","last_active":"2024-09-12T17:08:35.352549+0000","last_peered":"2024-09-12T17:08:35.352549+0000","last_clean":"2024-09-12T17:08:35.352549+0000","last_became_active":"2024-09-12T17:05:57.592287+0000","last_became_peered":"2024-09-12T17:05:57.592287+0000","last_unstale":"2024-09-12T17:08:35.352549+0000","last_undegraded":"2024-09-12T17:08:35.352549+0000","last_fullsized":"2024-09-12T17:08:35.352549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:52.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604303+0000","last_change":"2024-09-12T17:08:18.465677+0000","last_active":"2024-09-12T17:08:33.604303+0000","last_peered":"2024-09-12T17:08:33.604303+0000","last_clean":"2024-09-12T17:08:33.604303+0000","last_became_active":"2024-09-12T17:08:18.464334+0000","last_became_peered":"2024-09-12T17:08:18.464334+0000","last_unstale":"2024-09-12T17:08:33.604303+0000","last_undegraded":"2024-09-12T17:08:33.604303+0000","last_fullsized":"2024-09-12T17:08:33.604303+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:26.356922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601919+0000","last_change":"2024-09-12T17:08:21.462733+0000","last_active":"2024-09-12T17:08:33.601919+0000","last_peered":"2024-09-12T17:08:33.601919+0000","last_clean":"2024-09-12T17:08:33.601919+0000","last_became_active":"2024-09-12T17:08:21.461625+0000","last_became_peered":"2024-09-12T17:08:21.461625+0000","last_unstale":"2024-09-12T17:08:33.601919+0000","last_undegraded":"2024-09-12T17:08:33.601919+0000","last_fullsized":"2024-09-12T17:08:33.601919+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:08:09.553944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"103'24","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.250660+0000","last_change":"2024-09-12T17:05:47.544269+0000","last_active":"2024-09-12T17:09:03.250660+0000","last_peered":"2024-09-12T17:09:03.250660+0000","last_clean":"2024-09-12T17:09:03.250660+0000","last_became_active":"2024-09-12T17:05:47.543531+0000","last_became_peered":"2024-09-12T17:05:47.543531+0000","last_unstale":"2024-09-12T17:09:03.250660+0000","last_undegraded":"2024-09-12T17:09:03.250660+0000","last_fullsized":"2024-09-12T17:09:03.250660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:06:55.688363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":40969,"num_write":48,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605269+0000","last_change":"2024-09-12T17:08:18.466066+0000","last_active":"2024-09-12T17:08:33.605269+0000","last_peered":"2024-09-12T17:08:33.605269+0000","last_clean":"2024-09-12T17:08:33.605269+0000","last_became_active":"2024-09-12T17:08:18.465027+0000","last_became_peered":"2024-09-12T17:08:18.465027+0000","last_unstale":"2024-09-12T17:08:33.605269+0000","last_undegraded":"2024-09-12T17:08:33.605269+0000","last_fullsized":"2024-09-12T17:08:33.605269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"103'63","reported_seq":88,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.146760+0000","last_change":"2024-09-12T17:08:21.488130+0000","last_active":"2024-09-12T17:09:03.146760+0000","last_peered":"2024-09-12T17:09:03.146760+0000","last_clean":"2024-09-12T17:09:03.146760+0000","last_became_active":"2024-09-12T17:08:21.455260+0000","last_became_peered":"2024-09-12T17:08:21.455260+0000","last_unstale":"2024-09-12T17:09:03.146760+0000","last_undegraded":"2024-09-12T17:09:03.146760+0000","last_fullsized":"2024-09-12T17:09:03.146760+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:08.863638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":101,"num_read_kb":130,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":5726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606844+0000","last_change":"2024-09-12T17:05:55.556362+0000","last_active":"2024-09-12T17:08:33.606844+0000","last_peered":"2024-09-12T17:08:33.606844+0000","last_clean":"2024-09-12T17:08:33.606844+0000","last_became_active":"2024-09-12T17:05:55.555625+0000","last_became_peered":"2024-09-12T17:05:55.555625+0000","last_unstale":"2024-09-12T17:08:33.606844+0000","last_undegraded":"2024-09-12T17:08:33.606844+0000","last_fullsized":"2024-09-12T17:08:33.606844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"84'6","reported_seq":45,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114189+0000","last_change":"2024-09-12T17:08:18.577521+0000","last_active":"2024-09-12T17:08:35.114189+0000","last_peered":"2024-09-12T17:08:35.114189+0000","last_clean":"2024-09-12T17:08:35.114189+0000","last_became_active":"2024-09-12T17:08:18.446923+0000","last_became_peered":"2024-09-12T17:08:18.446923+0000","last_unstale":"2024-09-12T17:08:35.114189+0000","last_undegraded":"2024-09-12T17:08:35.114189+0000","last_fullsized":"2024-09-12T17:08:35.114189+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:00.600036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114457+0000","last_change":"2024-09-12T17:08:21.457044+0000","last_active":"2024-09-12T17:08:35.114457+0000","last_peered":"2024-09-12T17:08:35.114457+0000","last_clean":"2024-09-12T17:08:35.114457+0000","last_became_active":"2024-09-12T17:08:21.456705+0000","last_became_peered":"2024-09-12T17:08:21.456705+0000","last_unstale":"2024-09-12T17:08:35.114457+0000","last_undegraded":"2024-09-12T17:08:35.114457+0000","last_fullsized":"2024-09-12T17:08:35.114457+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:57.537595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023245+0000","last_change":"2024-09-12T17:05:42.677413+0000","last_active":"2024-09-12T17:08:36.023245+0000","last_peered":"2024-09-12T17:08:36.023245+0000","last_clean":"2024-09-12T17:08:36.023245+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:08:36.023245+0000","last_undegraded":"2024-09-12T17:08:36.023245+0000","last_fullsized":"2024-09-12T17:08:36.023245+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.836885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"103'20","reported_seq":69,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.138347+0000","last_change":"2024-09-12T17:08:18.715809+0000","last_active":"2024-09-12T17:09:03.138347+0000","last_peered":"2024-09-12T17:09:03.138347+0000","last_clean":"2024-09-12T17:09:03.138347+0000","last_became_active":"2024-09-12T17:08:18.446837+0000","last_became_peered":"2024-09-12T17:08:18.446837+0000","last_unstale":"2024-09-12T17:09:03.138347+0000","last_undegraded":"2024-09-12T17:09:03.138347+0000","last_fullsized":"2024-09-12T17:09:03.138347+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:43:22.706896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38918,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":161,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025411+0000","last_change":"2024-09-12T17:05:51.557262+0000","last_active":"2024-09-12T17:08:36.025411+0000","last_peered":"2024-09-12T17:08:36.025411+0000","last_clean":"2024-09-12T17:08:36.025411+0000","last_became_active":"2024-09-12T17:05:51.556959+0000","last_became_peered":"2024-09-12T17:05:51.556959+0000","last_unstale":"2024-09-12T17:08:36.025411+0000","last_undegraded":"2024-09-12T17:08:36.025411+0000","last_fullsized":"2024-09-12T17:08:36.025411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:11.963181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"103'16","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.760375+0000","last_change":"2024-09-12T17:05:53.555384+0000","last_active":"2024-09-12T17:08:36.760375+0000","last_peered":"2024-09-12T17:08:36.760375+0000","last_clean":"2024-09-12T17:08:36.760375+0000","last_became_active":"2024-09-12T17:05:53.554063+0000","last_became_peered":"2024-09-12T17:05:53.554063+0000","last_unstale":"2024-09-12T17:08:36.760375+0000","last_undegraded":"2024-09-12T17:08:36.760375+0000","last_fullsized":"2024-09-12T17:08:36.760375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602091+0000","last_change":"2024-09-12T17:05:55.547595+0000","last_active":"2024-09-12T17:08:33.602091+0000","last_peered":"2024-09-12T17:08:33.602091+0000","last_clean":"2024-09-12T17:08:33.602091+0000","last_became_active":"2024-09-12T17:05:55.546700+0000","last_became_peered":"2024-09-12T17:05:55.546700+0000","last_unstale":"2024-09-12T17:08:33.602091+0000","last_undegraded":"2024-09-12T17:08:33.602091+0000","last_fullsized":"2024-09-12T17:08:33.602091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023225+0000","last_change":"2024-09-12T17:05:57.587955+0000","last_active":"2024-09-12T17:08:36.023225+0000","last_peered":"2024-09-12T17:08:36.023225+0000","last_clean":"2024-09-12T17:08:36.023225+0000","last_became_active":"2024-09-12T17:05:57.587199+0000","last_became_peered":"2024-09-12T17:05:57.587199+0000","last_unstale":"2024-09-12T17:08:36.023225+0000","last_undegraded":"2024-09-12T17:08:36.023225+0000","last_fullsized":"2024-09-12T17:08:36.023225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.422656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114194+0000","last_change":"2024-09-12T17:08:21.456185+0000","last_active":"2024-09-12T17:08:35.114194+0000","last_peered":"2024-09-12T17:08:35.114194+0000","last_clean":"2024-09-12T17:08:35.114194+0000","last_became_active":"2024-09-12T17:08:21.455573+0000","last_became_peered":"2024-09-12T17:08:21.455573+0000","last_unstale":"2024-09-12T17:08:35.114194+0000","last_undegraded":"2024-09-12T17:08:35.114194+0000","last_fullsized":"2024-09-12T17:08:35.114194+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:02:45.008694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604023+0000","last_change":"2024-09-12T17:08:18.708570+0000","last_active":"2024-09-12T17:08:33.604023+0000","last_peered":"2024-09-12T17:08:33.604023+0000","last_clean":"2024-09-12T17:08:33.604023+0000","last_became_active":"2024-09-12T17:08:18.474152+0000","last_became_peered":"2024-09-12T17:08:18.474152+0000","last_unstale":"2024-09-12T17:08:33.604023+0000","last_undegraded":"2024-09-12T17:08:33.604023+0000","last_fullsized":"2024-09-12T17:08:33.604023+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:17.040784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"103'18","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.180222+0000","last_change":"2024-09-12T17:05:47.546543+0000","last_active":"2024-09-12T17:09:03.180222+0000","last_peered":"2024-09-12T17:09:03.180222+0000","last_clean":"2024-09-12T17:09:03.180222+0000","last_became_active":"2024-09-12T17:05:47.545554+0000","last_became_peered":"2024-09-12T17:05:47.545554+0000","last_unstale":"2024-09-12T17:09:03.180222+0000","last_undegraded":"2024-09-12T17:09:03.180222+0000","last_fullsized":"2024-09-12T17:09:03.180222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:07.148131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32771,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602766+0000","last_change":"2024-09-12T17:08:18.451242+0000","last_active":"2024-09-12T17:08:33.602766+0000","last_peered":"2024-09-12T17:08:33.602766+0000","last_clean":"2024-09-12T17:08:33.602766+0000","last_became_active":"2024-09-12T17:08:18.450835+0000","last_became_peered":"2024-09-12T17:08:18.450835+0000","last_unstale":"2024-09-12T17:08:33.602766+0000","last_undegraded":"2024-09-12T17:08:33.602766+0000","last_fullsized":"2024-09-12T17:08:33.602766+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025686+0000","last_change":"2024-09-12T17:05:53.551499+0000","last_active":"2024-09-12T17:08:36.025686+0000","last_peered":"2024-09-12T17:08:36.025686+0000","last_clean":"2024-09-12T17:08:36.025686+0000","last_became_active":"2024-09-12T17:05:53.550857+0000","last_became_peered":"2024-09-12T17:05:53.550857+0000","last_unstale":"2024-09-12T17:08:36.025686+0000","last_undegraded":"2024-09-12T17:08:36.025686+0000","last_fullsized":"2024-09-12T17:08:36.025686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354430+0000","last_change":"2024-09-12T17:05:55.571619+0000","last_active":"2024-09-12T17:08:35.354430+0000","last_peered":"2024-09-12T17:08:35.354430+0000","last_clean":"2024-09-12T17:08:35.354430+0000","last_became_active":"2024-09-12T17:05:55.570991+0000","last_became_peered":"2024-09-12T17:05:55.570991+0000","last_unstale":"2024-09-12T17:08:35.354430+0000","last_undegraded":"2024-09-12T17:08:35.354430+0000","last_fullsized":"2024-09-12T17:08:35.354430+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:00:02.401831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"84'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601534+0000","last_change":"2024-09-12T17:05:57.590482+0000","last_active":"2024-09-12T17:08:33.601534+0000","last_peered":"2024-09-12T17:08:33.601534+0000","last_clean":"2024-09-12T17:08:33.601534+0000","last_became_active":"2024-09-12T17:05:57.589542+0000","last_became_peered":"2024-09-12T17:05:57.589542+0000","last_unstale":"2024-09-12T17:08:33.601534+0000","last_undegraded":"2024-09-12T17:08:33.601534+0000","last_fullsized":"2024-09-12T17:08:33.601534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:20.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114011+0000","last_change":"2024-09-12T17:08:21.464126+0000","last_active":"2024-09-12T17:08:35.114011+0000","last_peered":"2024-09-12T17:08:35.114011+0000","last_clean":"2024-09-12T17:08:35.114011+0000","last_became_active":"2024-09-12T17:08:21.462608+0000","last_became_peered":"2024-09-12T17:08:21.462608+0000","last_unstale":"2024-09-12T17:08:35.114011+0000","last_undegraded":"2024-09-12T17:08:35.114011+0000","last_fullsized":"2024-09-12T17:08:35.114011+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:15.261389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"103'30","reported_seq":214,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.290711+0000","last_change":"2024-09-12T17:05:47.525858+0000","last_active":"2024-09-12T17:09:03.290711+0000","last_peered":"2024-09-12T17:09:03.290711+0000","last_clean":"2024-09-12T17:09:03.290711+0000","last_became_active":"2024-09-12T17:05:47.525258+0000","last_became_peered":"2024-09-12T17:05:47.525258+0000","last_unstale":"2024-09-12T17:09:03.290711+0000","last_undegraded":"2024-09-12T17:09:03.290711+0000","last_fullsized":"2024-09-12T17:09:03.290711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:35.734558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":59401,"num_write":54,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:07.318247+0000","last_change":"2024-09-12T17:09:07.318247+0000","last_active":"2024-09-12T17:09:07.318247+0000","last_peered":"2024-09-12T17:09:07.318247+0000","last_clean":"2024-09-12T17:09:07.318247+0000","last_became_active":"2024-09-12T17:08:18.460435+0000","last_became_peered":"2024-09-12T17:08:18.460435+0000","last_unstale":"2024-09-12T17:09:07.318247+0000","last_undegraded":"2024-09-12T17:09:07.318247+0000","last_fullsized":"2024-09-12T17:09:07.318247+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:07.318140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:07.318140+0000","last_clean_scrub_stamp":"2024-09-12T17:09:07.318140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:33.664197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602556+0000","last_change":"2024-09-12T17:05:51.544848+0000","last_active":"2024-09-12T17:08:33.602556+0000","last_peered":"2024-09-12T17:08:33.602556+0000","last_clean":"2024-09-12T17:08:33.602556+0000","last_became_active":"2024-09-12T17:05:51.544078+0000","last_became_peered":"2024-09-12T17:05:51.544078+0000","last_unstale":"2024-09-12T17:08:33.602556+0000","last_undegraded":"2024-09-12T17:08:33.602556+0000","last_fullsized":"2024-09-12T17:08:33.602556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"103'34","reported_seq":210,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.380912+0000","last_change":"2024-09-12T17:05:53.540181+0000","last_active":"2024-09-12T17:09:03.380912+0000","last_peered":"2024-09-12T17:09:03.380912+0000","last_clean":"2024-09-12T17:09:03.380912+0000","last_became_active":"2024-09-12T17:05:53.539372+0000","last_became_peered":"2024-09-12T17:05:53.539372+0000","last_unstale":"2024-09-12T17:09:03.380912+0000","last_undegraded":"2024-09-12T17:09:03.380912+0000","last_fullsized":"2024-09-12T17:09:03.380912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:58.931466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":59,"num_read_kb":69,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211474+0000","last_change":"2024-09-12T17:05:55.554060+0000","last_active":"2024-09-12T17:08:35.211474+0000","last_peered":"2024-09-12T17:08:35.211474+0000","last_clean":"2024-09-12T17:08:35.211474+0000","last_became_active":"2024-09-12T17:05:55.553263+0000","last_became_peered":"2024-09-12T17:05:55.553263+0000","last_unstale":"2024-09-12T17:08:35.211474+0000","last_undegraded":"2024-09-12T17:08:35.211474+0000","last_fullsized":"2024-09-12T17:08:35.211474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:44.303469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602500+0000","last_change":"2024-09-12T17:05:58.121180+0000","last_active":"2024-09-12T17:08:33.602500+0000","last_peered":"2024-09-12T17:08:33.602500+0000","last_clean":"2024-09-12T17:08:33.602500+0000","last_became_active":"2024-09-12T17:05:58.119755+0000","last_became_peered":"2024-09-12T17:05:58.119755+0000","last_unstale":"2024-09-12T17:08:33.602500+0000","last_undegraded":"2024-09-12T17:08:33.602500+0000","last_fullsized":"2024-09-12T17:08:33.602500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603740+0000","last_change":"2024-09-12T17:05:49.550213+0000","last_active":"2024-09-12T17:08:33.603740+0000","last_peered":"2024-09-12T17:08:33.603740+0000","last_clean":"2024-09-12T17:08:33.603740+0000","last_became_active":"2024-09-12T17:05:49.549583+0000","last_became_peered":"2024-09-12T17:05:49.549583+0000","last_unstale":"2024-09-12T17:08:33.603740+0000","last_undegraded":"2024-09-12T17:08:33.603740+0000","last_fullsized":"2024-09-12T17:08:33.603740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:01:05.085326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"103'20","reported_seq":70,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.331257+0000","last_change":"2024-09-12T17:08:18.869145+0000","last_active":"2024-09-12T17:09:03.331257+0000","last_peered":"2024-09-12T17:09:03.331257+0000","last_clean":"2024-09-12T17:09:03.331257+0000","last_became_active":"2024-09-12T17:08:18.448295+0000","last_became_peered":"2024-09-12T17:08:18.448295+0000","last_unstale":"2024-09-12T17:09:03.331257+0000","last_undegraded":"2024-09-12T17:09:03.331257+0000","last_fullsized":"2024-09-12T17:09:03.331257+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:20.400937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36867,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608651+0000","last_change":"2024-09-12T17:05:42.218804+0000","last_active":"2024-09-12T17:08:33.608651+0000","last_peered":"2024-09-12T17:08:33.608651+0000","last_clean":"2024-09-12T17:08:33.608651+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:08:33.608651+0000","last_undegraded":"2024-09-12T17:08:33.608651+0000","last_fullsized":"2024-09-12T17:08:33.608651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:06:48.189931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353195+0000","last_change":"2024-09-12T17:05:51.545963+0000","last_active":"2024-09-12T17:08:35.353195+0000","last_peered":"2024-09-12T17:08:35.353195+0000","last_clean":"2024-09-12T17:08:35.353195+0000","last_became_active":"2024-09-12T17:05:51.545225+0000","last_became_peered":"2024-09-12T17:05:51.545225+0000","last_unstale":"2024-09-12T17:08:35.353195+0000","last_undegraded":"2024-09-12T17:08:35.353195+0000","last_fullsized":"2024-09-12T17:08:35.353195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:40.407563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"36'14","reported_seq":55,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111954+0000","last_change":"2024-09-12T17:08:18.881993+0000","last_active":"2024-09-12T17:08:35.111954+0000","last_peered":"2024-09-12T17:08:35.111954+0000","last_clean":"2024-09-12T17:08:35.111954+0000","last_became_active":"2024-09-12T17:08:18.456095+0000","last_became_peered":"2024-09-12T17:08:18.456095+0000","last_unstale":"2024-09-12T17:08:35.111954+0000","last_undegraded":"2024-09-12T17:08:35.111954+0000","last_fullsized":"2024-09-12T17:08:35.111954+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:34:37.132692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"103'20","reported_seq":222,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.652459+0000","last_change":"2024-09-12T17:08:21.492858+0000","last_active":"2024-09-12T17:09:02.652459+0000","last_peered":"2024-09-12T17:09:02.652459+0000","last_clean":"2024-09-12T17:09:02.652459+0000","last_became_active":"2024-09-12T17:08:21.467026+0000","last_became_peered":"2024-09-12T17:08:21.467026+0000","last_unstale":"2024-09-12T17:09:02.652459+0000","last_undegraded":"2024-09-12T17:09:02.652459+0000","last_fullsized":"2024-09-12T17:09:02.652459+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:08.135205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.026036+0000","last_change":"2024-09-12T17:05:58.118437+0000","last_active":"2024-09-12T17:08:36.026036+0000","last_peered":"2024-09-12T17:08:36.026036+0000","last_clean":"2024-09-12T17:08:36.026036+0000","last_became_active":"2024-09-12T17:05:58.117710+0000","last_became_peered":"2024-09-12T17:05:58.117710+0000","last_unstale":"2024-09-12T17:08:36.026036+0000","last_undegraded":"2024-09-12T17:08:36.026036+0000","last_fullsized":"2024-09-12T17:08:36.026036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:00.239807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":126,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019063+0000","last_change":"2024-09-12T17:06:27.817661+0000","last_active":"2024-09-12T17:08:36.019063+0000","last_peered":"2024-09-12T17:08:36.019063+0000","last_clean":"2024-09-12T17:08:36.019063+0000","last_became_active":"2024-09-12T17:06:27.817451+0000","last_became_peered":"2024-09-12T17:06:27.817451+0000","last_unstale":"2024-09-12T17:08:36.019063+0000","last_undegraded":"2024-09-12T17:08:36.019063+0000","last_fullsized":"2024-09-12T17:08:36.019063+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:31.000633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"103'14","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.288851+0000","last_change":"2024-09-12T17:05:47.535321+0000","last_active":"2024-09-12T17:09:03.288851+0000","last_peered":"2024-09-12T17:09:03.288851+0000","last_clean":"2024-09-12T17:09:03.288851+0000","last_became_active":"2024-09-12T17:05:47.534790+0000","last_became_peered":"2024-09-12T17:05:47.534790+0000","last_unstale":"2024-09-12T17:09:03.288851+0000","last_undegraded":"2024-09-12T17:09:03.288851+0000","last_fullsized":"2024-09-12T17:09:03.288851+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26627,"num_write":22,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115452+0000","last_change":"2024-09-12T17:08:21.467295+0000","last_active":"2024-09-12T17:08:35.115452+0000","last_peered":"2024-09-12T17:08:35.115452+0000","last_clean":"2024-09-12T17:08:35.115452+0000","last_became_active":"2024-09-12T17:08:21.467016+0000","last_became_peered":"2024-09-12T17:08:21.467016+0000","last_unstale":"2024-09-12T17:08:35.115452+0000","last_undegraded":"2024-09-12T17:08:35.115452+0000","last_fullsized":"2024-09-12T17:08:35.115452+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:24.509905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211005+0000","last_change":"2024-09-12T17:05:51.533668+0000","last_active":"2024-09-12T17:08:35.211005+0000","last_peered":"2024-09-12T17:08:35.211005+0000","last_clean":"2024-09-12T17:08:35.211005+0000","last_became_active":"2024-09-12T17:05:51.532795+0000","last_became_peered":"2024-09-12T17:05:51.532795+0000","last_unstale":"2024-09-12T17:08:35.211005+0000","last_undegraded":"2024-09-12T17:08:35.211005+0000","last_fullsized":"2024-09-12T17:08:35.211005+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.655645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211301+0000","last_change":"2024-09-12T17:05:53.544503+0000","last_active":"2024-09-12T17:08:35.211301+0000","last_peered":"2024-09-12T17:08:35.211301+0000","last_clean":"2024-09-12T17:08:35.211301+0000","last_became_active":"2024-09-12T17:05:53.543495+0000","last_became_peered":"2024-09-12T17:05:53.543495+0000","last_unstale":"2024-09-12T17:08:35.211301+0000","last_undegraded":"2024-09-12T17:08:35.211301+0000","last_fullsized":"2024-09-12T17:08:35.211301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.721968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"103'18","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.659123+0000","last_change":"2024-09-12T17:05:55.567580+0000","last_active":"2024-09-12T17:09:02.659123+0000","last_peered":"2024-09-12T17:09:02.659123+0000","last_clean":"2024-09-12T17:09:02.659123+0000","last_became_active":"2024-09-12T17:05:55.566652+0000","last_became_peered":"2024-09-12T17:05:55.566652+0000","last_unstale":"2024-09-12T17:09:02.659123+0000","last_undegraded":"2024-09-12T17:09:02.659123+0000","last_fullsized":"2024-09-12T17:09:02.659123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:28.904117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"68'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602357+0000","last_change":"2024-09-12T17:05:57.585098+0000","last_active":"2024-09-12T17:08:33.602357+0000","last_peered":"2024-09-12T17:08:33.602357+0000","last_clean":"2024-09-12T17:08:33.602357+0000","last_became_active":"2024-09-12T17:05:57.584326+0000","last_became_peered":"2024-09-12T17:05:57.584326+0000","last_unstale":"2024-09-12T17:08:33.602357+0000","last_undegraded":"2024-09-12T17:08:33.602357+0000","last_fullsized":"2024-09-12T17:08:33.602357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210656+0000","last_change":"2024-09-12T17:05:49.553294+0000","last_active":"2024-09-12T17:08:35.210656+0000","last_peered":"2024-09-12T17:08:35.210656+0000","last_clean":"2024-09-12T17:08:35.210656+0000","last_became_active":"2024-09-12T17:05:49.551726+0000","last_became_peered":"2024-09-12T17:05:49.551726+0000","last_unstale":"2024-09-12T17:08:35.210656+0000","last_undegraded":"2024-09-12T17:08:35.210656+0000","last_fullsized":"2024-09-12T17:08:35.210656+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:50.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"103'12","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.122324+0000","last_change":"2024-09-12T17:08:18.767913+0000","last_active":"2024-09-12T17:09:03.122324+0000","last_peered":"2024-09-12T17:09:03.122324+0000","last_clean":"2024-09-12T17:09:03.122324+0000","last_became_active":"2024-09-12T17:08:18.466136+0000","last_became_peered":"2024-09-12T17:08:18.466136+0000","last_unstale":"2024-09-12T17:09:03.122324+0000","last_undegraded":"2024-09-12T17:09:03.122324+0000","last_fullsized":"2024-09-12T17:09:03.122324+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:20.220833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.355006+0000","last_change":"2024-09-12T17:05:42.680975+0000","last_active":"2024-09-12T17:08:35.355006+0000","last_peered":"2024-09-12T17:08:35.355006+0000","last_clean":"2024-09-12T17:08:35.355006+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:08:35.355006+0000","last_undegraded":"2024-09-12T17:08:35.355006+0000","last_fullsized":"2024-09-12T17:08:35.355006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:39.181825+0000","last_clean_scrub_stamp":"2024-09-12T17:05:39.181825+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:14:06.660350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022223+0000","last_change":"2024-09-12T17:08:18.450093+0000","last_active":"2024-09-12T17:08:36.022223+0000","last_peered":"2024-09-12T17:08:36.022223+0000","last_clean":"2024-09-12T17:08:36.022223+0000","last_became_active":"2024-09-12T17:08:18.449746+0000","last_became_peered":"2024-09-12T17:08:18.449746+0000","last_unstale":"2024-09-12T17:08:36.022223+0000","last_undegraded":"2024-09-12T17:08:36.022223+0000","last_fullsized":"2024-09-12T17:08:36.022223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:17:58.736246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"103'50","reported_seq":233,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.039198+0000","last_change":"2024-09-12T17:05:53.554751+0000","last_active":"2024-09-12T17:09:03.039198+0000","last_peered":"2024-09-12T17:09:03.039198+0000","last_clean":"2024-09-12T17:09:03.039198+0000","last_became_active":"2024-09-12T17:05:53.553914+0000","last_became_peered":"2024-09-12T17:05:53.553914+0000","last_unstale":"2024-09-12T17:09:03.039198+0000","last_undegraded":"2024-09-12T17:09:03.039198+0000","last_fullsized":"2024-09-12T17:09:03.039198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":92,"num_read_kb":158,"num_write":60,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022004+0000","last_change":"2024-09-12T17:08:21.458963+0000","last_active":"2024-09-12T17:08:36.022004+0000","last_peered":"2024-09-12T17:08:36.022004+0000","last_clean":"2024-09-12T17:08:36.022004+0000","last_became_active":"2024-09-12T17:08:21.458521+0000","last_became_peered":"2024-09-12T17:08:21.458521+0000","last_unstale":"2024-09-12T17:08:36.022004+0000","last_undegraded":"2024-09-12T17:08:36.022004+0000","last_fullsized":"2024-09-12T17:08:36.022004+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:56.903898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603355+0000","last_change":"2024-09-12T17:05:57.605829+0000","last_active":"2024-09-12T17:08:33.603355+0000","last_peered":"2024-09-12T17:08:33.603355+0000","last_clean":"2024-09-12T17:08:33.603355+0000","last_became_active":"2024-09-12T17:05:57.605041+0000","last_became_peered":"2024-09-12T17:05:57.605041+0000","last_unstale":"2024-09-12T17:08:33.603355+0000","last_undegraded":"2024-09-12T17:08:33.603355+0000","last_fullsized":"2024-09-12T17:08:33.603355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602885+0000","last_change":"2024-09-12T17:05:57.594498+0000","last_active":"2024-09-12T17:08:33.602885+0000","last_peered":"2024-09-12T17:08:33.602885+0000","last_clean":"2024-09-12T17:08:33.602885+0000","last_became_active":"2024-09-12T17:05:57.590196+0000","last_became_peered":"2024-09-12T17:05:57.590196+0000","last_unstale":"2024-09-12T17:08:33.602885+0000","last_undegraded":"2024-09-12T17:08:33.602885+0000","last_fullsized":"2024-09-12T17:08:33.602885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.543735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212141+0000","last_change":"2024-09-12T17:05:49.562121+0000","last_active":"2024-09-12T17:08:35.212141+0000","last_peered":"2024-09-12T17:08:35.212141+0000","last_clean":"2024-09-12T17:08:35.212141+0000","last_became_active":"2024-09-12T17:05:49.561429+0000","last_became_peered":"2024-09-12T17:05:49.561429+0000","last_unstale":"2024-09-12T17:08:35.212141+0000","last_undegraded":"2024-09-12T17:08:35.212141+0000","last_fullsized":"2024-09-12T17:08:35.212141+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:47.663366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"103'18","reported_seq":197,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.287230+0000","last_change":"2024-09-12T17:05:47.557270+0000","last_active":"2024-09-12T17:09:03.287230+0000","last_peered":"2024-09-12T17:09:03.287230+0000","last_clean":"2024-09-12T17:09:03.287230+0000","last_became_active":"2024-09-12T17:05:47.556417+0000","last_became_peered":"2024-09-12T17:05:47.556417+0000","last_unstale":"2024-09-12T17:09:03.287230+0000","last_undegraded":"2024-09-12T17:09:03.287230+0000","last_fullsized":"2024-09-12T17:09:03.287230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:18:00.210632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32774,"num_write":34,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111337+0000","last_change":"2024-09-12T17:08:18.464941+0000","last_active":"2024-09-12T17:08:35.111337+0000","last_peered":"2024-09-12T17:08:35.111337+0000","last_clean":"2024-09-12T17:08:35.111337+0000","last_became_active":"2024-09-12T17:08:18.464091+0000","last_became_peered":"2024-09-12T17:08:18.464091+0000","last_unstale":"2024-09-12T17:08:35.111337+0000","last_undegraded":"2024-09-12T17:08:35.111337+0000","last_fullsized":"2024-09-12T17:08:35.111337+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:15.952591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"103'20","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.211109+0000","last_change":"2024-09-12T17:05:53.542230+0000","last_active":"2024-09-12T17:09:03.211109+0000","last_peered":"2024-09-12T17:09:03.211109+0000","last_clean":"2024-09-12T17:09:03.211109+0000","last_became_active":"2024-09-12T17:05:53.541653+0000","last_became_peered":"2024-09-12T17:05:53.541653+0000","last_unstale":"2024-09-12T17:09:03.211109+0000","last_undegraded":"2024-09-12T17:09:03.211109+0000","last_fullsized":"2024-09-12T17:09:03.211109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":42,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022656+0000","last_change":"2024-09-12T17:05:55.556535+0000","last_active":"2024-09-12T17:08:36.022656+0000","last_peered":"2024-09-12T17:08:36.022656+0000","last_clean":"2024-09-12T17:08:36.022656+0000","last_became_active":"2024-09-12T17:05:55.555755+0000","last_became_peered":"2024-09-12T17:05:55.555755+0000","last_unstale":"2024-09-12T17:08:36.022656+0000","last_undegraded":"2024-09-12T17:08:36.022656+0000","last_fullsized":"2024-09-12T17:08:36.022656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.707384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"84'2","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025238+0000","last_change":"2024-09-12T17:05:57.593418+0000","last_active":"2024-09-12T17:08:36.025238+0000","last_peered":"2024-09-12T17:08:36.025238+0000","last_clean":"2024-09-12T17:08:36.025238+0000","last_became_active":"2024-09-12T17:05:57.592746+0000","last_became_peered":"2024-09-12T17:05:57.592746+0000","last_unstale":"2024-09-12T17:08:36.025238+0000","last_undegraded":"2024-09-12T17:08:36.025238+0000","last_fullsized":"2024-09-12T17:08:36.025238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:24.794382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"68'6","reported_seq":38,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113920+0000","last_change":"2024-09-12T17:08:21.616789+0000","last_active":"2024-09-12T17:08:35.113920+0000","last_peered":"2024-09-12T17:08:35.113920+0000","last_clean":"2024-09-12T17:08:35.113920+0000","last_became_active":"2024-09-12T17:08:21.466328+0000","last_became_peered":"2024-09-12T17:08:21.466328+0000","last_unstale":"2024-09-12T17:08:35.113920+0000","last_undegraded":"2024-09-12T17:08:35.113920+0000","last_fullsized":"2024-09-12T17:08:35.113920+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:16.524646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"103'12","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.068206+0000","last_change":"2024-09-12T17:05:47.559497+0000","last_active":"2024-09-12T17:09:03.068206+0000","last_peered":"2024-09-12T17:09:03.068206+0000","last_clean":"2024-09-12T17:09:03.068206+0000","last_became_active":"2024-09-12T17:05:47.558641+0000","last_became_peered":"2024-09-12T17:05:47.558641+0000","last_unstale":"2024-09-12T17:09:03.068206+0000","last_undegraded":"2024-09-12T17:09:03.068206+0000","last_fullsized":"2024-09-12T17:09:03.068206+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:37:00.096304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24585,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022987+0000","last_change":"2024-09-12T17:05:51.539784+0000","last_active":"2024-09-12T17:08:36.022987+0000","last_peered":"2024-09-12T17:08:36.022987+0000","last_clean":"2024-09-12T17:08:36.022987+0000","last_became_active":"2024-09-12T17:05:51.539275+0000","last_became_peered":"2024-09-12T17:05:51.539275+0000","last_unstale":"2024-09-12T17:08:36.022987+0000","last_undegraded":"2024-09-12T17:08:36.022987+0000","last_fullsized":"2024-09-12T17:08:36.022987+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"84'6","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600440+0000","last_change":"2024-09-12T17:05:53.544731+0000","last_active":"2024-09-12T17:08:33.600440+0000","last_peered":"2024-09-12T17:08:33.600440+0000","last_clean":"2024-09-12T17:08:33.600440+0000","last_became_active":"2024-09-12T17:05:53.544127+0000","last_became_peered":"2024-09-12T17:05:53.544127+0000","last_unstale":"2024-09-12T17:08:33.600440+0000","last_undegraded":"2024-09-12T17:08:33.600440+0000","last_fullsized":"2024-09-12T17:08:33.600440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:04.351698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604873+0000","last_change":"2024-09-12T17:05:55.571541+0000","last_active":"2024-09-12T17:08:33.604873+0000","last_peered":"2024-09-12T17:08:33.604873+0000","last_clean":"2024-09-12T17:08:33.604873+0000","last_became_active":"2024-09-12T17:05:55.570822+0000","last_became_peered":"2024-09-12T17:05:55.570822+0000","last_unstale":"2024-09-12T17:08:33.604873+0000","last_undegraded":"2024-09-12T17:08:33.604873+0000","last_fullsized":"2024-09-12T17:08:33.604873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'2","reported_seq":165,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602495+0000","last_change":"2024-09-12T17:08:18.704689+0000","last_active":"2024-09-12T17:08:33.602495+0000","last_peered":"2024-09-12T17:08:33.602495+0000","last_clean":"2024-09-12T17:08:33.602495+0000","last_became_active":"2024-09-12T17:08:18.450561+0000","last_became_peered":"2024-09-12T17:08:18.450561+0000","last_unstale":"2024-09-12T17:08:33.602495+0000","last_undegraded":"2024-09-12T17:08:33.602495+0000","last_fullsized":"2024-09-12T17:08:33.602495+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:43.088841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021066+0000","last_change":"2024-09-12T17:05:49.520508+0000","last_active":"2024-09-12T17:08:36.021066+0000","last_peered":"2024-09-12T17:08:36.021066+0000","last_clean":"2024-09-12T17:08:36.021066+0000","last_became_active":"2024-09-12T17:05:49.519721+0000","last_became_peered":"2024-09-12T17:05:49.519721+0000","last_unstale":"2024-09-12T17:08:36.021066+0000","last_undegraded":"2024-09-12T17:08:36.021066+0000","last_fullsized":"2024-09-12T17:08:36.021066+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:12:37.520757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"103'16","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.308419+0000","last_change":"2024-09-12T17:05:47.539549+0000","last_active":"2024-09-12T17:09:03.308419+0000","last_peered":"2024-09-12T17:09:03.308419+0000","last_clean":"2024-09-12T17:09:03.308419+0000","last_became_active":"2024-09-12T17:05:47.538581+0000","last_became_peered":"2024-09-12T17:05:47.538581+0000","last_unstale":"2024-09-12T17:09:03.308419+0000","last_undegraded":"2024-09-12T17:09:03.308419+0000","last_fullsized":"2024-09-12T17:09:03.308419+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:57.448924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601093+0000","last_change":"2024-09-12T17:05:51.530541+0000","last_active":"2024-09-12T17:08:33.601093+0000","last_peered":"2024-09-12T17:08:33.601093+0000","last_clean":"2024-09-12T17:08:33.601093+0000","last_became_active":"2024-09-12T17:05:51.527515+0000","last_became_peered":"2024-09-12T17:05:51.527515+0000","last_unstale":"2024-09-12T17:08:33.601093+0000","last_undegraded":"2024-09-12T17:08:33.601093+0000","last_fullsized":"2024-09-12T17:08:33.601093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"103'20","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.957945+0000","last_change":"2024-09-12T17:05:53.555017+0000","last_active":"2024-09-12T17:09:02.957945+0000","last_peered":"2024-09-12T17:09:02.957945+0000","last_clean":"2024-09-12T17:09:02.957945+0000","last_became_active":"2024-09-12T17:05:53.551154+0000","last_became_peered":"2024-09-12T17:05:53.551154+0000","last_unstale":"2024-09-12T17:09:02.957945+0000","last_undegraded":"2024-09-12T17:09:02.957945+0000","last_fullsized":"2024-09-12T17:09:02.957945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:50.736153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":37,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353172+0000","last_change":"2024-09-12T17:05:55.570872+0000","last_active":"2024-09-12T17:08:35.353172+0000","last_peered":"2024-09-12T17:08:35.353172+0000","last_clean":"2024-09-12T17:08:35.353172+0000","last_became_active":"2024-09-12T17:05:55.570137+0000","last_became_peered":"2024-09-12T17:05:55.570137+0000","last_unstale":"2024-09-12T17:08:35.353172+0000","last_undegraded":"2024-09-12T17:08:35.353172+0000","last_fullsized":"2024-09-12T17:08:35.353172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.684868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602407+0000","last_change":"2024-09-12T17:05:57.597088+0000","last_active":"2024-09-12T17:08:33.602407+0000","last_peered":"2024-09-12T17:08:33.602407+0000","last_clean":"2024-09-12T17:08:33.602407+0000","last_became_active":"2024-09-12T17:05:57.596377+0000","last_became_peered":"2024-09-12T17:05:57.596377+0000","last_unstale":"2024-09-12T17:08:33.602407+0000","last_undegraded":"2024-09-12T17:08:33.602407+0000","last_fullsized":"2024-09-12T17:08:33.602407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"68'2","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021754+0000","last_change":"2024-09-12T17:08:18.478612+0000","last_active":"2024-09-12T17:08:36.021754+0000","last_peered":"2024-09-12T17:08:36.021754+0000","last_clean":"2024-09-12T17:08:36.021754+0000","last_became_active":"2024-09-12T17:08:18.449338+0000","last_became_peered":"2024-09-12T17:08:18.449338+0000","last_unstale":"2024-09-12T17:08:36.021754+0000","last_undegraded":"2024-09-12T17:08:36.021754+0000","last_fullsized":"2024-09-12T17:08:36.021754+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:15:15.864351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"103'12","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:07.676026+0000","last_change":"2024-09-12T17:09:07.676026+0000","last_active":"2024-09-12T17:09:07.676026+0000","last_peered":"2024-09-12T17:09:07.676026+0000","last_clean":"2024-09-12T17:09:07.676026+0000","last_became_active":"2024-09-12T17:05:47.525874+0000","last_became_peered":"2024-09-12T17:05:47.525874+0000","last_unstale":"2024-09-12T17:09:07.676026+0000","last_undegraded":"2024-09-12T17:09:07.676026+0000","last_fullsized":"2024-09-12T17:09:07.676026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:07.675954+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:07.675954+0000","last_clean_scrub_stamp":"2024-09-12T17:09:07.675954+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:27.103026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":18435,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353031+0000","last_change":"2024-09-12T17:05:51.540509+0000","last_active":"2024-09-12T17:08:35.353031+0000","last_peered":"2024-09-12T17:08:35.353031+0000","last_clean":"2024-09-12T17:08:35.353031+0000","last_became_active":"2024-09-12T17:05:51.539607+0000","last_became_peered":"2024-09-12T17:05:51.539607+0000","last_unstale":"2024-09-12T17:08:35.353031+0000","last_undegraded":"2024-09-12T17:08:35.353031+0000","last_fullsized":"2024-09-12T17:08:35.353031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:02.652624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"103'17","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.892143+0000","last_change":"2024-09-12T17:05:53.549324+0000","last_active":"2024-09-12T17:09:02.892143+0000","last_peered":"2024-09-12T17:09:02.892143+0000","last_clean":"2024-09-12T17:09:02.892143+0000","last_became_active":"2024-09-12T17:05:53.548561+0000","last_became_peered":"2024-09-12T17:05:53.548561+0000","last_unstale":"2024-09-12T17:09:02.892143+0000","last_undegraded":"2024-09-12T17:09:02.892143+0000","last_fullsized":"2024-09-12T17:09:02.892143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:47.932776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601440+0000","last_change":"2024-09-12T17:05:55.561467+0000","last_active":"2024-09-12T17:08:33.601440+0000","last_peered":"2024-09-12T17:08:33.601440+0000","last_clean":"2024-09-12T17:08:33.601440+0000","last_became_active":"2024-09-12T17:05:55.560708+0000","last_became_peered":"2024-09-12T17:05:55.560708+0000","last_unstale":"2024-09-12T17:08:33.601440+0000","last_undegraded":"2024-09-12T17:08:33.601440+0000","last_fullsized":"2024-09-12T17:08:33.601440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"84'46","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354839+0000","last_change":"2024-09-12T17:05:49.547097+0000","last_active":"2024-09-12T17:08:35.354839+0000","last_peered":"2024-09-12T17:08:35.354839+0000","last_clean":"2024-09-12T17:08:35.354839+0000","last_became_active":"2024-09-12T17:05:49.546232+0000","last_became_peered":"2024-09-12T17:05:49.546232+0000","last_unstale":"2024-09-12T17:08:35.354839+0000","last_undegraded":"2024-09-12T17:08:35.354839+0000","last_fullsized":"2024-09-12T17:08:35.354839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:20:39.853300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"103'16","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.185162+0000","last_change":"2024-09-12T17:05:47.521779+0000","last_active":"2024-09-12T17:09:03.185162+0000","last_peered":"2024-09-12T17:09:03.185162+0000","last_clean":"2024-09-12T17:09:03.185162+0000","last_became_active":"2024-09-12T17:05:47.521097+0000","last_became_peered":"2024-09-12T17:05:47.521097+0000","last_unstale":"2024-09-12T17:09:03.185162+0000","last_undegraded":"2024-09-12T17:09:03.185162+0000","last_fullsized":"2024-09-12T17:09:03.185162+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:37.072896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24579,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604192+0000","last_change":"2024-09-12T17:05:51.525803+0000","last_active":"2024-09-12T17:08:33.604192+0000","last_peered":"2024-09-12T17:08:33.604192+0000","last_clean":"2024-09-12T17:08:33.604192+0000","last_became_active":"2024-09-12T17:05:51.525457+0000","last_became_peered":"2024-09-12T17:05:51.525457+0000","last_unstale":"2024-09-12T17:08:33.604192+0000","last_undegraded":"2024-09-12T17:08:33.604192+0000","last_fullsized":"2024-09-12T17:08:33.604192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"103'35","reported_seq":67,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.360634+0000","last_change":"2024-09-12T17:08:19.023629+0000","last_active":"2024-09-12T17:09:03.360634+0000","last_peered":"2024-09-12T17:09:03.360634+0000","last_clean":"2024-09-12T17:09:03.360634+0000","last_became_active":"2024-09-12T17:08:18.463961+0000","last_became_peered":"2024-09-12T17:08:18.463961+0000","last_unstale":"2024-09-12T17:09:03.360634+0000","last_undegraded":"2024-09-12T17:09:03.360634+0000","last_fullsized":"2024-09-12T17:09:03.360634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:09.409031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":124,"num_write":44,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":16653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603360+0000","last_change":"2024-09-12T17:05:55.563312+0000","last_active":"2024-09-12T17:08:33.603360+0000","last_peered":"2024-09-12T17:08:33.603360+0000","last_clean":"2024-09-12T17:08:33.603360+0000","last_became_active":"2024-09-12T17:05:55.562405+0000","last_became_peered":"2024-09-12T17:05:55.562405+0000","last_unstale":"2024-09-12T17:08:33.603360+0000","last_undegraded":"2024-09-12T17:08:33.603360+0000","last_fullsized":"2024-09-12T17:08:33.603360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022413+0000","last_change":"2024-09-12T17:05:58.121110+0000","last_active":"2024-09-12T17:08:36.022413+0000","last_peered":"2024-09-12T17:08:36.022413+0000","last_clean":"2024-09-12T17:08:36.022413+0000","last_became_active":"2024-09-12T17:05:58.120367+0000","last_became_peered":"2024-09-12T17:05:58.120367+0000","last_unstale":"2024-09-12T17:08:36.022413+0000","last_undegraded":"2024-09-12T17:08:36.022413+0000","last_fullsized":"2024-09-12T17:08:36.022413+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604265+0000","last_change":"2024-09-12T17:05:49.532377+0000","last_active":"2024-09-12T17:08:33.604265+0000","last_peered":"2024-09-12T17:08:33.604265+0000","last_clean":"2024-09-12T17:08:33.604265+0000","last_became_active":"2024-09-12T17:05:49.531975+0000","last_became_peered":"2024-09-12T17:05:49.531975+0000","last_unstale":"2024-09-12T17:08:33.604265+0000","last_undegraded":"2024-09-12T17:08:33.604265+0000","last_fullsized":"2024-09-12T17:08:33.604265+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"103'18","reported_seq":64,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.092357+0000","last_change":"2024-09-12T17:08:19.003420+0000","last_active":"2024-09-12T17:09:03.092357+0000","last_peered":"2024-09-12T17:09:03.092357+0000","last_clean":"2024-09-12T17:09:03.092357+0000","last_became_active":"2024-09-12T17:08:18.457074+0000","last_became_peered":"2024-09-12T17:08:18.457074+0000","last_unstale":"2024-09-12T17:09:03.092357+0000","last_undegraded":"2024-09-12T17:09:03.092357+0000","last_fullsized":"2024-09-12T17:09:03.092357+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:35:07.545826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":36876,"num_write":50,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.354606+0000","last_change":"2024-09-12T17:05:51.546117+0000","last_active":"2024-09-12T17:08:35.354606+0000","last_peered":"2024-09-12T17:08:35.354606+0000","last_clean":"2024-09-12T17:08:35.354606+0000","last_became_active":"2024-09-12T17:05:51.545154+0000","last_became_peered":"2024-09-12T17:05:51.545154+0000","last_unstale":"2024-09-12T17:08:35.354606+0000","last_undegraded":"2024-09-12T17:08:35.354606+0000","last_fullsized":"2024-09-12T17:08:35.354606+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:08:49.670591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"103'23","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.924701+0000","last_change":"2024-09-12T17:05:53.558834+0000","last_active":"2024-09-12T17:09:02.924701+0000","last_peered":"2024-09-12T17:09:02.924701+0000","last_clean":"2024-09-12T17:09:02.924701+0000","last_became_active":"2024-09-12T17:05:53.558086+0000","last_became_peered":"2024-09-12T17:05:53.558086+0000","last_unstale":"2024-09-12T17:09:02.924701+0000","last_undegraded":"2024-09-12T17:09:02.924701+0000","last_fullsized":"2024-09-12T17:09:02.924701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:43.690058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":51,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114479+0000","last_change":"2024-09-12T17:08:21.466904+0000","last_active":"2024-09-12T17:08:35.114479+0000","last_peered":"2024-09-12T17:08:35.114479+0000","last_clean":"2024-09-12T17:08:35.114479+0000","last_became_active":"2024-09-12T17:08:21.466295+0000","last_became_peered":"2024-09-12T17:08:21.466295+0000","last_unstale":"2024-09-12T17:08:35.114479+0000","last_undegraded":"2024-09-12T17:08:35.114479+0000","last_fullsized":"2024-09-12T17:08:35.114479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:22.041235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'2","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352817+0000","last_change":"2024-09-12T17:05:57.597468+0000","last_active":"2024-09-12T17:08:35.352817+0000","last_peered":"2024-09-12T17:08:35.352817+0000","last_clean":"2024-09-12T17:08:35.352817+0000","last_became_active":"2024-09-12T17:05:57.596651+0000","last_became_peered":"2024-09-12T17:05:57.596651+0000","last_unstale":"2024-09-12T17:08:35.352817+0000","last_undegraded":"2024-09-12T17:08:35.352817+0000","last_fullsized":"2024-09-12T17:08:35.352817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.466145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024382+0000","last_change":"2024-09-12T17:08:18.465892+0000","last_active":"2024-09-12T17:08:36.024382+0000","last_peered":"2024-09-12T17:08:36.024382+0000","last_clean":"2024-09-12T17:08:36.024382+0000","last_became_active":"2024-09-12T17:08:18.465478+0000","last_became_peered":"2024-09-12T17:08:18.465478+0000","last_unstale":"2024-09-12T17:08:36.024382+0000","last_undegraded":"2024-09-12T17:08:36.024382+0000","last_fullsized":"2024-09-12T17:08:36.024382+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:00.793079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"103'14","reported_seq":218,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.185988+0000","last_change":"2024-09-12T17:08:18.626808+0000","last_active":"2024-09-12T17:09:03.185988+0000","last_peered":"2024-09-12T17:09:03.185988+0000","last_clean":"2024-09-12T17:09:03.185988+0000","last_became_active":"2024-09-12T17:08:18.447694+0000","last_became_peered":"2024-09-12T17:08:18.447694+0000","last_unstale":"2024-09-12T17:09:03.185988+0000","last_undegraded":"2024-09-12T17:09:03.185988+0000","last_fullsized":"2024-09-12T17:09:03.185988+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:08:09.465286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28675,"num_write":22,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212636+0000","last_change":"2024-09-12T17:05:51.539916+0000","last_active":"2024-09-12T17:08:35.212636+0000","last_peered":"2024-09-12T17:08:35.212636+0000","last_clean":"2024-09-12T17:08:35.212636+0000","last_became_active":"2024-09-12T17:05:51.539054+0000","last_became_peered":"2024-09-12T17:05:51.539054+0000","last_unstale":"2024-09-12T17:08:35.212636+0000","last_undegraded":"2024-09-12T17:08:35.212636+0000","last_fullsized":"2024-09-12T17:08:35.212636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:11.640578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"103'20","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.274969+0000","last_change":"2024-09-12T17:05:53.557081+0000","last_active":"2024-09-12T17:09:03.274969+0000","last_peered":"2024-09-12T17:09:03.274969+0000","last_clean":"2024-09-12T17:09:03.274969+0000","last_became_active":"2024-09-12T17:05:53.556357+0000","last_became_peered":"2024-09-12T17:05:53.556357+0000","last_unstale":"2024-09-12T17:09:03.274969+0000","last_undegraded":"2024-09-12T17:09:03.274969+0000","last_fullsized":"2024-09-12T17:09:03.274969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:10.984649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":42,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115218+0000","last_change":"2024-09-12T17:08:21.461633+0000","last_active":"2024-09-12T17:08:35.115218+0000","last_peered":"2024-09-12T17:08:35.115218+0000","last_clean":"2024-09-12T17:08:35.115218+0000","last_became_active":"2024-09-12T17:08:21.460894+0000","last_became_peered":"2024-09-12T17:08:21.460894+0000","last_unstale":"2024-09-12T17:08:35.115218+0000","last_undegraded":"2024-09-12T17:08:35.115218+0000","last_fullsized":"2024-09-12T17:08:35.115218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:18.857770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601884+0000","last_change":"2024-09-12T17:05:57.596779+0000","last_active":"2024-09-12T17:08:33.601884+0000","last_peered":"2024-09-12T17:08:33.601884+0000","last_clean":"2024-09-12T17:08:33.601884+0000","last_became_active":"2024-09-12T17:05:57.596005+0000","last_became_peered":"2024-09-12T17:05:57.596005+0000","last_unstale":"2024-09-12T17:08:33.601884+0000","last_undegraded":"2024-09-12T17:08:33.601884+0000","last_fullsized":"2024-09-12T17:08:33.601884+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024995+0000","last_change":"2024-09-12T17:08:18.445744+0000","last_active":"2024-09-12T17:08:36.024995+0000","last_peered":"2024-09-12T17:08:36.024995+0000","last_clean":"2024-09-12T17:08:36.024995+0000","last_became_active":"2024-09-12T17:08:18.445415+0000","last_became_peered":"2024-09-12T17:08:18.445415+0000","last_unstale":"2024-09-12T17:08:36.024995+0000","last_undegraded":"2024-09-12T17:08:36.024995+0000","last_fullsized":"2024-09-12T17:08:36.024995+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:12:17.325226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"103'24","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.306577+0000","last_change":"2024-09-12T17:05:47.546051+0000","last_active":"2024-09-12T17:09:03.306577+0000","last_peered":"2024-09-12T17:09:03.306577+0000","last_clean":"2024-09-12T17:09:03.306577+0000","last_became_active":"2024-09-12T17:05:47.545466+0000","last_became_peered":"2024-09-12T17:05:47.545466+0000","last_unstale":"2024-09-12T17:09:03.306577+0000","last_undegraded":"2024-09-12T17:09:03.306577+0000","last_fullsized":"2024-09-12T17:09:03.306577+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:14.012928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":40966,"num_write":40,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114773+0000","last_change":"2024-09-12T17:08:18.457478+0000","last_active":"2024-09-12T17:08:35.114773+0000","last_peered":"2024-09-12T17:08:35.114773+0000","last_clean":"2024-09-12T17:08:35.114773+0000","last_became_active":"2024-09-12T17:08:18.457099+0000","last_became_peered":"2024-09-12T17:08:18.457099+0000","last_unstale":"2024-09-12T17:08:35.114773+0000","last_undegraded":"2024-09-12T17:08:35.114773+0000","last_fullsized":"2024-09-12T17:08:35.114773+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:09:30.371124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"86'12","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212137+0000","last_change":"2024-09-12T17:05:53.561278+0000","last_active":"2024-09-12T17:08:35.212137+0000","last_peered":"2024-09-12T17:08:35.212137+0000","last_clean":"2024-09-12T17:08:35.212137+0000","last_became_active":"2024-09-12T17:05:53.559688+0000","last_became_peered":"2024-09-12T17:05:53.559688+0000","last_unstale":"2024-09-12T17:08:35.212137+0000","last_undegraded":"2024-09-12T17:08:35.212137+0000","last_fullsized":"2024-09-12T17:08:35.212137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:37.392549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":16,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"103'18","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.651046+0000","last_change":"2024-09-12T17:05:55.576227+0000","last_active":"2024-09-12T17:09:02.651046+0000","last_peered":"2024-09-12T17:09:02.651046+0000","last_clean":"2024-09-12T17:09:02.651046+0000","last_became_active":"2024-09-12T17:05:55.571966+0000","last_became_peered":"2024-09-12T17:05:55.571966+0000","last_unstale":"2024-09-12T17:09:02.651046+0000","last_undegraded":"2024-09-12T17:09:02.651046+0000","last_fullsized":"2024-09-12T17:09:02.651046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:24.680106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601043+0000","last_change":"2024-09-12T17:05:57.595153+0000","last_active":"2024-09-12T17:08:33.601043+0000","last_peered":"2024-09-12T17:08:33.601043+0000","last_clean":"2024-09-12T17:08:33.601043+0000","last_became_active":"2024-09-12T17:05:57.594396+0000","last_became_peered":"2024-09-12T17:05:57.594396+0000","last_unstale":"2024-09-12T17:08:33.601043+0000","last_undegraded":"2024-09-12T17:08:33.601043+0000","last_fullsized":"2024-09-12T17:08:33.601043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:27.040243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211051+0000","last_change":"2024-09-12T17:05:49.543269+0000","last_active":"2024-09-12T17:08:35.211051+0000","last_peered":"2024-09-12T17:08:35.211051+0000","last_clean":"2024-09-12T17:08:35.211051+0000","last_became_active":"2024-09-12T17:05:49.542414+0000","last_became_peered":"2024-09-12T17:05:49.542414+0000","last_unstale":"2024-09-12T17:08:35.211051+0000","last_undegraded":"2024-09-12T17:08:35.211051+0000","last_fullsized":"2024-09-12T17:08:35.211051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:57:00.645399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"103'24","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.287532+0000","last_change":"2024-09-12T17:06:27.785226+0000","last_active":"2024-09-12T17:09:03.287532+0000","last_peered":"2024-09-12T17:09:03.287532+0000","last_clean":"2024-09-12T17:09:03.287532+0000","last_became_active":"2024-09-12T17:06:27.784897+0000","last_became_peered":"2024-09-12T17:06:27.784897+0000","last_unstale":"2024-09-12T17:09:03.287532+0000","last_undegraded":"2024-09-12T17:09:03.287532+0000","last_fullsized":"2024-09-12T17:09:03.287532+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:25.368283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":49158,"num_write":40,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604574+0000","last_change":"2024-09-12T17:05:51.528322+0000","last_active":"2024-09-12T17:08:33.604574+0000","last_peered":"2024-09-12T17:08:33.604574+0000","last_clean":"2024-09-12T17:08:33.604574+0000","last_became_active":"2024-09-12T17:05:51.527501+0000","last_became_peered":"2024-09-12T17:05:51.527501+0000","last_unstale":"2024-09-12T17:08:33.604574+0000","last_undegraded":"2024-09-12T17:08:33.604574+0000","last_fullsized":"2024-09-12T17:08:33.604574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"103'24","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.403800+0000","last_change":"2024-09-12T17:08:18.786022+0000","last_active":"2024-09-12T17:09:03.403800+0000","last_peered":"2024-09-12T17:09:03.403800+0000","last_clean":"2024-09-12T17:09:03.403800+0000","last_became_active":"2024-09-12T17:08:18.474969+0000","last_became_peered":"2024-09-12T17:08:18.474969+0000","last_unstale":"2024-09-12T17:09:03.403800+0000","last_undegraded":"2024-09-12T17:09:03.403800+0000","last_fullsized":"2024-09-12T17:09:03.403800+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1889,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.599911+0000","last_change":"2024-09-12T17:05:55.567202+0000","last_active":"2024-09-12T17:08:33.599911+0000","last_peered":"2024-09-12T17:08:33.599911+0000","last_clean":"2024-09-12T17:08:33.599911+0000","last_became_active":"2024-09-12T17:05:55.564710+0000","last_became_peered":"2024-09-12T17:05:55.564710+0000","last_unstale":"2024-09-12T17:08:33.599911+0000","last_undegraded":"2024-09-12T17:08:33.599911+0000","last_fullsized":"2024-09-12T17:08:33.599911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608195+0000","last_change":"2024-09-12T17:05:57.604052+0000","last_active":"2024-09-12T17:08:33.608195+0000","last_peered":"2024-09-12T17:08:33.608195+0000","last_clean":"2024-09-12T17:08:33.608195+0000","last_became_active":"2024-09-12T17:05:57.603285+0000","last_became_peered":"2024-09-12T17:05:57.603285+0000","last_unstale":"2024-09-12T17:08:33.608195+0000","last_undegraded":"2024-09-12T17:08:33.608195+0000","last_fullsized":"2024-09-12T17:08:33.608195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:31.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'6","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211495+0000","last_change":"2024-09-12T17:05:49.548224+0000","last_active":"2024-09-12T17:08:35.211495+0000","last_peered":"2024-09-12T17:08:35.211495+0000","last_clean":"2024-09-12T17:08:35.211495+0000","last_became_active":"2024-09-12T17:05:49.541007+0000","last_became_peered":"2024-09-12T17:05:49.541007+0000","last_unstale":"2024-09-12T17:08:35.211495+0000","last_undegraded":"2024-09-12T17:08:35.211495+0000","last_fullsized":"2024-09-12T17:08:35.211495+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:32:59.768842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"103'8","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.237965+0000","last_change":"2024-09-12T17:05:47.543197+0000","last_active":"2024-09-12T17:09:03.237965+0000","last_peered":"2024-09-12T17:09:03.237965+0000","last_clean":"2024-09-12T17:09:03.237965+0000","last_became_active":"2024-09-12T17:05:47.542345+0000","last_became_peered":"2024-09-12T17:05:47.542345+0000","last_unstale":"2024-09-12T17:09:03.237965+0000","last_undegraded":"2024-09-12T17:09:03.237965+0000","last_fullsized":"2024-09-12T17:09:03.237965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:59:14.858635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602461+0000","last_change":"2024-09-12T17:05:51.556256+0000","last_active":"2024-09-12T17:08:33.602461+0000","last_peered":"2024-09-12T17:08:33.602461+0000","last_clean":"2024-09-12T17:08:33.602461+0000","last_became_active":"2024-09-12T17:05:51.554248+0000","last_became_peered":"2024-09-12T17:05:51.554248+0000","last_unstale":"2024-09-12T17:08:33.602461+0000","last_undegraded":"2024-09-12T17:08:33.602461+0000","last_fullsized":"2024-09-12T17:08:33.602461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"103'17","reported_seq":214,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.416566+0000","last_change":"2024-09-12T17:08:18.486637+0000","last_active":"2024-09-12T17:09:03.416566+0000","last_peered":"2024-09-12T17:09:03.416566+0000","last_clean":"2024-09-12T17:09:03.416566+0000","last_became_active":"2024-09-12T17:08:18.450594+0000","last_became_peered":"2024-09-12T17:08:18.450594+0000","last_unstale":"2024-09-12T17:09:03.416566+0000","last_undegraded":"2024-09-12T17:09:03.416566+0000","last_fullsized":"2024-09-12T17:09:03.416566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352748+0000","last_change":"2024-09-12T17:05:55.567605+0000","last_active":"2024-09-12T17:08:35.352748+0000","last_peered":"2024-09-12T17:08:35.352748+0000","last_clean":"2024-09-12T17:08:35.352748+0000","last_became_active":"2024-09-12T17:05:55.566774+0000","last_became_peered":"2024-09-12T17:05:55.566774+0000","last_unstale":"2024-09-12T17:08:35.352748+0000","last_undegraded":"2024-09-12T17:08:35.352748+0000","last_fullsized":"2024-09-12T17:08:35.352748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:25.935376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025423+0000","last_change":"2024-09-12T17:05:58.121216+0000","last_active":"2024-09-12T17:08:36.025423+0000","last_peered":"2024-09-12T17:08:36.025423+0000","last_clean":"2024-09-12T17:08:36.025423+0000","last_became_active":"2024-09-12T17:05:58.120364+0000","last_became_peered":"2024-09-12T17:05:58.120364+0000","last_unstale":"2024-09-12T17:08:36.025423+0000","last_undegraded":"2024-09-12T17:08:36.025423+0000","last_fullsized":"2024-09-12T17:08:36.025423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021393+0000","last_change":"2024-09-12T17:05:49.549956+0000","last_active":"2024-09-12T17:08:36.021393+0000","last_peered":"2024-09-12T17:08:36.021393+0000","last_clean":"2024-09-12T17:08:36.021393+0000","last_became_active":"2024-09-12T17:05:49.549481+0000","last_became_peered":"2024-09-12T17:05:49.549481+0000","last_unstale":"2024-09-12T17:08:36.021393+0000","last_undegraded":"2024-09-12T17:08:36.021393+0000","last_fullsized":"2024-09-12T17:08:36.021393+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:58.893887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"103'18","reported_seq":197,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.100893+0000","last_change":"2024-09-12T17:05:47.510898+0000","last_active":"2024-09-12T17:09:03.100893+0000","last_peered":"2024-09-12T17:09:03.100893+0000","last_clean":"2024-09-12T17:09:03.100893+0000","last_became_active":"2024-09-12T17:05:47.510462+0000","last_became_peered":"2024-09-12T17:05:47.510462+0000","last_unstale":"2024-09-12T17:09:03.100893+0000","last_undegraded":"2024-09-12T17:09:03.100893+0000","last_fullsized":"2024-09-12T17:09:03.100893+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:30:26.128069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":30726,"num_write":34,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210191+0000","last_change":"2024-09-12T17:05:51.541454+0000","last_active":"2024-09-12T17:08:35.210191+0000","last_peered":"2024-09-12T17:08:35.210191+0000","last_clean":"2024-09-12T17:08:35.210191+0000","last_became_active":"2024-09-12T17:05:51.539938+0000","last_became_peered":"2024-09-12T17:05:51.539938+0000","last_unstale":"2024-09-12T17:08:35.210191+0000","last_undegraded":"2024-09-12T17:08:35.210191+0000","last_fullsized":"2024-09-12T17:08:35.210191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:18.328350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"103'15","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.240033+0000","last_change":"2024-09-12T17:05:53.555764+0000","last_active":"2024-09-12T17:09:03.240033+0000","last_peered":"2024-09-12T17:09:03.240033+0000","last_clean":"2024-09-12T17:09:03.240033+0000","last_became_active":"2024-09-12T17:05:53.552095+0000","last_became_peered":"2024-09-12T17:05:53.552095+0000","last_unstale":"2024-09-12T17:09:03.240033+0000","last_undegraded":"2024-09-12T17:09:03.240033+0000","last_fullsized":"2024-09-12T17:09:03.240033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":43,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210403+0000","last_change":"2024-09-12T17:05:55.571520+0000","last_active":"2024-09-12T17:08:35.210403+0000","last_peered":"2024-09-12T17:08:35.210403+0000","last_clean":"2024-09-12T17:08:35.210403+0000","last_became_active":"2024-09-12T17:05:55.570863+0000","last_became_peered":"2024-09-12T17:05:55.570863+0000","last_unstale":"2024-09-12T17:08:35.210403+0000","last_undegraded":"2024-09-12T17:08:35.210403+0000","last_fullsized":"2024-09-12T17:08:35.210403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607147+0000","last_change":"2024-09-12T17:08:21.467058+0000","last_active":"2024-09-12T17:08:33.607147+0000","last_peered":"2024-09-12T17:08:33.607147+0000","last_clean":"2024-09-12T17:08:33.607147+0000","last_became_active":"2024-09-12T17:08:21.466218+0000","last_became_peered":"2024-09-12T17:08:21.466218+0000","last_unstale":"2024-09-12T17:08:33.607147+0000","last_undegraded":"2024-09-12T17:08:33.607147+0000","last_fullsized":"2024-09-12T17:08:33.607147+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.336998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"84'38","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210705+0000","last_change":"2024-09-12T17:05:49.561555+0000","last_active":"2024-09-12T17:08:35.210705+0000","last_peered":"2024-09-12T17:08:35.210705+0000","last_clean":"2024-09-12T17:08:35.210705+0000","last_became_active":"2024-09-12T17:05:49.560875+0000","last_became_peered":"2024-09-12T17:05:49.560875+0000","last_unstale":"2024-09-12T17:08:35.210705+0000","last_undegraded":"2024-09-12T17:08:35.210705+0000","last_fullsized":"2024-09-12T17:08:35.210705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:32:00.493944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"103'24","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.289877+0000","last_change":"2024-09-12T17:05:47.528128+0000","last_active":"2024-09-12T17:09:03.289877+0000","last_peered":"2024-09-12T17:09:03.289877+0000","last_clean":"2024-09-12T17:09:03.289877+0000","last_became_active":"2024-09-12T17:05:47.527364+0000","last_became_peered":"2024-09-12T17:05:47.527364+0000","last_unstale":"2024-09-12T17:09:03.289877+0000","last_undegraded":"2024-09-12T17:09:03.289877+0000","last_fullsized":"2024-09-12T17:09:03.289877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:20.537156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45062,"num_write":40,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":43,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.111426+0000","last_change":"2024-09-12T17:08:19.007426+0000","last_active":"2024-09-12T17:08:35.111426+0000","last_peered":"2024-09-12T17:08:35.111426+0000","last_clean":"2024-09-12T17:08:35.111426+0000","last_became_active":"2024-09-12T17:08:18.463879+0000","last_became_peered":"2024-09-12T17:08:18.463879+0000","last_unstale":"2024-09-12T17:08:35.111426+0000","last_undegraded":"2024-09-12T17:08:35.111426+0000","last_fullsized":"2024-09-12T17:08:35.111426+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:10.396675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"103'20","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.311364+0000","last_change":"2024-09-12T17:05:53.548391+0000","last_active":"2024-09-12T17:09:03.311364+0000","last_peered":"2024-09-12T17:09:03.311364+0000","last_clean":"2024-09-12T17:09:03.311364+0000","last_became_active":"2024-09-12T17:05:53.547202+0000","last_became_peered":"2024-09-12T17:05:53.547202+0000","last_unstale":"2024-09-12T17:09:03.311364+0000","last_undegraded":"2024-09-12T17:09:03.311364+0000","last_fullsized":"2024-09-12T17:09:03.311364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:00.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":36,"num_read_kb":62,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601272+0000","last_change":"2024-09-12T17:05:55.566243+0000","last_active":"2024-09-12T17:08:33.601272+0000","last_peered":"2024-09-12T17:08:33.601272+0000","last_clean":"2024-09-12T17:08:33.601272+0000","last_became_active":"2024-09-12T17:05:55.565403+0000","last_became_peered":"2024-09-12T17:05:55.565403+0000","last_unstale":"2024-09-12T17:08:33.601272+0000","last_undegraded":"2024-09-12T17:08:33.601272+0000","last_fullsized":"2024-09-12T17:08:33.601272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212872+0000","last_change":"2024-09-12T17:05:57.589526+0000","last_active":"2024-09-12T17:08:35.212872+0000","last_peered":"2024-09-12T17:08:35.212872+0000","last_clean":"2024-09-12T17:08:35.212872+0000","last_became_active":"2024-09-12T17:05:57.588626+0000","last_became_peered":"2024-09-12T17:05:57.588626+0000","last_unstale":"2024-09-12T17:08:35.212872+0000","last_undegraded":"2024-09-12T17:08:35.212872+0000","last_fullsized":"2024-09-12T17:08:35.212872+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.472663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114540+0000","last_change":"2024-09-12T17:08:21.473957+0000","last_active":"2024-09-12T17:08:35.114540+0000","last_peered":"2024-09-12T17:08:35.114540+0000","last_clean":"2024-09-12T17:08:35.114540+0000","last_became_active":"2024-09-12T17:08:21.473677+0000","last_became_peered":"2024-09-12T17:08:21.473677+0000","last_unstale":"2024-09-12T17:08:35.114540+0000","last_undegraded":"2024-09-12T17:08:35.114540+0000","last_fullsized":"2024-09-12T17:08:35.114540+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:04.662160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"103'20","reported_seq":199,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.400960+0000","last_change":"2024-09-12T17:05:47.532523+0000","last_active":"2024-09-12T17:09:03.400960+0000","last_peered":"2024-09-12T17:09:03.400960+0000","last_clean":"2024-09-12T17:09:03.400960+0000","last_became_active":"2024-09-12T17:05:47.531750+0000","last_became_peered":"2024-09-12T17:05:47.531750+0000","last_unstale":"2024-09-12T17:09:03.400960+0000","last_undegraded":"2024-09-12T17:09:03.400960+0000","last_fullsized":"2024-09-12T17:09:03.400960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:04:03.075435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36867,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115367+0000","last_change":"2024-09-12T17:08:21.463425+0000","last_active":"2024-09-12T17:08:35.115367+0000","last_peered":"2024-09-12T17:08:35.115367+0000","last_clean":"2024-09-12T17:08:35.115367+0000","last_became_active":"2024-09-12T17:08:21.462942+0000","last_became_peered":"2024-09-12T17:08:21.462942+0000","last_unstale":"2024-09-12T17:08:35.115367+0000","last_undegraded":"2024-09-12T17:08:35.115367+0000","last_fullsized":"2024-09-12T17:08:35.115367+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:30:35.256332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"103'18","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.350858+0000","last_change":"2024-09-12T17:05:47.526020+0000","last_active":"2024-09-12T17:09:03.350858+0000","last_peered":"2024-09-12T17:09:03.350858+0000","last_clean":"2024-09-12T17:09:03.350858+0000","last_became_active":"2024-09-12T17:05:47.525481+0000","last_became_peered":"2024-09-12T17:05:47.525481+0000","last_unstale":"2024-09-12T17:09:03.350858+0000","last_undegraded":"2024-09-12T17:09:03.350858+0000","last_fullsized":"2024-09-12T17:09:03.350858+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:42:05.949135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34819,"num_write":26,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"84'46","reported_seq":211,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604578+0000","last_change":"2024-09-12T17:05:49.546848+0000","last_active":"2024-09-12T17:08:33.604578+0000","last_peered":"2024-09-12T17:08:33.604578+0000","last_clean":"2024-09-12T17:08:33.604578+0000","last_became_active":"2024-09-12T17:05:49.545382+0000","last_became_peered":"2024-09-12T17:05:49.545382+0000","last_unstale":"2024-09-12T17:08:33.604578+0000","last_undegraded":"2024-09-12T17:08:33.604578+0000","last_fullsized":"2024-09-12T17:08:33.604578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:27:42.832972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"103'16","reported_seq":105,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.303138+0000","last_change":"2024-09-12T17:07:28.249892+0000","last_active":"2024-09-12T17:09:03.303138+0000","last_peered":"2024-09-12T17:09:03.303138+0000","last_clean":"2024-09-12T17:09:03.303138+0000","last_became_active":"2024-09-12T17:07:28.191632+0000","last_became_peered":"2024-09-12T17:07:28.191632+0000","last_unstale":"2024-09-12T17:09:03.303138+0000","last_undegraded":"2024-09-12T17:09:03.303138+0000","last_fullsized":"2024-09-12T17:09:03.303138+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:03.324862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":16390,"num_write":32,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114360+0000","last_change":"2024-09-12T17:08:21.460639+0000","last_active":"2024-09-12T17:08:35.114360+0000","last_peered":"2024-09-12T17:08:35.114360+0000","last_clean":"2024-09-12T17:08:35.114360+0000","last_became_active":"2024-09-12T17:08:21.457133+0000","last_became_peered":"2024-09-12T17:08:21.457133+0000","last_unstale":"2024-09-12T17:08:35.114360+0000","last_undegraded":"2024-09-12T17:08:35.114360+0000","last_fullsized":"2024-09-12T17:08:35.114360+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:58.322770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"103'20","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.326007+0000","last_change":"2024-09-12T17:05:47.530275+0000","last_active":"2024-09-12T17:09:03.326007+0000","last_peered":"2024-09-12T17:09:03.326007+0000","last_clean":"2024-09-12T17:09:03.326007+0000","last_became_active":"2024-09-12T17:05:47.529857+0000","last_became_peered":"2024-09-12T17:05:47.529857+0000","last_unstale":"2024-09-12T17:09:03.326007+0000","last_undegraded":"2024-09-12T17:09:03.326007+0000","last_fullsized":"2024-09-12T17:09:03.326007+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:45:47.999516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32768,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'42","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023289+0000","last_change":"2024-09-12T17:05:49.525070+0000","last_active":"2024-09-12T17:08:36.023289+0000","last_peered":"2024-09-12T17:08:36.023289+0000","last_clean":"2024-09-12T17:08:36.023289+0000","last_became_active":"2024-09-12T17:05:49.524567+0000","last_became_peered":"2024-09-12T17:05:49.524567+0000","last_unstale":"2024-09-12T17:08:36.023289+0000","last_undegraded":"2024-09-12T17:08:36.023289+0000","last_fullsized":"2024-09-12T17:08:36.023289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:29:34.320123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"103'16","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.176287+0000","last_change":"2024-09-12T17:05:47.547765+0000","last_active":"2024-09-12T17:09:03.176287+0000","last_peered":"2024-09-12T17:09:03.176287+0000","last_clean":"2024-09-12T17:09:03.176287+0000","last_became_active":"2024-09-12T17:05:47.547393+0000","last_became_peered":"2024-09-12T17:05:47.547393+0000","last_unstale":"2024-09-12T17:09:03.176287+0000","last_undegraded":"2024-09-12T17:09:03.176287+0000","last_fullsized":"2024-09-12T17:09:03.176287+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:27:46.746261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":30729,"num_write":40,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211792+0000","last_change":"2024-09-12T17:05:49.561711+0000","last_active":"2024-09-12T17:08:35.211792+0000","last_peered":"2024-09-12T17:08:35.211792+0000","last_clean":"2024-09-12T17:08:35.211792+0000","last_became_active":"2024-09-12T17:05:49.560993+0000","last_became_peered":"2024-09-12T17:05:49.560993+0000","last_unstale":"2024-09-12T17:08:35.211792+0000","last_undegraded":"2024-09-12T17:08:35.211792+0000","last_fullsized":"2024-09-12T17:08:35.211792+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:37:38.400338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"103'16","reported_seq":59,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.336200+0000","last_change":"2024-09-12T17:08:21.614989+0000","last_active":"2024-09-12T17:09:03.336200+0000","last_peered":"2024-09-12T17:09:03.336200+0000","last_clean":"2024-09-12T17:09:03.336200+0000","last_became_active":"2024-09-12T17:08:21.461010+0000","last_became_peered":"2024-09-12T17:08:21.461010+0000","last_unstale":"2024-09-12T17:09:03.336200+0000","last_undegraded":"2024-09-12T17:09:03.336200+0000","last_fullsized":"2024-09-12T17:09:03.336200+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:41:52.706435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24579,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"68'2","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.020895+0000","last_change":"2024-09-12T17:08:28.561852+0000","last_active":"2024-09-12T17:08:36.020895+0000","last_peered":"2024-09-12T17:08:36.020895+0000","last_clean":"2024-09-12T17:08:36.020895+0000","last_became_active":"2024-09-12T17:08:28.558588+0000","last_became_peered":"2024-09-12T17:08:28.558588+0000","last_unstale":"2024-09-12T17:08:36.020895+0000","last_undegraded":"2024-09-12T17:08:36.020895+0000","last_fullsized":"2024-09-12T17:08:36.020895+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:55:45.704667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"103'16","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.307376+0000","last_change":"2024-09-12T17:05:47.541213+0000","last_active":"2024-09-12T17:09:03.307376+0000","last_peered":"2024-09-12T17:09:03.307376+0000","last_clean":"2024-09-12T17:09:03.307376+0000","last_became_active":"2024-09-12T17:05:47.540469+0000","last_became_peered":"2024-09-12T17:05:47.540469+0000","last_unstale":"2024-09-12T17:09:03.307376+0000","last_undegraded":"2024-09-12T17:09:03.307376+0000","last_fullsized":"2024-09-12T17:09:03.307376+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:26.620021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":30720,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"84'42","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352596+0000","last_change":"2024-09-12T17:05:49.541113+0000","last_active":"2024-09-12T17:08:35.352596+0000","last_peered":"2024-09-12T17:08:35.352596+0000","last_clean":"2024-09-12T17:08:35.352596+0000","last_became_active":"2024-09-12T17:05:49.540395+0000","last_became_peered":"2024-09-12T17:05:49.540395+0000","last_unstale":"2024-09-12T17:08:35.352596+0000","last_undegraded":"2024-09-12T17:08:35.352596+0000","last_fullsized":"2024-09-12T17:08:35.352596+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:45:32.506502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"103'32","reported_seq":218,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.325273+0000","last_change":"2024-09-12T17:05:47.539986+0000","last_active":"2024-09-12T17:09:03.325273+0000","last_peered":"2024-09-12T17:09:03.325273+0000","last_clean":"2024-09-12T17:09:03.325273+0000","last_became_active":"2024-09-12T17:05:47.539603+0000","last_became_peered":"2024-09-12T17:05:47.539603+0000","last_unstale":"2024-09-12T17:09:03.325273+0000","last_undegraded":"2024-09-12T17:09:03.325273+0000","last_fullsized":"2024-09-12T17:09:03.325273+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":57350,"num_write":48,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603269+0000","last_change":"2024-09-12T17:05:49.533938+0000","last_active":"2024-09-12T17:08:33.603269+0000","last_peered":"2024-09-12T17:08:33.603269+0000","last_clean":"2024-09-12T17:08:33.603269+0000","last_became_active":"2024-09-12T17:05:49.531769+0000","last_became_peered":"2024-09-12T17:05:49.531769+0000","last_unstale":"2024-09-12T17:08:33.603269+0000","last_undegraded":"2024-09-12T17:08:33.603269+0000","last_fullsized":"2024-09-12T17:08:33.603269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:33.763423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"103'20","reported_seq":197,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.356644+0000","last_change":"2024-09-12T17:05:47.525739+0000","last_active":"2024-09-12T17:09:03.356644+0000","last_peered":"2024-09-12T17:09:03.356644+0000","last_clean":"2024-09-12T17:09:03.356644+0000","last_became_active":"2024-09-12T17:05:47.524922+0000","last_became_peered":"2024-09-12T17:05:47.524922+0000","last_unstale":"2024-09-12T17:09:03.356644+0000","last_undegraded":"2024-09-12T17:09:03.356644+0000","last_fullsized":"2024-09-12T17:09:03.356644+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:37.151576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38915,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212448+0000","last_change":"2024-09-12T17:05:49.555307+0000","last_active":"2024-09-12T17:08:35.212448+0000","last_peered":"2024-09-12T17:08:35.212448+0000","last_clean":"2024-09-12T17:08:35.212448+0000","last_became_active":"2024-09-12T17:05:49.554566+0000","last_became_peered":"2024-09-12T17:05:49.554566+0000","last_unstale":"2024-09-12T17:08:35.212448+0000","last_undegraded":"2024-09-12T17:08:35.212448+0000","last_fullsized":"2024-09-12T17:08:35.212448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:45.017623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"103'18","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.325313+0000","last_change":"2024-09-12T17:05:47.543468+0000","last_active":"2024-09-12T17:09:03.325313+0000","last_peered":"2024-09-12T17:09:03.325313+0000","last_clean":"2024-09-12T17:09:03.325313+0000","last_became_active":"2024-09-12T17:05:47.542753+0000","last_became_peered":"2024-09-12T17:05:47.542753+0000","last_unstale":"2024-09-12T17:09:03.325313+0000","last_undegraded":"2024-09-12T17:09:03.325313+0000","last_fullsized":"2024-09-12T17:09:03.325313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:43:11.659435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":34825,"num_write":42,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'34","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024298+0000","last_change":"2024-09-12T17:05:49.536693+0000","last_active":"2024-09-12T17:08:36.024298+0000","last_peered":"2024-09-12T17:08:36.024298+0000","last_clean":"2024-09-12T17:08:36.024298+0000","last_became_active":"2024-09-12T17:05:49.536385+0000","last_became_peered":"2024-09-12T17:05:49.536385+0000","last_unstale":"2024-09-12T17:08:36.024298+0000","last_undegraded":"2024-09-12T17:08:36.024298+0000","last_fullsized":"2024-09-12T17:08:36.024298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:01.024498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"103'10","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.112618+0000","last_change":"2024-09-12T17:05:47.545251+0000","last_active":"2024-09-12T17:09:03.112618+0000","last_peered":"2024-09-12T17:09:03.112618+0000","last_clean":"2024-09-12T17:09:03.112618+0000","last_became_active":"2024-09-12T17:05:47.544406+0000","last_became_peered":"2024-09-12T17:05:47.544406+0000","last_unstale":"2024-09-12T17:09:03.112618+0000","last_undegraded":"2024-09-12T17:09:03.112618+0000","last_fullsized":"2024-09-12T17:09:03.112618+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:12:52.167194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20483,"num_write":18,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"84'38","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212586+0000","last_change":"2024-09-12T17:05:49.564446+0000","last_active":"2024-09-12T17:08:35.212586+0000","last_peered":"2024-09-12T17:08:35.212586+0000","last_clean":"2024-09-12T17:08:35.212586+0000","last_became_active":"2024-09-12T17:05:49.563625+0000","last_became_peered":"2024-09-12T17:05:49.563625+0000","last_unstale":"2024-09-12T17:08:35.212586+0000","last_undegraded":"2024-09-12T17:08:35.212586+0000","last_fullsized":"2024-09-12T17:08:35.212586+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:40:45.324265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"103'20","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.344649+0000","last_change":"2024-09-12T17:05:47.558422+0000","last_active":"2024-09-12T17:09:03.344649+0000","last_peered":"2024-09-12T17:09:03.344649+0000","last_clean":"2024-09-12T17:09:03.344649+0000","last_became_active":"2024-09-12T17:05:47.558047+0000","last_became_peered":"2024-09-12T17:05:47.558047+0000","last_unstale":"2024-09-12T17:09:03.344649+0000","last_undegraded":"2024-09-12T17:09:03.344649+0000","last_fullsized":"2024-09-12T17:09:03.344649+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:08:25.267884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":38912,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604202+0000","last_change":"2024-09-12T17:05:49.522750+0000","last_active":"2024-09-12T17:08:33.604202+0000","last_peered":"2024-09-12T17:08:33.604202+0000","last_clean":"2024-09-12T17:08:33.604202+0000","last_became_active":"2024-09-12T17:05:49.522097+0000","last_became_peered":"2024-09-12T17:05:49.522097+0000","last_unstale":"2024-09-12T17:08:33.604202+0000","last_undegraded":"2024-09-12T17:08:33.604202+0000","last_fullsized":"2024-09-12T17:08:33.604202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:04:54.677796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"103'22","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.296321+0000","last_change":"2024-09-12T17:05:47.552865+0000","last_active":"2024-09-12T17:09:03.296321+0000","last_peered":"2024-09-12T17:09:03.296321+0000","last_clean":"2024-09-12T17:09:03.296321+0000","last_became_active":"2024-09-12T17:05:47.552207+0000","last_became_peered":"2024-09-12T17:05:47.552207+0000","last_unstale":"2024-09-12T17:09:03.296321+0000","last_undegraded":"2024-09-12T17:09:03.296321+0000","last_fullsized":"2024-09-12T17:09:03.296321+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:00.286455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":40969,"num_write":46,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601066+0000","last_change":"2024-09-12T17:08:18.465159+0000","last_active":"2024-09-12T17:08:33.601066+0000","last_peered":"2024-09-12T17:08:33.601066+0000","last_clean":"2024-09-12T17:08:33.601066+0000","last_became_active":"2024-09-12T17:08:18.464823+0000","last_became_peered":"2024-09-12T17:08:18.464823+0000","last_unstale":"2024-09-12T17:08:33.601066+0000","last_undegraded":"2024-09-12T17:08:33.601066+0000","last_fullsized":"2024-09-12T17:08:33.601066+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:08.427170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"103'26","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.305047+0000","last_change":"2024-09-12T17:05:47.561338+0000","last_active":"2024-09-12T17:09:03.305047+0000","last_peered":"2024-09-12T17:09:03.305047+0000","last_clean":"2024-09-12T17:09:03.305047+0000","last_became_active":"2024-09-12T17:05:47.560439+0000","last_became_peered":"2024-09-12T17:05:47.560439+0000","last_unstale":"2024-09-12T17:09:03.305047+0000","last_undegraded":"2024-09-12T17:09:03.305047+0000","last_fullsized":"2024-09-12T17:09:03.305047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:05:58.530869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":51203,"num_write":34,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":124,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601674+0000","last_change":"2024-09-12T17:06:27.819106+0000","last_active":"2024-09-12T17:08:33.601674+0000","last_peered":"2024-09-12T17:08:33.601674+0000","last_clean":"2024-09-12T17:08:33.601674+0000","last_became_active":"2024-09-12T17:06:27.818761+0000","last_became_peered":"2024-09-12T17:06:27.818761+0000","last_unstale":"2024-09-12T17:08:33.601674+0000","last_undegraded":"2024-09-12T17:08:33.601674+0000","last_fullsized":"2024-09-12T17:08:33.601674+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:29.107938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"103'16","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.340446+0000","last_change":"2024-09-12T17:05:47.512066+0000","last_active":"2024-09-12T17:09:03.340446+0000","last_peered":"2024-09-12T17:09:03.340446+0000","last_clean":"2024-09-12T17:09:03.340446+0000","last_became_active":"2024-09-12T17:05:47.511470+0000","last_became_peered":"2024-09-12T17:05:47.511470+0000","last_unstale":"2024-09-12T17:09:03.340446+0000","last_undegraded":"2024-09-12T17:09:03.340446+0000","last_fullsized":"2024-09-12T17:09:03.340446+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:49:38.323322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30723,"num_write":24,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601648+0000","last_change":"2024-09-12T17:05:49.523060+0000","last_active":"2024-09-12T17:08:33.601648+0000","last_peered":"2024-09-12T17:08:33.601648+0000","last_clean":"2024-09-12T17:08:33.601648+0000","last_became_active":"2024-09-12T17:05:49.522157+0000","last_became_peered":"2024-09-12T17:05:49.522157+0000","last_unstale":"2024-09-12T17:08:33.601648+0000","last_undegraded":"2024-09-12T17:08:33.601648+0000","last_fullsized":"2024-09-12T17:08:33.601648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:00:47.930705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"103'10","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.061042+0000","last_change":"2024-09-12T17:05:47.538305+0000","last_active":"2024-09-12T17:09:03.061042+0000","last_peered":"2024-09-12T17:09:03.061042+0000","last_clean":"2024-09-12T17:09:03.061042+0000","last_became_active":"2024-09-12T17:05:47.535569+0000","last_became_peered":"2024-09-12T17:05:47.535569+0000","last_unstale":"2024-09-12T17:09:03.061042+0000","last_undegraded":"2024-09-12T17:09:03.061042+0000","last_fullsized":"2024-09-12T17:09:03.061042+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:04:24.817907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":18432,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"103'10","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.358873+0000","last_change":"2024-09-12T17:05:47.537712+0000","last_active":"2024-09-12T17:09:03.358873+0000","last_peered":"2024-09-12T17:09:03.358873+0000","last_clean":"2024-09-12T17:09:03.358873+0000","last_became_active":"2024-09-12T17:05:47.536958+0000","last_became_peered":"2024-09-12T17:05:47.536958+0000","last_unstale":"2024-09-12T17:09:03.358873+0000","last_undegraded":"2024-09-12T17:09:03.358873+0000","last_fullsized":"2024-09-12T17:09:03.358873+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:26:46.509172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603188+0000","last_change":"2024-09-12T17:05:49.544841+0000","last_active":"2024-09-12T17:08:33.603188+0000","last_peered":"2024-09-12T17:08:33.603188+0000","last_clean":"2024-09-12T17:08:33.603188+0000","last_became_active":"2024-09-12T17:05:49.538757+0000","last_became_peered":"2024-09-12T17:05:49.538757+0000","last_unstale":"2024-09-12T17:08:33.603188+0000","last_undegraded":"2024-09-12T17:08:33.603188+0000","last_fullsized":"2024-09-12T17:08:33.603188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:42:20.976348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"103'14","reported_seq":60,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.142208+0000","last_change":"2024-09-12T17:08:18.573927+0000","last_active":"2024-09-12T17:09:03.142208+0000","last_peered":"2024-09-12T17:09:03.142208+0000","last_clean":"2024-09-12T17:09:03.142208+0000","last_became_active":"2024-09-12T17:08:18.441161+0000","last_became_peered":"2024-09-12T17:08:18.441161+0000","last_unstale":"2024-09-12T17:09:03.142208+0000","last_undegraded":"2024-09-12T17:09:03.142208+0000","last_fullsized":"2024-09-12T17:09:03.142208+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:46.485722+0000","last_clean_scrub_stamp":"2024-09-12T17:05:46.485722+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:13:21.365549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24582,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605089+0000","last_change":"2024-09-12T17:05:49.552327+0000","last_active":"2024-09-12T17:08:33.605089+0000","last_peered":"2024-09-12T17:08:33.605089+0000","last_clean":"2024-09-12T17:08:33.605089+0000","last_became_active":"2024-09-12T17:05:49.551604+0000","last_became_peered":"2024-09-12T17:05:49.551604+0000","last_unstale":"2024-09-12T17:08:33.605089+0000","last_undegraded":"2024-09-12T17:08:33.605089+0000","last_fullsized":"2024-09-12T17:08:33.605089+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:50:55.648527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":40,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":127268,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":1212,"num_read_kb":1590,"num_write":777,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":41697,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":707,"ondisk_log_size":707,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1867,"num_read_kb":1448,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1533,"num_read_kb":2031945,"num_write":1980,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":241172480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542191,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37172,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334668,"statfs":{"total":96636764160,"available":96598700032,"internally_reserved":0,"allocated":1867776,"data_stored":1295858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542192,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36608,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335232,"statfs":{"total":96636764160,"available":96599277568,"internally_reserved":0,"allocated":1249280,"data_stored":704830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542192,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40808,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331032,"statfs":{"total":96636764160,"available":96594976768,"internally_reserved":0,"allocated":1302528,"data_stored":706113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542192,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40720,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331120,"statfs":{"total":96636764160,"available":96595066880,"internally_reserved":0,"allocated":1236992,"data_stored":704328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542192,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36624,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335216,"statfs":{"total":96636764160,"available":96599261184,"internally_reserved":0,"allocated":1269760,"data_stored":705662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542192,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36568,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335272,"statfs":{"total":96636764160,"available":96599318528,"internally_reserved":0,"allocated":1241088,"data_stored":705385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542191,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36644,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335196,"statfs":{"total":96636764160,"available":96599240704,"internally_reserved":0,"allocated":1269760,"data_stored":705099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542192,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37152,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334688,"statfs":{"total":96636764160,"available":96598720512,"internally_reserved":0,"allocated":1851392,"data_stored":1296257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:09:10.347 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.347 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.347 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.347 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.347 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.347 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.347 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.347 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.348 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.348 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.348 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.348 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.348 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.348 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.348 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.348 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.349 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.349 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.349 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.349 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.349 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.349 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.349 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.349 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.349 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.350 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.350 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.350 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.350 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.350 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.350 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.350 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.350 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.350 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.351 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.351 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.351 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.351 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.351 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.351 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.351 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.351 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.351 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.352 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.352 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.352 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.352 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.352 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.352 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.353 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.353 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.353 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.353 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.353 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.353 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.354 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.354 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.354 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.354 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.354 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.354 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.354 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.354 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.354 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.355 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.355 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.355 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.355 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.355 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.355 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.355 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.356 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.356 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.356 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.356 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.356 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.356 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.356 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.357 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.357 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.357 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.357 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.357 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.357 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.357 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.357 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.357 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.358 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.358 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.358 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.358 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.358 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.358 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.358 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.358 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.358 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.358 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.359 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.359 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.359 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.359 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T17:05:34.151079+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=34, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.359 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T17:05:39.181825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.359 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.359 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.359 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.359 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.360 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.360 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.360 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T17:05:39.181825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.360 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.360 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.360 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.360 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.360 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.361 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.361 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T17:05:39.181825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.361 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.361 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.361 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.361 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.361 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.361 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.362 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T17:05:39.181825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.362 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.362 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.362 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.362 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.362 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.363 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.363 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.363 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.363 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.363 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.363 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.363 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.364 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.364 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T17:05:39.181825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.364 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.364 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.364 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.365 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.365 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.365 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.366 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T17:05:39.181825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.366 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.366 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.366 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.366 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.367 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.367 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.367 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T17:05:39.181825+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.367 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.367 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.367 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.368 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.368 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.368 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.368 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.368 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.369 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.369 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.369 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.369 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.370 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.370 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.370 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.370 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.370 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.370 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.371 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.371 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.371 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.371 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.371 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.371 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.371 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.371 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.372 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.372 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.372 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.372 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.372 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.372 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.372 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.372 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.372 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.373 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.373 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.373 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.373 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.373 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.373 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.373 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.374 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.374 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.374 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.374 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.374 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.374 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.374 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.375 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.375 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.375 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.375 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.375 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.375 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.375 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.375 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.375 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.376 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.376 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.376 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.376 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.376 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.376 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.376 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.376 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.377 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.377 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.377 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.377 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.377 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.377 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.377 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.377 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.377 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.378 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.378 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.378 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.378 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.378 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.378 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.378 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.378 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.378 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.379 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.379 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.379 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.379 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.379 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.379 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.379 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.379 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.379 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.380 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.380 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.380 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.380 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.380 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.380 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.380 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.381 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.381 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.381 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.381 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.381 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.381 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.381 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.381 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.381 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.382 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T17:05:46.485722+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.382 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:10.382 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:09:30.383 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:09:30.746 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:09:30.755 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:09:30.762 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-09-12T17:09:30.004584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":719268,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4774,"num_read_kb":2035132,"num_write":3618,"num_write_kb":2050327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":241214307,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2571,"ondisk_log_size":2571,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":310416,"kb_used_data":11024,"kb_used_omap":12,"kb_used_meta":299251,"kb_avail":754664304,"statfs":{"total":773094113280,"available":772776247296,"internally_reserved":0,"allocated":11288576,"data_stored":6823532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":306433584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005876"},"pg_stats":[{"pgid":"3.3f","version":"103'30","reported_seq":223,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.940781+0000","last_change":"2024-09-12T17:09:21.940781+0000","last_active":"2024-09-12T17:09:21.940781+0000","last_peered":"2024-09-12T17:09:21.940781+0000","last_clean":"2024-09-12T17:09:21.940781+0000","last_became_active":"2024-09-12T17:05:47.560791+0000","last_became_peered":"2024-09-12T17:05:47.560791+0000","last_unstale":"2024-09-12T17:09:21.940781+0000","last_undegraded":"2024-09-12T17:09:21.940781+0000","last_fullsized":"2024-09-12T17:09:21.940781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'30","last_scrub_stamp":"2024-09-12T17:09:21.940614+0000","last_deep_scrub":"103'30","last_deep_scrub_stamp":"2024-09-12T17:09:21.940614+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.940614+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:38.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":57356,"num_write":62,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"84'44","reported_seq":220,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.212120+0000","last_change":"2024-09-12T17:09:26.212120+0000","last_active":"2024-09-12T17:09:26.212120+0000","last_peered":"2024-09-12T17:09:26.212120+0000","last_clean":"2024-09-12T17:09:26.212120+0000","last_became_active":"2024-09-12T17:05:49.557287+0000","last_became_peered":"2024-09-12T17:05:49.557287+0000","last_unstale":"2024-09-12T17:09:26.212120+0000","last_undegraded":"2024-09-12T17:09:26.212120+0000","last_fullsized":"2024-09-12T17:09:26.212120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'44","last_scrub_stamp":"2024-09-12T17:09:26.211934+0000","last_deep_scrub":"84'44","last_deep_scrub_stamp":"2024-09-12T17:09:26.211934+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.211934+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:01.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":132,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"103'6","reported_seq":53,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.242144+0000","last_change":"2024-09-12T17:09:13.242144+0000","last_active":"2024-09-12T17:09:13.242144+0000","last_peered":"2024-09-12T17:09:13.242144+0000","last_clean":"2024-09-12T17:09:13.242144+0000","last_became_active":"2024-09-12T17:08:21.462766+0000","last_became_peered":"2024-09-12T17:08:21.462766+0000","last_unstale":"2024-09-12T17:09:13.242144+0000","last_undegraded":"2024-09-12T17:09:13.242144+0000","last_fullsized":"2024-09-12T17:09:13.242144+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'6","last_scrub_stamp":"2024-09-12T17:09:13.241936+0000","last_deep_scrub":"103'6","last_deep_scrub_stamp":"2024-09-12T17:09:13.241936+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.241936+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:39.879138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.945738+0000","last_change":"2024-09-12T17:09:25.945738+0000","last_active":"2024-09-12T17:09:25.945738+0000","last_peered":"2024-09-12T17:09:25.945738+0000","last_clean":"2024-09-12T17:09:25.945738+0000","last_became_active":"2024-09-12T17:08:18.442986+0000","last_became_peered":"2024-09-12T17:08:18.442986+0000","last_unstale":"2024-09-12T17:09:25.945738+0000","last_undegraded":"2024-09-12T17:09:25.945738+0000","last_fullsized":"2024-09-12T17:09:25.945738+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:25.945538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:25.945538+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.945538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:49.096989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"103'24","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.894977+0000","last_change":"2024-09-12T17:09:14.894977+0000","last_active":"2024-09-12T17:09:14.894977+0000","last_peered":"2024-09-12T17:09:14.894977+0000","last_clean":"2024-09-12T17:09:14.894977+0000","last_became_active":"2024-09-12T17:05:47.522544+0000","last_became_peered":"2024-09-12T17:05:47.522544+0000","last_unstale":"2024-09-12T17:09:14.894977+0000","last_undegraded":"2024-09-12T17:09:14.894977+0000","last_fullsized":"2024-09-12T17:09:14.894977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'24","last_scrub_stamp":"2024-09-12T17:09:14.894731+0000","last_deep_scrub":"103'24","last_deep_scrub_stamp":"2024-09-12T17:09:14.894731+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.894731+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:00.211809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":38921,"num_write":48,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"84'34","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211197+0000","last_change":"2024-09-12T17:05:49.549990+0000","last_active":"2024-09-12T17:08:35.211197+0000","last_peered":"2024-09-12T17:08:35.211197+0000","last_clean":"2024-09-12T17:08:35.211197+0000","last_became_active":"2024-09-12T17:05:49.549241+0000","last_became_peered":"2024-09-12T17:05:49.549241+0000","last_unstale":"2024-09-12T17:08:35.211197+0000","last_undegraded":"2024-09-12T17:08:35.211197+0000","last_fullsized":"2024-09-12T17:08:35.211197+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:20:44.601256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"103'16","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.569097+0000","last_change":"2024-09-12T17:09:18.569097+0000","last_active":"2024-09-12T17:09:18.569097+0000","last_peered":"2024-09-12T17:09:18.569097+0000","last_clean":"2024-09-12T17:09:18.569097+0000","last_became_active":"2024-09-12T17:06:27.748390+0000","last_became_peered":"2024-09-12T17:06:27.748390+0000","last_unstale":"2024-09-12T17:09:18.569097+0000","last_undegraded":"2024-09-12T17:09:18.569097+0000","last_fullsized":"2024-09-12T17:09:18.569097+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:18.568906+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:18.568906+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.568906+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:23.913498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":30732,"num_write":48,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.804817+0000","last_change":"2024-09-12T17:09:24.804817+0000","last_active":"2024-09-12T17:09:24.804817+0000","last_peered":"2024-09-12T17:09:24.804817+0000","last_clean":"2024-09-12T17:09:24.804817+0000","last_became_active":"2024-09-12T17:05:49.541354+0000","last_became_peered":"2024-09-12T17:05:49.541354+0000","last_unstale":"2024-09-12T17:09:24.804817+0000","last_undegraded":"2024-09-12T17:09:24.804817+0000","last_fullsized":"2024-09-12T17:09:24.804817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:24.804621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:24.804621+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.804621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:09.476400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"103'12","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.940835+0000","last_change":"2024-09-12T17:09:19.940835+0000","last_active":"2024-09-12T17:09:19.940835+0000","last_peered":"2024-09-12T17:09:19.940835+0000","last_clean":"2024-09-12T17:09:19.940835+0000","last_became_active":"2024-09-12T17:05:47.555396+0000","last_became_peered":"2024-09-12T17:05:47.555396+0000","last_unstale":"2024-09-12T17:09:19.940835+0000","last_undegraded":"2024-09-12T17:09:19.940835+0000","last_fullsized":"2024-09-12T17:09:19.940835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:19.940651+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:19.940651+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.940651+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:22.326811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22534,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.188665+0000","last_change":"2024-09-12T17:09:21.188665+0000","last_active":"2024-09-12T17:09:21.188665+0000","last_peered":"2024-09-12T17:09:21.188665+0000","last_clean":"2024-09-12T17:09:21.188665+0000","last_became_active":"2024-09-12T17:05:49.528184+0000","last_became_peered":"2024-09-12T17:05:49.528184+0000","last_unstale":"2024-09-12T17:09:21.188665+0000","last_undegraded":"2024-09-12T17:09:21.188665+0000","last_fullsized":"2024-09-12T17:09:21.188665+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:21.188458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:21.188458+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.188458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:07.946828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"103'18","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.240091+0000","last_change":"2024-09-12T17:09:19.240091+0000","last_active":"2024-09-12T17:09:19.240091+0000","last_peered":"2024-09-12T17:09:19.240091+0000","last_clean":"2024-09-12T17:09:19.240091+0000","last_became_active":"2024-09-12T17:05:47.531427+0000","last_became_peered":"2024-09-12T17:05:47.531427+0000","last_unstale":"2024-09-12T17:09:19.240091+0000","last_undegraded":"2024-09-12T17:09:19.240091+0000","last_fullsized":"2024-09-12T17:09:19.240091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:19.239908+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:19.239908+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.239908+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:04.556985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34822,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.990422+0000","last_change":"2024-09-12T17:09:27.990422+0000","last_active":"2024-09-12T17:09:27.990422+0000","last_peered":"2024-09-12T17:09:27.990422+0000","last_clean":"2024-09-12T17:09:27.990422+0000","last_became_active":"2024-09-12T17:05:49.549066+0000","last_became_peered":"2024-09-12T17:05:49.549066+0000","last_unstale":"2024-09-12T17:09:27.990422+0000","last_undegraded":"2024-09-12T17:09:27.990422+0000","last_fullsized":"2024-09-12T17:09:27.990422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:27.990182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:27.990182+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.990182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:00.837453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"103'12","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.942250+0000","last_change":"2024-09-12T17:09:18.942250+0000","last_active":"2024-09-12T17:09:18.942250+0000","last_peered":"2024-09-12T17:09:18.942250+0000","last_clean":"2024-09-12T17:09:18.942250+0000","last_became_active":"2024-09-12T17:05:47.559160+0000","last_became_peered":"2024-09-12T17:05:47.559160+0000","last_unstale":"2024-09-12T17:09:18.942250+0000","last_undegraded":"2024-09-12T17:09:18.942250+0000","last_fullsized":"2024-09-12T17:09:18.942250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:18.942025+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:18.942025+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.942025+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:08.090928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'2","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.244390+0000","last_change":"2024-09-12T17:09:27.244390+0000","last_active":"2024-09-12T17:09:27.244390+0000","last_peered":"2024-09-12T17:09:27.244390+0000","last_clean":"2024-09-12T17:09:27.244390+0000","last_became_active":"2024-09-12T17:08:18.471124+0000","last_became_peered":"2024-09-12T17:08:18.471124+0000","last_unstale":"2024-09-12T17:09:27.244390+0000","last_undegraded":"2024-09-12T17:09:27.244390+0000","last_fullsized":"2024-09-12T17:09:27.244390+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-09-12T17:09:27.244205+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-09-12T17:09:27.244205+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.244205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:42.696680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"103'14","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.556355+0000","last_change":"2024-09-12T17:09:17.556355+0000","last_active":"2024-09-12T17:09:17.556355+0000","last_peered":"2024-09-12T17:09:17.556355+0000","last_clean":"2024-09-12T17:09:17.556355+0000","last_became_active":"2024-09-12T17:06:27.748329+0000","last_became_peered":"2024-09-12T17:06:27.748329+0000","last_unstale":"2024-09-12T17:09:17.556355+0000","last_undegraded":"2024-09-12T17:09:17.556355+0000","last_fullsized":"2024-09-12T17:09:17.556355+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'14","last_scrub_stamp":"2024-09-12T17:09:17.556143+0000","last_deep_scrub":"103'14","last_deep_scrub_stamp":"2024-09-12T17:09:17.556143+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.556143+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:50.642631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26633,"num_write":38,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.500908+0000","last_change":"2024-09-12T17:09:13.500908+0000","last_active":"2024-09-12T17:09:13.500908+0000","last_peered":"2024-09-12T17:09:13.500908+0000","last_clean":"2024-09-12T17:09:13.500908+0000","last_became_active":"2024-09-12T17:07:28.190245+0000","last_became_peered":"2024-09-12T17:07:28.190245+0000","last_unstale":"2024-09-12T17:09:13.500908+0000","last_undegraded":"2024-09-12T17:09:13.500908+0000","last_fullsized":"2024-09-12T17:09:13.500908+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:13.500739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:13.500739+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.500739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:56.427917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.924646+0000","last_change":"2024-09-12T17:09:25.924646+0000","last_active":"2024-09-12T17:09:25.924646+0000","last_peered":"2024-09-12T17:09:25.924646+0000","last_clean":"2024-09-12T17:09:25.924646+0000","last_became_active":"2024-09-12T17:05:49.548292+0000","last_became_peered":"2024-09-12T17:05:49.548292+0000","last_unstale":"2024-09-12T17:09:25.924646+0000","last_undegraded":"2024-09-12T17:09:25.924646+0000","last_fullsized":"2024-09-12T17:09:25.924646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:25.924458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:25.924458+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.924458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:24.176688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"103'10","reported_seq":44,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.040006+0000","last_change":"2024-09-12T17:09:20.040006+0000","last_active":"2024-09-12T17:09:20.040006+0000","last_peered":"2024-09-12T17:09:20.040006+0000","last_clean":"2024-09-12T17:09:20.040006+0000","last_became_active":"2024-09-12T17:08:28.568157+0000","last_became_peered":"2024-09-12T17:08:28.568157+0000","last_unstale":"2024-09-12T17:09:20.040006+0000","last_undegraded":"2024-09-12T17:09:20.040006+0000","last_fullsized":"2024-09-12T17:09:20.040006+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'10","last_scrub_stamp":"2024-09-12T17:09:20.039818+0000","last_deep_scrub":"103'10","last_deep_scrub_stamp":"2024-09-12T17:09:20.039818+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.039818+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:48.714577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":18,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.941208+0000","last_change":"2024-09-12T17:09:23.941208+0000","last_active":"2024-09-12T17:09:23.941208+0000","last_peered":"2024-09-12T17:09:23.941208+0000","last_clean":"2024-09-12T17:09:23.941208+0000","last_became_active":"2024-09-12T17:08:18.454062+0000","last_became_peered":"2024-09-12T17:08:18.454062+0000","last_unstale":"2024-09-12T17:09:23.941208+0000","last_undegraded":"2024-09-12T17:09:23.941208+0000","last_fullsized":"2024-09-12T17:09:23.941208+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:23.941028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:23.941028+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.941028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:43.368100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"103'18","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.047458+0000","last_change":"2024-09-12T17:09:12.047458+0000","last_active":"2024-09-12T17:09:12.047458+0000","last_peered":"2024-09-12T17:09:12.047458+0000","last_clean":"2024-09-12T17:09:12.047458+0000","last_became_active":"2024-09-12T17:05:47.527533+0000","last_became_peered":"2024-09-12T17:05:47.527533+0000","last_unstale":"2024-09-12T17:09:12.047458+0000","last_undegraded":"2024-09-12T17:09:12.047458+0000","last_fullsized":"2024-09-12T17:09:12.047458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:12.047250+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:12.047250+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.047250+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:16.254720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34828,"num_write":50,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"84'30","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.260269+0000","last_change":"2024-09-12T17:09:24.260269+0000","last_active":"2024-09-12T17:09:24.260269+0000","last_peered":"2024-09-12T17:09:24.260269+0000","last_clean":"2024-09-12T17:09:24.260269+0000","last_became_active":"2024-09-12T17:05:49.542113+0000","last_became_peered":"2024-09-12T17:05:49.542113+0000","last_unstale":"2024-09-12T17:09:24.260269+0000","last_undegraded":"2024-09-12T17:09:24.260269+0000","last_fullsized":"2024-09-12T17:09:24.260269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'30","last_scrub_stamp":"2024-09-12T17:09:24.260086+0000","last_deep_scrub":"84'30","last_deep_scrub_stamp":"2024-09-12T17:09:24.260086+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.260086+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:07.684537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":90,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"103'20","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.152807+0000","last_change":"2024-09-12T17:09:16.152807+0000","last_active":"2024-09-12T17:09:16.152807+0000","last_peered":"2024-09-12T17:09:16.152807+0000","last_clean":"2024-09-12T17:09:16.152807+0000","last_became_active":"2024-09-12T17:05:47.529083+0000","last_became_peered":"2024-09-12T17:05:47.529083+0000","last_unstale":"2024-09-12T17:09:16.152807+0000","last_undegraded":"2024-09-12T17:09:16.152807+0000","last_fullsized":"2024-09-12T17:09:16.152807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:16.152512+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:16.152512+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.152512+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:12.663244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":40969,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.566057+0000","last_change":"2024-09-12T17:09:20.566057+0000","last_active":"2024-09-12T17:09:20.566057+0000","last_peered":"2024-09-12T17:09:20.566057+0000","last_clean":"2024-09-12T17:09:20.566057+0000","last_became_active":"2024-09-12T17:05:49.539930+0000","last_became_peered":"2024-09-12T17:05:49.539930+0000","last_unstale":"2024-09-12T17:09:20.566057+0000","last_undegraded":"2024-09-12T17:09:20.566057+0000","last_fullsized":"2024-09-12T17:09:20.566057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:20.565878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:20.565878+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.565878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:07.628948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"103'12","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.795775+0000","last_change":"2024-09-12T17:09:17.795775+0000","last_active":"2024-09-12T17:09:17.795775+0000","last_peered":"2024-09-12T17:09:17.795775+0000","last_clean":"2024-09-12T17:09:17.795775+0000","last_became_active":"2024-09-12T17:05:47.547430+0000","last_became_peered":"2024-09-12T17:05:47.547430+0000","last_unstale":"2024-09-12T17:09:17.795775+0000","last_undegraded":"2024-09-12T17:09:17.795775+0000","last_fullsized":"2024-09-12T17:09:17.795775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:17.795587+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:17.795587+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.795587+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:55.111652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.615335+0000","last_change":"2024-09-12T17:09:19.615335+0000","last_active":"2024-09-12T17:09:19.615335+0000","last_peered":"2024-09-12T17:09:19.615335+0000","last_clean":"2024-09-12T17:09:19.615335+0000","last_became_active":"2024-09-12T17:05:49.555033+0000","last_became_peered":"2024-09-12T17:05:49.555033+0000","last_unstale":"2024-09-12T17:09:19.615335+0000","last_undegraded":"2024-09-12T17:09:19.615335+0000","last_fullsized":"2024-09-12T17:09:19.615335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:19.615134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:19.615134+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.615134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:12.797854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"103'20","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.348393+0000","last_change":"2024-09-12T17:09:17.348393+0000","last_active":"2024-09-12T17:09:17.348393+0000","last_peered":"2024-09-12T17:09:17.348393+0000","last_clean":"2024-09-12T17:09:17.348393+0000","last_became_active":"2024-09-12T17:05:47.510364+0000","last_became_peered":"2024-09-12T17:05:47.510364+0000","last_unstale":"2024-09-12T17:09:17.348393+0000","last_undegraded":"2024-09-12T17:09:17.348393+0000","last_fullsized":"2024-09-12T17:09:17.348393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:17.348116+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:17.348116+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.348116+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:00.772566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":38912,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.972078+0000","last_change":"2024-09-12T17:09:26.972078+0000","last_active":"2024-09-12T17:09:26.972078+0000","last_peered":"2024-09-12T17:09:26.972078+0000","last_clean":"2024-09-12T17:09:26.972078+0000","last_became_active":"2024-09-12T17:08:18.447353+0000","last_became_peered":"2024-09-12T17:08:18.447353+0000","last_unstale":"2024-09-12T17:09:26.972078+0000","last_undegraded":"2024-09-12T17:09:26.972078+0000","last_fullsized":"2024-09-12T17:09:26.972078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:26.971893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:26.971893+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.971893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.812113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"103'8","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.888506+0000","last_change":"2024-09-12T17:09:15.888506+0000","last_active":"2024-09-12T17:09:15.888506+0000","last_peered":"2024-09-12T17:09:15.888506+0000","last_clean":"2024-09-12T17:09:15.888506+0000","last_became_active":"2024-09-12T17:08:18.467826+0000","last_became_peered":"2024-09-12T17:08:18.467826+0000","last_unstale":"2024-09-12T17:09:15.888506+0000","last_undegraded":"2024-09-12T17:09:15.888506+0000","last_fullsized":"2024-09-12T17:09:15.888506+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'8","last_scrub_stamp":"2024-09-12T17:09:15.888324+0000","last_deep_scrub":"103'8","last_deep_scrub_stamp":"2024-09-12T17:09:15.888324+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.888324+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:27.359384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14339,"num_write":16,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10485760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"84'2","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210149+0000","last_change":"2024-09-12T17:05:57.588515+0000","last_active":"2024-09-12T17:08:35.210149+0000","last_peered":"2024-09-12T17:08:35.210149+0000","last_clean":"2024-09-12T17:08:35.210149+0000","last_became_active":"2024-09-12T17:05:57.587891+0000","last_became_peered":"2024-09-12T17:05:57.587891+0000","last_unstale":"2024-09-12T17:08:35.210149+0000","last_undegraded":"2024-09-12T17:08:35.210149+0000","last_fullsized":"2024-09-12T17:08:35.210149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:16:24.257847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.396852+0000","last_change":"2024-09-12T17:09:19.396852+0000","last_active":"2024-09-12T17:09:19.396852+0000","last_peered":"2024-09-12T17:09:19.396852+0000","last_clean":"2024-09-12T17:09:19.396852+0000","last_became_active":"2024-09-12T17:08:21.457526+0000","last_became_peered":"2024-09-12T17:08:21.457526+0000","last_unstale":"2024-09-12T17:09:19.396852+0000","last_undegraded":"2024-09-12T17:09:19.396852+0000","last_fullsized":"2024-09-12T17:09:19.396852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:19.396639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:19.396639+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.396639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:55.115521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"103'20","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.894432+0000","last_change":"2024-09-12T17:09:15.894432+0000","last_active":"2024-09-12T17:09:15.894432+0000","last_peered":"2024-09-12T17:09:15.894432+0000","last_clean":"2024-09-12T17:09:15.894432+0000","last_became_active":"2024-09-12T17:05:47.556980+0000","last_became_peered":"2024-09-12T17:05:47.556980+0000","last_unstale":"2024-09-12T17:09:15.894432+0000","last_undegraded":"2024-09-12T17:09:15.894432+0000","last_fullsized":"2024-09-12T17:09:15.894432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:15.894179+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:15.894179+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.894179+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:28.189296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38921,"num_write":44,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606120+0000","last_change":"2024-09-12T17:08:18.472276+0000","last_active":"2024-09-12T17:08:33.606120+0000","last_peered":"2024-09-12T17:08:33.606120+0000","last_clean":"2024-09-12T17:08:33.606120+0000","last_became_active":"2024-09-12T17:08:18.471264+0000","last_became_peered":"2024-09-12T17:08:18.471264+0000","last_unstale":"2024-09-12T17:08:33.606120+0000","last_undegraded":"2024-09-12T17:08:33.606120+0000","last_fullsized":"2024-09-12T17:08:33.606120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:18:10.434396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"103'18","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.076371+0000","last_change":"2024-09-12T17:05:53.537592+0000","last_active":"2024-09-12T17:09:03.076371+0000","last_peered":"2024-09-12T17:09:03.076371+0000","last_clean":"2024-09-12T17:09:03.076371+0000","last_became_active":"2024-09-12T17:05:53.536921+0000","last_became_peered":"2024-09-12T17:05:53.536921+0000","last_unstale":"2024-09-12T17:09:03.076371+0000","last_undegraded":"2024-09-12T17:09:03.076371+0000","last_fullsized":"2024-09-12T17:09:03.076371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:25:25.788309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":50,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607496+0000","last_change":"2024-09-12T17:05:55.559431+0000","last_active":"2024-09-12T17:08:33.607496+0000","last_peered":"2024-09-12T17:08:33.607496+0000","last_clean":"2024-09-12T17:08:33.607496+0000","last_became_active":"2024-09-12T17:05:55.558297+0000","last_became_peered":"2024-09-12T17:05:55.558297+0000","last_unstale":"2024-09-12T17:08:33.607496+0000","last_undegraded":"2024-09-12T17:08:33.607496+0000","last_fullsized":"2024-09-12T17:08:33.607496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"84'4","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601882+0000","last_change":"2024-09-12T17:05:57.592599+0000","last_active":"2024-09-12T17:08:33.601882+0000","last_peered":"2024-09-12T17:08:33.601882+0000","last_clean":"2024-09-12T17:08:33.601882+0000","last_became_active":"2024-09-12T17:05:57.591877+0000","last_became_peered":"2024-09-12T17:05:57.591877+0000","last_unstale":"2024-09-12T17:08:33.601882+0000","last_undegraded":"2024-09-12T17:08:33.601882+0000","last_fullsized":"2024-09-12T17:08:33.601882+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:58:57.557525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"68'6","reported_seq":179,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.304923+0000","last_change":"2024-09-12T17:09:21.304923+0000","last_active":"2024-09-12T17:09:21.304923+0000","last_peered":"2024-09-12T17:09:21.304923+0000","last_clean":"2024-09-12T17:09:21.304923+0000","last_became_active":"2024-09-12T17:05:49.544425+0000","last_became_peered":"2024-09-12T17:05:49.544425+0000","last_unstale":"2024-09-12T17:09:21.304923+0000","last_undegraded":"2024-09-12T17:09:21.304923+0000","last_fullsized":"2024-09-12T17:09:21.304923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-09-12T17:09:21.304739+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-09-12T17:09:21.304739+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.304739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:00.863153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"103'12","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:06.631792+0000","last_change":"2024-09-12T17:09:06.631792+0000","last_active":"2024-09-12T17:09:06.631792+0000","last_peered":"2024-09-12T17:09:06.631792+0000","last_clean":"2024-09-12T17:09:06.631792+0000","last_became_active":"2024-09-12T17:05:47.534833+0000","last_became_peered":"2024-09-12T17:05:47.534833+0000","last_unstale":"2024-09-12T17:09:06.631792+0000","last_undegraded":"2024-09-12T17:09:06.631792+0000","last_fullsized":"2024-09-12T17:09:06.631792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:06.631723+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:06.631723+0000","last_clean_scrub_stamp":"2024-09-12T17:09:06.631723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:39.456148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023193+0000","last_change":"2024-09-12T17:05:51.533888+0000","last_active":"2024-09-12T17:08:36.023193+0000","last_peered":"2024-09-12T17:08:36.023193+0000","last_clean":"2024-09-12T17:08:36.023193+0000","last_became_active":"2024-09-12T17:05:51.533164+0000","last_became_peered":"2024-09-12T17:05:51.533164+0000","last_unstale":"2024-09-12T17:08:36.023193+0000","last_undegraded":"2024-09-12T17:08:36.023193+0000","last_fullsized":"2024-09-12T17:08:36.023193+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:34:33.007858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"36'6","reported_seq":165,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212582+0000","last_change":"2024-09-12T17:05:53.549534+0000","last_active":"2024-09-12T17:08:35.212582+0000","last_peered":"2024-09-12T17:08:35.212582+0000","last_clean":"2024-09-12T17:08:35.212582+0000","last_became_active":"2024-09-12T17:05:53.548824+0000","last_became_peered":"2024-09-12T17:05:53.548824+0000","last_unstale":"2024-09-12T17:08:35.212582+0000","last_undegraded":"2024-09-12T17:08:35.212582+0000","last_fullsized":"2024-09-12T17:08:35.212582+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:32:47.765832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211657+0000","last_change":"2024-09-12T17:05:55.557468+0000","last_active":"2024-09-12T17:08:35.211657+0000","last_peered":"2024-09-12T17:08:35.211657+0000","last_clean":"2024-09-12T17:08:35.211657+0000","last_became_active":"2024-09-12T17:05:55.556689+0000","last_became_peered":"2024-09-12T17:05:55.556689+0000","last_unstale":"2024-09-12T17:08:35.211657+0000","last_undegraded":"2024-09-12T17:08:35.211657+0000","last_fullsized":"2024-09-12T17:08:35.211657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:56.879576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601144+0000","last_change":"2024-09-12T17:05:57.589569+0000","last_active":"2024-09-12T17:08:33.601144+0000","last_peered":"2024-09-12T17:08:33.601144+0000","last_clean":"2024-09-12T17:08:33.601144+0000","last_became_active":"2024-09-12T17:05:57.588649+0000","last_became_peered":"2024-09-12T17:05:57.588649+0000","last_unstale":"2024-09-12T17:08:33.601144+0000","last_undegraded":"2024-09-12T17:08:33.601144+0000","last_fullsized":"2024-09-12T17:08:33.601144+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"68'10","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.928216+0000","last_change":"2024-09-12T17:09:17.928216+0000","last_active":"2024-09-12T17:09:17.928216+0000","last_peered":"2024-09-12T17:09:17.928216+0000","last_clean":"2024-09-12T17:09:17.928216+0000","last_became_active":"2024-09-12T17:05:49.530687+0000","last_became_peered":"2024-09-12T17:05:49.530687+0000","last_unstale":"2024-09-12T17:09:17.928216+0000","last_undegraded":"2024-09-12T17:09:17.928216+0000","last_fullsized":"2024-09-12T17:09:17.928216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'10","last_scrub_stamp":"2024-09-12T17:09:17.928021+0000","last_deep_scrub":"68'10","last_deep_scrub_stamp":"2024-09-12T17:09:17.928021+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.928021+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:55.208885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"103'18","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.901212+0000","last_change":"2024-09-12T17:09:16.901212+0000","last_active":"2024-09-12T17:09:16.901212+0000","last_peered":"2024-09-12T17:09:16.901212+0000","last_clean":"2024-09-12T17:09:16.901212+0000","last_became_active":"2024-09-12T17:05:47.564189+0000","last_became_peered":"2024-09-12T17:05:47.564189+0000","last_unstale":"2024-09-12T17:09:16.901212+0000","last_undegraded":"2024-09-12T17:09:16.901212+0000","last_fullsized":"2024-09-12T17:09:16.901212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:16.901007+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:16.901007+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.901007+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:44.267397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":34825,"num_write":42,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.026238+0000","last_change":"2024-09-12T17:08:18.465074+0000","last_active":"2024-09-12T17:08:36.026238+0000","last_peered":"2024-09-12T17:08:36.026238+0000","last_clean":"2024-09-12T17:08:36.026238+0000","last_became_active":"2024-09-12T17:08:18.464648+0000","last_became_peered":"2024-09-12T17:08:18.464648+0000","last_unstale":"2024-09-12T17:08:36.026238+0000","last_undegraded":"2024-09-12T17:08:36.026238+0000","last_fullsized":"2024-09-12T17:08:36.026238+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:04.122655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023933+0000","last_change":"2024-09-12T17:05:53.549328+0000","last_active":"2024-09-12T17:08:36.023933+0000","last_peered":"2024-09-12T17:08:36.023933+0000","last_clean":"2024-09-12T17:08:36.023933+0000","last_became_active":"2024-09-12T17:05:53.548968+0000","last_became_peered":"2024-09-12T17:05:53.548968+0000","last_unstale":"2024-09-12T17:08:36.023933+0000","last_undegraded":"2024-09-12T17:08:36.023933+0000","last_fullsized":"2024-09-12T17:08:36.023933+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:36.974950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"103'20","reported_seq":234,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.654674+0000","last_change":"2024-09-12T17:08:21.488239+0000","last_active":"2024-09-12T17:09:02.654674+0000","last_peered":"2024-09-12T17:09:02.654674+0000","last_clean":"2024-09-12T17:09:02.654674+0000","last_became_active":"2024-09-12T17:08:21.464957+0000","last_became_peered":"2024-09-12T17:08:21.464957+0000","last_unstale":"2024-09-12T17:09:02.654674+0000","last_undegraded":"2024-09-12T17:09:02.654674+0000","last_fullsized":"2024-09-12T17:09:02.654674+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:04:20.266320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210946+0000","last_change":"2024-09-12T17:05:58.122522+0000","last_active":"2024-09-12T17:08:35.210946+0000","last_peered":"2024-09-12T17:08:35.210946+0000","last_clean":"2024-09-12T17:08:35.210946+0000","last_became_active":"2024-09-12T17:05:58.121871+0000","last_became_peered":"2024-09-12T17:05:58.121871+0000","last_unstale":"2024-09-12T17:08:35.210946+0000","last_undegraded":"2024-09-12T17:08:35.210946+0000","last_fullsized":"2024-09-12T17:08:35.210946+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:07:22.625236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.400068+0000","last_change":"2024-09-12T17:09:20.400068+0000","last_active":"2024-09-12T17:09:20.400068+0000","last_peered":"2024-09-12T17:09:20.400068+0000","last_clean":"2024-09-12T17:09:20.400068+0000","last_became_active":"2024-09-12T17:05:49.527758+0000","last_became_peered":"2024-09-12T17:05:49.527758+0000","last_unstale":"2024-09-12T17:09:20.400068+0000","last_undegraded":"2024-09-12T17:09:20.400068+0000","last_fullsized":"2024-09-12T17:09:20.400068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:20.399852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:20.399852+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.399852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:35.852327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"103'28","reported_seq":219,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.047899+0000","last_change":"2024-09-12T17:09:11.047899+0000","last_active":"2024-09-12T17:09:11.047899+0000","last_peered":"2024-09-12T17:09:11.047899+0000","last_clean":"2024-09-12T17:09:11.047899+0000","last_became_active":"2024-09-12T17:05:47.520943+0000","last_became_peered":"2024-09-12T17:05:47.520943+0000","last_unstale":"2024-09-12T17:09:11.047899+0000","last_undegraded":"2024-09-12T17:09:11.047899+0000","last_fullsized":"2024-09-12T17:09:11.047899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'28","last_scrub_stamp":"2024-09-12T17:09:11.047719+0000","last_deep_scrub":"103'28","last_deep_scrub_stamp":"2024-09-12T17:09:11.047719+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.047719+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:55.669095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":51203,"num_write":36,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"29'1","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.606726+0000","last_change":"2024-09-12T17:05:51.556202+0000","last_active":"2024-09-12T17:09:02.606726+0000","last_peered":"2024-09-12T17:09:02.606726+0000","last_clean":"2024-09-12T17:09:02.606726+0000","last_became_active":"2024-09-12T17:05:51.555420+0000","last_became_peered":"2024-09-12T17:05:51.555420+0000","last_unstale":"2024-09-12T17:09:02.606726+0000","last_undegraded":"2024-09-12T17:09:02.606726+0000","last_fullsized":"2024-09-12T17:09:02.606726+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:19:56.903853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"103'17","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.972638+0000","last_change":"2024-09-12T17:05:53.554159+0000","last_active":"2024-09-12T17:09:02.972638+0000","last_peered":"2024-09-12T17:09:02.972638+0000","last_clean":"2024-09-12T17:09:02.972638+0000","last_became_active":"2024-09-12T17:05:53.553333+0000","last_became_peered":"2024-09-12T17:05:53.553333+0000","last_unstale":"2024-09-12T17:09:02.972638+0000","last_undegraded":"2024-09-12T17:09:02.972638+0000","last_fullsized":"2024-09-12T17:09:02.972638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:27:53.266475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"103'18","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.660606+0000","last_change":"2024-09-12T17:05:55.556502+0000","last_active":"2024-09-12T17:09:02.660606+0000","last_peered":"2024-09-12T17:09:02.660606+0000","last_clean":"2024-09-12T17:09:02.660606+0000","last_became_active":"2024-09-12T17:05:55.555879+0000","last_became_peered":"2024-09-12T17:05:55.555879+0000","last_unstale":"2024-09-12T17:09:02.660606+0000","last_undegraded":"2024-09-12T17:09:02.660606+0000","last_fullsized":"2024-09-12T17:09:02.660606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:18.672296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.259800+0000","last_change":"2024-09-12T17:09:20.259800+0000","last_active":"2024-09-12T17:09:20.259800+0000","last_peered":"2024-09-12T17:09:20.259800+0000","last_clean":"2024-09-12T17:09:20.259800+0000","last_became_active":"2024-09-12T17:05:49.552637+0000","last_became_peered":"2024-09-12T17:05:49.552637+0000","last_unstale":"2024-09-12T17:09:20.259800+0000","last_undegraded":"2024-09-12T17:09:20.259800+0000","last_fullsized":"2024-09-12T17:09:20.259800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:20.259563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:20.259563+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.259563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:31.730623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"103'12","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.859440+0000","last_change":"2024-09-12T17:09:13.859440+0000","last_active":"2024-09-12T17:09:13.859440+0000","last_peered":"2024-09-12T17:09:13.859440+0000","last_clean":"2024-09-12T17:09:13.859440+0000","last_became_active":"2024-09-12T17:05:47.562465+0000","last_became_peered":"2024-09-12T17:05:47.562465+0000","last_unstale":"2024-09-12T17:09:13.859440+0000","last_undegraded":"2024-09-12T17:09:13.859440+0000","last_fullsized":"2024-09-12T17:09:13.859440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:13.859257+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:13.859257+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.859257+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:22.090316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24585,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604488+0000","last_change":"2024-09-12T17:05:51.542349+0000","last_active":"2024-09-12T17:08:33.604488+0000","last_peered":"2024-09-12T17:08:33.604488+0000","last_clean":"2024-09-12T17:08:33.604488+0000","last_became_active":"2024-09-12T17:05:51.541205+0000","last_became_peered":"2024-09-12T17:05:51.541205+0000","last_unstale":"2024-09-12T17:08:33.604488+0000","last_undegraded":"2024-09-12T17:08:33.604488+0000","last_fullsized":"2024-09-12T17:08:33.604488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:30:51.208512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"103'32","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.198917+0000","last_change":"2024-09-12T17:05:53.560400+0000","last_active":"2024-09-12T17:09:03.198917+0000","last_peered":"2024-09-12T17:09:03.198917+0000","last_clean":"2024-09-12T17:09:03.198917+0000","last_became_active":"2024-09-12T17:05:53.559463+0000","last_became_peered":"2024-09-12T17:05:53.559463+0000","last_unstale":"2024-09-12T17:09:03.198917+0000","last_undegraded":"2024-09-12T17:09:03.198917+0000","last_fullsized":"2024-09-12T17:09:03.198917+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":84,"num_write":38,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.075639+0000","last_change":"2024-09-12T17:09:19.075639+0000","last_active":"2024-09-12T17:09:19.075639+0000","last_peered":"2024-09-12T17:09:19.075639+0000","last_clean":"2024-09-12T17:09:19.075639+0000","last_became_active":"2024-09-12T17:08:21.463161+0000","last_became_peered":"2024-09-12T17:08:21.463161+0000","last_unstale":"2024-09-12T17:09:19.075639+0000","last_undegraded":"2024-09-12T17:09:19.075639+0000","last_fullsized":"2024-09-12T17:09:19.075639+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:19.075369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:19.075369+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.075369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:25.576582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603071+0000","last_change":"2024-09-12T17:05:57.599403+0000","last_active":"2024-09-12T17:08:33.603071+0000","last_peered":"2024-09-12T17:08:33.603071+0000","last_clean":"2024-09-12T17:08:33.603071+0000","last_became_active":"2024-09-12T17:05:57.598703+0000","last_became_peered":"2024-09-12T17:05:57.598703+0000","last_unstale":"2024-09-12T17:08:33.603071+0000","last_undegraded":"2024-09-12T17:08:33.603071+0000","last_fullsized":"2024-09-12T17:08:33.603071+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"84'34","reported_seq":225,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.792471+0000","last_change":"2024-09-12T17:09:13.792471+0000","last_active":"2024-09-12T17:09:13.792471+0000","last_peered":"2024-09-12T17:09:13.792471+0000","last_clean":"2024-09-12T17:09:13.792471+0000","last_became_active":"2024-09-12T17:08:18.443808+0000","last_became_peered":"2024-09-12T17:08:18.443808+0000","last_unstale":"2024-09-12T17:09:13.792471+0000","last_undegraded":"2024-09-12T17:09:13.792471+0000","last_fullsized":"2024-09-12T17:09:13.792471+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'34","last_scrub_stamp":"2024-09-12T17:09:13.792226+0000","last_deep_scrub":"84'34","last_deep_scrub_stamp":"2024-09-12T17:09:13.792226+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.792226+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:40.138283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"103'14","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.899760+0000","last_change":"2024-09-12T17:09:14.899760+0000","last_active":"2024-09-12T17:09:14.899760+0000","last_peered":"2024-09-12T17:09:14.899760+0000","last_clean":"2024-09-12T17:09:14.899760+0000","last_became_active":"2024-09-12T17:05:47.562812+0000","last_became_peered":"2024-09-12T17:05:47.562812+0000","last_unstale":"2024-09-12T17:09:14.899760+0000","last_undegraded":"2024-09-12T17:09:14.899760+0000","last_fullsized":"2024-09-12T17:09:14.899760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'14","last_scrub_stamp":"2024-09-12T17:09:14.899578+0000","last_deep_scrub":"103'14","last_deep_scrub_stamp":"2024-09-12T17:09:14.899578+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.899578+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:28.517045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24579,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.566472+0000","last_change":"2024-09-12T17:09:23.566472+0000","last_active":"2024-09-12T17:09:23.566472+0000","last_peered":"2024-09-12T17:09:23.566472+0000","last_clean":"2024-09-12T17:09:23.566472+0000","last_became_active":"2024-09-12T17:05:51.544649+0000","last_became_peered":"2024-09-12T17:05:51.544649+0000","last_unstale":"2024-09-12T17:09:23.566472+0000","last_undegraded":"2024-09-12T17:09:23.566472+0000","last_fullsized":"2024-09-12T17:09:23.566472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:23.566279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:23.566279+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.566279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:13.364596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"103'16","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.428796+0000","last_change":"2024-09-12T17:05:53.552838+0000","last_active":"2024-09-12T17:09:03.428796+0000","last_peered":"2024-09-12T17:09:03.428796+0000","last_clean":"2024-09-12T17:09:03.428796+0000","last_became_active":"2024-09-12T17:05:53.550042+0000","last_became_peered":"2024-09-12T17:05:53.550042+0000","last_unstale":"2024-09-12T17:09:03.428796+0000","last_undegraded":"2024-09-12T17:09:03.428796+0000","last_fullsized":"2024-09-12T17:09:03.428796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:11:24.303645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.021994+0000","last_change":"2024-09-12T17:05:55.558761+0000","last_active":"2024-09-12T17:08:36.021994+0000","last_peered":"2024-09-12T17:08:36.021994+0000","last_clean":"2024-09-12T17:08:36.021994+0000","last_became_active":"2024-09-12T17:05:55.557930+0000","last_became_peered":"2024-09-12T17:05:55.557930+0000","last_unstale":"2024-09-12T17:08:36.021994+0000","last_undegraded":"2024-09-12T17:08:36.021994+0000","last_fullsized":"2024-09-12T17:08:36.021994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:25.015675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353619+0000","last_change":"2024-09-12T17:05:57.592611+0000","last_active":"2024-09-12T17:08:35.353619+0000","last_peered":"2024-09-12T17:08:35.353619+0000","last_clean":"2024-09-12T17:08:35.353619+0000","last_became_active":"2024-09-12T17:05:57.591855+0000","last_became_peered":"2024-09-12T17:05:57.591855+0000","last_unstale":"2024-09-12T17:08:35.353619+0000","last_undegraded":"2024-09-12T17:08:35.353619+0000","last_fullsized":"2024-09-12T17:08:35.353619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:02.854519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.173723+0000","last_change":"2024-09-12T17:09:20.173723+0000","last_active":"2024-09-12T17:09:20.173723+0000","last_peered":"2024-09-12T17:09:20.173723+0000","last_clean":"2024-09-12T17:09:20.173723+0000","last_became_active":"2024-09-12T17:08:18.466877+0000","last_became_peered":"2024-09-12T17:08:18.466877+0000","last_unstale":"2024-09-12T17:09:20.173723+0000","last_undegraded":"2024-09-12T17:09:20.173723+0000","last_fullsized":"2024-09-12T17:09:20.173723+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:20.173520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:20.173520+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.173520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:28.818313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"103'18","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.949024+0000","last_change":"2024-09-12T17:09:17.949024+0000","last_active":"2024-09-12T17:09:17.949024+0000","last_peered":"2024-09-12T17:09:17.949024+0000","last_clean":"2024-09-12T17:09:17.949024+0000","last_became_active":"2024-09-12T17:05:47.561587+0000","last_became_peered":"2024-09-12T17:05:47.561587+0000","last_unstale":"2024-09-12T17:09:17.949024+0000","last_undegraded":"2024-09-12T17:09:17.949024+0000","last_fullsized":"2024-09-12T17:09:17.949024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:17.948844+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:17.948844+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.948844+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:26.011536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28672,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"103'2","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.663647+0000","last_change":"2024-09-12T17:09:26.663647+0000","last_active":"2024-09-12T17:09:26.663647+0000","last_peered":"2024-09-12T17:09:26.663647+0000","last_clean":"2024-09-12T17:09:26.663647+0000","last_became_active":"2024-09-12T17:05:51.542457+0000","last_became_peered":"2024-09-12T17:05:51.542457+0000","last_unstale":"2024-09-12T17:09:26.663647+0000","last_undegraded":"2024-09-12T17:09:26.663647+0000","last_fullsized":"2024-09-12T17:09:26.663647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-12T17:09:26.663462+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-12T17:09:26.663462+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.663462+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:24.582475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"103'24","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.226396+0000","last_change":"2024-09-12T17:05:53.548729+0000","last_active":"2024-09-12T17:09:03.226396+0000","last_peered":"2024-09-12T17:09:03.226396+0000","last_clean":"2024-09-12T17:09:03.226396+0000","last_became_active":"2024-09-12T17:05:53.547990+0000","last_became_peered":"2024-09-12T17:05:53.547990+0000","last_unstale":"2024-09-12T17:09:03.226396+0000","last_undegraded":"2024-09-12T17:09:03.226396+0000","last_fullsized":"2024-09-12T17:09:03.226396+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:25:22.845485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"103'20","reported_seq":232,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.661863+0000","last_change":"2024-09-12T17:08:21.470468+0000","last_active":"2024-09-12T17:09:02.661863+0000","last_peered":"2024-09-12T17:09:02.661863+0000","last_clean":"2024-09-12T17:09:02.661863+0000","last_became_active":"2024-09-12T17:08:21.465057+0000","last_became_peered":"2024-09-12T17:08:21.465057+0000","last_unstale":"2024-09-12T17:09:02.661863+0000","last_undegraded":"2024-09-12T17:09:02.661863+0000","last_fullsized":"2024-09-12T17:09:02.661863+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:12:02.580430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604073+0000","last_change":"2024-09-12T17:05:57.596229+0000","last_active":"2024-09-12T17:08:33.604073+0000","last_peered":"2024-09-12T17:08:33.604073+0000","last_clean":"2024-09-12T17:08:33.604073+0000","last_became_active":"2024-09-12T17:05:57.595658+0000","last_became_peered":"2024-09-12T17:05:57.595658+0000","last_unstale":"2024-09-12T17:08:33.604073+0000","last_undegraded":"2024-09-12T17:08:33.604073+0000","last_fullsized":"2024-09-12T17:08:33.604073+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:51:39.644627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.822427+0000","last_change":"2024-09-12T17:09:21.822427+0000","last_active":"2024-09-12T17:09:21.822427+0000","last_peered":"2024-09-12T17:09:21.822427+0000","last_clean":"2024-09-12T17:09:21.822427+0000","last_became_active":"2024-09-12T17:08:18.464976+0000","last_became_peered":"2024-09-12T17:08:18.464976+0000","last_unstale":"2024-09-12T17:09:21.822427+0000","last_undegraded":"2024-09-12T17:09:21.822427+0000","last_fullsized":"2024-09-12T17:09:21.822427+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:21.822212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:21.822212+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.822212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:57.541094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"103'20","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.073435+0000","last_change":"2024-09-12T17:09:11.073435+0000","last_active":"2024-09-12T17:09:11.073435+0000","last_peered":"2024-09-12T17:09:11.073435+0000","last_clean":"2024-09-12T17:09:11.073435+0000","last_became_active":"2024-09-12T17:05:47.534607+0000","last_became_peered":"2024-09-12T17:05:47.534607+0000","last_unstale":"2024-09-12T17:09:11.073435+0000","last_undegraded":"2024-09-12T17:09:11.073435+0000","last_fullsized":"2024-09-12T17:09:11.073435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:11.073246+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:11.073246+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.073246+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:31.724300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36876,"num_write":52,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.545123+0000","last_change":"2024-09-12T17:09:22.545123+0000","last_active":"2024-09-12T17:09:22.545123+0000","last_peered":"2024-09-12T17:09:22.545123+0000","last_clean":"2024-09-12T17:09:22.545123+0000","last_became_active":"2024-09-12T17:05:51.547939+0000","last_became_peered":"2024-09-12T17:05:51.547939+0000","last_unstale":"2024-09-12T17:09:22.545123+0000","last_undegraded":"2024-09-12T17:09:22.545123+0000","last_fullsized":"2024-09-12T17:09:22.545123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:22.544941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:22.544941+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.544941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:05.223688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"103'31","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.259212+0000","last_change":"2024-09-12T17:05:53.535756+0000","last_active":"2024-09-12T17:09:03.259212+0000","last_peered":"2024-09-12T17:09:03.259212+0000","last_clean":"2024-09-12T17:09:03.259212+0000","last_became_active":"2024-09-12T17:05:53.535062+0000","last_became_peered":"2024-09-12T17:05:53.535062+0000","last_unstale":"2024-09-12T17:09:03.259212+0000","last_undegraded":"2024-09-12T17:09:03.259212+0000","last_fullsized":"2024-09-12T17:09:03.259212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":57,"num_read_kb":81,"num_write":36,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.019032+0000","last_change":"2024-09-12T17:05:55.564010+0000","last_active":"2024-09-12T17:08:36.019032+0000","last_peered":"2024-09-12T17:08:36.019032+0000","last_clean":"2024-09-12T17:08:36.019032+0000","last_became_active":"2024-09-12T17:05:55.563125+0000","last_became_peered":"2024-09-12T17:05:55.563125+0000","last_unstale":"2024-09-12T17:08:36.019032+0000","last_undegraded":"2024-09-12T17:08:36.019032+0000","last_fullsized":"2024-09-12T17:08:36.019032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:05:00.697571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114671+0000","last_change":"2024-09-12T17:08:18.459890+0000","last_active":"2024-09-12T17:08:35.114671+0000","last_peered":"2024-09-12T17:08:35.114671+0000","last_clean":"2024-09-12T17:08:35.114671+0000","last_became_active":"2024-09-12T17:08:18.459544+0000","last_became_peered":"2024-09-12T17:08:18.459544+0000","last_unstale":"2024-09-12T17:08:35.114671+0000","last_undegraded":"2024-09-12T17:08:35.114671+0000","last_fullsized":"2024-09-12T17:08:35.114671+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:48:05.030891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.805545+0000","last_change":"2024-09-12T17:09:16.805545+0000","last_active":"2024-09-12T17:09:16.805545+0000","last_peered":"2024-09-12T17:09:16.805545+0000","last_clean":"2024-09-12T17:09:16.805545+0000","last_became_active":"2024-09-12T17:05:49.543307+0000","last_became_peered":"2024-09-12T17:05:49.543307+0000","last_unstale":"2024-09-12T17:09:16.805545+0000","last_undegraded":"2024-09-12T17:09:16.805545+0000","last_fullsized":"2024-09-12T17:09:16.805545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:16.805360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:16.805360+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.805360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:52.193400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"103'12","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.407498+0000","last_change":"2024-09-12T17:09:10.407498+0000","last_active":"2024-09-12T17:09:10.407498+0000","last_peered":"2024-09-12T17:09:10.407498+0000","last_clean":"2024-09-12T17:09:10.407498+0000","last_became_active":"2024-09-12T17:05:47.525696+0000","last_became_peered":"2024-09-12T17:05:47.525696+0000","last_unstale":"2024-09-12T17:09:10.407498+0000","last_undegraded":"2024-09-12T17:09:10.407498+0000","last_fullsized":"2024-09-12T17:09:10.407498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:10.407275+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:10.407275+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.407275+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:44.594207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":18438,"num_write":28,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.599533+0000","last_change":"2024-09-12T17:09:24.599533+0000","last_active":"2024-09-12T17:09:24.599533+0000","last_peered":"2024-09-12T17:09:24.599533+0000","last_clean":"2024-09-12T17:09:24.599533+0000","last_became_active":"2024-09-12T17:05:51.542737+0000","last_became_peered":"2024-09-12T17:05:51.542737+0000","last_unstale":"2024-09-12T17:09:24.599533+0000","last_undegraded":"2024-09-12T17:09:24.599533+0000","last_fullsized":"2024-09-12T17:09:24.599533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:24.599315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:24.599315+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.599315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:21.084174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"103'23","reported_seq":227,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.860878+0000","last_change":"2024-09-12T17:08:21.484446+0000","last_active":"2024-09-12T17:09:02.860878+0000","last_peered":"2024-09-12T17:09:02.860878+0000","last_clean":"2024-09-12T17:09:02.860878+0000","last_became_active":"2024-09-12T17:08:21.465207+0000","last_became_peered":"2024-09-12T17:08:21.465207+0000","last_unstale":"2024-09-12T17:09:02.860878+0000","last_undegraded":"2024-09-12T17:09:02.860878+0000","last_fullsized":"2024-09-12T17:09:02.860878+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:37.839396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":61,"num_write":28,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3559,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603073+0000","last_change":"2024-09-12T17:05:55.565575+0000","last_active":"2024-09-12T17:08:33.603073+0000","last_peered":"2024-09-12T17:08:33.603073+0000","last_clean":"2024-09-12T17:08:33.603073+0000","last_became_active":"2024-09-12T17:05:55.564802+0000","last_became_peered":"2024-09-12T17:05:55.564802+0000","last_unstale":"2024-09-12T17:08:33.603073+0000","last_undegraded":"2024-09-12T17:08:33.603073+0000","last_fullsized":"2024-09-12T17:08:33.603073+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:22:48.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022911+0000","last_change":"2024-09-12T17:05:57.592294+0000","last_active":"2024-09-12T17:08:36.022911+0000","last_peered":"2024-09-12T17:08:36.022911+0000","last_clean":"2024-09-12T17:08:36.022911+0000","last_became_active":"2024-09-12T17:05:57.591389+0000","last_became_peered":"2024-09-12T17:05:57.591389+0000","last_unstale":"2024-09-12T17:08:36.022911+0000","last_undegraded":"2024-09-12T17:08:36.022911+0000","last_fullsized":"2024-09-12T17:08:36.022911+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:29:03.322220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'10","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.836015+0000","last_change":"2024-09-12T17:09:15.836015+0000","last_active":"2024-09-12T17:09:15.836015+0000","last_peered":"2024-09-12T17:09:15.836015+0000","last_clean":"2024-09-12T17:09:15.836015+0000","last_became_active":"2024-09-12T17:05:49.552270+0000","last_became_peered":"2024-09-12T17:05:49.552270+0000","last_unstale":"2024-09-12T17:09:15.836015+0000","last_undegraded":"2024-09-12T17:09:15.836015+0000","last_fullsized":"2024-09-12T17:09:15.836015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'10","last_scrub_stamp":"2024-09-12T17:09:15.835764+0000","last_deep_scrub":"68'10","last_deep_scrub_stamp":"2024-09-12T17:09:15.835764+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.835764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:54.565957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"103'16","reported_seq":200,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.091046+0000","last_change":"2024-09-12T17:09:10.091046+0000","last_active":"2024-09-12T17:09:10.091046+0000","last_peered":"2024-09-12T17:09:10.091046+0000","last_clean":"2024-09-12T17:09:10.091046+0000","last_became_active":"2024-09-12T17:05:47.542362+0000","last_became_peered":"2024-09-12T17:05:47.542362+0000","last_unstale":"2024-09-12T17:09:10.091046+0000","last_undegraded":"2024-09-12T17:09:10.091046+0000","last_fullsized":"2024-09-12T17:09:10.091046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:10.090858+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:10.090858+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.090858+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:44.006073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114518+0000","last_change":"2024-09-12T17:08:18.456938+0000","last_active":"2024-09-12T17:08:35.114518+0000","last_peered":"2024-09-12T17:08:35.114518+0000","last_clean":"2024-09-12T17:08:35.114518+0000","last_became_active":"2024-09-12T17:08:18.452101+0000","last_became_peered":"2024-09-12T17:08:18.452101+0000","last_unstale":"2024-09-12T17:08:35.114518+0000","last_undegraded":"2024-09-12T17:08:35.114518+0000","last_fullsized":"2024-09-12T17:08:35.114518+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:08:36.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"103'29","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.650005+0000","last_change":"2024-09-12T17:09:25.650005+0000","last_active":"2024-09-12T17:09:25.650005+0000","last_peered":"2024-09-12T17:09:25.650005+0000","last_clean":"2024-09-12T17:09:25.650005+0000","last_became_active":"2024-09-12T17:05:53.554131+0000","last_became_peered":"2024-09-12T17:05:53.554131+0000","last_unstale":"2024-09-12T17:09:25.650005+0000","last_undegraded":"2024-09-12T17:09:25.650005+0000","last_fullsized":"2024-09-12T17:09:25.650005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'29","last_scrub_stamp":"2024-09-12T17:09:25.649799+0000","last_deep_scrub":"103'29","last_deep_scrub_stamp":"2024-09-12T17:09:25.649799+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.649799+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:18.813939+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"103'18","reported_seq":223,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.620751+0000","last_change":"2024-09-12T17:09:27.620751+0000","last_active":"2024-09-12T17:09:27.620751+0000","last_peered":"2024-09-12T17:09:27.620751+0000","last_clean":"2024-09-12T17:09:27.620751+0000","last_became_active":"2024-09-12T17:05:55.556488+0000","last_became_peered":"2024-09-12T17:05:55.556488+0000","last_unstale":"2024-09-12T17:09:27.620751+0000","last_undegraded":"2024-09-12T17:09:27.620751+0000","last_fullsized":"2024-09-12T17:09:27.620751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:27.620570+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:27.620570+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.620570+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:57.992690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":47,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.965025+0000","last_change":"2024-09-12T17:09:27.965025+0000","last_active":"2024-09-12T17:09:27.965025+0000","last_peered":"2024-09-12T17:09:27.965025+0000","last_clean":"2024-09-12T17:09:27.965025+0000","last_became_active":"2024-09-12T17:08:18.460345+0000","last_became_peered":"2024-09-12T17:08:18.460345+0000","last_unstale":"2024-09-12T17:09:27.965025+0000","last_undegraded":"2024-09-12T17:09:27.965025+0000","last_fullsized":"2024-09-12T17:09:27.965025+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:27.964842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:27.964842+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.964842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:50.042436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"68'6","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.789348+0000","last_change":"2024-09-12T17:09:14.789348+0000","last_active":"2024-09-12T17:09:14.789348+0000","last_peered":"2024-09-12T17:09:14.789348+0000","last_clean":"2024-09-12T17:09:14.789348+0000","last_became_active":"2024-09-12T17:05:49.561200+0000","last_became_peered":"2024-09-12T17:05:49.561200+0000","last_unstale":"2024-09-12T17:09:14.789348+0000","last_undegraded":"2024-09-12T17:09:14.789348+0000","last_fullsized":"2024-09-12T17:09:14.789348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-09-12T17:09:14.789152+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-09-12T17:09:14.789152+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.789152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:08.191245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"103'12","reported_seq":197,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:09.788662+0000","last_change":"2024-09-12T17:09:09.788662+0000","last_active":"2024-09-12T17:09:09.788662+0000","last_peered":"2024-09-12T17:09:09.788662+0000","last_clean":"2024-09-12T17:09:09.788662+0000","last_became_active":"2024-09-12T17:05:47.540484+0000","last_became_peered":"2024-09-12T17:05:47.540484+0000","last_unstale":"2024-09-12T17:09:09.788662+0000","last_undegraded":"2024-09-12T17:09:09.788662+0000","last_fullsized":"2024-09-12T17:09:09.788662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:09.788445+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:09.788445+0000","last_clean_scrub_stamp":"2024-09-12T17:09:09.788445+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:39.325156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24585,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.619866+0000","last_change":"2024-09-12T17:05:51.556083+0000","last_active":"2024-09-12T17:09:02.619866+0000","last_peered":"2024-09-12T17:09:02.619866+0000","last_clean":"2024-09-12T17:09:02.619866+0000","last_became_active":"2024-09-12T17:05:51.554176+0000","last_became_peered":"2024-09-12T17:05:51.554176+0000","last_unstale":"2024-09-12T17:09:02.619866+0000","last_undegraded":"2024-09-12T17:09:02.619866+0000","last_fullsized":"2024-09-12T17:09:02.619866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:02.345570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.024529+0000","last_change":"2024-09-12T17:05:53.553304+0000","last_active":"2024-09-12T17:08:36.024529+0000","last_peered":"2024-09-12T17:08:36.024529+0000","last_clean":"2024-09-12T17:08:36.024529+0000","last_became_active":"2024-09-12T17:05:53.552545+0000","last_became_peered":"2024-09-12T17:05:53.552545+0000","last_unstale":"2024-09-12T17:08:36.024529+0000","last_undegraded":"2024-09-12T17:08:36.024529+0000","last_fullsized":"2024-09-12T17:08:36.024529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:11.708260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"103'20","reported_seq":234,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.659114+0000","last_change":"2024-09-12T17:08:18.628128+0000","last_active":"2024-09-12T17:09:02.659114+0000","last_peered":"2024-09-12T17:09:02.659114+0000","last_clean":"2024-09-12T17:09:02.659114+0000","last_became_active":"2024-09-12T17:08:18.471539+0000","last_became_peered":"2024-09-12T17:08:18.471539+0000","last_unstale":"2024-09-12T17:09:02.659114+0000","last_undegraded":"2024-09-12T17:09:02.659114+0000","last_fullsized":"2024-09-12T17:09:02.659114+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:09:47.486729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210930+0000","last_change":"2024-09-12T17:05:57.597870+0000","last_active":"2024-09-12T17:08:35.210930+0000","last_peered":"2024-09-12T17:08:35.210930+0000","last_clean":"2024-09-12T17:08:35.210930+0000","last_became_active":"2024-09-12T17:05:57.597076+0000","last_became_peered":"2024-09-12T17:05:57.597076+0000","last_unstale":"2024-09-12T17:08:35.210930+0000","last_undegraded":"2024-09-12T17:08:35.210930+0000","last_fullsized":"2024-09-12T17:08:35.210930+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:57:02.648974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"68'6","reported_seq":51,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.079527+0000","last_change":"2024-09-12T17:09:23.079527+0000","last_active":"2024-09-12T17:09:23.079527+0000","last_peered":"2024-09-12T17:09:23.079527+0000","last_clean":"2024-09-12T17:09:23.079527+0000","last_became_active":"2024-09-12T17:08:18.457423+0000","last_became_peered":"2024-09-12T17:08:18.457423+0000","last_unstale":"2024-09-12T17:09:23.079527+0000","last_undegraded":"2024-09-12T17:09:23.079527+0000","last_fullsized":"2024-09-12T17:09:23.079527+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-09-12T17:09:23.079289+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-09-12T17:09:23.079289+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.079289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:55.810540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"103'16","reported_seq":232,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:08.451684+0000","last_change":"2024-09-12T17:09:08.451684+0000","last_active":"2024-09-12T17:09:08.451684+0000","last_peered":"2024-09-12T17:09:08.451684+0000","last_clean":"2024-09-12T17:09:08.451684+0000","last_became_active":"2024-09-12T17:08:18.449468+0000","last_became_peered":"2024-09-12T17:08:18.449468+0000","last_unstale":"2024-09-12T17:09:08.451684+0000","last_undegraded":"2024-09-12T17:09:08.451684+0000","last_fullsized":"2024-09-12T17:09:08.451684+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:08.451508+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:08.451508+0000","last_clean_scrub_stamp":"2024-09-12T17:09:08.451508+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:30.947913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":28678,"num_write":32,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212218+0000","last_change":"2024-09-12T17:05:51.540047+0000","last_active":"2024-09-12T17:08:35.212218+0000","last_peered":"2024-09-12T17:08:35.212218+0000","last_clean":"2024-09-12T17:08:35.212218+0000","last_became_active":"2024-09-12T17:05:51.539302+0000","last_became_peered":"2024-09-12T17:05:51.539302+0000","last_unstale":"2024-09-12T17:08:35.212218+0000","last_undegraded":"2024-09-12T17:08:35.212218+0000","last_fullsized":"2024-09-12T17:08:35.212218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:18:21.253801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"103'27","reported_seq":244,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.129426+0000","last_change":"2024-09-12T17:08:21.515721+0000","last_active":"2024-09-12T17:09:03.129426+0000","last_peered":"2024-09-12T17:09:03.129426+0000","last_clean":"2024-09-12T17:09:03.129426+0000","last_became_active":"2024-09-12T17:08:21.467530+0000","last_became_peered":"2024-09-12T17:08:21.467530+0000","last_unstale":"2024-09-12T17:09:03.129426+0000","last_undegraded":"2024-09-12T17:09:03.129426+0000","last_fullsized":"2024-09-12T17:09:03.129426+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:59:04.806432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":75,"num_write":30,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":12538,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.215579+0000","last_change":"2024-09-12T17:09:26.215579+0000","last_active":"2024-09-12T17:09:26.215579+0000","last_peered":"2024-09-12T17:09:26.215579+0000","last_clean":"2024-09-12T17:09:26.215579+0000","last_became_active":"2024-09-12T17:05:55.565979+0000","last_became_peered":"2024-09-12T17:05:55.565979+0000","last_unstale":"2024-09-12T17:09:26.215579+0000","last_undegraded":"2024-09-12T17:09:26.215579+0000","last_fullsized":"2024-09-12T17:09:26.215579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:26.215387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:26.215387+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.215387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:03.439689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.113928+0000","last_change":"2024-09-12T17:08:21.461881+0000","last_active":"2024-09-12T17:08:35.113928+0000","last_peered":"2024-09-12T17:08:35.113928+0000","last_clean":"2024-09-12T17:08:35.113928+0000","last_became_active":"2024-09-12T17:08:21.461496+0000","last_became_peered":"2024-09-12T17:08:21.461496+0000","last_unstale":"2024-09-12T17:08:35.113928+0000","last_undegraded":"2024-09-12T17:08:35.113928+0000","last_fullsized":"2024-09-12T17:08:35.113928+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:41.000825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.133390+0000","last_change":"2024-09-12T17:09:17.133390+0000","last_active":"2024-09-12T17:09:17.133390+0000","last_peered":"2024-09-12T17:09:17.133390+0000","last_clean":"2024-09-12T17:09:17.133390+0000","last_became_active":"2024-09-12T17:05:49.538713+0000","last_became_peered":"2024-09-12T17:05:49.538713+0000","last_unstale":"2024-09-12T17:09:17.133390+0000","last_undegraded":"2024-09-12T17:09:17.133390+0000","last_fullsized":"2024-09-12T17:09:17.133390+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:17.133216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:17.133216+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.133216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:26.172848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"103'74","reported_seq":282,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.842278+0000","last_change":"2024-09-12T17:09:10.842278+0000","last_active":"2024-09-12T17:09:10.842278+0000","last_peered":"2024-09-12T17:09:10.842278+0000","last_clean":"2024-09-12T17:09:10.842278+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:09:10.842278+0000","last_undegraded":"2024-09-12T17:09:10.842278+0000","last_fullsized":"2024-09-12T17:09:10.842278+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'74","last_scrub_stamp":"2024-09-12T17:09:10.842079+0000","last_deep_scrub":"103'74","last_deep_scrub_stamp":"2024-09-12T17:09:10.842079+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.842079+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:46.894248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"103'2","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.159756+0000","last_change":"2024-09-12T17:09:15.159756+0000","last_active":"2024-09-12T17:09:15.159756+0000","last_peered":"2024-09-12T17:09:15.159756+0000","last_clean":"2024-09-12T17:09:15.159756+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:09:15.159756+0000","last_undegraded":"2024-09-12T17:09:15.159756+0000","last_fullsized":"2024-09-12T17:09:15.159756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-12T17:09:15.159497+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-12T17:09:15.159497+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.159497+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:37.655902+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"103'20","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.376701+0000","last_change":"2024-09-12T17:09:11.376701+0000","last_active":"2024-09-12T17:09:11.376701+0000","last_peered":"2024-09-12T17:09:11.376701+0000","last_clean":"2024-09-12T17:09:11.376701+0000","last_became_active":"2024-09-12T17:05:47.525694+0000","last_became_peered":"2024-09-12T17:05:47.525694+0000","last_unstale":"2024-09-12T17:09:11.376701+0000","last_undegraded":"2024-09-12T17:09:11.376701+0000","last_fullsized":"2024-09-12T17:09:11.376701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:11.376516+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:11.376516+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.376516+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:06.091901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38921,"num_write":44,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":166,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.971042+0000","last_change":"2024-09-12T17:09:27.971042+0000","last_active":"2024-09-12T17:09:27.971042+0000","last_peered":"2024-09-12T17:09:27.971042+0000","last_clean":"2024-09-12T17:09:27.971042+0000","last_became_active":"2024-09-12T17:05:51.547503+0000","last_became_peered":"2024-09-12T17:05:51.547503+0000","last_unstale":"2024-09-12T17:09:27.971042+0000","last_undegraded":"2024-09-12T17:09:27.971042+0000","last_fullsized":"2024-09-12T17:09:27.971042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:27.970835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:27.970835+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.970835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:50.467240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"103'42","reported_seq":222,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.376712+0000","last_change":"2024-09-12T17:05:53.546057+0000","last_active":"2024-09-12T17:09:03.376712+0000","last_peered":"2024-09-12T17:09:03.376712+0000","last_clean":"2024-09-12T17:09:03.376712+0000","last_became_active":"2024-09-12T17:05:53.545266+0000","last_became_peered":"2024-09-12T17:05:53.545266+0000","last_unstale":"2024-09-12T17:09:03.376712+0000","last_undegraded":"2024-09-12T17:09:03.376712+0000","last_fullsized":"2024-09-12T17:09:03.376712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":120,"num_write":50,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604135+0000","last_change":"2024-09-12T17:05:55.562246+0000","last_active":"2024-09-12T17:08:33.604135+0000","last_peered":"2024-09-12T17:08:33.604135+0000","last_clean":"2024-09-12T17:08:33.604135+0000","last_became_active":"2024-09-12T17:05:55.561410+0000","last_became_peered":"2024-09-12T17:05:55.561410+0000","last_unstale":"2024-09-12T17:08:33.604135+0000","last_undegraded":"2024-09-12T17:08:33.604135+0000","last_fullsized":"2024-09-12T17:08:33.604135+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:44:36.373235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"68'2","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352549+0000","last_change":"2024-09-12T17:05:57.593095+0000","last_active":"2024-09-12T17:08:35.352549+0000","last_peered":"2024-09-12T17:08:35.352549+0000","last_clean":"2024-09-12T17:08:35.352549+0000","last_became_active":"2024-09-12T17:05:57.592287+0000","last_became_peered":"2024-09-12T17:05:57.592287+0000","last_unstale":"2024-09-12T17:08:35.352549+0000","last_undegraded":"2024-09-12T17:08:35.352549+0000","last_fullsized":"2024-09-12T17:08:35.352549+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:52.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.917572+0000","last_change":"2024-09-12T17:09:18.917572+0000","last_active":"2024-09-12T17:09:18.917572+0000","last_peered":"2024-09-12T17:09:18.917572+0000","last_clean":"2024-09-12T17:09:18.917572+0000","last_became_active":"2024-09-12T17:08:18.464334+0000","last_became_peered":"2024-09-12T17:08:18.464334+0000","last_unstale":"2024-09-12T17:09:18.917572+0000","last_undegraded":"2024-09-12T17:09:18.917572+0000","last_fullsized":"2024-09-12T17:09:18.917572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:18.917345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:18.917345+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.917345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:29.517391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.821477+0000","last_change":"2024-09-12T17:09:11.821477+0000","last_active":"2024-09-12T17:09:11.821477+0000","last_peered":"2024-09-12T17:09:11.821477+0000","last_clean":"2024-09-12T17:09:11.821477+0000","last_became_active":"2024-09-12T17:08:21.461625+0000","last_became_peered":"2024-09-12T17:08:21.461625+0000","last_unstale":"2024-09-12T17:09:11.821477+0000","last_undegraded":"2024-09-12T17:09:11.821477+0000","last_fullsized":"2024-09-12T17:09:11.821477+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:11.821255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:11.821255+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.821255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:59.918091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"103'24","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:09.764897+0000","last_change":"2024-09-12T17:09:09.764897+0000","last_active":"2024-09-12T17:09:09.764897+0000","last_peered":"2024-09-12T17:09:09.764897+0000","last_clean":"2024-09-12T17:09:09.764897+0000","last_became_active":"2024-09-12T17:05:47.543531+0000","last_became_peered":"2024-09-12T17:05:47.543531+0000","last_unstale":"2024-09-12T17:09:09.764897+0000","last_undegraded":"2024-09-12T17:09:09.764897+0000","last_fullsized":"2024-09-12T17:09:09.764897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'24","last_scrub_stamp":"2024-09-12T17:09:09.764680+0000","last_deep_scrub":"103'24","last_deep_scrub_stamp":"2024-09-12T17:09:09.764680+0000","last_clean_scrub_stamp":"2024-09-12T17:09:09.764680+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:03.438309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":40969,"num_write":48,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.605269+0000","last_change":"2024-09-12T17:08:18.466066+0000","last_active":"2024-09-12T17:08:33.605269+0000","last_peered":"2024-09-12T17:08:33.605269+0000","last_clean":"2024-09-12T17:08:33.605269+0000","last_became_active":"2024-09-12T17:08:18.465027+0000","last_became_peered":"2024-09-12T17:08:18.465027+0000","last_unstale":"2024-09-12T17:08:33.605269+0000","last_undegraded":"2024-09-12T17:08:33.605269+0000","last_fullsized":"2024-09-12T17:08:33.605269+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:19:31.767038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"103'63","reported_seq":88,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.146760+0000","last_change":"2024-09-12T17:08:21.488130+0000","last_active":"2024-09-12T17:09:03.146760+0000","last_peered":"2024-09-12T17:09:03.146760+0000","last_clean":"2024-09-12T17:09:03.146760+0000","last_became_active":"2024-09-12T17:08:21.455260+0000","last_became_peered":"2024-09-12T17:08:21.455260+0000","last_unstale":"2024-09-12T17:09:03.146760+0000","last_undegraded":"2024-09-12T17:09:03.146760+0000","last_fullsized":"2024-09-12T17:09:03.146760+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:47:08.863638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":101,"num_read_kb":130,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":5726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.606844+0000","last_change":"2024-09-12T17:05:55.556362+0000","last_active":"2024-09-12T17:08:33.606844+0000","last_peered":"2024-09-12T17:08:33.606844+0000","last_clean":"2024-09-12T17:08:33.606844+0000","last_became_active":"2024-09-12T17:05:55.555625+0000","last_became_peered":"2024-09-12T17:05:55.555625+0000","last_unstale":"2024-09-12T17:08:33.606844+0000","last_undegraded":"2024-09-12T17:08:33.606844+0000","last_fullsized":"2024-09-12T17:08:33.606844+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"84'6","reported_seq":45,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114189+0000","last_change":"2024-09-12T17:08:18.577521+0000","last_active":"2024-09-12T17:08:35.114189+0000","last_peered":"2024-09-12T17:08:35.114189+0000","last_clean":"2024-09-12T17:08:35.114189+0000","last_became_active":"2024-09-12T17:08:18.446923+0000","last_became_peered":"2024-09-12T17:08:18.446923+0000","last_unstale":"2024-09-12T17:08:35.114189+0000","last_undegraded":"2024-09-12T17:08:35.114189+0000","last_fullsized":"2024-09-12T17:08:35.114189+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:25:00.600036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.070537+0000","last_change":"2024-09-12T17:09:24.070537+0000","last_active":"2024-09-12T17:09:24.070537+0000","last_peered":"2024-09-12T17:09:24.070537+0000","last_clean":"2024-09-12T17:09:24.070537+0000","last_became_active":"2024-09-12T17:08:21.456705+0000","last_became_peered":"2024-09-12T17:08:21.456705+0000","last_unstale":"2024-09-12T17:09:24.070537+0000","last_undegraded":"2024-09-12T17:09:24.070537+0000","last_fullsized":"2024-09-12T17:09:24.070537+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:24.070352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:24.070352+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.070352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:00.265417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:08.346404+0000","last_change":"2024-09-12T17:09:08.346404+0000","last_active":"2024-09-12T17:09:08.346404+0000","last_peered":"2024-09-12T17:09:08.346404+0000","last_clean":"2024-09-12T17:09:08.346404+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:09:08.346404+0000","last_undegraded":"2024-09-12T17:09:08.346404+0000","last_fullsized":"2024-09-12T17:09:08.346404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:08.346328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:08.346328+0000","last_clean_scrub_stamp":"2024-09-12T17:09:08.346328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:55.221358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"103'20","reported_seq":77,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:09.348278+0000","last_change":"2024-09-12T17:09:09.348278+0000","last_active":"2024-09-12T17:09:09.348278+0000","last_peered":"2024-09-12T17:09:09.348278+0000","last_clean":"2024-09-12T17:09:09.348278+0000","last_became_active":"2024-09-12T17:08:18.446837+0000","last_became_peered":"2024-09-12T17:08:18.446837+0000","last_unstale":"2024-09-12T17:09:09.348278+0000","last_undegraded":"2024-09-12T17:09:09.348278+0000","last_fullsized":"2024-09-12T17:09:09.348278+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:09.348085+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:09.348085+0000","last_clean_scrub_stamp":"2024-09-12T17:09:09.348085+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:53.275651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38918,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"103'2","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.538720+0000","last_change":"2024-09-12T17:09:21.538720+0000","last_active":"2024-09-12T17:09:21.538720+0000","last_peered":"2024-09-12T17:09:21.538720+0000","last_clean":"2024-09-12T17:09:21.538720+0000","last_became_active":"2024-09-12T17:05:51.556959+0000","last_became_peered":"2024-09-12T17:05:51.556959+0000","last_unstale":"2024-09-12T17:09:21.538720+0000","last_undegraded":"2024-09-12T17:09:21.538720+0000","last_fullsized":"2024-09-12T17:09:21.538720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-12T17:09:21.538539+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-12T17:09:21.538539+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.538539+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:02.037412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"103'16","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.760375+0000","last_change":"2024-09-12T17:05:53.555384+0000","last_active":"2024-09-12T17:08:36.760375+0000","last_peered":"2024-09-12T17:08:36.760375+0000","last_clean":"2024-09-12T17:08:36.760375+0000","last_became_active":"2024-09-12T17:05:53.554063+0000","last_became_peered":"2024-09-12T17:05:53.554063+0000","last_unstale":"2024-09-12T17:08:36.760375+0000","last_undegraded":"2024-09-12T17:08:36.760375+0000","last_fullsized":"2024-09-12T17:08:36.760375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602091+0000","last_change":"2024-09-12T17:05:55.547595+0000","last_active":"2024-09-12T17:08:33.602091+0000","last_peered":"2024-09-12T17:08:33.602091+0000","last_clean":"2024-09-12T17:08:33.602091+0000","last_became_active":"2024-09-12T17:05:55.546700+0000","last_became_peered":"2024-09-12T17:05:55.546700+0000","last_unstale":"2024-09-12T17:08:33.602091+0000","last_undegraded":"2024-09-12T17:08:33.602091+0000","last_fullsized":"2024-09-12T17:08:33.602091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:44:55.929468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.023225+0000","last_change":"2024-09-12T17:05:57.587955+0000","last_active":"2024-09-12T17:08:36.023225+0000","last_peered":"2024-09-12T17:08:36.023225+0000","last_clean":"2024-09-12T17:08:36.023225+0000","last_became_active":"2024-09-12T17:05:57.587199+0000","last_became_peered":"2024-09-12T17:05:57.587199+0000","last_unstale":"2024-09-12T17:08:36.023225+0000","last_undegraded":"2024-09-12T17:08:36.023225+0000","last_fullsized":"2024-09-12T17:08:36.023225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:50.422656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.006173+0000","last_change":"2024-09-12T17:09:27.006173+0000","last_active":"2024-09-12T17:09:27.006173+0000","last_peered":"2024-09-12T17:09:27.006173+0000","last_clean":"2024-09-12T17:09:27.006173+0000","last_became_active":"2024-09-12T17:08:21.455573+0000","last_became_peered":"2024-09-12T17:08:21.455573+0000","last_unstale":"2024-09-12T17:09:27.006173+0000","last_undegraded":"2024-09-12T17:09:27.006173+0000","last_fullsized":"2024-09-12T17:09:27.006173+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:27.005953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:27.005953+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.005953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:47.351653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"103'3","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:09.168962+0000","last_change":"2024-09-12T17:09:09.168962+0000","last_active":"2024-09-12T17:09:09.168962+0000","last_peered":"2024-09-12T17:09:09.168962+0000","last_clean":"2024-09-12T17:09:09.168962+0000","last_became_active":"2024-09-12T17:08:18.474152+0000","last_became_peered":"2024-09-12T17:08:18.474152+0000","last_unstale":"2024-09-12T17:09:09.168962+0000","last_undegraded":"2024-09-12T17:09:09.168962+0000","last_fullsized":"2024-09-12T17:09:09.168962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'3","last_scrub_stamp":"2024-09-12T17:09:09.168776+0000","last_deep_scrub":"103'3","last_deep_scrub_stamp":"2024-09-12T17:09:09.168776+0000","last_clean_scrub_stamp":"2024-09-12T17:09:09.168776+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:55.870444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"103'18","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:08.805634+0000","last_change":"2024-09-12T17:09:08.805634+0000","last_active":"2024-09-12T17:09:08.805634+0000","last_peered":"2024-09-12T17:09:08.805634+0000","last_clean":"2024-09-12T17:09:08.805634+0000","last_became_active":"2024-09-12T17:05:47.545554+0000","last_became_peered":"2024-09-12T17:05:47.545554+0000","last_unstale":"2024-09-12T17:09:08.805634+0000","last_undegraded":"2024-09-12T17:09:08.805634+0000","last_fullsized":"2024-09-12T17:09:08.805634+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:08.805436+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:08.805436+0000","last_clean_scrub_stamp":"2024-09-12T17:09:08.805436+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:01.333417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32771,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.769447+0000","last_change":"2024-09-12T17:09:26.769447+0000","last_active":"2024-09-12T17:09:26.769447+0000","last_peered":"2024-09-12T17:09:26.769447+0000","last_clean":"2024-09-12T17:09:26.769447+0000","last_became_active":"2024-09-12T17:08:18.450835+0000","last_became_peered":"2024-09-12T17:08:18.450835+0000","last_unstale":"2024-09-12T17:09:26.769447+0000","last_undegraded":"2024-09-12T17:09:26.769447+0000","last_fullsized":"2024-09-12T17:09:26.769447+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:26.769263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:26.769263+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.769263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:09.364714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"36'12","reported_seq":174,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025686+0000","last_change":"2024-09-12T17:05:53.551499+0000","last_active":"2024-09-12T17:08:36.025686+0000","last_peered":"2024-09-12T17:08:36.025686+0000","last_clean":"2024-09-12T17:08:36.025686+0000","last_became_active":"2024-09-12T17:05:53.550857+0000","last_became_peered":"2024-09-12T17:05:53.550857+0000","last_unstale":"2024-09-12T17:08:36.025686+0000","last_undegraded":"2024-09-12T17:08:36.025686+0000","last_fullsized":"2024-09-12T17:08:36.025686+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:17:33.125306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.180498+0000","last_change":"2024-09-12T17:09:25.180498+0000","last_active":"2024-09-12T17:09:25.180498+0000","last_peered":"2024-09-12T17:09:25.180498+0000","last_clean":"2024-09-12T17:09:25.180498+0000","last_became_active":"2024-09-12T17:05:55.570991+0000","last_became_peered":"2024-09-12T17:05:55.570991+0000","last_unstale":"2024-09-12T17:09:25.180498+0000","last_undegraded":"2024-09-12T17:09:25.180498+0000","last_fullsized":"2024-09-12T17:09:25.180498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:25.180290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:25.180290+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.180290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:41.344487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"84'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601534+0000","last_change":"2024-09-12T17:05:57.590482+0000","last_active":"2024-09-12T17:08:33.601534+0000","last_peered":"2024-09-12T17:08:33.601534+0000","last_clean":"2024-09-12T17:08:33.601534+0000","last_became_active":"2024-09-12T17:05:57.589542+0000","last_became_peered":"2024-09-12T17:05:57.589542+0000","last_unstale":"2024-09-12T17:08:33.601534+0000","last_undegraded":"2024-09-12T17:08:33.601534+0000","last_fullsized":"2024-09-12T17:08:33.601534+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:17:20.696864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.268759+0000","last_change":"2024-09-12T17:09:12.268759+0000","last_active":"2024-09-12T17:09:12.268759+0000","last_peered":"2024-09-12T17:09:12.268759+0000","last_clean":"2024-09-12T17:09:12.268759+0000","last_became_active":"2024-09-12T17:08:21.462608+0000","last_became_peered":"2024-09-12T17:08:21.462608+0000","last_unstale":"2024-09-12T17:09:12.268759+0000","last_undegraded":"2024-09-12T17:09:12.268759+0000","last_fullsized":"2024-09-12T17:09:12.268759+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:12.268576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:12.268576+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.268576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:10.879115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"103'30","reported_seq":222,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.117828+0000","last_change":"2024-09-12T17:09:10.117828+0000","last_active":"2024-09-12T17:09:10.117828+0000","last_peered":"2024-09-12T17:09:10.117828+0000","last_clean":"2024-09-12T17:09:10.117828+0000","last_became_active":"2024-09-12T17:05:47.525258+0000","last_became_peered":"2024-09-12T17:05:47.525258+0000","last_unstale":"2024-09-12T17:09:10.117828+0000","last_undegraded":"2024-09-12T17:09:10.117828+0000","last_fullsized":"2024-09-12T17:09:10.117828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'30","last_scrub_stamp":"2024-09-12T17:09:10.117650+0000","last_deep_scrub":"103'30","last_deep_scrub_stamp":"2024-09-12T17:09:10.117650+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.117650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:48.282872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":59401,"num_write":54,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:07.318247+0000","last_change":"2024-09-12T17:09:07.318247+0000","last_active":"2024-09-12T17:09:07.318247+0000","last_peered":"2024-09-12T17:09:07.318247+0000","last_clean":"2024-09-12T17:09:07.318247+0000","last_became_active":"2024-09-12T17:08:18.460435+0000","last_became_peered":"2024-09-12T17:08:18.460435+0000","last_unstale":"2024-09-12T17:09:07.318247+0000","last_undegraded":"2024-09-12T17:09:07.318247+0000","last_fullsized":"2024-09-12T17:09:07.318247+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:07.318140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:07.318140+0000","last_clean_scrub_stamp":"2024-09-12T17:09:07.318140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:33.664197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":166,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.782022+0000","last_change":"2024-09-12T17:09:25.782022+0000","last_active":"2024-09-12T17:09:25.782022+0000","last_peered":"2024-09-12T17:09:25.782022+0000","last_clean":"2024-09-12T17:09:25.782022+0000","last_became_active":"2024-09-12T17:05:51.544078+0000","last_became_peered":"2024-09-12T17:05:51.544078+0000","last_unstale":"2024-09-12T17:09:25.782022+0000","last_undegraded":"2024-09-12T17:09:25.782022+0000","last_fullsized":"2024-09-12T17:09:25.782022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:25.781837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:25.781837+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.781837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.802633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"103'34","reported_seq":210,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.380912+0000","last_change":"2024-09-12T17:05:53.540181+0000","last_active":"2024-09-12T17:09:03.380912+0000","last_peered":"2024-09-12T17:09:03.380912+0000","last_clean":"2024-09-12T17:09:03.380912+0000","last_became_active":"2024-09-12T17:05:53.539372+0000","last_became_peered":"2024-09-12T17:05:53.539372+0000","last_unstale":"2024-09-12T17:09:03.380912+0000","last_undegraded":"2024-09-12T17:09:03.380912+0000","last_fullsized":"2024-09-12T17:09:03.380912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:05:58.931466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":59,"num_read_kb":69,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211474+0000","last_change":"2024-09-12T17:05:55.554060+0000","last_active":"2024-09-12T17:08:35.211474+0000","last_peered":"2024-09-12T17:08:35.211474+0000","last_clean":"2024-09-12T17:08:35.211474+0000","last_became_active":"2024-09-12T17:05:55.553263+0000","last_became_peered":"2024-09-12T17:05:55.553263+0000","last_unstale":"2024-09-12T17:08:35.211474+0000","last_undegraded":"2024-09-12T17:08:35.211474+0000","last_fullsized":"2024-09-12T17:08:35.211474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:53:44.303469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602500+0000","last_change":"2024-09-12T17:05:58.121180+0000","last_active":"2024-09-12T17:08:33.602500+0000","last_peered":"2024-09-12T17:08:33.602500+0000","last_clean":"2024-09-12T17:08:33.602500+0000","last_became_active":"2024-09-12T17:05:58.119755+0000","last_became_peered":"2024-09-12T17:05:58.119755+0000","last_unstale":"2024-09-12T17:08:33.602500+0000","last_undegraded":"2024-09-12T17:08:33.602500+0000","last_fullsized":"2024-09-12T17:08:33.602500+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:12:11.504510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.901615+0000","last_change":"2024-09-12T17:09:16.901615+0000","last_active":"2024-09-12T17:09:16.901615+0000","last_peered":"2024-09-12T17:09:16.901615+0000","last_clean":"2024-09-12T17:09:16.901615+0000","last_became_active":"2024-09-12T17:05:49.549583+0000","last_became_peered":"2024-09-12T17:05:49.549583+0000","last_unstale":"2024-09-12T17:09:16.901615+0000","last_undegraded":"2024-09-12T17:09:16.901615+0000","last_fullsized":"2024-09-12T17:09:16.901615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:16.901435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:16.901435+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.901435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:56.459849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"103'20","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.316998+0000","last_change":"2024-09-12T17:09:10.316998+0000","last_active":"2024-09-12T17:09:10.316998+0000","last_peered":"2024-09-12T17:09:10.316998+0000","last_clean":"2024-09-12T17:09:10.316998+0000","last_became_active":"2024-09-12T17:08:18.448295+0000","last_became_peered":"2024-09-12T17:08:18.448295+0000","last_unstale":"2024-09-12T17:09:10.316998+0000","last_undegraded":"2024-09-12T17:09:10.316998+0000","last_fullsized":"2024-09-12T17:09:10.316998+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:10.316935+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:10.316935+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.316935+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:10.408719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36867,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.860433+0000","last_change":"2024-09-12T17:09:12.860433+0000","last_active":"2024-09-12T17:09:12.860433+0000","last_peered":"2024-09-12T17:09:12.860433+0000","last_clean":"2024-09-12T17:09:12.860433+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:09:12.860433+0000","last_undegraded":"2024-09-12T17:09:12.860433+0000","last_fullsized":"2024-09-12T17:09:12.860433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:12.860165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:12.860165+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.860165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:50.719125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.206536+0000","last_change":"2024-09-12T17:09:22.206536+0000","last_active":"2024-09-12T17:09:22.206536+0000","last_peered":"2024-09-12T17:09:22.206536+0000","last_clean":"2024-09-12T17:09:22.206536+0000","last_became_active":"2024-09-12T17:05:51.545225+0000","last_became_peered":"2024-09-12T17:05:51.545225+0000","last_unstale":"2024-09-12T17:09:22.206536+0000","last_undegraded":"2024-09-12T17:09:22.206536+0000","last_fullsized":"2024-09-12T17:09:22.206536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:22.206356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:22.206356+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.206356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:48.969783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"103'21","reported_seq":70,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.051385+0000","last_change":"2024-09-12T17:09:22.051385+0000","last_active":"2024-09-12T17:09:22.051385+0000","last_peered":"2024-09-12T17:09:22.051385+0000","last_clean":"2024-09-12T17:09:22.051385+0000","last_became_active":"2024-09-12T17:08:18.456095+0000","last_became_peered":"2024-09-12T17:08:18.456095+0000","last_unstale":"2024-09-12T17:09:22.051385+0000","last_undegraded":"2024-09-12T17:09:22.051385+0000","last_fullsized":"2024-09-12T17:09:22.051385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'21","last_scrub_stamp":"2024-09-12T17:09:22.051178+0000","last_deep_scrub":"103'21","last_deep_scrub_stamp":"2024-09-12T17:09:22.051178+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.051178+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:01.067947+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"103'20","reported_seq":222,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.652459+0000","last_change":"2024-09-12T17:08:21.492858+0000","last_active":"2024-09-12T17:09:02.652459+0000","last_peered":"2024-09-12T17:09:02.652459+0000","last_clean":"2024-09-12T17:09:02.652459+0000","last_became_active":"2024-09-12T17:08:21.467026+0000","last_became_peered":"2024-09-12T17:08:21.467026+0000","last_unstale":"2024-09-12T17:09:02.652459+0000","last_undegraded":"2024-09-12T17:09:02.652459+0000","last_fullsized":"2024-09-12T17:09:02.652459+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:02:08.135205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.026036+0000","last_change":"2024-09-12T17:05:58.118437+0000","last_active":"2024-09-12T17:08:36.026036+0000","last_peered":"2024-09-12T17:08:36.026036+0000","last_clean":"2024-09-12T17:08:36.026036+0000","last_became_active":"2024-09-12T17:05:58.117710+0000","last_became_peered":"2024-09-12T17:05:58.117710+0000","last_unstale":"2024-09-12T17:08:36.026036+0000","last_undegraded":"2024-09-12T17:08:36.026036+0000","last_fullsized":"2024-09-12T17:08:36.026036+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:00.239807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":134,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.533557+0000","last_change":"2024-09-12T17:09:16.533557+0000","last_active":"2024-09-12T17:09:16.533557+0000","last_peered":"2024-09-12T17:09:16.533557+0000","last_clean":"2024-09-12T17:09:16.533557+0000","last_became_active":"2024-09-12T17:06:27.817451+0000","last_became_peered":"2024-09-12T17:06:27.817451+0000","last_unstale":"2024-09-12T17:09:16.533557+0000","last_undegraded":"2024-09-12T17:09:16.533557+0000","last_fullsized":"2024-09-12T17:09:16.533557+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:16.533375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:16.533375+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.533375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:56.600068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"103'14","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:09.409890+0000","last_change":"2024-09-12T17:09:09.409890+0000","last_active":"2024-09-12T17:09:09.409890+0000","last_peered":"2024-09-12T17:09:09.409890+0000","last_clean":"2024-09-12T17:09:09.409890+0000","last_became_active":"2024-09-12T17:05:47.534790+0000","last_became_peered":"2024-09-12T17:05:47.534790+0000","last_unstale":"2024-09-12T17:09:09.409890+0000","last_undegraded":"2024-09-12T17:09:09.409890+0000","last_fullsized":"2024-09-12T17:09:09.409890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'14","last_scrub_stamp":"2024-09-12T17:09:09.409700+0000","last_deep_scrub":"103'14","last_deep_scrub_stamp":"2024-09-12T17:09:09.409700+0000","last_clean_scrub_stamp":"2024-09-12T17:09:09.409700+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:45.523551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26627,"num_write":22,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:08.300906+0000","last_change":"2024-09-12T17:09:08.300906+0000","last_active":"2024-09-12T17:09:08.300906+0000","last_peered":"2024-09-12T17:09:08.300906+0000","last_clean":"2024-09-12T17:09:08.300906+0000","last_became_active":"2024-09-12T17:08:21.467016+0000","last_became_peered":"2024-09-12T17:08:21.467016+0000","last_unstale":"2024-09-12T17:09:08.300906+0000","last_undegraded":"2024-09-12T17:09:08.300906+0000","last_fullsized":"2024-09-12T17:09:08.300906+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:08.300823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:08.300823+0000","last_clean_scrub_stamp":"2024-09-12T17:09:08.300823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:01.702916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211005+0000","last_change":"2024-09-12T17:05:51.533668+0000","last_active":"2024-09-12T17:08:35.211005+0000","last_peered":"2024-09-12T17:08:35.211005+0000","last_clean":"2024-09-12T17:08:35.211005+0000","last_became_active":"2024-09-12T17:05:51.532795+0000","last_became_peered":"2024-09-12T17:05:51.532795+0000","last_unstale":"2024-09-12T17:08:35.211005+0000","last_undegraded":"2024-09-12T17:08:35.211005+0000","last_fullsized":"2024-09-12T17:08:35.211005+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:32:49.655645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"36'10","reported_seq":171,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.211301+0000","last_change":"2024-09-12T17:05:53.544503+0000","last_active":"2024-09-12T17:08:35.211301+0000","last_peered":"2024-09-12T17:08:35.211301+0000","last_clean":"2024-09-12T17:08:35.211301+0000","last_became_active":"2024-09-12T17:05:53.543495+0000","last_became_peered":"2024-09-12T17:05:53.543495+0000","last_unstale":"2024-09-12T17:08:35.211301+0000","last_undegraded":"2024-09-12T17:08:35.211301+0000","last_fullsized":"2024-09-12T17:08:35.211301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:06:31.721968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"103'18","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.659123+0000","last_change":"2024-09-12T17:05:55.567580+0000","last_active":"2024-09-12T17:09:02.659123+0000","last_peered":"2024-09-12T17:09:02.659123+0000","last_clean":"2024-09-12T17:09:02.659123+0000","last_became_active":"2024-09-12T17:05:55.566652+0000","last_became_peered":"2024-09-12T17:05:55.566652+0000","last_unstale":"2024-09-12T17:09:02.659123+0000","last_undegraded":"2024-09-12T17:09:02.659123+0000","last_fullsized":"2024-09-12T17:09:02.659123+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:39:28.904117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"68'2","reported_seq":149,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602357+0000","last_change":"2024-09-12T17:05:57.585098+0000","last_active":"2024-09-12T17:08:33.602357+0000","last_peered":"2024-09-12T17:08:33.602357+0000","last_clean":"2024-09-12T17:08:33.602357+0000","last_became_active":"2024-09-12T17:05:57.584326+0000","last_became_peered":"2024-09-12T17:05:57.584326+0000","last_unstale":"2024-09-12T17:08:33.602357+0000","last_undegraded":"2024-09-12T17:08:33.602357+0000","last_fullsized":"2024-09-12T17:08:33.602357+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.788725+0000","last_change":"2024-09-12T17:09:11.788725+0000","last_active":"2024-09-12T17:09:11.788725+0000","last_peered":"2024-09-12T17:09:11.788725+0000","last_clean":"2024-09-12T17:09:11.788725+0000","last_became_active":"2024-09-12T17:05:49.551726+0000","last_became_peered":"2024-09-12T17:05:49.551726+0000","last_unstale":"2024-09-12T17:09:11.788725+0000","last_undegraded":"2024-09-12T17:09:11.788725+0000","last_fullsized":"2024-09-12T17:09:11.788725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:11.788545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:11.788545+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.788545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:08.935777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"103'12","reported_seq":220,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:08.716958+0000","last_change":"2024-09-12T17:09:08.716958+0000","last_active":"2024-09-12T17:09:08.716958+0000","last_peered":"2024-09-12T17:09:08.716958+0000","last_clean":"2024-09-12T17:09:08.716958+0000","last_became_active":"2024-09-12T17:08:18.466136+0000","last_became_peered":"2024-09-12T17:08:18.466136+0000","last_unstale":"2024-09-12T17:09:08.716958+0000","last_undegraded":"2024-09-12T17:09:08.716958+0000","last_fullsized":"2024-09-12T17:09:08.716958+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:08.716872+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:08.716872+0000","last_clean_scrub_stamp":"2024-09-12T17:09:08.716872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:16.240759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.125408+0000","last_change":"2024-09-12T17:09:14.125408+0000","last_active":"2024-09-12T17:09:14.125408+0000","last_peered":"2024-09-12T17:09:14.125408+0000","last_clean":"2024-09-12T17:09:14.125408+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:09:14.125408+0000","last_undegraded":"2024-09-12T17:09:14.125408+0000","last_fullsized":"2024-09-12T17:09:14.125408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:14.125234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:14.125234+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.125234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:31.022949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.295466+0000","last_change":"2024-09-12T17:09:26.295466+0000","last_active":"2024-09-12T17:09:26.295466+0000","last_peered":"2024-09-12T17:09:26.295466+0000","last_clean":"2024-09-12T17:09:26.295466+0000","last_became_active":"2024-09-12T17:08:18.449746+0000","last_became_peered":"2024-09-12T17:08:18.449746+0000","last_unstale":"2024-09-12T17:09:26.295466+0000","last_undegraded":"2024-09-12T17:09:26.295466+0000","last_fullsized":"2024-09-12T17:09:26.295466+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:26.295255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:26.295255+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.295255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:43.350440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"103'50","reported_seq":233,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.039198+0000","last_change":"2024-09-12T17:05:53.554751+0000","last_active":"2024-09-12T17:09:03.039198+0000","last_peered":"2024-09-12T17:09:03.039198+0000","last_clean":"2024-09-12T17:09:03.039198+0000","last_became_active":"2024-09-12T17:05:53.553914+0000","last_became_peered":"2024-09-12T17:05:53.553914+0000","last_unstale":"2024-09-12T17:09:03.039198+0000","last_undegraded":"2024-09-12T17:09:03.039198+0000","last_fullsized":"2024-09-12T17:09:03.039198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:12.449581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":92,"num_read_kb":158,"num_write":60,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":164,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022004+0000","last_change":"2024-09-12T17:08:21.458963+0000","last_active":"2024-09-12T17:08:36.022004+0000","last_peered":"2024-09-12T17:08:36.022004+0000","last_clean":"2024-09-12T17:08:36.022004+0000","last_became_active":"2024-09-12T17:08:21.458521+0000","last_became_peered":"2024-09-12T17:08:21.458521+0000","last_unstale":"2024-09-12T17:08:36.022004+0000","last_undegraded":"2024-09-12T17:08:36.022004+0000","last_fullsized":"2024-09-12T17:08:36.022004+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:59:56.903898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603355+0000","last_change":"2024-09-12T17:05:57.605829+0000","last_active":"2024-09-12T17:08:33.603355+0000","last_peered":"2024-09-12T17:08:33.603355+0000","last_clean":"2024-09-12T17:08:33.603355+0000","last_became_active":"2024-09-12T17:05:57.605041+0000","last_became_peered":"2024-09-12T17:05:57.605041+0000","last_unstale":"2024-09-12T17:08:33.603355+0000","last_undegraded":"2024-09-12T17:08:33.603355+0000","last_fullsized":"2024-09-12T17:08:33.603355+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:07:29.537577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602885+0000","last_change":"2024-09-12T17:05:57.594498+0000","last_active":"2024-09-12T17:08:33.602885+0000","last_peered":"2024-09-12T17:08:33.602885+0000","last_clean":"2024-09-12T17:08:33.602885+0000","last_became_active":"2024-09-12T17:05:57.590196+0000","last_became_peered":"2024-09-12T17:05:57.590196+0000","last_unstale":"2024-09-12T17:08:33.602885+0000","last_undegraded":"2024-09-12T17:08:33.602885+0000","last_fullsized":"2024-09-12T17:08:33.602885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:50:07.543735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.819913+0000","last_change":"2024-09-12T17:09:18.819913+0000","last_active":"2024-09-12T17:09:18.819913+0000","last_peered":"2024-09-12T17:09:18.819913+0000","last_clean":"2024-09-12T17:09:18.819913+0000","last_became_active":"2024-09-12T17:05:49.561429+0000","last_became_peered":"2024-09-12T17:05:49.561429+0000","last_unstale":"2024-09-12T17:09:18.819913+0000","last_undegraded":"2024-09-12T17:09:18.819913+0000","last_fullsized":"2024-09-12T17:09:18.819913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:18.819725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:18.819725+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.819725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:17.430263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"103'18","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.765901+0000","last_change":"2024-09-12T17:09:12.765901+0000","last_active":"2024-09-12T17:09:12.765901+0000","last_peered":"2024-09-12T17:09:12.765901+0000","last_clean":"2024-09-12T17:09:12.765901+0000","last_became_active":"2024-09-12T17:05:47.556417+0000","last_became_peered":"2024-09-12T17:05:47.556417+0000","last_unstale":"2024-09-12T17:09:12.765901+0000","last_undegraded":"2024-09-12T17:09:12.765901+0000","last_fullsized":"2024-09-12T17:09:12.765901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:12.765705+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:12.765705+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.765705+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:29.251261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32774,"num_write":34,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":47,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.145949+0000","last_change":"2024-09-12T17:09:16.145949+0000","last_active":"2024-09-12T17:09:16.145949+0000","last_peered":"2024-09-12T17:09:16.145949+0000","last_clean":"2024-09-12T17:09:16.145949+0000","last_became_active":"2024-09-12T17:08:18.464091+0000","last_became_peered":"2024-09-12T17:08:18.464091+0000","last_unstale":"2024-09-12T17:09:16.145949+0000","last_undegraded":"2024-09-12T17:09:16.145949+0000","last_fullsized":"2024-09-12T17:09:16.145949+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:16.145766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:16.145766+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.145766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:36.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"103'20","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.211109+0000","last_change":"2024-09-12T17:05:53.542230+0000","last_active":"2024-09-12T17:09:03.211109+0000","last_peered":"2024-09-12T17:09:03.211109+0000","last_clean":"2024-09-12T17:09:03.211109+0000","last_became_active":"2024-09-12T17:05:53.541653+0000","last_became_peered":"2024-09-12T17:05:53.541653+0000","last_unstale":"2024-09-12T17:09:03.211109+0000","last_undegraded":"2024-09-12T17:09:03.211109+0000","last_fullsized":"2024-09-12T17:09:03.211109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:51:43.312101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":42,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022656+0000","last_change":"2024-09-12T17:05:55.556535+0000","last_active":"2024-09-12T17:08:36.022656+0000","last_peered":"2024-09-12T17:08:36.022656+0000","last_clean":"2024-09-12T17:08:36.022656+0000","last_became_active":"2024-09-12T17:05:55.555755+0000","last_became_peered":"2024-09-12T17:05:55.555755+0000","last_unstale":"2024-09-12T17:08:36.022656+0000","last_undegraded":"2024-09-12T17:08:36.022656+0000","last_fullsized":"2024-09-12T17:08:36.022656+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:04:06.707384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"84'2","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025238+0000","last_change":"2024-09-12T17:05:57.593418+0000","last_active":"2024-09-12T17:08:36.025238+0000","last_peered":"2024-09-12T17:08:36.025238+0000","last_clean":"2024-09-12T17:08:36.025238+0000","last_became_active":"2024-09-12T17:05:57.592746+0000","last_became_peered":"2024-09-12T17:05:57.592746+0000","last_unstale":"2024-09-12T17:08:36.025238+0000","last_undegraded":"2024-09-12T17:08:36.025238+0000","last_fullsized":"2024-09-12T17:08:36.025238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:19:24.794382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"68'6","reported_seq":46,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.211873+0000","last_change":"2024-09-12T17:09:14.211873+0000","last_active":"2024-09-12T17:09:14.211873+0000","last_peered":"2024-09-12T17:09:14.211873+0000","last_clean":"2024-09-12T17:09:14.211873+0000","last_became_active":"2024-09-12T17:08:21.466328+0000","last_became_peered":"2024-09-12T17:08:21.466328+0000","last_unstale":"2024-09-12T17:09:14.211873+0000","last_undegraded":"2024-09-12T17:09:14.211873+0000","last_fullsized":"2024-09-12T17:09:14.211873+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-09-12T17:09:14.211689+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-09-12T17:09:14.211689+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.211689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:29.550680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"103'12","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.990639+0000","last_change":"2024-09-12T17:09:20.990639+0000","last_active":"2024-09-12T17:09:20.990639+0000","last_peered":"2024-09-12T17:09:20.990639+0000","last_clean":"2024-09-12T17:09:20.990639+0000","last_became_active":"2024-09-12T17:05:47.558641+0000","last_became_peered":"2024-09-12T17:05:47.558641+0000","last_unstale":"2024-09-12T17:09:20.990639+0000","last_undegraded":"2024-09-12T17:09:20.990639+0000","last_fullsized":"2024-09-12T17:09:20.990639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:20.990456+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:20.990456+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.990456+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:18.712905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24585,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.253209+0000","last_change":"2024-09-12T17:09:27.253209+0000","last_active":"2024-09-12T17:09:27.253209+0000","last_peered":"2024-09-12T17:09:27.253209+0000","last_clean":"2024-09-12T17:09:27.253209+0000","last_became_active":"2024-09-12T17:05:51.539275+0000","last_became_peered":"2024-09-12T17:05:51.539275+0000","last_unstale":"2024-09-12T17:09:27.253209+0000","last_undegraded":"2024-09-12T17:09:27.253209+0000","last_fullsized":"2024-09-12T17:09:27.253209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:27.253027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:27.253027+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.253027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:24.774906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"84'6","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.600440+0000","last_change":"2024-09-12T17:05:53.544731+0000","last_active":"2024-09-12T17:08:33.600440+0000","last_peered":"2024-09-12T17:08:33.600440+0000","last_clean":"2024-09-12T17:08:33.600440+0000","last_became_active":"2024-09-12T17:05:53.544127+0000","last_became_peered":"2024-09-12T17:05:53.544127+0000","last_unstale":"2024-09-12T17:08:33.600440+0000","last_undegraded":"2024-09-12T17:08:33.600440+0000","last_fullsized":"2024-09-12T17:08:33.600440+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:54:04.351698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604873+0000","last_change":"2024-09-12T17:05:55.571541+0000","last_active":"2024-09-12T17:08:33.604873+0000","last_peered":"2024-09-12T17:08:33.604873+0000","last_clean":"2024-09-12T17:08:33.604873+0000","last_became_active":"2024-09-12T17:05:55.570822+0000","last_became_peered":"2024-09-12T17:05:55.570822+0000","last_unstale":"2024-09-12T17:08:33.604873+0000","last_undegraded":"2024-09-12T17:08:33.604873+0000","last_fullsized":"2024-09-12T17:08:33.604873+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'2","reported_seq":165,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602495+0000","last_change":"2024-09-12T17:08:18.704689+0000","last_active":"2024-09-12T17:08:33.602495+0000","last_peered":"2024-09-12T17:08:33.602495+0000","last_clean":"2024-09-12T17:08:33.602495+0000","last_became_active":"2024-09-12T17:08:18.450561+0000","last_became_peered":"2024-09-12T17:08:18.450561+0000","last_unstale":"2024-09-12T17:08:33.602495+0000","last_undegraded":"2024-09-12T17:08:33.602495+0000","last_fullsized":"2024-09-12T17:08:33.602495+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:00:43.088841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.387598+0000","last_change":"2024-09-12T17:09:21.387598+0000","last_active":"2024-09-12T17:09:21.387598+0000","last_peered":"2024-09-12T17:09:21.387598+0000","last_clean":"2024-09-12T17:09:21.387598+0000","last_became_active":"2024-09-12T17:05:49.519721+0000","last_became_peered":"2024-09-12T17:05:49.519721+0000","last_unstale":"2024-09-12T17:09:21.387598+0000","last_undegraded":"2024-09-12T17:09:21.387598+0000","last_fullsized":"2024-09-12T17:09:21.387598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:21.387416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:21.387416+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.387416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:12.445311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"103'16","reported_seq":199,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.063154+0000","last_change":"2024-09-12T17:09:12.063154+0000","last_active":"2024-09-12T17:09:12.063154+0000","last_peered":"2024-09-12T17:09:12.063154+0000","last_clean":"2024-09-12T17:09:12.063154+0000","last_became_active":"2024-09-12T17:05:47.538581+0000","last_became_peered":"2024-09-12T17:05:47.538581+0000","last_unstale":"2024-09-12T17:09:12.063154+0000","last_undegraded":"2024-09-12T17:09:12.063154+0000","last_fullsized":"2024-09-12T17:09:12.063154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:12.062963+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:12.062963+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.062963+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:20.939537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601093+0000","last_change":"2024-09-12T17:05:51.530541+0000","last_active":"2024-09-12T17:08:33.601093+0000","last_peered":"2024-09-12T17:08:33.601093+0000","last_clean":"2024-09-12T17:08:33.601093+0000","last_became_active":"2024-09-12T17:05:51.527515+0000","last_became_peered":"2024-09-12T17:05:51.527515+0000","last_unstale":"2024-09-12T17:08:33.601093+0000","last_undegraded":"2024-09-12T17:08:33.601093+0000","last_fullsized":"2024-09-12T17:08:33.601093+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:27:56.885344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"103'20","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.957945+0000","last_change":"2024-09-12T17:05:53.555017+0000","last_active":"2024-09-12T17:09:02.957945+0000","last_peered":"2024-09-12T17:09:02.957945+0000","last_clean":"2024-09-12T17:09:02.957945+0000","last_became_active":"2024-09-12T17:05:53.551154+0000","last_became_peered":"2024-09-12T17:05:53.551154+0000","last_unstale":"2024-09-12T17:09:02.957945+0000","last_undegraded":"2024-09-12T17:09:02.957945+0000","last_fullsized":"2024-09-12T17:09:02.957945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:26:50.736153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":37,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.353172+0000","last_change":"2024-09-12T17:05:55.570872+0000","last_active":"2024-09-12T17:08:35.353172+0000","last_peered":"2024-09-12T17:08:35.353172+0000","last_clean":"2024-09-12T17:08:35.353172+0000","last_became_active":"2024-09-12T17:05:55.570137+0000","last_became_peered":"2024-09-12T17:05:55.570137+0000","last_unstale":"2024-09-12T17:08:35.353172+0000","last_undegraded":"2024-09-12T17:08:35.353172+0000","last_fullsized":"2024-09-12T17:08:35.353172+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:30.684868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602407+0000","last_change":"2024-09-12T17:05:57.597088+0000","last_active":"2024-09-12T17:08:33.602407+0000","last_peered":"2024-09-12T17:08:33.602407+0000","last_clean":"2024-09-12T17:08:33.602407+0000","last_became_active":"2024-09-12T17:05:57.596377+0000","last_became_peered":"2024-09-12T17:05:57.596377+0000","last_unstale":"2024-09-12T17:08:33.602407+0000","last_undegraded":"2024-09-12T17:08:33.602407+0000","last_fullsized":"2024-09-12T17:08:33.602407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:49:03.042303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"68'2","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.381722+0000","last_change":"2024-09-12T17:09:18.381722+0000","last_active":"2024-09-12T17:09:18.381722+0000","last_peered":"2024-09-12T17:09:18.381722+0000","last_clean":"2024-09-12T17:09:18.381722+0000","last_became_active":"2024-09-12T17:08:18.449338+0000","last_became_peered":"2024-09-12T17:08:18.449338+0000","last_unstale":"2024-09-12T17:09:18.381722+0000","last_undegraded":"2024-09-12T17:09:18.381722+0000","last_fullsized":"2024-09-12T17:09:18.381722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-09-12T17:09:18.381508+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-09-12T17:09:18.381508+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.381508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:16.532668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"103'12","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:07.676026+0000","last_change":"2024-09-12T17:09:07.676026+0000","last_active":"2024-09-12T17:09:07.676026+0000","last_peered":"2024-09-12T17:09:07.676026+0000","last_clean":"2024-09-12T17:09:07.676026+0000","last_became_active":"2024-09-12T17:05:47.525874+0000","last_became_peered":"2024-09-12T17:05:47.525874+0000","last_unstale":"2024-09-12T17:09:07.676026+0000","last_undegraded":"2024-09-12T17:09:07.676026+0000","last_fullsized":"2024-09-12T17:09:07.676026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:07.675954+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:07.675954+0000","last_clean_scrub_stamp":"2024-09-12T17:09:07.675954+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:27.103026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":18435,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.252302+0000","last_change":"2024-09-12T17:09:23.252302+0000","last_active":"2024-09-12T17:09:23.252302+0000","last_peered":"2024-09-12T17:09:23.252302+0000","last_clean":"2024-09-12T17:09:23.252302+0000","last_became_active":"2024-09-12T17:05:51.539607+0000","last_became_peered":"2024-09-12T17:05:51.539607+0000","last_unstale":"2024-09-12T17:09:23.252302+0000","last_undegraded":"2024-09-12T17:09:23.252302+0000","last_fullsized":"2024-09-12T17:09:23.252302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:23.252121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:23.252121+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.252121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:50.775617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"103'17","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.892143+0000","last_change":"2024-09-12T17:05:53.549324+0000","last_active":"2024-09-12T17:09:02.892143+0000","last_peered":"2024-09-12T17:09:02.892143+0000","last_clean":"2024-09-12T17:09:02.892143+0000","last_became_active":"2024-09-12T17:05:53.548561+0000","last_became_peered":"2024-09-12T17:05:53.548561+0000","last_unstale":"2024-09-12T17:09:02.892143+0000","last_undegraded":"2024-09-12T17:09:02.892143+0000","last_fullsized":"2024-09-12T17:09:02.892143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:26:47.932776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601440+0000","last_change":"2024-09-12T17:05:55.561467+0000","last_active":"2024-09-12T17:08:33.601440+0000","last_peered":"2024-09-12T17:08:33.601440+0000","last_clean":"2024-09-12T17:08:33.601440+0000","last_became_active":"2024-09-12T17:05:55.560708+0000","last_became_peered":"2024-09-12T17:05:55.560708+0000","last_unstale":"2024-09-12T17:08:33.601440+0000","last_undegraded":"2024-09-12T17:08:33.601440+0000","last_fullsized":"2024-09-12T17:08:33.601440+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"84'46","reported_seq":221,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.161582+0000","last_change":"2024-09-12T17:09:18.161582+0000","last_active":"2024-09-12T17:09:18.161582+0000","last_peered":"2024-09-12T17:09:18.161582+0000","last_clean":"2024-09-12T17:09:18.161582+0000","last_became_active":"2024-09-12T17:05:49.546232+0000","last_became_peered":"2024-09-12T17:05:49.546232+0000","last_unstale":"2024-09-12T17:09:18.161582+0000","last_undegraded":"2024-09-12T17:09:18.161582+0000","last_fullsized":"2024-09-12T17:09:18.161582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'46","last_scrub_stamp":"2024-09-12T17:09:18.161400+0000","last_deep_scrub":"84'46","last_deep_scrub_stamp":"2024-09-12T17:09:18.161400+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.161400+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:27.986208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"103'16","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.394020+0000","last_change":"2024-09-12T17:09:14.394020+0000","last_active":"2024-09-12T17:09:14.394020+0000","last_peered":"2024-09-12T17:09:14.394020+0000","last_clean":"2024-09-12T17:09:14.394020+0000","last_became_active":"2024-09-12T17:05:47.521097+0000","last_became_peered":"2024-09-12T17:05:47.521097+0000","last_unstale":"2024-09-12T17:09:14.394020+0000","last_undegraded":"2024-09-12T17:09:14.394020+0000","last_fullsized":"2024-09-12T17:09:14.394020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:14.393817+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:14.393817+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.393817+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:53.952231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24579,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":166,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.731908+0000","last_change":"2024-09-12T17:09:27.731908+0000","last_active":"2024-09-12T17:09:27.731908+0000","last_peered":"2024-09-12T17:09:27.731908+0000","last_clean":"2024-09-12T17:09:27.731908+0000","last_became_active":"2024-09-12T17:05:51.525457+0000","last_became_peered":"2024-09-12T17:05:51.525457+0000","last_unstale":"2024-09-12T17:09:27.731908+0000","last_undegraded":"2024-09-12T17:09:27.731908+0000","last_fullsized":"2024-09-12T17:09:27.731908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:27.731717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:27.731717+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.731717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:59.925317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"103'38","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.053966+0000","last_change":"2024-09-12T17:09:25.053966+0000","last_active":"2024-09-12T17:09:25.053966+0000","last_peered":"2024-09-12T17:09:25.053966+0000","last_clean":"2024-09-12T17:09:25.053966+0000","last_became_active":"2024-09-12T17:08:18.463961+0000","last_became_peered":"2024-09-12T17:08:18.463961+0000","last_unstale":"2024-09-12T17:09:25.053966+0000","last_undegraded":"2024-09-12T17:09:25.053966+0000","last_fullsized":"2024-09-12T17:09:25.053966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'38","last_scrub_stamp":"2024-09-12T17:09:25.053751+0000","last_deep_scrub":"103'38","last_deep_scrub_stamp":"2024-09-12T17:09:25.053751+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.053751+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:41.478348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":124,"num_write":44,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":16653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.603360+0000","last_change":"2024-09-12T17:05:55.563312+0000","last_active":"2024-09-12T17:08:33.603360+0000","last_peered":"2024-09-12T17:08:33.603360+0000","last_clean":"2024-09-12T17:08:33.603360+0000","last_became_active":"2024-09-12T17:05:55.562405+0000","last_became_peered":"2024-09-12T17:05:55.562405+0000","last_unstale":"2024-09-12T17:08:33.603360+0000","last_undegraded":"2024-09-12T17:08:33.603360+0000","last_fullsized":"2024-09-12T17:08:33.603360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:25:05.138499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.022413+0000","last_change":"2024-09-12T17:05:58.121110+0000","last_active":"2024-09-12T17:08:36.022413+0000","last_peered":"2024-09-12T17:08:36.022413+0000","last_clean":"2024-09-12T17:08:36.022413+0000","last_became_active":"2024-09-12T17:05:58.120367+0000","last_became_peered":"2024-09-12T17:05:58.120367+0000","last_unstale":"2024-09-12T17:08:36.022413+0000","last_undegraded":"2024-09-12T17:08:36.022413+0000","last_fullsized":"2024-09-12T17:08:36.022413+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:33:01.561859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.876624+0000","last_change":"2024-09-12T17:09:19.876624+0000","last_active":"2024-09-12T17:09:19.876624+0000","last_peered":"2024-09-12T17:09:19.876624+0000","last_clean":"2024-09-12T17:09:19.876624+0000","last_became_active":"2024-09-12T17:05:49.531975+0000","last_became_peered":"2024-09-12T17:05:49.531975+0000","last_unstale":"2024-09-12T17:09:19.876624+0000","last_undegraded":"2024-09-12T17:09:19.876624+0000","last_fullsized":"2024-09-12T17:09:19.876624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:19.876442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:19.876442+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.876442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:03.300892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"103'18","reported_seq":72,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.312490+0000","last_change":"2024-09-12T17:09:11.312490+0000","last_active":"2024-09-12T17:09:11.312490+0000","last_peered":"2024-09-12T17:09:11.312490+0000","last_clean":"2024-09-12T17:09:11.312490+0000","last_became_active":"2024-09-12T17:08:18.457074+0000","last_became_peered":"2024-09-12T17:08:18.457074+0000","last_unstale":"2024-09-12T17:09:11.312490+0000","last_undegraded":"2024-09-12T17:09:11.312490+0000","last_fullsized":"2024-09-12T17:09:11.312490+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:11.312305+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:11.312305+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.312305+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:48.628370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":36876,"num_write":50,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.229400+0000","last_change":"2024-09-12T17:09:24.229400+0000","last_active":"2024-09-12T17:09:24.229400+0000","last_peered":"2024-09-12T17:09:24.229400+0000","last_clean":"2024-09-12T17:09:24.229400+0000","last_became_active":"2024-09-12T17:05:51.545154+0000","last_became_peered":"2024-09-12T17:05:51.545154+0000","last_unstale":"2024-09-12T17:09:24.229400+0000","last_undegraded":"2024-09-12T17:09:24.229400+0000","last_fullsized":"2024-09-12T17:09:24.229400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:24.229185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:24.229185+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.229185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:09.557266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"103'23","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.924701+0000","last_change":"2024-09-12T17:05:53.558834+0000","last_active":"2024-09-12T17:09:02.924701+0000","last_peered":"2024-09-12T17:09:02.924701+0000","last_clean":"2024-09-12T17:09:02.924701+0000","last_became_active":"2024-09-12T17:05:53.558086+0000","last_became_peered":"2024-09-12T17:05:53.558086+0000","last_unstale":"2024-09-12T17:09:02.924701+0000","last_undegraded":"2024-09-12T17:09:02.924701+0000","last_fullsized":"2024-09-12T17:09:02.924701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:16:43.690058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":51,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114479+0000","last_change":"2024-09-12T17:08:21.466904+0000","last_active":"2024-09-12T17:08:35.114479+0000","last_peered":"2024-09-12T17:08:35.114479+0000","last_clean":"2024-09-12T17:08:35.114479+0000","last_became_active":"2024-09-12T17:08:21.466295+0000","last_became_peered":"2024-09-12T17:08:21.466295+0000","last_unstale":"2024-09-12T17:08:35.114479+0000","last_undegraded":"2024-09-12T17:08:35.114479+0000","last_fullsized":"2024-09-12T17:08:35.114479+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:39:22.041235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'2","reported_seq":151,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352817+0000","last_change":"2024-09-12T17:05:57.597468+0000","last_active":"2024-09-12T17:08:35.352817+0000","last_peered":"2024-09-12T17:08:35.352817+0000","last_clean":"2024-09-12T17:08:35.352817+0000","last_became_active":"2024-09-12T17:05:57.596651+0000","last_became_peered":"2024-09-12T17:05:57.596651+0000","last_unstale":"2024-09-12T17:08:35.352817+0000","last_undegraded":"2024-09-12T17:08:35.352817+0000","last_fullsized":"2024-09-12T17:08:35.352817+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:58:05.466145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.352736+0000","last_change":"2024-09-12T17:09:23.352736+0000","last_active":"2024-09-12T17:09:23.352736+0000","last_peered":"2024-09-12T17:09:23.352736+0000","last_clean":"2024-09-12T17:09:23.352736+0000","last_became_active":"2024-09-12T17:08:18.465478+0000","last_became_peered":"2024-09-12T17:08:18.465478+0000","last_unstale":"2024-09-12T17:09:23.352736+0000","last_undegraded":"2024-09-12T17:09:23.352736+0000","last_fullsized":"2024-09-12T17:09:23.352736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:23.352534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:23.352534+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.352534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:10.229056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"103'14","reported_seq":226,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.803082+0000","last_change":"2024-09-12T17:09:10.803082+0000","last_active":"2024-09-12T17:09:10.803082+0000","last_peered":"2024-09-12T17:09:10.803082+0000","last_clean":"2024-09-12T17:09:10.803082+0000","last_became_active":"2024-09-12T17:08:18.447694+0000","last_became_peered":"2024-09-12T17:08:18.447694+0000","last_unstale":"2024-09-12T17:09:10.803082+0000","last_undegraded":"2024-09-12T17:09:10.803082+0000","last_fullsized":"2024-09-12T17:09:10.803082+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'14","last_scrub_stamp":"2024-09-12T17:09:10.802897+0000","last_deep_scrub":"103'14","last_deep_scrub_stamp":"2024-09-12T17:09:10.802897+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.802897+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:04.679641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28675,"num_write":22,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212636+0000","last_change":"2024-09-12T17:05:51.539916+0000","last_active":"2024-09-12T17:08:35.212636+0000","last_peered":"2024-09-12T17:08:35.212636+0000","last_clean":"2024-09-12T17:08:35.212636+0000","last_became_active":"2024-09-12T17:05:51.539054+0000","last_became_peered":"2024-09-12T17:05:51.539054+0000","last_unstale":"2024-09-12T17:08:35.212636+0000","last_undegraded":"2024-09-12T17:08:35.212636+0000","last_fullsized":"2024-09-12T17:08:35.212636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:11.640578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"103'20","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.274969+0000","last_change":"2024-09-12T17:05:53.557081+0000","last_active":"2024-09-12T17:09:03.274969+0000","last_peered":"2024-09-12T17:09:03.274969+0000","last_clean":"2024-09-12T17:09:03.274969+0000","last_became_active":"2024-09-12T17:05:53.556357+0000","last_became_peered":"2024-09-12T17:05:53.556357+0000","last_unstale":"2024-09-12T17:09:03.274969+0000","last_undegraded":"2024-09-12T17:09:03.274969+0000","last_fullsized":"2024-09-12T17:09:03.274969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:10.984649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":42,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.115218+0000","last_change":"2024-09-12T17:08:21.461633+0000","last_active":"2024-09-12T17:08:35.115218+0000","last_peered":"2024-09-12T17:08:35.115218+0000","last_clean":"2024-09-12T17:08:35.115218+0000","last_became_active":"2024-09-12T17:08:21.460894+0000","last_became_peered":"2024-09-12T17:08:21.460894+0000","last_unstale":"2024-09-12T17:08:35.115218+0000","last_undegraded":"2024-09-12T17:08:35.115218+0000","last_fullsized":"2024-09-12T17:08:35.115218+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:18.857770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601884+0000","last_change":"2024-09-12T17:05:57.596779+0000","last_active":"2024-09-12T17:08:33.601884+0000","last_peered":"2024-09-12T17:08:33.601884+0000","last_clean":"2024-09-12T17:08:33.601884+0000","last_became_active":"2024-09-12T17:05:57.596005+0000","last_became_peered":"2024-09-12T17:05:57.596005+0000","last_unstale":"2024-09-12T17:08:33.601884+0000","last_undegraded":"2024-09-12T17:08:33.601884+0000","last_fullsized":"2024-09-12T17:08:33.601884+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:54.225124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.569372+0000","last_change":"2024-09-12T17:09:15.569372+0000","last_active":"2024-09-12T17:09:15.569372+0000","last_peered":"2024-09-12T17:09:15.569372+0000","last_clean":"2024-09-12T17:09:15.569372+0000","last_became_active":"2024-09-12T17:08:18.445415+0000","last_became_peered":"2024-09-12T17:08:18.445415+0000","last_unstale":"2024-09-12T17:09:15.569372+0000","last_undegraded":"2024-09-12T17:09:15.569372+0000","last_fullsized":"2024-09-12T17:09:15.569372+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:15.569195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:15.569195+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.569195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:44.634479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"103'24","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.802596+0000","last_change":"2024-09-12T17:09:11.802596+0000","last_active":"2024-09-12T17:09:11.802596+0000","last_peered":"2024-09-12T17:09:11.802596+0000","last_clean":"2024-09-12T17:09:11.802596+0000","last_became_active":"2024-09-12T17:05:47.545466+0000","last_became_peered":"2024-09-12T17:05:47.545466+0000","last_unstale":"2024-09-12T17:09:11.802596+0000","last_undegraded":"2024-09-12T17:09:11.802596+0000","last_fullsized":"2024-09-12T17:09:11.802596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'24","last_scrub_stamp":"2024-09-12T17:09:11.802406+0000","last_deep_scrub":"103'24","last_deep_scrub_stamp":"2024-09-12T17:09:11.802406+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.802406+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:05.416311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":40966,"num_write":40,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":47,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.040432+0000","last_change":"2024-09-12T17:09:26.040432+0000","last_active":"2024-09-12T17:09:26.040432+0000","last_peered":"2024-09-12T17:09:26.040432+0000","last_clean":"2024-09-12T17:09:26.040432+0000","last_became_active":"2024-09-12T17:08:18.457099+0000","last_became_peered":"2024-09-12T17:08:18.457099+0000","last_unstale":"2024-09-12T17:09:26.040432+0000","last_undegraded":"2024-09-12T17:09:26.040432+0000","last_fullsized":"2024-09-12T17:09:26.040432+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:26.040252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:26.040252+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.040252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:26.001607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"86'12","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212137+0000","last_change":"2024-09-12T17:05:53.561278+0000","last_active":"2024-09-12T17:08:35.212137+0000","last_peered":"2024-09-12T17:08:35.212137+0000","last_clean":"2024-09-12T17:08:35.212137+0000","last_became_active":"2024-09-12T17:05:53.559688+0000","last_became_peered":"2024-09-12T17:05:53.559688+0000","last_unstale":"2024-09-12T17:08:35.212137+0000","last_undegraded":"2024-09-12T17:08:35.212137+0000","last_fullsized":"2024-09-12T17:08:35.212137+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:26:37.392549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":16,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"103'18","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:02.651046+0000","last_change":"2024-09-12T17:05:55.576227+0000","last_active":"2024-09-12T17:09:02.651046+0000","last_peered":"2024-09-12T17:09:02.651046+0000","last_clean":"2024-09-12T17:09:02.651046+0000","last_became_active":"2024-09-12T17:05:55.571966+0000","last_became_peered":"2024-09-12T17:05:55.571966+0000","last_unstale":"2024-09-12T17:09:02.651046+0000","last_undegraded":"2024-09-12T17:09:02.651046+0000","last_fullsized":"2024-09-12T17:09:02.651046+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:32:24.680106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601043+0000","last_change":"2024-09-12T17:05:57.595153+0000","last_active":"2024-09-12T17:08:33.601043+0000","last_peered":"2024-09-12T17:08:33.601043+0000","last_clean":"2024-09-12T17:08:33.601043+0000","last_became_active":"2024-09-12T17:05:57.594396+0000","last_became_peered":"2024-09-12T17:05:57.594396+0000","last_unstale":"2024-09-12T17:08:33.601043+0000","last_undegraded":"2024-09-12T17:08:33.601043+0000","last_fullsized":"2024-09-12T17:08:33.601043+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:27.040243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.834494+0000","last_change":"2024-09-12T17:09:22.834494+0000","last_active":"2024-09-12T17:09:22.834494+0000","last_peered":"2024-09-12T17:09:22.834494+0000","last_clean":"2024-09-12T17:09:22.834494+0000","last_became_active":"2024-09-12T17:05:49.542414+0000","last_became_peered":"2024-09-12T17:05:49.542414+0000","last_unstale":"2024-09-12T17:09:22.834494+0000","last_undegraded":"2024-09-12T17:09:22.834494+0000","last_fullsized":"2024-09-12T17:09:22.834494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:22.834262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:22.834262+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.834262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:43.545590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"103'24","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.407557+0000","last_change":"2024-09-12T17:09:11.407557+0000","last_active":"2024-09-12T17:09:11.407557+0000","last_peered":"2024-09-12T17:09:11.407557+0000","last_clean":"2024-09-12T17:09:11.407557+0000","last_became_active":"2024-09-12T17:06:27.784897+0000","last_became_peered":"2024-09-12T17:06:27.784897+0000","last_unstale":"2024-09-12T17:09:11.407557+0000","last_undegraded":"2024-09-12T17:09:11.407557+0000","last_fullsized":"2024-09-12T17:09:11.407557+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'24","last_scrub_stamp":"2024-09-12T17:09:11.407380+0000","last_deep_scrub":"103'24","last_deep_scrub_stamp":"2024-09-12T17:09:11.407380+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.407380+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:48.270232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":49158,"num_write":40,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.604574+0000","last_change":"2024-09-12T17:05:51.528322+0000","last_active":"2024-09-12T17:08:33.604574+0000","last_peered":"2024-09-12T17:08:33.604574+0000","last_clean":"2024-09-12T17:08:33.604574+0000","last_became_active":"2024-09-12T17:05:51.527501+0000","last_became_peered":"2024-09-12T17:05:51.527501+0000","last_unstale":"2024-09-12T17:08:33.604574+0000","last_undegraded":"2024-09-12T17:08:33.604574+0000","last_fullsized":"2024-09-12T17:08:33.604574+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:20:56.909343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"103'24","reported_seq":236,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.403800+0000","last_change":"2024-09-12T17:08:18.786022+0000","last_active":"2024-09-12T17:09:03.403800+0000","last_peered":"2024-09-12T17:09:03.403800+0000","last_clean":"2024-09-12T17:09:03.403800+0000","last_became_active":"2024-09-12T17:08:18.474969+0000","last_became_peered":"2024-09-12T17:08:18.474969+0000","last_unstale":"2024-09-12T17:09:03.403800+0000","last_undegraded":"2024-09-12T17:09:03.403800+0000","last_fullsized":"2024-09-12T17:09:03.403800+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1889,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.599911+0000","last_change":"2024-09-12T17:05:55.567202+0000","last_active":"2024-09-12T17:08:33.599911+0000","last_peered":"2024-09-12T17:08:33.599911+0000","last_clean":"2024-09-12T17:08:33.599911+0000","last_became_active":"2024-09-12T17:05:55.564710+0000","last_became_peered":"2024-09-12T17:05:55.564710+0000","last_unstale":"2024-09-12T17:08:33.599911+0000","last_undegraded":"2024-09-12T17:08:33.599911+0000","last_fullsized":"2024-09-12T17:08:33.599911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:10:12.991071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":146,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.608195+0000","last_change":"2024-09-12T17:05:57.604052+0000","last_active":"2024-09-12T17:08:33.608195+0000","last_peered":"2024-09-12T17:08:33.608195+0000","last_clean":"2024-09-12T17:08:33.608195+0000","last_became_active":"2024-09-12T17:05:57.603285+0000","last_became_peered":"2024-09-12T17:05:57.603285+0000","last_unstale":"2024-09-12T17:08:33.608195+0000","last_undegraded":"2024-09-12T17:08:33.608195+0000","last_fullsized":"2024-09-12T17:08:33.608195+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:01:31.225285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'6","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.811026+0000","last_change":"2024-09-12T17:09:20.811026+0000","last_active":"2024-09-12T17:09:20.811026+0000","last_peered":"2024-09-12T17:09:20.811026+0000","last_clean":"2024-09-12T17:09:20.811026+0000","last_became_active":"2024-09-12T17:05:49.541007+0000","last_became_peered":"2024-09-12T17:05:49.541007+0000","last_unstale":"2024-09-12T17:09:20.811026+0000","last_undegraded":"2024-09-12T17:09:20.811026+0000","last_fullsized":"2024-09-12T17:09:20.811026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-09-12T17:09:20.810800+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-09-12T17:09:20.810800+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.810800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:13.788947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"103'8","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.100077+0000","last_change":"2024-09-12T17:09:13.100077+0000","last_active":"2024-09-12T17:09:13.100077+0000","last_peered":"2024-09-12T17:09:13.100077+0000","last_clean":"2024-09-12T17:09:13.100077+0000","last_became_active":"2024-09-12T17:05:47.542345+0000","last_became_peered":"2024-09-12T17:05:47.542345+0000","last_unstale":"2024-09-12T17:09:13.100077+0000","last_undegraded":"2024-09-12T17:09:13.100077+0000","last_fullsized":"2024-09-12T17:09:13.100077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'8","last_scrub_stamp":"2024-09-12T17:09:13.099848+0000","last_deep_scrub":"103'8","last_deep_scrub_stamp":"2024-09-12T17:09:13.099848+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.099848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:20.623736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.602461+0000","last_change":"2024-09-12T17:05:51.556256+0000","last_active":"2024-09-12T17:08:33.602461+0000","last_peered":"2024-09-12T17:08:33.602461+0000","last_clean":"2024-09-12T17:08:33.602461+0000","last_became_active":"2024-09-12T17:05:51.554248+0000","last_became_peered":"2024-09-12T17:05:51.554248+0000","last_unstale":"2024-09-12T17:08:33.602461+0000","last_undegraded":"2024-09-12T17:08:33.602461+0000","last_fullsized":"2024-09-12T17:08:33.602461+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:14:59.658090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"103'17","reported_seq":214,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.416566+0000","last_change":"2024-09-12T17:08:18.486637+0000","last_active":"2024-09-12T17:09:03.416566+0000","last_peered":"2024-09-12T17:09:03.416566+0000","last_clean":"2024-09-12T17:09:03.416566+0000","last_became_active":"2024-09-12T17:08:18.450594+0000","last_became_peered":"2024-09-12T17:08:18.450594+0000","last_unstale":"2024-09-12T17:09:03.416566+0000","last_undegraded":"2024-09-12T17:09:03.416566+0000","last_fullsized":"2024-09-12T17:09:03.416566+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:13:21.334111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.352748+0000","last_change":"2024-09-12T17:05:55.567605+0000","last_active":"2024-09-12T17:08:35.352748+0000","last_peered":"2024-09-12T17:08:35.352748+0000","last_clean":"2024-09-12T17:08:35.352748+0000","last_became_active":"2024-09-12T17:05:55.566774+0000","last_became_peered":"2024-09-12T17:05:55.566774+0000","last_unstale":"2024-09-12T17:08:35.352748+0000","last_undegraded":"2024-09-12T17:08:35.352748+0000","last_fullsized":"2024-09-12T17:08:35.352748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:24:25.935376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:36.025423+0000","last_change":"2024-09-12T17:05:58.121216+0000","last_active":"2024-09-12T17:08:36.025423+0000","last_peered":"2024-09-12T17:08:36.025423+0000","last_clean":"2024-09-12T17:08:36.025423+0000","last_became_active":"2024-09-12T17:05:58.120364+0000","last_became_peered":"2024-09-12T17:05:58.120364+0000","last_unstale":"2024-09-12T17:08:36.025423+0000","last_undegraded":"2024-09-12T17:08:36.025423+0000","last_fullsized":"2024-09-12T17:08:36.025423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:09:55.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.371952+0000","last_change":"2024-09-12T17:09:22.371952+0000","last_active":"2024-09-12T17:09:22.371952+0000","last_peered":"2024-09-12T17:09:22.371952+0000","last_clean":"2024-09-12T17:09:22.371952+0000","last_became_active":"2024-09-12T17:05:49.549481+0000","last_became_peered":"2024-09-12T17:05:49.549481+0000","last_unstale":"2024-09-12T17:09:22.371952+0000","last_undegraded":"2024-09-12T17:09:22.371952+0000","last_fullsized":"2024-09-12T17:09:22.371952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:22.371763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:22.371763+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.371763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:35.061353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"103'18","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.414423+0000","last_change":"2024-09-12T17:09:13.414423+0000","last_active":"2024-09-12T17:09:13.414423+0000","last_peered":"2024-09-12T17:09:13.414423+0000","last_clean":"2024-09-12T17:09:13.414423+0000","last_became_active":"2024-09-12T17:05:47.510462+0000","last_became_peered":"2024-09-12T17:05:47.510462+0000","last_unstale":"2024-09-12T17:09:13.414423+0000","last_undegraded":"2024-09-12T17:09:13.414423+0000","last_fullsized":"2024-09-12T17:09:13.414423+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:13.414237+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:13.414237+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.414237+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:24.885296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":30726,"num_write":34,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210191+0000","last_change":"2024-09-12T17:05:51.541454+0000","last_active":"2024-09-12T17:08:35.210191+0000","last_peered":"2024-09-12T17:08:35.210191+0000","last_clean":"2024-09-12T17:08:35.210191+0000","last_became_active":"2024-09-12T17:05:51.539938+0000","last_became_peered":"2024-09-12T17:05:51.539938+0000","last_unstale":"2024-09-12T17:08:35.210191+0000","last_undegraded":"2024-09-12T17:08:35.210191+0000","last_fullsized":"2024-09-12T17:08:35.210191+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:50.505188+0000","last_clean_scrub_stamp":"2024-09-12T17:05:50.505188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:15:18.328350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"103'15","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.240033+0000","last_change":"2024-09-12T17:05:53.555764+0000","last_active":"2024-09-12T17:09:03.240033+0000","last_peered":"2024-09-12T17:09:03.240033+0000","last_clean":"2024-09-12T17:09:03.240033+0000","last_became_active":"2024-09-12T17:05:53.552095+0000","last_became_peered":"2024-09-12T17:05:53.552095+0000","last_unstale":"2024-09-12T17:09:03.240033+0000","last_undegraded":"2024-09-12T17:09:03.240033+0000","last_fullsized":"2024-09-12T17:09:03.240033+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:10:47.838610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":43,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":152,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.210403+0000","last_change":"2024-09-12T17:05:55.571520+0000","last_active":"2024-09-12T17:08:35.210403+0000","last_peered":"2024-09-12T17:08:35.210403+0000","last_clean":"2024-09-12T17:08:35.210403+0000","last_became_active":"2024-09-12T17:05:55.570863+0000","last_became_peered":"2024-09-12T17:05:55.570863+0000","last_unstale":"2024-09-12T17:08:35.210403+0000","last_undegraded":"2024-09-12T17:08:35.210403+0000","last_fullsized":"2024-09-12T17:08:35.210403+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:58.505521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.607147+0000","last_change":"2024-09-12T17:08:21.467058+0000","last_active":"2024-09-12T17:08:33.607147+0000","last_peered":"2024-09-12T17:08:33.607147+0000","last_clean":"2024-09-12T17:08:33.607147+0000","last_became_active":"2024-09-12T17:08:21.466218+0000","last_became_peered":"2024-09-12T17:08:21.466218+0000","last_unstale":"2024-09-12T17:08:33.607147+0000","last_undegraded":"2024-09-12T17:08:33.607147+0000","last_fullsized":"2024-09-12T17:08:33.607147+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:54:41.336998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"84'38","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.858626+0000","last_change":"2024-09-12T17:09:19.858626+0000","last_active":"2024-09-12T17:09:19.858626+0000","last_peered":"2024-09-12T17:09:19.858626+0000","last_clean":"2024-09-12T17:09:19.858626+0000","last_became_active":"2024-09-12T17:05:49.560875+0000","last_became_peered":"2024-09-12T17:05:49.560875+0000","last_unstale":"2024-09-12T17:09:19.858626+0000","last_undegraded":"2024-09-12T17:09:19.858626+0000","last_fullsized":"2024-09-12T17:09:19.858626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'38","last_scrub_stamp":"2024-09-12T17:09:19.858426+0000","last_deep_scrub":"84'38","last_deep_scrub_stamp":"2024-09-12T17:09:19.858426+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.858426+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:14.057363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"103'24","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.781380+0000","last_change":"2024-09-12T17:09:10.781380+0000","last_active":"2024-09-12T17:09:10.781380+0000","last_peered":"2024-09-12T17:09:10.781380+0000","last_clean":"2024-09-12T17:09:10.781380+0000","last_became_active":"2024-09-12T17:05:47.527364+0000","last_became_peered":"2024-09-12T17:05:47.527364+0000","last_unstale":"2024-09-12T17:09:10.781380+0000","last_undegraded":"2024-09-12T17:09:10.781380+0000","last_fullsized":"2024-09-12T17:09:10.781380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'24","last_scrub_stamp":"2024-09-12T17:09:10.781194+0000","last_deep_scrub":"103'24","last_deep_scrub_stamp":"2024-09-12T17:09:10.781194+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.781194+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:46.126494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45062,"num_write":40,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"103'2","reported_seq":52,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.121308+0000","last_change":"2024-09-12T17:09:18.121308+0000","last_active":"2024-09-12T17:09:18.121308+0000","last_peered":"2024-09-12T17:09:18.121308+0000","last_clean":"2024-09-12T17:09:18.121308+0000","last_became_active":"2024-09-12T17:08:18.463879+0000","last_became_peered":"2024-09-12T17:08:18.463879+0000","last_unstale":"2024-09-12T17:09:18.121308+0000","last_undegraded":"2024-09-12T17:09:18.121308+0000","last_fullsized":"2024-09-12T17:09:18.121308+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-12T17:09:18.121127+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-12T17:09:18.121127+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.121127+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:13.475769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"103'20","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:03.311364+0000","last_change":"2024-09-12T17:05:53.548391+0000","last_active":"2024-09-12T17:09:03.311364+0000","last_peered":"2024-09-12T17:09:03.311364+0000","last_clean":"2024-09-12T17:09:03.311364+0000","last_became_active":"2024-09-12T17:05:53.547202+0000","last_became_peered":"2024-09-12T17:05:53.547202+0000","last_unstale":"2024-09-12T17:09:03.311364+0000","last_undegraded":"2024-09-12T17:09:03.311364+0000","last_fullsized":"2024-09-12T17:09:03.311364+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:52.511316+0000","last_clean_scrub_stamp":"2024-09-12T17:05:52.511316+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:22:00.861022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":36,"num_read_kb":62,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":150,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:33.601272+0000","last_change":"2024-09-12T17:05:55.566243+0000","last_active":"2024-09-12T17:08:33.601272+0000","last_peered":"2024-09-12T17:08:33.601272+0000","last_clean":"2024-09-12T17:08:33.601272+0000","last_became_active":"2024-09-12T17:05:55.565403+0000","last_became_peered":"2024-09-12T17:05:55.565403+0000","last_unstale":"2024-09-12T17:08:33.601272+0000","last_undegraded":"2024-09-12T17:08:33.601272+0000","last_fullsized":"2024-09-12T17:08:33.601272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:54.517738+0000","last_clean_scrub_stamp":"2024-09-12T17:05:54.517738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:16:08.172093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":148,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.212872+0000","last_change":"2024-09-12T17:05:57.589526+0000","last_active":"2024-09-12T17:08:35.212872+0000","last_peered":"2024-09-12T17:08:35.212872+0000","last_clean":"2024-09-12T17:08:35.212872+0000","last_became_active":"2024-09-12T17:05:57.588626+0000","last_became_peered":"2024-09-12T17:05:57.588626+0000","last_unstale":"2024-09-12T17:08:35.212872+0000","last_undegraded":"2024-09-12T17:08:35.212872+0000","last_fullsized":"2024-09-12T17:08:35.212872+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:56.542306+0000","last_clean_scrub_stamp":"2024-09-12T17:05:56.542306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:33:29.472663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114540+0000","last_change":"2024-09-12T17:08:21.473957+0000","last_active":"2024-09-12T17:08:35.114540+0000","last_peered":"2024-09-12T17:08:35.114540+0000","last_clean":"2024-09-12T17:08:35.114540+0000","last_became_active":"2024-09-12T17:08:21.473677+0000","last_became_peered":"2024-09-12T17:08:21.473677+0000","last_unstale":"2024-09-12T17:08:35.114540+0000","last_undegraded":"2024-09-12T17:08:35.114540+0000","last_fullsized":"2024-09-12T17:08:35.114540+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:36:04.662160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"103'20","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.138511+0000","last_change":"2024-09-12T17:09:15.138511+0000","last_active":"2024-09-12T17:09:15.138511+0000","last_peered":"2024-09-12T17:09:15.138511+0000","last_clean":"2024-09-12T17:09:15.138511+0000","last_became_active":"2024-09-12T17:05:47.531750+0000","last_became_peered":"2024-09-12T17:05:47.531750+0000","last_unstale":"2024-09-12T17:09:15.138511+0000","last_undegraded":"2024-09-12T17:09:15.138511+0000","last_fullsized":"2024-09-12T17:09:15.138511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:15.138244+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:15.138244+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.138244+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:18.358900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36867,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.016282+0000","last_change":"2024-09-12T17:09:21.016282+0000","last_active":"2024-09-12T17:09:21.016282+0000","last_peered":"2024-09-12T17:09:21.016282+0000","last_clean":"2024-09-12T17:09:21.016282+0000","last_became_active":"2024-09-12T17:08:21.462942+0000","last_became_peered":"2024-09-12T17:08:21.462942+0000","last_unstale":"2024-09-12T17:09:21.016282+0000","last_undegraded":"2024-09-12T17:09:21.016282+0000","last_fullsized":"2024-09-12T17:09:21.016282+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:21.016097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:21.016097+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.016097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:16.105281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"103'18","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:09.378230+0000","last_change":"2024-09-12T17:09:09.378230+0000","last_active":"2024-09-12T17:09:09.378230+0000","last_peered":"2024-09-12T17:09:09.378230+0000","last_clean":"2024-09-12T17:09:09.378230+0000","last_became_active":"2024-09-12T17:05:47.525481+0000","last_became_peered":"2024-09-12T17:05:47.525481+0000","last_unstale":"2024-09-12T17:09:09.378230+0000","last_undegraded":"2024-09-12T17:09:09.378230+0000","last_fullsized":"2024-09-12T17:09:09.378230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:09.378083+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:09.378083+0000","last_clean_scrub_stamp":"2024-09-12T17:09:09.378083+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:42.577647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34819,"num_write":26,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"84'46","reported_seq":219,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.271272+0000","last_change":"2024-09-12T17:09:22.271272+0000","last_active":"2024-09-12T17:09:22.271272+0000","last_peered":"2024-09-12T17:09:22.271272+0000","last_clean":"2024-09-12T17:09:22.271272+0000","last_became_active":"2024-09-12T17:05:49.545382+0000","last_became_peered":"2024-09-12T17:05:49.545382+0000","last_unstale":"2024-09-12T17:09:22.271272+0000","last_undegraded":"2024-09-12T17:09:22.271272+0000","last_fullsized":"2024-09-12T17:09:22.271272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'46","last_scrub_stamp":"2024-09-12T17:09:22.271031+0000","last_deep_scrub":"84'46","last_deep_scrub_stamp":"2024-09-12T17:09:22.271031+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.271031+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:59.551895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"103'16","reported_seq":113,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.455874+0000","last_change":"2024-09-12T17:09:12.455874+0000","last_active":"2024-09-12T17:09:12.455874+0000","last_peered":"2024-09-12T17:09:12.455874+0000","last_clean":"2024-09-12T17:09:12.455874+0000","last_became_active":"2024-09-12T17:07:28.191632+0000","last_became_peered":"2024-09-12T17:07:28.191632+0000","last_unstale":"2024-09-12T17:09:12.455874+0000","last_undegraded":"2024-09-12T17:09:12.455874+0000","last_fullsized":"2024-09-12T17:09:12.455874+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:12.455703+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:12.455703+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.455703+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:29.492372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":16390,"num_write":32,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:08:35.114360+0000","last_change":"2024-09-12T17:08:21.460639+0000","last_active":"2024-09-12T17:08:35.114360+0000","last_peered":"2024-09-12T17:08:35.114360+0000","last_clean":"2024-09-12T17:08:35.114360+0000","last_became_active":"2024-09-12T17:08:21.457133+0000","last_became_peered":"2024-09-12T17:08:21.457133+0000","last_unstale":"2024-09-12T17:08:35.114360+0000","last_undegraded":"2024-09-12T17:08:35.114360+0000","last_fullsized":"2024-09-12T17:08:35.114360+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:05:48.497962+0000","last_clean_scrub_stamp":"2024-09-12T17:05:48.497962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:58.322770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"103'20","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.821881+0000","last_change":"2024-09-12T17:09:12.821881+0000","last_active":"2024-09-12T17:09:12.821881+0000","last_peered":"2024-09-12T17:09:12.821881+0000","last_clean":"2024-09-12T17:09:12.821881+0000","last_became_active":"2024-09-12T17:05:47.529857+0000","last_became_peered":"2024-09-12T17:05:47.529857+0000","last_unstale":"2024-09-12T17:09:12.821881+0000","last_undegraded":"2024-09-12T17:09:12.821881+0000","last_fullsized":"2024-09-12T17:09:12.821881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:12.821691+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:12.821691+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.821691+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:40.170708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32768,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'42","reported_seq":217,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.320871+0000","last_change":"2024-09-12T17:09:24.320871+0000","last_active":"2024-09-12T17:09:24.320871+0000","last_peered":"2024-09-12T17:09:24.320871+0000","last_clean":"2024-09-12T17:09:24.320871+0000","last_became_active":"2024-09-12T17:05:49.524567+0000","last_became_peered":"2024-09-12T17:05:49.524567+0000","last_unstale":"2024-09-12T17:09:24.320871+0000","last_undegraded":"2024-09-12T17:09:24.320871+0000","last_fullsized":"2024-09-12T17:09:24.320871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'42","last_scrub_stamp":"2024-09-12T17:09:24.320675+0000","last_deep_scrub":"84'42","last_deep_scrub_stamp":"2024-09-12T17:09:24.320675+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.320675+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.514275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"103'16","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.408151+0000","last_change":"2024-09-12T17:09:12.408151+0000","last_active":"2024-09-12T17:09:12.408151+0000","last_peered":"2024-09-12T17:09:12.408151+0000","last_clean":"2024-09-12T17:09:12.408151+0000","last_became_active":"2024-09-12T17:05:47.547393+0000","last_became_peered":"2024-09-12T17:05:47.547393+0000","last_unstale":"2024-09-12T17:09:12.408151+0000","last_undegraded":"2024-09-12T17:09:12.408151+0000","last_fullsized":"2024-09-12T17:09:12.408151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:12.407969+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:12.407969+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.407969+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:35.063384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":30729,"num_write":40,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.850009+0000","last_change":"2024-09-12T17:09:21.850009+0000","last_active":"2024-09-12T17:09:21.850009+0000","last_peered":"2024-09-12T17:09:21.850009+0000","last_clean":"2024-09-12T17:09:21.850009+0000","last_became_active":"2024-09-12T17:05:49.560993+0000","last_became_peered":"2024-09-12T17:05:49.560993+0000","last_unstale":"2024-09-12T17:09:21.850009+0000","last_undegraded":"2024-09-12T17:09:21.850009+0000","last_fullsized":"2024-09-12T17:09:21.850009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:21.849815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:21.849815+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.849815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:13.024431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"103'16","reported_seq":67,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.120401+0000","last_change":"2024-09-12T17:09:17.120401+0000","last_active":"2024-09-12T17:09:17.120401+0000","last_peered":"2024-09-12T17:09:17.120401+0000","last_clean":"2024-09-12T17:09:17.120401+0000","last_became_active":"2024-09-12T17:08:21.461010+0000","last_became_peered":"2024-09-12T17:08:21.461010+0000","last_unstale":"2024-09-12T17:09:17.120401+0000","last_undegraded":"2024-09-12T17:09:17.120401+0000","last_fullsized":"2024-09-12T17:09:17.120401+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:17.120215+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:17.120215+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.120215+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:15.327625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24579,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"68'2","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.287467+0000","last_change":"2024-09-12T17:09:25.287467+0000","last_active":"2024-09-12T17:09:25.287467+0000","last_peered":"2024-09-12T17:09:25.287467+0000","last_clean":"2024-09-12T17:09:25.287467+0000","last_became_active":"2024-09-12T17:08:28.558588+0000","last_became_peered":"2024-09-12T17:08:28.558588+0000","last_unstale":"2024-09-12T17:09:25.287467+0000","last_undegraded":"2024-09-12T17:09:25.287467+0000","last_fullsized":"2024-09-12T17:09:25.287467+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-09-12T17:09:25.287274+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-09-12T17:09:25.287274+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.287274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:53.081061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"103'16","reported_seq":200,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.092495+0000","last_change":"2024-09-12T17:09:13.092495+0000","last_active":"2024-09-12T17:09:13.092495+0000","last_peered":"2024-09-12T17:09:13.092495+0000","last_clean":"2024-09-12T17:09:13.092495+0000","last_became_active":"2024-09-12T17:05:47.540469+0000","last_became_peered":"2024-09-12T17:05:47.540469+0000","last_unstale":"2024-09-12T17:09:13.092495+0000","last_undegraded":"2024-09-12T17:09:13.092495+0000","last_fullsized":"2024-09-12T17:09:13.092495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:13.092301+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:13.092301+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.092301+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:17.391036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":30720,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"84'42","reported_seq":217,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.175909+0000","last_change":"2024-09-12T17:09:19.175909+0000","last_active":"2024-09-12T17:09:19.175909+0000","last_peered":"2024-09-12T17:09:19.175909+0000","last_clean":"2024-09-12T17:09:19.175909+0000","last_became_active":"2024-09-12T17:05:49.540395+0000","last_became_peered":"2024-09-12T17:05:49.540395+0000","last_unstale":"2024-09-12T17:09:19.175909+0000","last_undegraded":"2024-09-12T17:09:19.175909+0000","last_fullsized":"2024-09-12T17:09:19.175909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'42","last_scrub_stamp":"2024-09-12T17:09:19.175717+0000","last_deep_scrub":"84'42","last_deep_scrub_stamp":"2024-09-12T17:09:19.175717+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.175717+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:21.821690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"103'32","reported_seq":226,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.360291+0000","last_change":"2024-09-12T17:09:15.360291+0000","last_active":"2024-09-12T17:09:15.360291+0000","last_peered":"2024-09-12T17:09:15.360291+0000","last_clean":"2024-09-12T17:09:15.360291+0000","last_became_active":"2024-09-12T17:05:47.539603+0000","last_became_peered":"2024-09-12T17:05:47.539603+0000","last_unstale":"2024-09-12T17:09:15.360291+0000","last_undegraded":"2024-09-12T17:09:15.360291+0000","last_fullsized":"2024-09-12T17:09:15.360291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'32","last_scrub_stamp":"2024-09-12T17:09:15.360088+0000","last_deep_scrub":"103'32","last_deep_scrub_stamp":"2024-09-12T17:09:15.360088+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.360088+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:52.640951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":57350,"num_write":48,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.847642+0000","last_change":"2024-09-12T17:09:22.847642+0000","last_active":"2024-09-12T17:09:22.847642+0000","last_peered":"2024-09-12T17:09:22.847642+0000","last_clean":"2024-09-12T17:09:22.847642+0000","last_became_active":"2024-09-12T17:05:49.531769+0000","last_became_peered":"2024-09-12T17:05:49.531769+0000","last_unstale":"2024-09-12T17:09:22.847642+0000","last_undegraded":"2024-09-12T17:09:22.847642+0000","last_fullsized":"2024-09-12T17:09:22.847642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:22.847422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:22.847422+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.847422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:38.299897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"103'20","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.119957+0000","last_change":"2024-09-12T17:09:14.119957+0000","last_active":"2024-09-12T17:09:14.119957+0000","last_peered":"2024-09-12T17:09:14.119957+0000","last_clean":"2024-09-12T17:09:14.119957+0000","last_became_active":"2024-09-12T17:05:47.524922+0000","last_became_peered":"2024-09-12T17:05:47.524922+0000","last_unstale":"2024-09-12T17:09:14.119957+0000","last_undegraded":"2024-09-12T17:09:14.119957+0000","last_fullsized":"2024-09-12T17:09:14.119957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:14.119777+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:14.119777+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.119777+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:07.793407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38915,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.875497+0000","last_change":"2024-09-12T17:09:24.875497+0000","last_active":"2024-09-12T17:09:24.875497+0000","last_peered":"2024-09-12T17:09:24.875497+0000","last_clean":"2024-09-12T17:09:24.875497+0000","last_became_active":"2024-09-12T17:05:49.554566+0000","last_became_peered":"2024-09-12T17:05:49.554566+0000","last_unstale":"2024-09-12T17:09:24.875497+0000","last_undegraded":"2024-09-12T17:09:24.875497+0000","last_fullsized":"2024-09-12T17:09:24.875497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:24.875286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:24.875286+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.875286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:17.732964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"103'18","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.313093+0000","last_change":"2024-09-12T17:09:16.313093+0000","last_active":"2024-09-12T17:09:16.313093+0000","last_peered":"2024-09-12T17:09:16.313093+0000","last_clean":"2024-09-12T17:09:16.313093+0000","last_became_active":"2024-09-12T17:05:47.542753+0000","last_became_peered":"2024-09-12T17:05:47.542753+0000","last_unstale":"2024-09-12T17:09:16.313093+0000","last_undegraded":"2024-09-12T17:09:16.313093+0000","last_fullsized":"2024-09-12T17:09:16.313093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:16.312920+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:16.312920+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.312920+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:26.912967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":34825,"num_write":42,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'34","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.524910+0000","last_change":"2024-09-12T17:09:14.524910+0000","last_active":"2024-09-12T17:09:14.524910+0000","last_peered":"2024-09-12T17:09:14.524910+0000","last_clean":"2024-09-12T17:09:14.524910+0000","last_became_active":"2024-09-12T17:05:49.536385+0000","last_became_peered":"2024-09-12T17:05:49.536385+0000","last_unstale":"2024-09-12T17:09:14.524910+0000","last_undegraded":"2024-09-12T17:09:14.524910+0000","last_fullsized":"2024-09-12T17:09:14.524910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'34","last_scrub_stamp":"2024-09-12T17:09:14.524718+0000","last_deep_scrub":"84'34","last_deep_scrub_stamp":"2024-09-12T17:09:14.524718+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.524718+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:37.090006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"103'10","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.168976+0000","last_change":"2024-09-12T17:09:16.168976+0000","last_active":"2024-09-12T17:09:16.168976+0000","last_peered":"2024-09-12T17:09:16.168976+0000","last_clean":"2024-09-12T17:09:16.168976+0000","last_became_active":"2024-09-12T17:05:47.544406+0000","last_became_peered":"2024-09-12T17:05:47.544406+0000","last_unstale":"2024-09-12T17:09:16.168976+0000","last_undegraded":"2024-09-12T17:09:16.168976+0000","last_fullsized":"2024-09-12T17:09:16.168976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'10","last_scrub_stamp":"2024-09-12T17:09:16.168791+0000","last_deep_scrub":"103'10","last_deep_scrub_stamp":"2024-09-12T17:09:16.168791+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.168791+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:38.060627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20483,"num_write":18,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"84'38","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.847149+0000","last_change":"2024-09-12T17:09:23.847149+0000","last_active":"2024-09-12T17:09:23.847149+0000","last_peered":"2024-09-12T17:09:23.847149+0000","last_clean":"2024-09-12T17:09:23.847149+0000","last_became_active":"2024-09-12T17:05:49.563625+0000","last_became_peered":"2024-09-12T17:05:49.563625+0000","last_unstale":"2024-09-12T17:09:23.847149+0000","last_undegraded":"2024-09-12T17:09:23.847149+0000","last_fullsized":"2024-09-12T17:09:23.847149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'38","last_scrub_stamp":"2024-09-12T17:09:23.846959+0000","last_deep_scrub":"84'38","last_deep_scrub_stamp":"2024-09-12T17:09:23.846959+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.846959+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:22.054370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"103'20","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.845588+0000","last_change":"2024-09-12T17:09:13.845588+0000","last_active":"2024-09-12T17:09:13.845588+0000","last_peered":"2024-09-12T17:09:13.845588+0000","last_clean":"2024-09-12T17:09:13.845588+0000","last_became_active":"2024-09-12T17:05:47.558047+0000","last_became_peered":"2024-09-12T17:05:47.558047+0000","last_unstale":"2024-09-12T17:09:13.845588+0000","last_undegraded":"2024-09-12T17:09:13.845588+0000","last_fullsized":"2024-09-12T17:09:13.845588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:13.845404+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:13.845404+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.845404+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:28.438127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":38912,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.939857+0000","last_change":"2024-09-12T17:09:26.939857+0000","last_active":"2024-09-12T17:09:26.939857+0000","last_peered":"2024-09-12T17:09:26.939857+0000","last_clean":"2024-09-12T17:09:26.939857+0000","last_became_active":"2024-09-12T17:05:49.522097+0000","last_became_peered":"2024-09-12T17:05:49.522097+0000","last_unstale":"2024-09-12T17:09:26.939857+0000","last_undegraded":"2024-09-12T17:09:26.939857+0000","last_fullsized":"2024-09-12T17:09:26.939857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:26.939655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:26.939655+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.939655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:12.322502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"103'22","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.251654+0000","last_change":"2024-09-12T17:09:27.251654+0000","last_active":"2024-09-12T17:09:27.251654+0000","last_peered":"2024-09-12T17:09:27.251654+0000","last_clean":"2024-09-12T17:09:27.251654+0000","last_became_active":"2024-09-12T17:05:47.552207+0000","last_became_peered":"2024-09-12T17:05:47.552207+0000","last_unstale":"2024-09-12T17:09:27.251654+0000","last_undegraded":"2024-09-12T17:09:27.251654+0000","last_fullsized":"2024-09-12T17:09:27.251654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'22","last_scrub_stamp":"2024-09-12T17:09:27.251470+0000","last_deep_scrub":"103'22","last_deep_scrub_stamp":"2024-09-12T17:09:27.251470+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.251470+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:03.495280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":40969,"num_write":46,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.848494+0000","last_change":"2024-09-12T17:09:20.848494+0000","last_active":"2024-09-12T17:09:20.848494+0000","last_peered":"2024-09-12T17:09:20.848494+0000","last_clean":"2024-09-12T17:09:20.848494+0000","last_became_active":"2024-09-12T17:08:18.464823+0000","last_became_peered":"2024-09-12T17:08:18.464823+0000","last_unstale":"2024-09-12T17:09:20.848494+0000","last_undegraded":"2024-09-12T17:09:20.848494+0000","last_fullsized":"2024-09-12T17:09:20.848494+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:20.848277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:20.848277+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.848277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:18.999436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"103'26","reported_seq":214,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.980330+0000","last_change":"2024-09-12T17:09:24.980330+0000","last_active":"2024-09-12T17:09:24.980330+0000","last_peered":"2024-09-12T17:09:24.980330+0000","last_clean":"2024-09-12T17:09:24.980330+0000","last_became_active":"2024-09-12T17:05:47.560439+0000","last_became_peered":"2024-09-12T17:05:47.560439+0000","last_unstale":"2024-09-12T17:09:24.980330+0000","last_undegraded":"2024-09-12T17:09:24.980330+0000","last_fullsized":"2024-09-12T17:09:24.980330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'26","last_scrub_stamp":"2024-09-12T17:09:24.980144+0000","last_deep_scrub":"103'26","last_deep_scrub_stamp":"2024-09-12T17:09:24.980144+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.980144+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:05.560406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":51203,"num_write":34,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":132,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.234259+0000","last_change":"2024-09-12T17:09:23.234259+0000","last_active":"2024-09-12T17:09:23.234259+0000","last_peered":"2024-09-12T17:09:23.234259+0000","last_clean":"2024-09-12T17:09:23.234259+0000","last_became_active":"2024-09-12T17:06:27.818761+0000","last_became_peered":"2024-09-12T17:06:27.818761+0000","last_unstale":"2024-09-12T17:09:23.234259+0000","last_undegraded":"2024-09-12T17:09:23.234259+0000","last_fullsized":"2024-09-12T17:09:23.234259+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:23.234072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:23.234072+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.234072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:33.834118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"103'16","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.356398+0000","last_change":"2024-09-12T17:09:10.356398+0000","last_active":"2024-09-12T17:09:10.356398+0000","last_peered":"2024-09-12T17:09:10.356398+0000","last_clean":"2024-09-12T17:09:10.356398+0000","last_became_active":"2024-09-12T17:05:47.511470+0000","last_became_peered":"2024-09-12T17:05:47.511470+0000","last_unstale":"2024-09-12T17:09:10.356398+0000","last_undegraded":"2024-09-12T17:09:10.356398+0000","last_fullsized":"2024-09-12T17:09:10.356398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:10.356302+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:10.356302+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.356302+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:14.053803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30723,"num_write":24,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.896316+0000","last_change":"2024-09-12T17:09:22.896316+0000","last_active":"2024-09-12T17:09:22.896316+0000","last_peered":"2024-09-12T17:09:22.896316+0000","last_clean":"2024-09-12T17:09:22.896316+0000","last_became_active":"2024-09-12T17:05:49.522157+0000","last_became_peered":"2024-09-12T17:05:49.522157+0000","last_unstale":"2024-09-12T17:09:22.896316+0000","last_undegraded":"2024-09-12T17:09:22.896316+0000","last_fullsized":"2024-09-12T17:09:22.896316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:22.896130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:22.896130+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.896130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:55.720555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"103'10","reported_seq":189,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.170255+0000","last_change":"2024-09-12T17:09:17.170255+0000","last_active":"2024-09-12T17:09:17.170255+0000","last_peered":"2024-09-12T17:09:17.170255+0000","last_clean":"2024-09-12T17:09:17.170255+0000","last_became_active":"2024-09-12T17:05:47.535569+0000","last_became_peered":"2024-09-12T17:05:47.535569+0000","last_unstale":"2024-09-12T17:09:17.170255+0000","last_undegraded":"2024-09-12T17:09:17.170255+0000","last_fullsized":"2024-09-12T17:09:17.170255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'10","last_scrub_stamp":"2024-09-12T17:09:17.170029+0000","last_deep_scrub":"103'10","last_deep_scrub_stamp":"2024-09-12T17:09:17.170029+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.170029+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:44.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":18432,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"103'10","reported_seq":189,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.190636+0000","last_change":"2024-09-12T17:09:18.190636+0000","last_active":"2024-09-12T17:09:18.190636+0000","last_peered":"2024-09-12T17:09:18.190636+0000","last_clean":"2024-09-12T17:09:18.190636+0000","last_became_active":"2024-09-12T17:05:47.536958+0000","last_became_peered":"2024-09-12T17:05:47.536958+0000","last_unstale":"2024-09-12T17:09:18.190636+0000","last_undegraded":"2024-09-12T17:09:18.190636+0000","last_fullsized":"2024-09-12T17:09:18.190636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'10","last_scrub_stamp":"2024-09-12T17:09:18.190457+0000","last_deep_scrub":"103'10","last_deep_scrub_stamp":"2024-09-12T17:09:18.190457+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.190457+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:32.783180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.849600+0000","last_change":"2024-09-12T17:09:23.849600+0000","last_active":"2024-09-12T17:09:23.849600+0000","last_peered":"2024-09-12T17:09:23.849600+0000","last_clean":"2024-09-12T17:09:23.849600+0000","last_became_active":"2024-09-12T17:05:49.538757+0000","last_became_peered":"2024-09-12T17:05:49.538757+0000","last_unstale":"2024-09-12T17:09:23.849600+0000","last_undegraded":"2024-09-12T17:09:23.849600+0000","last_fullsized":"2024-09-12T17:09:23.849600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:23.849400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:23.849400+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.849400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:14.907294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"103'14","reported_seq":68,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.163300+0000","last_change":"2024-09-12T17:09:15.163300+0000","last_active":"2024-09-12T17:09:15.163300+0000","last_peered":"2024-09-12T17:09:15.163300+0000","last_clean":"2024-09-12T17:09:15.163300+0000","last_became_active":"2024-09-12T17:08:18.441161+0000","last_became_peered":"2024-09-12T17:08:18.441161+0000","last_unstale":"2024-09-12T17:09:15.163300+0000","last_undegraded":"2024-09-12T17:09:15.163300+0000","last_fullsized":"2024-09-12T17:09:15.163300+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'14","last_scrub_stamp":"2024-09-12T17:09:15.163115+0000","last_deep_scrub":"103'14","last_deep_scrub_stamp":"2024-09-12T17:09:15.163115+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.163115+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:00.669243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24582,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.254417+0000","last_change":"2024-09-12T17:09:25.254417+0000","last_active":"2024-09-12T17:09:25.254417+0000","last_peered":"2024-09-12T17:09:25.254417+0000","last_clean":"2024-09-12T17:09:25.254417+0000","last_became_active":"2024-09-12T17:05:49.551604+0000","last_became_peered":"2024-09-12T17:05:49.551604+0000","last_unstale":"2024-09-12T17:09:25.254417+0000","last_undegraded":"2024-09-12T17:09:25.254417+0000","last_fullsized":"2024-09-12T17:09:25.254417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:25.254214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:25.254214+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.254214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:23.405373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":40,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":127268,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":1212,"num_read_kb":1590,"num_write":777,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":41697,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":723,"ondisk_log_size":723,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1867,"num_read_kb":1448,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1533,"num_read_kb":2031945,"num_write":1980,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":241172480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542195,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37168,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334672,"statfs":{"total":96636764160,"available":96598704128,"internally_reserved":0,"allocated":1867776,"data_stored":1295858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542196,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40724,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331116,"statfs":{"total":96636764160,"available":96595062784,"internally_reserved":0,"allocated":1249280,"data_stored":704830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542196,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40776,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331064,"statfs":{"total":96636764160,"available":96595009536,"internally_reserved":0,"allocated":1302528,"data_stored":706113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542196,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40712,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331128,"statfs":{"total":96636764160,"available":96595075072,"internally_reserved":0,"allocated":1236992,"data_stored":704328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542196,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36584,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335256,"statfs":{"total":96636764160,"available":96599302144,"internally_reserved":0,"allocated":1269760,"data_stored":705662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542196,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1241088,"data_stored":705385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542195,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40744,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331096,"statfs":{"total":96636764160,"available":96595042304,"internally_reserved":0,"allocated":1269760,"data_stored":705099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542196,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37152,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334688,"statfs":{"total":96636764160,"available":96598720512,"internally_reserved":0,"allocated":1851392,"data_stored":1296257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:09:30.776 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.776 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.776 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.776 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.777 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.777 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.777 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.777 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.777 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.777 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.777 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.777 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.778 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.778 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.778 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.778 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.778 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.778 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.778 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.778 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.779 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.779 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.779 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.779 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.779 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.779 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.779 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.779 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.780 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.780 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.780 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.780 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.780 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.780 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.780 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.780 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.781 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.781 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.781 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.781 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.781 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.781 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.781 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.782 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.782 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.782 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.782 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.782 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.782 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.782 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.782 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.783 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.783 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.783 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.783 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.783 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.783 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.783 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.783 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.784 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.784 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.784 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.784 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.784 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.784 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.784 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.784 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.785 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.785 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.785 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.785 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.785 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.785 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.785 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.785 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.786 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.786 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.786 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.786 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.786 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.786 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.786 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.787 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.787 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.787 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.787 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.787 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.787 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.787 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.787 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.787 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.788 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.788 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.788 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.788 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.788 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.788 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.788 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T17:05:50.505188+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.788 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.789 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.789 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.789 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T17:05:52.511316+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.789 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T17:05:54.517738+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.789 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T17:05:56.542306+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=56, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.789 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.789 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T17:05:48.497962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=5, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=17, tm_min=9, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T17:09:30.790 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T17:09:50.791 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T17:09:51.145 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-09-12T17:09:51.152 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-09-12T17:09:51.163 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-09-12T17:09:50.015227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":719268,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4774,"num_read_kb":2035132,"num_write":3618,"num_write_kb":2050327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":241214307,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2727,"ondisk_log_size":2727,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":314576,"kb_used_data":11024,"kb_used_omap":12,"kb_used_meta":303411,"kb_avail":754660144,"statfs":{"total":773094113280,"available":772771987456,"internally_reserved":0,"allocated":11288576,"data_stored":6823532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":310693424},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1716,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005982"},"pg_stats":[{"pgid":"3.3f","version":"103'30","reported_seq":223,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.940781+0000","last_change":"2024-09-12T17:09:21.940781+0000","last_active":"2024-09-12T17:09:21.940781+0000","last_peered":"2024-09-12T17:09:21.940781+0000","last_clean":"2024-09-12T17:09:21.940781+0000","last_became_active":"2024-09-12T17:05:47.560791+0000","last_became_peered":"2024-09-12T17:05:47.560791+0000","last_unstale":"2024-09-12T17:09:21.940781+0000","last_undegraded":"2024-09-12T17:09:21.940781+0000","last_fullsized":"2024-09-12T17:09:21.940781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'30","last_scrub_stamp":"2024-09-12T17:09:21.940614+0000","last_deep_scrub":"103'30","last_deep_scrub_stamp":"2024-09-12T17:09:21.940614+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.940614+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:55:38.254409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":57356,"num_write":62,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"84'44","reported_seq":220,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.212120+0000","last_change":"2024-09-12T17:09:26.212120+0000","last_active":"2024-09-12T17:09:26.212120+0000","last_peered":"2024-09-12T17:09:26.212120+0000","last_clean":"2024-09-12T17:09:26.212120+0000","last_became_active":"2024-09-12T17:05:49.557287+0000","last_became_peered":"2024-09-12T17:05:49.557287+0000","last_unstale":"2024-09-12T17:09:26.212120+0000","last_undegraded":"2024-09-12T17:09:26.212120+0000","last_fullsized":"2024-09-12T17:09:26.212120+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'44","last_scrub_stamp":"2024-09-12T17:09:26.211934+0000","last_deep_scrub":"84'44","last_deep_scrub_stamp":"2024-09-12T17:09:26.211934+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.211934+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:01.930817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":132,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"103'6","reported_seq":53,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.242144+0000","last_change":"2024-09-12T17:09:13.242144+0000","last_active":"2024-09-12T17:09:13.242144+0000","last_peered":"2024-09-12T17:09:13.242144+0000","last_clean":"2024-09-12T17:09:13.242144+0000","last_became_active":"2024-09-12T17:08:21.462766+0000","last_became_peered":"2024-09-12T17:08:21.462766+0000","last_unstale":"2024-09-12T17:09:13.242144+0000","last_undegraded":"2024-09-12T17:09:13.242144+0000","last_fullsized":"2024-09-12T17:09:13.242144+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'6","last_scrub_stamp":"2024-09-12T17:09:13.241936+0000","last_deep_scrub":"103'6","last_deep_scrub_stamp":"2024-09-12T17:09:13.241936+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.241936+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:54:39.879138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.945738+0000","last_change":"2024-09-12T17:09:25.945738+0000","last_active":"2024-09-12T17:09:25.945738+0000","last_peered":"2024-09-12T17:09:25.945738+0000","last_clean":"2024-09-12T17:09:25.945738+0000","last_became_active":"2024-09-12T17:08:18.442986+0000","last_became_peered":"2024-09-12T17:08:18.442986+0000","last_unstale":"2024-09-12T17:09:25.945738+0000","last_undegraded":"2024-09-12T17:09:25.945738+0000","last_fullsized":"2024-09-12T17:09:25.945738+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:25.945538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:25.945538+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.945538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:07:49.096989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"103'24","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.894977+0000","last_change":"2024-09-12T17:09:14.894977+0000","last_active":"2024-09-12T17:09:14.894977+0000","last_peered":"2024-09-12T17:09:14.894977+0000","last_clean":"2024-09-12T17:09:14.894977+0000","last_became_active":"2024-09-12T17:05:47.522544+0000","last_became_peered":"2024-09-12T17:05:47.522544+0000","last_unstale":"2024-09-12T17:09:14.894977+0000","last_undegraded":"2024-09-12T17:09:14.894977+0000","last_fullsized":"2024-09-12T17:09:14.894977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'24","last_scrub_stamp":"2024-09-12T17:09:14.894731+0000","last_deep_scrub":"103'24","last_deep_scrub_stamp":"2024-09-12T17:09:14.894731+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.894731+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:00.211809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":38921,"num_write":48,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"84'34","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:29.948021+0000","last_change":"2024-09-12T17:09:29.948021+0000","last_active":"2024-09-12T17:09:29.948021+0000","last_peered":"2024-09-12T17:09:29.948021+0000","last_clean":"2024-09-12T17:09:29.948021+0000","last_became_active":"2024-09-12T17:05:49.549241+0000","last_became_peered":"2024-09-12T17:05:49.549241+0000","last_unstale":"2024-09-12T17:09:29.948021+0000","last_undegraded":"2024-09-12T17:09:29.948021+0000","last_fullsized":"2024-09-12T17:09:29.948021+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'34","last_scrub_stamp":"2024-09-12T17:09:29.947879+0000","last_deep_scrub":"84'34","last_deep_scrub_stamp":"2024-09-12T17:09:29.947879+0000","last_clean_scrub_stamp":"2024-09-12T17:09:29.947879+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:53:02.679131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"103'16","reported_seq":162,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.569097+0000","last_change":"2024-09-12T17:09:18.569097+0000","last_active":"2024-09-12T17:09:18.569097+0000","last_peered":"2024-09-12T17:09:18.569097+0000","last_clean":"2024-09-12T17:09:18.569097+0000","last_became_active":"2024-09-12T17:06:27.748390+0000","last_became_peered":"2024-09-12T17:06:27.748390+0000","last_unstale":"2024-09-12T17:09:18.569097+0000","last_undegraded":"2024-09-12T17:09:18.569097+0000","last_fullsized":"2024-09-12T17:09:18.569097+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:18.568906+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:18.568906+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.568906+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:23.913498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":30732,"num_write":48,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.804817+0000","last_change":"2024-09-12T17:09:24.804817+0000","last_active":"2024-09-12T17:09:24.804817+0000","last_peered":"2024-09-12T17:09:24.804817+0000","last_clean":"2024-09-12T17:09:24.804817+0000","last_became_active":"2024-09-12T17:05:49.541354+0000","last_became_peered":"2024-09-12T17:05:49.541354+0000","last_unstale":"2024-09-12T17:09:24.804817+0000","last_undegraded":"2024-09-12T17:09:24.804817+0000","last_fullsized":"2024-09-12T17:09:24.804817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:24.804621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:24.804621+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.804621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:09.476400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"103'12","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.940835+0000","last_change":"2024-09-12T17:09:19.940835+0000","last_active":"2024-09-12T17:09:19.940835+0000","last_peered":"2024-09-12T17:09:19.940835+0000","last_clean":"2024-09-12T17:09:19.940835+0000","last_became_active":"2024-09-12T17:05:47.555396+0000","last_became_peered":"2024-09-12T17:05:47.555396+0000","last_unstale":"2024-09-12T17:09:19.940835+0000","last_undegraded":"2024-09-12T17:09:19.940835+0000","last_fullsized":"2024-09-12T17:09:19.940835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:19.940651+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:19.940651+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.940651+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:03:22.326811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22534,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.188665+0000","last_change":"2024-09-12T17:09:21.188665+0000","last_active":"2024-09-12T17:09:21.188665+0000","last_peered":"2024-09-12T17:09:21.188665+0000","last_clean":"2024-09-12T17:09:21.188665+0000","last_became_active":"2024-09-12T17:05:49.528184+0000","last_became_peered":"2024-09-12T17:05:49.528184+0000","last_unstale":"2024-09-12T17:09:21.188665+0000","last_undegraded":"2024-09-12T17:09:21.188665+0000","last_fullsized":"2024-09-12T17:09:21.188665+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:21.188458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:21.188458+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.188458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:34:07.946828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"103'18","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.240091+0000","last_change":"2024-09-12T17:09:19.240091+0000","last_active":"2024-09-12T17:09:19.240091+0000","last_peered":"2024-09-12T17:09:19.240091+0000","last_clean":"2024-09-12T17:09:19.240091+0000","last_became_active":"2024-09-12T17:05:47.531427+0000","last_became_peered":"2024-09-12T17:05:47.531427+0000","last_unstale":"2024-09-12T17:09:19.240091+0000","last_undegraded":"2024-09-12T17:09:19.240091+0000","last_fullsized":"2024-09-12T17:09:19.240091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:19.239908+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:19.239908+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.239908+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:04:04.556985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34822,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.990422+0000","last_change":"2024-09-12T17:09:27.990422+0000","last_active":"2024-09-12T17:09:27.990422+0000","last_peered":"2024-09-12T17:09:27.990422+0000","last_clean":"2024-09-12T17:09:27.990422+0000","last_became_active":"2024-09-12T17:05:49.549066+0000","last_became_peered":"2024-09-12T17:05:49.549066+0000","last_unstale":"2024-09-12T17:09:27.990422+0000","last_undegraded":"2024-09-12T17:09:27.990422+0000","last_fullsized":"2024-09-12T17:09:27.990422+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:27.990182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:27.990182+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.990182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:33:00.837453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"103'12","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.942250+0000","last_change":"2024-09-12T17:09:18.942250+0000","last_active":"2024-09-12T17:09:18.942250+0000","last_peered":"2024-09-12T17:09:18.942250+0000","last_clean":"2024-09-12T17:09:18.942250+0000","last_became_active":"2024-09-12T17:05:47.559160+0000","last_became_peered":"2024-09-12T17:05:47.559160+0000","last_unstale":"2024-09-12T17:09:18.942250+0000","last_undegraded":"2024-09-12T17:09:18.942250+0000","last_fullsized":"2024-09-12T17:09:18.942250+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:18.942025+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:18.942025+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.942025+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:54:08.090928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"68'2","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.244390+0000","last_change":"2024-09-12T17:09:27.244390+0000","last_active":"2024-09-12T17:09:27.244390+0000","last_peered":"2024-09-12T17:09:27.244390+0000","last_clean":"2024-09-12T17:09:27.244390+0000","last_became_active":"2024-09-12T17:08:18.471124+0000","last_became_peered":"2024-09-12T17:08:18.471124+0000","last_unstale":"2024-09-12T17:09:27.244390+0000","last_undegraded":"2024-09-12T17:09:27.244390+0000","last_fullsized":"2024-09-12T17:09:27.244390+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-09-12T17:09:27.244205+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-09-12T17:09:27.244205+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.244205+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:42.696680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"103'14","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.556355+0000","last_change":"2024-09-12T17:09:17.556355+0000","last_active":"2024-09-12T17:09:17.556355+0000","last_peered":"2024-09-12T17:09:17.556355+0000","last_clean":"2024-09-12T17:09:17.556355+0000","last_became_active":"2024-09-12T17:06:27.748329+0000","last_became_peered":"2024-09-12T17:06:27.748329+0000","last_unstale":"2024-09-12T17:09:17.556355+0000","last_undegraded":"2024-09-12T17:09:17.556355+0000","last_fullsized":"2024-09-12T17:09:17.556355+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'14","last_scrub_stamp":"2024-09-12T17:09:17.556143+0000","last_deep_scrub":"103'14","last_deep_scrub_stamp":"2024-09-12T17:09:17.556143+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.556143+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:22:50.642631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26633,"num_write":38,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.500908+0000","last_change":"2024-09-12T17:09:13.500908+0000","last_active":"2024-09-12T17:09:13.500908+0000","last_peered":"2024-09-12T17:09:13.500908+0000","last_clean":"2024-09-12T17:09:13.500908+0000","last_became_active":"2024-09-12T17:07:28.190245+0000","last_became_peered":"2024-09-12T17:07:28.190245+0000","last_unstale":"2024-09-12T17:09:13.500908+0000","last_undegraded":"2024-09-12T17:09:13.500908+0000","last_fullsized":"2024-09-12T17:09:13.500908+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:13.500739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:13.500739+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.500739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:56.427917+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.924646+0000","last_change":"2024-09-12T17:09:25.924646+0000","last_active":"2024-09-12T17:09:25.924646+0000","last_peered":"2024-09-12T17:09:25.924646+0000","last_clean":"2024-09-12T17:09:25.924646+0000","last_became_active":"2024-09-12T17:05:49.548292+0000","last_became_peered":"2024-09-12T17:05:49.548292+0000","last_unstale":"2024-09-12T17:09:25.924646+0000","last_undegraded":"2024-09-12T17:09:25.924646+0000","last_fullsized":"2024-09-12T17:09:25.924646+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:25.924458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:25.924458+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.924458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:39:24.176688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"103'10","reported_seq":44,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.040006+0000","last_change":"2024-09-12T17:09:20.040006+0000","last_active":"2024-09-12T17:09:20.040006+0000","last_peered":"2024-09-12T17:09:20.040006+0000","last_clean":"2024-09-12T17:09:20.040006+0000","last_became_active":"2024-09-12T17:08:28.568157+0000","last_became_peered":"2024-09-12T17:08:28.568157+0000","last_unstale":"2024-09-12T17:09:20.040006+0000","last_undegraded":"2024-09-12T17:09:20.040006+0000","last_fullsized":"2024-09-12T17:09:20.040006+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'10","last_scrub_stamp":"2024-09-12T17:09:20.039818+0000","last_deep_scrub":"103'10","last_deep_scrub_stamp":"2024-09-12T17:09:20.039818+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.039818+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:19:48.714577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":18434,"num_write":18,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":14680064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.941208+0000","last_change":"2024-09-12T17:09:23.941208+0000","last_active":"2024-09-12T17:09:23.941208+0000","last_peered":"2024-09-12T17:09:23.941208+0000","last_clean":"2024-09-12T17:09:23.941208+0000","last_became_active":"2024-09-12T17:08:18.454062+0000","last_became_peered":"2024-09-12T17:08:18.454062+0000","last_unstale":"2024-09-12T17:09:23.941208+0000","last_undegraded":"2024-09-12T17:09:23.941208+0000","last_fullsized":"2024-09-12T17:09:23.941208+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:23.941028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:23.941028+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.941028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:43.368100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"103'18","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.047458+0000","last_change":"2024-09-12T17:09:12.047458+0000","last_active":"2024-09-12T17:09:12.047458+0000","last_peered":"2024-09-12T17:09:12.047458+0000","last_clean":"2024-09-12T17:09:12.047458+0000","last_became_active":"2024-09-12T17:05:47.527533+0000","last_became_peered":"2024-09-12T17:05:47.527533+0000","last_unstale":"2024-09-12T17:09:12.047458+0000","last_undegraded":"2024-09-12T17:09:12.047458+0000","last_fullsized":"2024-09-12T17:09:12.047458+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:12.047250+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:12.047250+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.047250+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:48:16.254720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":34828,"num_write":50,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"84'30","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.260269+0000","last_change":"2024-09-12T17:09:24.260269+0000","last_active":"2024-09-12T17:09:24.260269+0000","last_peered":"2024-09-12T17:09:24.260269+0000","last_clean":"2024-09-12T17:09:24.260269+0000","last_became_active":"2024-09-12T17:05:49.542113+0000","last_became_peered":"2024-09-12T17:05:49.542113+0000","last_unstale":"2024-09-12T17:09:24.260269+0000","last_undegraded":"2024-09-12T17:09:24.260269+0000","last_fullsized":"2024-09-12T17:09:24.260269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'30","last_scrub_stamp":"2024-09-12T17:09:24.260086+0000","last_deep_scrub":"84'30","last_deep_scrub_stamp":"2024-09-12T17:09:24.260086+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.260086+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:07.684537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":90,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"103'20","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.152807+0000","last_change":"2024-09-12T17:09:16.152807+0000","last_active":"2024-09-12T17:09:16.152807+0000","last_peered":"2024-09-12T17:09:16.152807+0000","last_clean":"2024-09-12T17:09:16.152807+0000","last_became_active":"2024-09-12T17:05:47.529083+0000","last_became_peered":"2024-09-12T17:05:47.529083+0000","last_unstale":"2024-09-12T17:09:16.152807+0000","last_undegraded":"2024-09-12T17:09:16.152807+0000","last_fullsized":"2024-09-12T17:09:16.152807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:16.152512+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:16.152512+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.152512+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:06:12.663244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":40969,"num_write":44,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.566057+0000","last_change":"2024-09-12T17:09:20.566057+0000","last_active":"2024-09-12T17:09:20.566057+0000","last_peered":"2024-09-12T17:09:20.566057+0000","last_clean":"2024-09-12T17:09:20.566057+0000","last_became_active":"2024-09-12T17:05:49.539930+0000","last_became_peered":"2024-09-12T17:05:49.539930+0000","last_unstale":"2024-09-12T17:09:20.566057+0000","last_undegraded":"2024-09-12T17:09:20.566057+0000","last_fullsized":"2024-09-12T17:09:20.566057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:20.565878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:20.565878+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.565878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:46:07.628948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"103'12","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.795775+0000","last_change":"2024-09-12T17:09:17.795775+0000","last_active":"2024-09-12T17:09:17.795775+0000","last_peered":"2024-09-12T17:09:17.795775+0000","last_clean":"2024-09-12T17:09:17.795775+0000","last_became_active":"2024-09-12T17:05:47.547430+0000","last_became_peered":"2024-09-12T17:05:47.547430+0000","last_unstale":"2024-09-12T17:09:17.795775+0000","last_undegraded":"2024-09-12T17:09:17.795775+0000","last_fullsized":"2024-09-12T17:09:17.795775+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:17.795587+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:17.795587+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.795587+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:55.111652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.615335+0000","last_change":"2024-09-12T17:09:19.615335+0000","last_active":"2024-09-12T17:09:19.615335+0000","last_peered":"2024-09-12T17:09:19.615335+0000","last_clean":"2024-09-12T17:09:19.615335+0000","last_became_active":"2024-09-12T17:05:49.555033+0000","last_became_peered":"2024-09-12T17:05:49.555033+0000","last_unstale":"2024-09-12T17:09:19.615335+0000","last_undegraded":"2024-09-12T17:09:19.615335+0000","last_fullsized":"2024-09-12T17:09:19.615335+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:19.615134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:19.615134+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.615134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:40:12.797854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"103'20","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.348393+0000","last_change":"2024-09-12T17:09:17.348393+0000","last_active":"2024-09-12T17:09:17.348393+0000","last_peered":"2024-09-12T17:09:17.348393+0000","last_clean":"2024-09-12T17:09:17.348393+0000","last_became_active":"2024-09-12T17:05:47.510364+0000","last_became_peered":"2024-09-12T17:05:47.510364+0000","last_unstale":"2024-09-12T17:09:17.348393+0000","last_undegraded":"2024-09-12T17:09:17.348393+0000","last_fullsized":"2024-09-12T17:09:17.348393+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:17.348116+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:17.348116+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.348116+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:00.772566+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":38912,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.972078+0000","last_change":"2024-09-12T17:09:26.972078+0000","last_active":"2024-09-12T17:09:26.972078+0000","last_peered":"2024-09-12T17:09:26.972078+0000","last_clean":"2024-09-12T17:09:26.972078+0000","last_became_active":"2024-09-12T17:08:18.447353+0000","last_became_peered":"2024-09-12T17:08:18.447353+0000","last_unstale":"2024-09-12T17:09:26.972078+0000","last_undegraded":"2024-09-12T17:09:26.972078+0000","last_fullsized":"2024-09-12T17:09:26.972078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:26.971893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:26.971893+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.971893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:52:38.812113+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"103'8","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.888506+0000","last_change":"2024-09-12T17:09:15.888506+0000","last_active":"2024-09-12T17:09:15.888506+0000","last_peered":"2024-09-12T17:09:15.888506+0000","last_clean":"2024-09-12T17:09:15.888506+0000","last_became_active":"2024-09-12T17:08:18.467826+0000","last_became_peered":"2024-09-12T17:08:18.467826+0000","last_unstale":"2024-09-12T17:09:15.888506+0000","last_undegraded":"2024-09-12T17:09:15.888506+0000","last_fullsized":"2024-09-12T17:09:15.888506+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'8","last_scrub_stamp":"2024-09-12T17:09:15.888324+0000","last_deep_scrub":"103'8","last_deep_scrub_stamp":"2024-09-12T17:09:15.888324+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.888324+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:27.359384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14339,"num_write":16,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10485760,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"84'2","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:43.755430+0000","last_change":"2024-09-12T17:09:43.755430+0000","last_active":"2024-09-12T17:09:43.755430+0000","last_peered":"2024-09-12T17:09:43.755430+0000","last_clean":"2024-09-12T17:09:43.755430+0000","last_became_active":"2024-09-12T17:05:57.587891+0000","last_became_peered":"2024-09-12T17:05:57.587891+0000","last_unstale":"2024-09-12T17:09:43.755430+0000","last_undegraded":"2024-09-12T17:09:43.755430+0000","last_fullsized":"2024-09-12T17:09:43.755430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-09-12T17:09:43.755209+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-09-12T17:09:43.755209+0000","last_clean_scrub_stamp":"2024-09-12T17:09:43.755209+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:41.713956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.396852+0000","last_change":"2024-09-12T17:09:19.396852+0000","last_active":"2024-09-12T17:09:19.396852+0000","last_peered":"2024-09-12T17:09:19.396852+0000","last_clean":"2024-09-12T17:09:19.396852+0000","last_became_active":"2024-09-12T17:08:21.457526+0000","last_became_peered":"2024-09-12T17:08:21.457526+0000","last_unstale":"2024-09-12T17:09:19.396852+0000","last_undegraded":"2024-09-12T17:09:19.396852+0000","last_fullsized":"2024-09-12T17:09:19.396852+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:19.396639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:19.396639+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.396639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:55.115521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"103'20","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.894432+0000","last_change":"2024-09-12T17:09:15.894432+0000","last_active":"2024-09-12T17:09:15.894432+0000","last_peered":"2024-09-12T17:09:15.894432+0000","last_clean":"2024-09-12T17:09:15.894432+0000","last_became_active":"2024-09-12T17:05:47.556980+0000","last_became_peered":"2024-09-12T17:05:47.556980+0000","last_unstale":"2024-09-12T17:09:15.894432+0000","last_undegraded":"2024-09-12T17:09:15.894432+0000","last_fullsized":"2024-09-12T17:09:15.894432+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:15.894179+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:15.894179+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.894179+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:02:28.189296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38921,"num_write":44,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:30.217620+0000","last_change":"2024-09-12T17:09:30.217620+0000","last_active":"2024-09-12T17:09:30.217620+0000","last_peered":"2024-09-12T17:09:30.217620+0000","last_clean":"2024-09-12T17:09:30.217620+0000","last_became_active":"2024-09-12T17:08:18.471264+0000","last_became_peered":"2024-09-12T17:08:18.471264+0000","last_unstale":"2024-09-12T17:09:30.217620+0000","last_undegraded":"2024-09-12T17:09:30.217620+0000","last_fullsized":"2024-09-12T17:09:30.217620+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:30.217415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:30.217415+0000","last_clean_scrub_stamp":"2024-09-12T17:09:30.217415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:42.238212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"103'21","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:30.785702+0000","last_change":"2024-09-12T17:09:30.785702+0000","last_active":"2024-09-12T17:09:30.785702+0000","last_peered":"2024-09-12T17:09:30.785702+0000","last_clean":"2024-09-12T17:09:30.785702+0000","last_became_active":"2024-09-12T17:05:53.536921+0000","last_became_peered":"2024-09-12T17:05:53.536921+0000","last_unstale":"2024-09-12T17:09:30.785702+0000","last_undegraded":"2024-09-12T17:09:30.785702+0000","last_fullsized":"2024-09-12T17:09:30.785702+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'21","last_scrub_stamp":"2024-09-12T17:09:30.785592+0000","last_deep_scrub":"103'21","last_deep_scrub_stamp":"2024-09-12T17:09:30.785592+0000","last_clean_scrub_stamp":"2024-09-12T17:09:30.785592+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:15.418636+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":50,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:42.071084+0000","last_change":"2024-09-12T17:09:42.071084+0000","last_active":"2024-09-12T17:09:42.071084+0000","last_peered":"2024-09-12T17:09:42.071084+0000","last_clean":"2024-09-12T17:09:42.071084+0000","last_became_active":"2024-09-12T17:05:55.558297+0000","last_became_peered":"2024-09-12T17:05:55.558297+0000","last_unstale":"2024-09-12T17:09:42.071084+0000","last_undegraded":"2024-09-12T17:09:42.071084+0000","last_fullsized":"2024-09-12T17:09:42.071084+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:42.070901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:42.070901+0000","last_clean_scrub_stamp":"2024-09-12T17:09:42.070901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:54.760492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"84'4","reported_seq":159,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:43.158063+0000","last_change":"2024-09-12T17:09:43.158063+0000","last_active":"2024-09-12T17:09:43.158063+0000","last_peered":"2024-09-12T17:09:43.158063+0000","last_clean":"2024-09-12T17:09:43.158063+0000","last_became_active":"2024-09-12T17:05:57.591877+0000","last_became_peered":"2024-09-12T17:05:57.591877+0000","last_unstale":"2024-09-12T17:09:43.158063+0000","last_undegraded":"2024-09-12T17:09:43.158063+0000","last_fullsized":"2024-09-12T17:09:43.158063+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'4","last_scrub_stamp":"2024-09-12T17:09:43.157867+0000","last_deep_scrub":"84'4","last_deep_scrub_stamp":"2024-09-12T17:09:43.157867+0000","last_clean_scrub_stamp":"2024-09-12T17:09:43.157867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:53:59.764646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"68'6","reported_seq":179,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.304923+0000","last_change":"2024-09-12T17:09:21.304923+0000","last_active":"2024-09-12T17:09:21.304923+0000","last_peered":"2024-09-12T17:09:21.304923+0000","last_clean":"2024-09-12T17:09:21.304923+0000","last_became_active":"2024-09-12T17:05:49.544425+0000","last_became_peered":"2024-09-12T17:05:49.544425+0000","last_unstale":"2024-09-12T17:09:21.304923+0000","last_undegraded":"2024-09-12T17:09:21.304923+0000","last_fullsized":"2024-09-12T17:09:21.304923+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-09-12T17:09:21.304739+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-09-12T17:09:21.304739+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.304739+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:00.863153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"103'12","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:06.631792+0000","last_change":"2024-09-12T17:09:06.631792+0000","last_active":"2024-09-12T17:09:06.631792+0000","last_peered":"2024-09-12T17:09:06.631792+0000","last_clean":"2024-09-12T17:09:06.631792+0000","last_became_active":"2024-09-12T17:05:47.534833+0000","last_became_peered":"2024-09-12T17:05:47.534833+0000","last_unstale":"2024-09-12T17:09:06.631792+0000","last_undegraded":"2024-09-12T17:09:06.631792+0000","last_fullsized":"2024-09-12T17:09:06.631792+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:06.631723+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:06.631723+0000","last_clean_scrub_stamp":"2024-09-12T17:09:06.631723+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:39.456148+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":22528,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:28.263593+0000","last_change":"2024-09-12T17:09:28.263593+0000","last_active":"2024-09-12T17:09:28.263593+0000","last_peered":"2024-09-12T17:09:28.263593+0000","last_clean":"2024-09-12T17:09:28.263593+0000","last_became_active":"2024-09-12T17:05:51.533164+0000","last_became_peered":"2024-09-12T17:05:51.533164+0000","last_unstale":"2024-09-12T17:09:28.263593+0000","last_undegraded":"2024-09-12T17:09:28.263593+0000","last_fullsized":"2024-09-12T17:09:28.263593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:28.263380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:28.263380+0000","last_clean_scrub_stamp":"2024-09-12T17:09:28.263380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:12.896425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"103'9","reported_seq":176,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:35.853030+0000","last_change":"2024-09-12T17:09:35.853030+0000","last_active":"2024-09-12T17:09:35.853030+0000","last_peered":"2024-09-12T17:09:35.853030+0000","last_clean":"2024-09-12T17:09:35.853030+0000","last_became_active":"2024-09-12T17:05:53.548824+0000","last_became_peered":"2024-09-12T17:05:53.548824+0000","last_unstale":"2024-09-12T17:09:35.853030+0000","last_undegraded":"2024-09-12T17:09:35.853030+0000","last_fullsized":"2024-09-12T17:09:35.853030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'9","last_scrub_stamp":"2024-09-12T17:09:35.852817+0000","last_deep_scrub":"103'9","last_deep_scrub_stamp":"2024-09-12T17:09:35.852817+0000","last_clean_scrub_stamp":"2024-09-12T17:09:35.852817+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:14.298448+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:39.775141+0000","last_change":"2024-09-12T17:09:39.775141+0000","last_active":"2024-09-12T17:09:39.775141+0000","last_peered":"2024-09-12T17:09:39.775141+0000","last_clean":"2024-09-12T17:09:39.775141+0000","last_became_active":"2024-09-12T17:05:55.556689+0000","last_became_peered":"2024-09-12T17:05:55.556689+0000","last_unstale":"2024-09-12T17:09:39.775141+0000","last_undegraded":"2024-09-12T17:09:39.775141+0000","last_fullsized":"2024-09-12T17:09:39.775141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:39.774946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:39.774946+0000","last_clean_scrub_stamp":"2024-09-12T17:09:39.774946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:27:05.438366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":154,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:43.881738+0000","last_change":"2024-09-12T17:09:43.881738+0000","last_active":"2024-09-12T17:09:43.881738+0000","last_peered":"2024-09-12T17:09:43.881738+0000","last_clean":"2024-09-12T17:09:43.881738+0000","last_became_active":"2024-09-12T17:05:57.588649+0000","last_became_peered":"2024-09-12T17:05:57.588649+0000","last_unstale":"2024-09-12T17:09:43.881738+0000","last_undegraded":"2024-09-12T17:09:43.881738+0000","last_fullsized":"2024-09-12T17:09:43.881738+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:43.881537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:43.881537+0000","last_clean_scrub_stamp":"2024-09-12T17:09:43.881537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:39.386629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"68'10","reported_seq":183,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.928216+0000","last_change":"2024-09-12T17:09:17.928216+0000","last_active":"2024-09-12T17:09:17.928216+0000","last_peered":"2024-09-12T17:09:17.928216+0000","last_clean":"2024-09-12T17:09:17.928216+0000","last_became_active":"2024-09-12T17:05:49.530687+0000","last_became_peered":"2024-09-12T17:05:49.530687+0000","last_unstale":"2024-09-12T17:09:17.928216+0000","last_undegraded":"2024-09-12T17:09:17.928216+0000","last_fullsized":"2024-09-12T17:09:17.928216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'10","last_scrub_stamp":"2024-09-12T17:09:17.928021+0000","last_deep_scrub":"68'10","last_deep_scrub_stamp":"2024-09-12T17:09:17.928021+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.928021+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:55.208885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"103'18","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.901212+0000","last_change":"2024-09-12T17:09:16.901212+0000","last_active":"2024-09-12T17:09:16.901212+0000","last_peered":"2024-09-12T17:09:16.901212+0000","last_clean":"2024-09-12T17:09:16.901212+0000","last_became_active":"2024-09-12T17:05:47.564189+0000","last_became_peered":"2024-09-12T17:05:47.564189+0000","last_unstale":"2024-09-12T17:09:16.901212+0000","last_undegraded":"2024-09-12T17:09:16.901212+0000","last_fullsized":"2024-09-12T17:09:16.901212+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:16.901007+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:16.901007+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.901007+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:18:44.267397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":34825,"num_write":42,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:29.307849+0000","last_change":"2024-09-12T17:09:29.307849+0000","last_active":"2024-09-12T17:09:29.307849+0000","last_peered":"2024-09-12T17:09:29.307849+0000","last_clean":"2024-09-12T17:09:29.307849+0000","last_became_active":"2024-09-12T17:08:18.464648+0000","last_became_peered":"2024-09-12T17:08:18.464648+0000","last_unstale":"2024-09-12T17:09:29.307849+0000","last_undegraded":"2024-09-12T17:09:29.307849+0000","last_fullsized":"2024-09-12T17:09:29.307849+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:29.307658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:29.307658+0000","last_clean_scrub_stamp":"2024-09-12T17:09:29.307658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:13:48.428251+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"103'15","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:29.615290+0000","last_change":"2024-09-12T17:09:29.615290+0000","last_active":"2024-09-12T17:09:29.615290+0000","last_peered":"2024-09-12T17:09:29.615290+0000","last_clean":"2024-09-12T17:09:29.615290+0000","last_became_active":"2024-09-12T17:05:53.548968+0000","last_became_peered":"2024-09-12T17:05:53.548968+0000","last_unstale":"2024-09-12T17:09:29.615290+0000","last_undegraded":"2024-09-12T17:09:29.615290+0000","last_fullsized":"2024-09-12T17:09:29.615290+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'15","last_scrub_stamp":"2024-09-12T17:09:29.615081+0000","last_deep_scrub":"103'15","last_deep_scrub_stamp":"2024-09-12T17:09:29.615081+0000","last_clean_scrub_stamp":"2024-09-12T17:09:29.615081+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:07:55.363663+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"103'21","reported_seq":243,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:39.020268+0000","last_change":"2024-09-12T17:09:39.020268+0000","last_active":"2024-09-12T17:09:39.020268+0000","last_peered":"2024-09-12T17:09:39.020268+0000","last_clean":"2024-09-12T17:09:39.020268+0000","last_became_active":"2024-09-12T17:08:21.464957+0000","last_became_peered":"2024-09-12T17:08:21.464957+0000","last_unstale":"2024-09-12T17:09:39.020268+0000","last_undegraded":"2024-09-12T17:09:39.020268+0000","last_fullsized":"2024-09-12T17:09:39.020268+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'21","last_scrub_stamp":"2024-09-12T17:09:39.020085+0000","last_deep_scrub":"103'21","last_deep_scrub_stamp":"2024-09-12T17:09:39.020085+0000","last_clean_scrub_stamp":"2024-09-12T17:09:39.020085+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:23:14.738968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":156,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:44.731547+0000","last_change":"2024-09-12T17:09:44.731547+0000","last_active":"2024-09-12T17:09:44.731547+0000","last_peered":"2024-09-12T17:09:44.731547+0000","last_clean":"2024-09-12T17:09:44.731547+0000","last_became_active":"2024-09-12T17:05:58.121871+0000","last_became_peered":"2024-09-12T17:05:58.121871+0000","last_unstale":"2024-09-12T17:09:44.731547+0000","last_undegraded":"2024-09-12T17:09:44.731547+0000","last_fullsized":"2024-09-12T17:09:44.731547+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:44.731366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:44.731366+0000","last_clean_scrub_stamp":"2024-09-12T17:09:44.731366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:57.556971+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.400068+0000","last_change":"2024-09-12T17:09:20.400068+0000","last_active":"2024-09-12T17:09:20.400068+0000","last_peered":"2024-09-12T17:09:20.400068+0000","last_clean":"2024-09-12T17:09:20.400068+0000","last_became_active":"2024-09-12T17:05:49.527758+0000","last_became_peered":"2024-09-12T17:05:49.527758+0000","last_unstale":"2024-09-12T17:09:20.400068+0000","last_undegraded":"2024-09-12T17:09:20.400068+0000","last_fullsized":"2024-09-12T17:09:20.400068+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:20.399852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:20.399852+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.399852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:35.852327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"103'28","reported_seq":219,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.047899+0000","last_change":"2024-09-12T17:09:11.047899+0000","last_active":"2024-09-12T17:09:11.047899+0000","last_peered":"2024-09-12T17:09:11.047899+0000","last_clean":"2024-09-12T17:09:11.047899+0000","last_became_active":"2024-09-12T17:05:47.520943+0000","last_became_peered":"2024-09-12T17:05:47.520943+0000","last_unstale":"2024-09-12T17:09:11.047899+0000","last_undegraded":"2024-09-12T17:09:11.047899+0000","last_fullsized":"2024-09-12T17:09:11.047899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'28","last_scrub_stamp":"2024-09-12T17:09:11.047719+0000","last_deep_scrub":"103'28","last_deep_scrub_stamp":"2024-09-12T17:09:11.047719+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.047719+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:37:55.669095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":51203,"num_write":36,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"103'2","reported_seq":179,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:31.179474+0000","last_change":"2024-09-12T17:09:31.179474+0000","last_active":"2024-09-12T17:09:31.179474+0000","last_peered":"2024-09-12T17:09:31.179474+0000","last_clean":"2024-09-12T17:09:31.179474+0000","last_became_active":"2024-09-12T17:05:51.555420+0000","last_became_peered":"2024-09-12T17:05:51.555420+0000","last_unstale":"2024-09-12T17:09:31.179474+0000","last_undegraded":"2024-09-12T17:09:31.179474+0000","last_fullsized":"2024-09-12T17:09:31.179474+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-12T17:09:31.179296+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-12T17:09:31.179296+0000","last_clean_scrub_stamp":"2024-09-12T17:09:31.179296+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:13.774747+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"103'21","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:36.937320+0000","last_change":"2024-09-12T17:09:36.937320+0000","last_active":"2024-09-12T17:09:36.937320+0000","last_peered":"2024-09-12T17:09:36.937320+0000","last_clean":"2024-09-12T17:09:36.937320+0000","last_became_active":"2024-09-12T17:05:53.553333+0000","last_became_peered":"2024-09-12T17:05:53.553333+0000","last_unstale":"2024-09-12T17:09:36.937320+0000","last_undegraded":"2024-09-12T17:09:36.937320+0000","last_fullsized":"2024-09-12T17:09:36.937320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'21","last_scrub_stamp":"2024-09-12T17:09:36.937138+0000","last_deep_scrub":"103'21","last_deep_scrub_stamp":"2024-09-12T17:09:36.937138+0000","last_clean_scrub_stamp":"2024-09-12T17:09:36.937138+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:20.361588+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"103'19","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:42.414970+0000","last_change":"2024-09-12T17:09:42.414970+0000","last_active":"2024-09-12T17:09:42.414970+0000","last_peered":"2024-09-12T17:09:42.414970+0000","last_clean":"2024-09-12T17:09:42.414970+0000","last_became_active":"2024-09-12T17:05:55.555879+0000","last_became_peered":"2024-09-12T17:05:55.555879+0000","last_unstale":"2024-09-12T17:09:42.414970+0000","last_undegraded":"2024-09-12T17:09:42.414970+0000","last_fullsized":"2024-09-12T17:09:42.414970+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'19","last_scrub_stamp":"2024-09-12T17:09:42.414737+0000","last_deep_scrub":"103'19","last_deep_scrub_stamp":"2024-09-12T17:09:42.414737+0000","last_clean_scrub_stamp":"2024-09-12T17:09:42.414737+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:13:34.163800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.259800+0000","last_change":"2024-09-12T17:09:20.259800+0000","last_active":"2024-09-12T17:09:20.259800+0000","last_peered":"2024-09-12T17:09:20.259800+0000","last_clean":"2024-09-12T17:09:20.259800+0000","last_became_active":"2024-09-12T17:05:49.552637+0000","last_became_peered":"2024-09-12T17:05:49.552637+0000","last_unstale":"2024-09-12T17:09:20.259800+0000","last_undegraded":"2024-09-12T17:09:20.259800+0000","last_fullsized":"2024-09-12T17:09:20.259800+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:20.259563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:20.259563+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.259563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:31.730623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"103'12","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.859440+0000","last_change":"2024-09-12T17:09:13.859440+0000","last_active":"2024-09-12T17:09:13.859440+0000","last_peered":"2024-09-12T17:09:13.859440+0000","last_clean":"2024-09-12T17:09:13.859440+0000","last_became_active":"2024-09-12T17:05:47.562465+0000","last_became_peered":"2024-09-12T17:05:47.562465+0000","last_unstale":"2024-09-12T17:09:13.859440+0000","last_undegraded":"2024-09-12T17:09:13.859440+0000","last_fullsized":"2024-09-12T17:09:13.859440+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:13.859257+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:13.859257+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.859257+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:21:22.090316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24585,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":166,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:28.983289+0000","last_change":"2024-09-12T17:09:28.983289+0000","last_active":"2024-09-12T17:09:28.983289+0000","last_peered":"2024-09-12T17:09:28.983289+0000","last_clean":"2024-09-12T17:09:28.983289+0000","last_became_active":"2024-09-12T17:05:51.541205+0000","last_became_peered":"2024-09-12T17:05:51.541205+0000","last_unstale":"2024-09-12T17:09:28.983289+0000","last_undegraded":"2024-09-12T17:09:28.983289+0000","last_fullsized":"2024-09-12T17:09:28.983289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:28.983105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:28.983105+0000","last_clean_scrub_stamp":"2024-09-12T17:09:28.983105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:14:05.096957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"103'41","reported_seq":219,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:35.150239+0000","last_change":"2024-09-12T17:09:35.150239+0000","last_active":"2024-09-12T17:09:35.150239+0000","last_peered":"2024-09-12T17:09:35.150239+0000","last_clean":"2024-09-12T17:09:35.150239+0000","last_became_active":"2024-09-12T17:05:53.559463+0000","last_became_peered":"2024-09-12T17:05:53.559463+0000","last_unstale":"2024-09-12T17:09:35.150239+0000","last_undegraded":"2024-09-12T17:09:35.150239+0000","last_fullsized":"2024-09-12T17:09:35.150239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'41","last_scrub_stamp":"2024-09-12T17:09:35.150028+0000","last_deep_scrub":"103'41","last_deep_scrub_stamp":"2024-09-12T17:09:35.150028+0000","last_clean_scrub_stamp":"2024-09-12T17:09:35.150028+0000","objects_scrubbed":9,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:35:19.783072+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":55,"num_read_kb":84,"num_write":38,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.075639+0000","last_change":"2024-09-12T17:09:19.075639+0000","last_active":"2024-09-12T17:09:19.075639+0000","last_peered":"2024-09-12T17:09:19.075639+0000","last_clean":"2024-09-12T17:09:19.075639+0000","last_became_active":"2024-09-12T17:08:21.463161+0000","last_became_peered":"2024-09-12T17:08:21.463161+0000","last_unstale":"2024-09-12T17:09:19.075639+0000","last_undegraded":"2024-09-12T17:09:19.075639+0000","last_fullsized":"2024-09-12T17:09:19.075639+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:19.075369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:19.075369+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.075369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:27:25.576582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":154,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:39.105270+0000","last_change":"2024-09-12T17:09:39.105270+0000","last_active":"2024-09-12T17:09:39.105270+0000","last_peered":"2024-09-12T17:09:39.105270+0000","last_clean":"2024-09-12T17:09:39.105270+0000","last_became_active":"2024-09-12T17:05:57.598703+0000","last_became_peered":"2024-09-12T17:05:57.598703+0000","last_unstale":"2024-09-12T17:09:39.105270+0000","last_undegraded":"2024-09-12T17:09:39.105270+0000","last_fullsized":"2024-09-12T17:09:39.105270+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:39.105081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:39.105081+0000","last_clean_scrub_stamp":"2024-09-12T17:09:39.105081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:32:36.772039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"84'34","reported_seq":225,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.792471+0000","last_change":"2024-09-12T17:09:13.792471+0000","last_active":"2024-09-12T17:09:13.792471+0000","last_peered":"2024-09-12T17:09:13.792471+0000","last_clean":"2024-09-12T17:09:13.792471+0000","last_became_active":"2024-09-12T17:08:18.443808+0000","last_became_peered":"2024-09-12T17:08:18.443808+0000","last_unstale":"2024-09-12T17:09:13.792471+0000","last_undegraded":"2024-09-12T17:09:13.792471+0000","last_fullsized":"2024-09-12T17:09:13.792471+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'34","last_scrub_stamp":"2024-09-12T17:09:13.792226+0000","last_deep_scrub":"84'34","last_deep_scrub_stamp":"2024-09-12T17:09:13.792226+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.792226+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:40.138283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"103'14","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.899760+0000","last_change":"2024-09-12T17:09:14.899760+0000","last_active":"2024-09-12T17:09:14.899760+0000","last_peered":"2024-09-12T17:09:14.899760+0000","last_clean":"2024-09-12T17:09:14.899760+0000","last_became_active":"2024-09-12T17:05:47.562812+0000","last_became_peered":"2024-09-12T17:05:47.562812+0000","last_unstale":"2024-09-12T17:09:14.899760+0000","last_undegraded":"2024-09-12T17:09:14.899760+0000","last_fullsized":"2024-09-12T17:09:14.899760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'14","last_scrub_stamp":"2024-09-12T17:09:14.899578+0000","last_deep_scrub":"103'14","last_deep_scrub_stamp":"2024-09-12T17:09:14.899578+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.899578+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:05:28.517045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24579,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.566472+0000","last_change":"2024-09-12T17:09:23.566472+0000","last_active":"2024-09-12T17:09:23.566472+0000","last_peered":"2024-09-12T17:09:23.566472+0000","last_clean":"2024-09-12T17:09:23.566472+0000","last_became_active":"2024-09-12T17:05:51.544649+0000","last_became_peered":"2024-09-12T17:05:51.544649+0000","last_unstale":"2024-09-12T17:09:23.566472+0000","last_undegraded":"2024-09-12T17:09:23.566472+0000","last_fullsized":"2024-09-12T17:09:23.566472+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:23.566279+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:23.566279+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.566279+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:37:13.364596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"103'19","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:30.349067+0000","last_change":"2024-09-12T17:09:30.349067+0000","last_active":"2024-09-12T17:09:30.349067+0000","last_peered":"2024-09-12T17:09:30.349067+0000","last_clean":"2024-09-12T17:09:30.349067+0000","last_became_active":"2024-09-12T17:05:53.550042+0000","last_became_peered":"2024-09-12T17:05:53.550042+0000","last_unstale":"2024-09-12T17:09:30.349067+0000","last_undegraded":"2024-09-12T17:09:30.349067+0000","last_fullsized":"2024-09-12T17:09:30.349067+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'19","last_scrub_stamp":"2024-09-12T17:09:30.348882+0000","last_deep_scrub":"103'19","last_deep_scrub_stamp":"2024-09-12T17:09:30.348882+0000","last_clean_scrub_stamp":"2024-09-12T17:09:30.348882+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:43:35.714795+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:40.508418+0000","last_change":"2024-09-12T17:09:40.508418+0000","last_active":"2024-09-12T17:09:40.508418+0000","last_peered":"2024-09-12T17:09:40.508418+0000","last_clean":"2024-09-12T17:09:40.508418+0000","last_became_active":"2024-09-12T17:05:55.557930+0000","last_became_peered":"2024-09-12T17:05:55.557930+0000","last_unstale":"2024-09-12T17:09:40.508418+0000","last_undegraded":"2024-09-12T17:09:40.508418+0000","last_fullsized":"2024-09-12T17:09:40.508418+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:40.508247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:40.508247+0000","last_clean_scrub_stamp":"2024-09-12T17:09:40.508247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:36.013339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":156,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:32.277299+0000","last_change":"2024-09-12T17:09:32.277299+0000","last_active":"2024-09-12T17:09:32.277299+0000","last_peered":"2024-09-12T17:09:32.277299+0000","last_clean":"2024-09-12T17:09:32.277299+0000","last_became_active":"2024-09-12T17:05:57.591855+0000","last_became_peered":"2024-09-12T17:05:57.591855+0000","last_unstale":"2024-09-12T17:09:32.277299+0000","last_undegraded":"2024-09-12T17:09:32.277299+0000","last_fullsized":"2024-09-12T17:09:32.277299+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:32.277092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:32.277092+0000","last_clean_scrub_stamp":"2024-09-12T17:09:32.277092+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:26.153835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.173723+0000","last_change":"2024-09-12T17:09:20.173723+0000","last_active":"2024-09-12T17:09:20.173723+0000","last_peered":"2024-09-12T17:09:20.173723+0000","last_clean":"2024-09-12T17:09:20.173723+0000","last_became_active":"2024-09-12T17:08:18.466877+0000","last_became_peered":"2024-09-12T17:08:18.466877+0000","last_unstale":"2024-09-12T17:09:20.173723+0000","last_undegraded":"2024-09-12T17:09:20.173723+0000","last_fullsized":"2024-09-12T17:09:20.173723+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:20.173520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:20.173520+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.173520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:17:28.818313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"103'18","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.949024+0000","last_change":"2024-09-12T17:09:17.949024+0000","last_active":"2024-09-12T17:09:17.949024+0000","last_peered":"2024-09-12T17:09:17.949024+0000","last_clean":"2024-09-12T17:09:17.949024+0000","last_became_active":"2024-09-12T17:05:47.561587+0000","last_became_peered":"2024-09-12T17:05:47.561587+0000","last_unstale":"2024-09-12T17:09:17.949024+0000","last_undegraded":"2024-09-12T17:09:17.949024+0000","last_fullsized":"2024-09-12T17:09:17.949024+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:17.948844+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:17.948844+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.948844+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:15:26.011536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28672,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"103'2","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.663647+0000","last_change":"2024-09-12T17:09:26.663647+0000","last_active":"2024-09-12T17:09:26.663647+0000","last_peered":"2024-09-12T17:09:26.663647+0000","last_clean":"2024-09-12T17:09:26.663647+0000","last_became_active":"2024-09-12T17:05:51.542457+0000","last_became_peered":"2024-09-12T17:05:51.542457+0000","last_unstale":"2024-09-12T17:09:26.663647+0000","last_undegraded":"2024-09-12T17:09:26.663647+0000","last_fullsized":"2024-09-12T17:09:26.663647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-12T17:09:26.663462+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-12T17:09:26.663462+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.663462+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:00:24.582475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"103'31","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:33.991048+0000","last_change":"2024-09-12T17:09:33.991048+0000","last_active":"2024-09-12T17:09:33.991048+0000","last_peered":"2024-09-12T17:09:33.991048+0000","last_clean":"2024-09-12T17:09:33.991048+0000","last_became_active":"2024-09-12T17:05:53.547990+0000","last_became_peered":"2024-09-12T17:05:53.547990+0000","last_unstale":"2024-09-12T17:09:33.991048+0000","last_undegraded":"2024-09-12T17:09:33.991048+0000","last_fullsized":"2024-09-12T17:09:33.991048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'31","last_scrub_stamp":"2024-09-12T17:09:33.990844+0000","last_deep_scrub":"103'31","last_deep_scrub_stamp":"2024-09-12T17:09:33.990844+0000","last_clean_scrub_stamp":"2024-09-12T17:09:33.990844+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:01:13.549258+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"103'21","reported_seq":241,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:34.873747+0000","last_change":"2024-09-12T17:09:34.873747+0000","last_active":"2024-09-12T17:09:34.873747+0000","last_peered":"2024-09-12T17:09:34.873747+0000","last_clean":"2024-09-12T17:09:34.873747+0000","last_became_active":"2024-09-12T17:08:21.465057+0000","last_became_peered":"2024-09-12T17:08:21.465057+0000","last_unstale":"2024-09-12T17:09:34.873747+0000","last_undegraded":"2024-09-12T17:09:34.873747+0000","last_fullsized":"2024-09-12T17:09:34.873747+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'21","last_scrub_stamp":"2024-09-12T17:09:34.873459+0000","last_deep_scrub":"103'21","last_deep_scrub_stamp":"2024-09-12T17:09:34.873459+0000","last_clean_scrub_stamp":"2024-09-12T17:09:34.873459+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:24.851555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":154,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:40.881389+0000","last_change":"2024-09-12T17:09:40.881389+0000","last_active":"2024-09-12T17:09:40.881389+0000","last_peered":"2024-09-12T17:09:40.881389+0000","last_clean":"2024-09-12T17:09:40.881389+0000","last_became_active":"2024-09-12T17:05:57.595658+0000","last_became_peered":"2024-09-12T17:05:57.595658+0000","last_unstale":"2024-09-12T17:09:40.881389+0000","last_undegraded":"2024-09-12T17:09:40.881389+0000","last_fullsized":"2024-09-12T17:09:40.881389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:40.881199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:40.881199+0000","last_clean_scrub_stamp":"2024-09-12T17:09:40.881199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:16.558102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.822427+0000","last_change":"2024-09-12T17:09:21.822427+0000","last_active":"2024-09-12T17:09:21.822427+0000","last_peered":"2024-09-12T17:09:21.822427+0000","last_clean":"2024-09-12T17:09:21.822427+0000","last_became_active":"2024-09-12T17:08:18.464976+0000","last_became_peered":"2024-09-12T17:08:18.464976+0000","last_unstale":"2024-09-12T17:09:21.822427+0000","last_undegraded":"2024-09-12T17:09:21.822427+0000","last_fullsized":"2024-09-12T17:09:21.822427+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:21.822212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:21.822212+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.822212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:22:57.541094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"103'20","reported_seq":208,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.073435+0000","last_change":"2024-09-12T17:09:11.073435+0000","last_active":"2024-09-12T17:09:11.073435+0000","last_peered":"2024-09-12T17:09:11.073435+0000","last_clean":"2024-09-12T17:09:11.073435+0000","last_became_active":"2024-09-12T17:05:47.534607+0000","last_became_peered":"2024-09-12T17:05:47.534607+0000","last_unstale":"2024-09-12T17:09:11.073435+0000","last_undegraded":"2024-09-12T17:09:11.073435+0000","last_fullsized":"2024-09-12T17:09:11.073435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:11.073246+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:11.073246+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.073246+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:50:31.724300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":36876,"num_write":52,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.545123+0000","last_change":"2024-09-12T17:09:22.545123+0000","last_active":"2024-09-12T17:09:22.545123+0000","last_peered":"2024-09-12T17:09:22.545123+0000","last_clean":"2024-09-12T17:09:22.545123+0000","last_became_active":"2024-09-12T17:05:51.547939+0000","last_became_peered":"2024-09-12T17:05:51.547939+0000","last_unstale":"2024-09-12T17:09:22.545123+0000","last_undegraded":"2024-09-12T17:09:22.545123+0000","last_fullsized":"2024-09-12T17:09:22.545123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:22.544941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:22.544941+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.544941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:05.223688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"103'34","reported_seq":215,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:28.757393+0000","last_change":"2024-09-12T17:09:28.757393+0000","last_active":"2024-09-12T17:09:28.757393+0000","last_peered":"2024-09-12T17:09:28.757393+0000","last_clean":"2024-09-12T17:09:28.757393+0000","last_became_active":"2024-09-12T17:05:53.535062+0000","last_became_peered":"2024-09-12T17:05:53.535062+0000","last_unstale":"2024-09-12T17:09:28.757393+0000","last_undegraded":"2024-09-12T17:09:28.757393+0000","last_fullsized":"2024-09-12T17:09:28.757393+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'34","last_scrub_stamp":"2024-09-12T17:09:28.757191+0000","last_deep_scrub":"103'34","last_deep_scrub_stamp":"2024-09-12T17:09:28.757191+0000","last_clean_scrub_stamp":"2024-09-12T17:09:28.757191+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:12.421851+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":57,"num_read_kb":81,"num_write":36,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:28.631715+0000","last_change":"2024-09-12T17:09:28.631715+0000","last_active":"2024-09-12T17:09:28.631715+0000","last_peered":"2024-09-12T17:09:28.631715+0000","last_clean":"2024-09-12T17:09:28.631715+0000","last_became_active":"2024-09-12T17:05:55.563125+0000","last_became_peered":"2024-09-12T17:05:55.563125+0000","last_unstale":"2024-09-12T17:09:28.631715+0000","last_undegraded":"2024-09-12T17:09:28.631715+0000","last_fullsized":"2024-09-12T17:09:28.631715+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:28.631504+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:28.631504+0000","last_clean_scrub_stamp":"2024-09-12T17:09:28.631504+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:58:13.426196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":47,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:34.924768+0000","last_change":"2024-09-12T17:09:34.924768+0000","last_active":"2024-09-12T17:09:34.924768+0000","last_peered":"2024-09-12T17:09:34.924768+0000","last_clean":"2024-09-12T17:09:34.924768+0000","last_became_active":"2024-09-12T17:08:18.459544+0000","last_became_peered":"2024-09-12T17:08:18.459544+0000","last_unstale":"2024-09-12T17:09:34.924768+0000","last_undegraded":"2024-09-12T17:09:34.924768+0000","last_fullsized":"2024-09-12T17:09:34.924768+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:34.924588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:34.924588+0000","last_clean_scrub_stamp":"2024-09-12T17:09:34.924588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:43.012335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.805545+0000","last_change":"2024-09-12T17:09:16.805545+0000","last_active":"2024-09-12T17:09:16.805545+0000","last_peered":"2024-09-12T17:09:16.805545+0000","last_clean":"2024-09-12T17:09:16.805545+0000","last_became_active":"2024-09-12T17:05:49.543307+0000","last_became_peered":"2024-09-12T17:05:49.543307+0000","last_unstale":"2024-09-12T17:09:16.805545+0000","last_undegraded":"2024-09-12T17:09:16.805545+0000","last_fullsized":"2024-09-12T17:09:16.805545+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:16.805360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:16.805360+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.805360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:44:52.193400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"103'12","reported_seq":196,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.407498+0000","last_change":"2024-09-12T17:09:10.407498+0000","last_active":"2024-09-12T17:09:10.407498+0000","last_peered":"2024-09-12T17:09:10.407498+0000","last_clean":"2024-09-12T17:09:10.407498+0000","last_became_active":"2024-09-12T17:05:47.525696+0000","last_became_peered":"2024-09-12T17:05:47.525696+0000","last_unstale":"2024-09-12T17:09:10.407498+0000","last_undegraded":"2024-09-12T17:09:10.407498+0000","last_fullsized":"2024-09-12T17:09:10.407498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:10.407275+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:10.407275+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.407275+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:44.594207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":18438,"num_write":28,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.599533+0000","last_change":"2024-09-12T17:09:24.599533+0000","last_active":"2024-09-12T17:09:24.599533+0000","last_peered":"2024-09-12T17:09:24.599533+0000","last_clean":"2024-09-12T17:09:24.599533+0000","last_became_active":"2024-09-12T17:05:51.542737+0000","last_became_peered":"2024-09-12T17:05:51.542737+0000","last_unstale":"2024-09-12T17:09:24.599533+0000","last_undegraded":"2024-09-12T17:09:24.599533+0000","last_fullsized":"2024-09-12T17:09:24.599533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:24.599315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:24.599315+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.599315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:30:21.084174+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"103'28","reported_seq":240,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:34.877833+0000","last_change":"2024-09-12T17:09:34.877833+0000","last_active":"2024-09-12T17:09:34.877833+0000","last_peered":"2024-09-12T17:09:34.877833+0000","last_clean":"2024-09-12T17:09:34.877833+0000","last_became_active":"2024-09-12T17:08:21.465207+0000","last_became_peered":"2024-09-12T17:08:21.465207+0000","last_unstale":"2024-09-12T17:09:34.877833+0000","last_undegraded":"2024-09-12T17:09:34.877833+0000","last_fullsized":"2024-09-12T17:09:34.877833+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'28","last_scrub_stamp":"2024-09-12T17:09:34.877635+0000","last_deep_scrub":"103'28","last_deep_scrub_stamp":"2024-09-12T17:09:34.877635+0000","last_clean_scrub_stamp":"2024-09-12T17:09:34.877635+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:33:27.817137+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":61,"num_write":28,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3559,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:39.846982+0000","last_change":"2024-09-12T17:09:39.846982+0000","last_active":"2024-09-12T17:09:39.846982+0000","last_peered":"2024-09-12T17:09:39.846982+0000","last_clean":"2024-09-12T17:09:39.846982+0000","last_became_active":"2024-09-12T17:05:55.564802+0000","last_became_peered":"2024-09-12T17:05:55.564802+0000","last_unstale":"2024-09-12T17:09:39.846982+0000","last_undegraded":"2024-09-12T17:09:39.846982+0000","last_fullsized":"2024-09-12T17:09:39.846982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:39.846775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:39.846775+0000","last_clean_scrub_stamp":"2024-09-12T17:09:39.846775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:43.330077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":156,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:41.460449+0000","last_change":"2024-09-12T17:09:41.460449+0000","last_active":"2024-09-12T17:09:41.460449+0000","last_peered":"2024-09-12T17:09:41.460449+0000","last_clean":"2024-09-12T17:09:41.460449+0000","last_became_active":"2024-09-12T17:05:57.591389+0000","last_became_peered":"2024-09-12T17:05:57.591389+0000","last_unstale":"2024-09-12T17:09:41.460449+0000","last_undegraded":"2024-09-12T17:09:41.460449+0000","last_fullsized":"2024-09-12T17:09:41.460449+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:41.460164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:41.460164+0000","last_clean_scrub_stamp":"2024-09-12T17:09:41.460164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:19:56.404353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"68'10","reported_seq":185,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.836015+0000","last_change":"2024-09-12T17:09:15.836015+0000","last_active":"2024-09-12T17:09:15.836015+0000","last_peered":"2024-09-12T17:09:15.836015+0000","last_clean":"2024-09-12T17:09:15.836015+0000","last_became_active":"2024-09-12T17:05:49.552270+0000","last_became_peered":"2024-09-12T17:05:49.552270+0000","last_unstale":"2024-09-12T17:09:15.836015+0000","last_undegraded":"2024-09-12T17:09:15.836015+0000","last_fullsized":"2024-09-12T17:09:15.836015+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'10","last_scrub_stamp":"2024-09-12T17:09:15.835764+0000","last_deep_scrub":"68'10","last_deep_scrub_stamp":"2024-09-12T17:09:15.835764+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.835764+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:05:54.565957+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"103'16","reported_seq":200,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.091046+0000","last_change":"2024-09-12T17:09:10.091046+0000","last_active":"2024-09-12T17:09:10.091046+0000","last_peered":"2024-09-12T17:09:10.091046+0000","last_clean":"2024-09-12T17:09:10.091046+0000","last_became_active":"2024-09-12T17:05:47.542362+0000","last_became_peered":"2024-09-12T17:05:47.542362+0000","last_unstale":"2024-09-12T17:09:10.091046+0000","last_undegraded":"2024-09-12T17:09:10.091046+0000","last_fullsized":"2024-09-12T17:09:10.091046+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:10.090858+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:10.090858+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.090858+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:55:44.006073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":47,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:33.015385+0000","last_change":"2024-09-12T17:09:33.015385+0000","last_active":"2024-09-12T17:09:33.015385+0000","last_peered":"2024-09-12T17:09:33.015385+0000","last_clean":"2024-09-12T17:09:33.015385+0000","last_became_active":"2024-09-12T17:08:18.452101+0000","last_became_peered":"2024-09-12T17:08:18.452101+0000","last_unstale":"2024-09-12T17:09:33.015385+0000","last_undegraded":"2024-09-12T17:09:33.015385+0000","last_fullsized":"2024-09-12T17:09:33.015385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:33.015184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:33.015184+0000","last_clean_scrub_stamp":"2024-09-12T17:09:33.015184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:26:58.678603+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"103'29","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.650005+0000","last_change":"2024-09-12T17:09:25.650005+0000","last_active":"2024-09-12T17:09:25.650005+0000","last_peered":"2024-09-12T17:09:25.650005+0000","last_clean":"2024-09-12T17:09:25.650005+0000","last_became_active":"2024-09-12T17:05:53.554131+0000","last_became_peered":"2024-09-12T17:05:53.554131+0000","last_unstale":"2024-09-12T17:09:25.650005+0000","last_undegraded":"2024-09-12T17:09:25.650005+0000","last_fullsized":"2024-09-12T17:09:25.650005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'29","last_scrub_stamp":"2024-09-12T17:09:25.649799+0000","last_deep_scrub":"103'29","last_deep_scrub_stamp":"2024-09-12T17:09:25.649799+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.649799+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:04:18.813939+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"103'18","reported_seq":223,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.620751+0000","last_change":"2024-09-12T17:09:27.620751+0000","last_active":"2024-09-12T17:09:27.620751+0000","last_peered":"2024-09-12T17:09:27.620751+0000","last_clean":"2024-09-12T17:09:27.620751+0000","last_became_active":"2024-09-12T17:05:55.556488+0000","last_became_peered":"2024-09-12T17:05:55.556488+0000","last_unstale":"2024-09-12T17:09:27.620751+0000","last_undegraded":"2024-09-12T17:09:27.620751+0000","last_fullsized":"2024-09-12T17:09:27.620751+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:27.620570+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:27.620570+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.620570+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:11:57.992690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":47,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.965025+0000","last_change":"2024-09-12T17:09:27.965025+0000","last_active":"2024-09-12T17:09:27.965025+0000","last_peered":"2024-09-12T17:09:27.965025+0000","last_clean":"2024-09-12T17:09:27.965025+0000","last_became_active":"2024-09-12T17:08:18.460345+0000","last_became_peered":"2024-09-12T17:08:18.460345+0000","last_unstale":"2024-09-12T17:09:27.965025+0000","last_undegraded":"2024-09-12T17:09:27.965025+0000","last_fullsized":"2024-09-12T17:09:27.965025+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:27.964842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:27.964842+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.964842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:33:50.042436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"68'6","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.789348+0000","last_change":"2024-09-12T17:09:14.789348+0000","last_active":"2024-09-12T17:09:14.789348+0000","last_peered":"2024-09-12T17:09:14.789348+0000","last_clean":"2024-09-12T17:09:14.789348+0000","last_became_active":"2024-09-12T17:05:49.561200+0000","last_became_peered":"2024-09-12T17:05:49.561200+0000","last_unstale":"2024-09-12T17:09:14.789348+0000","last_undegraded":"2024-09-12T17:09:14.789348+0000","last_fullsized":"2024-09-12T17:09:14.789348+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-09-12T17:09:14.789152+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-09-12T17:09:14.789152+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.789152+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:08.191245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"103'12","reported_seq":197,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:09.788662+0000","last_change":"2024-09-12T17:09:09.788662+0000","last_active":"2024-09-12T17:09:09.788662+0000","last_peered":"2024-09-12T17:09:09.788662+0000","last_clean":"2024-09-12T17:09:09.788662+0000","last_became_active":"2024-09-12T17:05:47.540484+0000","last_became_peered":"2024-09-12T17:05:47.540484+0000","last_unstale":"2024-09-12T17:09:09.788662+0000","last_undegraded":"2024-09-12T17:09:09.788662+0000","last_fullsized":"2024-09-12T17:09:09.788662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:09.788445+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:09.788445+0000","last_clean_scrub_stamp":"2024-09-12T17:09:09.788445+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:56:39.325156+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24585,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"103'4","reported_seq":192,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:29.265571+0000","last_change":"2024-09-12T17:09:29.265571+0000","last_active":"2024-09-12T17:09:29.265571+0000","last_peered":"2024-09-12T17:09:29.265571+0000","last_clean":"2024-09-12T17:09:29.265571+0000","last_became_active":"2024-09-12T17:05:51.554176+0000","last_became_peered":"2024-09-12T17:05:51.554176+0000","last_unstale":"2024-09-12T17:09:29.265571+0000","last_undegraded":"2024-09-12T17:09:29.265571+0000","last_fullsized":"2024-09-12T17:09:29.265571+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'4","last_scrub_stamp":"2024-09-12T17:09:29.265388+0000","last_deep_scrub":"103'4","last_deep_scrub_stamp":"2024-09-12T17:09:29.265388+0000","last_clean_scrub_stamp":"2024-09-12T17:09:29.265388+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:13:13.937167+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"103'15","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:32.364881+0000","last_change":"2024-09-12T17:09:32.364881+0000","last_active":"2024-09-12T17:09:32.364881+0000","last_peered":"2024-09-12T17:09:32.364881+0000","last_clean":"2024-09-12T17:09:32.364881+0000","last_became_active":"2024-09-12T17:05:53.552545+0000","last_became_peered":"2024-09-12T17:05:53.552545+0000","last_unstale":"2024-09-12T17:09:32.364881+0000","last_undegraded":"2024-09-12T17:09:32.364881+0000","last_fullsized":"2024-09-12T17:09:32.364881+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'15","last_scrub_stamp":"2024-09-12T17:09:32.364682+0000","last_deep_scrub":"103'15","last_deep_scrub_stamp":"2024-09-12T17:09:32.364682+0000","last_clean_scrub_stamp":"2024-09-12T17:09:32.364682+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:51.735250+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"103'20","reported_seq":242,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:28.244622+0000","last_change":"2024-09-12T17:09:28.244622+0000","last_active":"2024-09-12T17:09:28.244622+0000","last_peered":"2024-09-12T17:09:28.244622+0000","last_clean":"2024-09-12T17:09:28.244622+0000","last_became_active":"2024-09-12T17:08:18.471539+0000","last_became_peered":"2024-09-12T17:08:18.471539+0000","last_unstale":"2024-09-12T17:09:28.244622+0000","last_undegraded":"2024-09-12T17:09:28.244622+0000","last_fullsized":"2024-09-12T17:09:28.244622+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:28.244384+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:28.244384+0000","last_clean_scrub_stamp":"2024-09-12T17:09:28.244384+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:37:46.098681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":156,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:41.797415+0000","last_change":"2024-09-12T17:09:41.797415+0000","last_active":"2024-09-12T17:09:41.797415+0000","last_peered":"2024-09-12T17:09:41.797415+0000","last_clean":"2024-09-12T17:09:41.797415+0000","last_became_active":"2024-09-12T17:05:57.597076+0000","last_became_peered":"2024-09-12T17:05:57.597076+0000","last_unstale":"2024-09-12T17:09:41.797415+0000","last_undegraded":"2024-09-12T17:09:41.797415+0000","last_fullsized":"2024-09-12T17:09:41.797415+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:41.797231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:41.797231+0000","last_clean_scrub_stamp":"2024-09-12T17:09:41.797231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:51:49.884979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"68'6","reported_seq":51,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.079527+0000","last_change":"2024-09-12T17:09:23.079527+0000","last_active":"2024-09-12T17:09:23.079527+0000","last_peered":"2024-09-12T17:09:23.079527+0000","last_clean":"2024-09-12T17:09:23.079527+0000","last_became_active":"2024-09-12T17:08:18.457423+0000","last_became_peered":"2024-09-12T17:08:18.457423+0000","last_unstale":"2024-09-12T17:09:23.079527+0000","last_undegraded":"2024-09-12T17:09:23.079527+0000","last_fullsized":"2024-09-12T17:09:23.079527+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-09-12T17:09:23.079289+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-09-12T17:09:23.079289+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.079289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:52:55.810540+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"103'16","reported_seq":232,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:08.451684+0000","last_change":"2024-09-12T17:09:08.451684+0000","last_active":"2024-09-12T17:09:08.451684+0000","last_peered":"2024-09-12T17:09:08.451684+0000","last_clean":"2024-09-12T17:09:08.451684+0000","last_became_active":"2024-09-12T17:08:18.449468+0000","last_became_peered":"2024-09-12T17:08:18.449468+0000","last_unstale":"2024-09-12T17:09:08.451684+0000","last_undegraded":"2024-09-12T17:09:08.451684+0000","last_fullsized":"2024-09-12T17:09:08.451684+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:08.451508+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:08.451508+0000","last_clean_scrub_stamp":"2024-09-12T17:09:08.451508+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:30.947913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":28678,"num_write":32,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:30.921556+0000","last_change":"2024-09-12T17:09:30.921556+0000","last_active":"2024-09-12T17:09:30.921556+0000","last_peered":"2024-09-12T17:09:30.921556+0000","last_clean":"2024-09-12T17:09:30.921556+0000","last_became_active":"2024-09-12T17:05:51.539302+0000","last_became_peered":"2024-09-12T17:05:51.539302+0000","last_unstale":"2024-09-12T17:09:30.921556+0000","last_undegraded":"2024-09-12T17:09:30.921556+0000","last_fullsized":"2024-09-12T17:09:30.921556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:30.921341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:30.921341+0000","last_clean_scrub_stamp":"2024-09-12T17:09:30.921341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:07.116405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"103'35","reported_seq":260,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:34.119558+0000","last_change":"2024-09-12T17:09:34.119558+0000","last_active":"2024-09-12T17:09:34.119558+0000","last_peered":"2024-09-12T17:09:34.119558+0000","last_clean":"2024-09-12T17:09:34.119558+0000","last_became_active":"2024-09-12T17:08:21.467530+0000","last_became_peered":"2024-09-12T17:08:21.467530+0000","last_unstale":"2024-09-12T17:09:34.119558+0000","last_undegraded":"2024-09-12T17:09:34.119558+0000","last_fullsized":"2024-09-12T17:09:34.119558+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'35","last_scrub_stamp":"2024-09-12T17:09:34.119341+0000","last_deep_scrub":"103'35","last_deep_scrub_stamp":"2024-09-12T17:09:34.119341+0000","last_clean_scrub_stamp":"2024-09-12T17:09:34.119341+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:31.641221+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":75,"num_write":30,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":12538,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.215579+0000","last_change":"2024-09-12T17:09:26.215579+0000","last_active":"2024-09-12T17:09:26.215579+0000","last_peered":"2024-09-12T17:09:26.215579+0000","last_clean":"2024-09-12T17:09:26.215579+0000","last_became_active":"2024-09-12T17:05:55.565979+0000","last_became_peered":"2024-09-12T17:05:55.565979+0000","last_unstale":"2024-09-12T17:09:26.215579+0000","last_undegraded":"2024-09-12T17:09:26.215579+0000","last_fullsized":"2024-09-12T17:09:26.215579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:26.215387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:26.215387+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.215387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:09:03.439689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:30.005973+0000","last_change":"2024-09-12T17:09:30.005973+0000","last_active":"2024-09-12T17:09:30.005973+0000","last_peered":"2024-09-12T17:09:30.005973+0000","last_clean":"2024-09-12T17:09:30.005973+0000","last_became_active":"2024-09-12T17:08:21.461496+0000","last_became_peered":"2024-09-12T17:08:21.461496+0000","last_unstale":"2024-09-12T17:09:30.005973+0000","last_undegraded":"2024-09-12T17:09:30.005973+0000","last_fullsized":"2024-09-12T17:09:30.005973+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:30.005790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:30.005790+0000","last_clean_scrub_stamp":"2024-09-12T17:09:30.005790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:28:56.310337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.133390+0000","last_change":"2024-09-12T17:09:17.133390+0000","last_active":"2024-09-12T17:09:17.133390+0000","last_peered":"2024-09-12T17:09:17.133390+0000","last_clean":"2024-09-12T17:09:17.133390+0000","last_became_active":"2024-09-12T17:05:49.538713+0000","last_became_peered":"2024-09-12T17:05:49.538713+0000","last_unstale":"2024-09-12T17:09:17.133390+0000","last_undegraded":"2024-09-12T17:09:17.133390+0000","last_fullsized":"2024-09-12T17:09:17.133390+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:17.133216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:17.133216+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.133216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:29:26.172848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"103'74","reported_seq":283,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.842459+0000","last_change":"2024-09-12T17:09:10.842278+0000","last_active":"2024-09-12T17:09:10.842459+0000","last_peered":"2024-09-12T17:09:10.842459+0000","last_clean":"2024-09-12T17:09:10.842459+0000","last_became_active":"2024-09-12T17:05:35.685699+0000","last_became_peered":"2024-09-12T17:05:35.685699+0000","last_unstale":"2024-09-12T17:09:10.842459+0000","last_undegraded":"2024-09-12T17:09:10.842459+0000","last_fullsized":"2024-09-12T17:09:10.842459+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'74","last_scrub_stamp":"2024-09-12T17:09:10.842079+0000","last_deep_scrub":"103'74","last_deep_scrub_stamp":"2024-09-12T17:09:10.842079+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.842079+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:45:46.894248+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"103'2","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.159756+0000","last_change":"2024-09-12T17:09:15.159756+0000","last_active":"2024-09-12T17:09:15.159756+0000","last_peered":"2024-09-12T17:09:15.159756+0000","last_clean":"2024-09-12T17:09:15.159756+0000","last_became_active":"2024-09-12T17:05:40.214653+0000","last_became_peered":"2024-09-12T17:05:40.214653+0000","last_unstale":"2024-09-12T17:09:15.159756+0000","last_undegraded":"2024-09-12T17:09:15.159756+0000","last_fullsized":"2024-09-12T17:09:15.159756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-12T17:09:15.159497+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-12T17:09:15.159497+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.159497+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:37.655902+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0012748309999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"103'20","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.376701+0000","last_change":"2024-09-12T17:09:11.376701+0000","last_active":"2024-09-12T17:09:11.376701+0000","last_peered":"2024-09-12T17:09:11.376701+0000","last_clean":"2024-09-12T17:09:11.376701+0000","last_became_active":"2024-09-12T17:05:47.525694+0000","last_became_peered":"2024-09-12T17:05:47.525694+0000","last_unstale":"2024-09-12T17:09:11.376701+0000","last_undegraded":"2024-09-12T17:09:11.376701+0000","last_fullsized":"2024-09-12T17:09:11.376701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:11.376516+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:11.376516+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.376516+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:06.091901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38921,"num_write":44,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":166,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.971042+0000","last_change":"2024-09-12T17:09:27.971042+0000","last_active":"2024-09-12T17:09:27.971042+0000","last_peered":"2024-09-12T17:09:27.971042+0000","last_clean":"2024-09-12T17:09:27.971042+0000","last_became_active":"2024-09-12T17:05:51.547503+0000","last_became_peered":"2024-09-12T17:05:51.547503+0000","last_unstale":"2024-09-12T17:09:27.971042+0000","last_undegraded":"2024-09-12T17:09:27.971042+0000","last_fullsized":"2024-09-12T17:09:27.971042+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:27.970835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:27.970835+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.970835+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:17:50.467240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"103'44","reported_seq":232,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:32.149068+0000","last_change":"2024-09-12T17:09:32.149068+0000","last_active":"2024-09-12T17:09:32.149068+0000","last_peered":"2024-09-12T17:09:32.149068+0000","last_clean":"2024-09-12T17:09:32.149068+0000","last_became_active":"2024-09-12T17:05:53.545266+0000","last_became_peered":"2024-09-12T17:05:53.545266+0000","last_unstale":"2024-09-12T17:09:32.149068+0000","last_undegraded":"2024-09-12T17:09:32.149068+0000","last_fullsized":"2024-09-12T17:09:32.149068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'44","last_scrub_stamp":"2024-09-12T17:09:32.148866+0000","last_deep_scrub":"103'44","last_deep_scrub_stamp":"2024-09-12T17:09:32.148866+0000","last_clean_scrub_stamp":"2024-09-12T17:09:32.148866+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:04.342466+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":120,"num_write":50,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:35.834999+0000","last_change":"2024-09-12T17:09:35.834999+0000","last_active":"2024-09-12T17:09:35.834999+0000","last_peered":"2024-09-12T17:09:35.834999+0000","last_clean":"2024-09-12T17:09:35.834999+0000","last_became_active":"2024-09-12T17:05:55.561410+0000","last_became_peered":"2024-09-12T17:05:55.561410+0000","last_unstale":"2024-09-12T17:09:35.834999+0000","last_undegraded":"2024-09-12T17:09:35.834999+0000","last_fullsized":"2024-09-12T17:09:35.834999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:35.834776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:35.834776+0000","last_clean_scrub_stamp":"2024-09-12T17:09:35.834776+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:01:55.205344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"68'2","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:34.300550+0000","last_change":"2024-09-12T17:09:34.300550+0000","last_active":"2024-09-12T17:09:34.300550+0000","last_peered":"2024-09-12T17:09:34.300550+0000","last_clean":"2024-09-12T17:09:34.300550+0000","last_became_active":"2024-09-12T17:05:57.592287+0000","last_became_peered":"2024-09-12T17:05:57.592287+0000","last_unstale":"2024-09-12T17:09:34.300550+0000","last_undegraded":"2024-09-12T17:09:34.300550+0000","last_fullsized":"2024-09-12T17:09:34.300550+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-09-12T17:09:34.300320+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-09-12T17:09:34.300320+0000","last_clean_scrub_stamp":"2024-09-12T17:09:34.300320+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:50.785877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.917572+0000","last_change":"2024-09-12T17:09:18.917572+0000","last_active":"2024-09-12T17:09:18.917572+0000","last_peered":"2024-09-12T17:09:18.917572+0000","last_clean":"2024-09-12T17:09:18.917572+0000","last_became_active":"2024-09-12T17:08:18.464334+0000","last_became_peered":"2024-09-12T17:08:18.464334+0000","last_unstale":"2024-09-12T17:09:18.917572+0000","last_undegraded":"2024-09-12T17:09:18.917572+0000","last_fullsized":"2024-09-12T17:09:18.917572+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:18.917345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:18.917345+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.917345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:29.517391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":202,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.821738+0000","last_change":"2024-09-12T17:09:11.821477+0000","last_active":"2024-09-12T17:09:11.821738+0000","last_peered":"2024-09-12T17:09:11.821738+0000","last_clean":"2024-09-12T17:09:11.821738+0000","last_became_active":"2024-09-12T17:08:21.461625+0000","last_became_peered":"2024-09-12T17:08:21.461625+0000","last_unstale":"2024-09-12T17:09:11.821738+0000","last_undegraded":"2024-09-12T17:09:11.821738+0000","last_fullsized":"2024-09-12T17:09:11.821738+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:11.821255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:11.821255+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.821255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:15:59.918091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00079288399999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"103'24","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:09.764897+0000","last_change":"2024-09-12T17:09:09.764897+0000","last_active":"2024-09-12T17:09:09.764897+0000","last_peered":"2024-09-12T17:09:09.764897+0000","last_clean":"2024-09-12T17:09:09.764897+0000","last_became_active":"2024-09-12T17:05:47.543531+0000","last_became_peered":"2024-09-12T17:05:47.543531+0000","last_unstale":"2024-09-12T17:09:09.764897+0000","last_undegraded":"2024-09-12T17:09:09.764897+0000","last_fullsized":"2024-09-12T17:09:09.764897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'24","last_scrub_stamp":"2024-09-12T17:09:09.764680+0000","last_deep_scrub":"103'24","last_deep_scrub_stamp":"2024-09-12T17:09:09.764680+0000","last_clean_scrub_stamp":"2024-09-12T17:09:09.764680+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:03.438309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":40969,"num_write":48,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:28.220218+0000","last_change":"2024-09-12T17:09:28.220218+0000","last_active":"2024-09-12T17:09:28.220218+0000","last_peered":"2024-09-12T17:09:28.220218+0000","last_clean":"2024-09-12T17:09:28.220218+0000","last_became_active":"2024-09-12T17:08:18.465027+0000","last_became_peered":"2024-09-12T17:08:18.465027+0000","last_unstale":"2024-09-12T17:09:28.220218+0000","last_undegraded":"2024-09-12T17:09:28.220218+0000","last_fullsized":"2024-09-12T17:09:28.220218+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:28.220035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:28.220035+0000","last_clean_scrub_stamp":"2024-09-12T17:09:28.220035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:19.277929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"103'73","reported_seq":106,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:37.031718+0000","last_change":"2024-09-12T17:09:37.031718+0000","last_active":"2024-09-12T17:09:37.031718+0000","last_peered":"2024-09-12T17:09:37.031718+0000","last_clean":"2024-09-12T17:09:37.031718+0000","last_became_active":"2024-09-12T17:08:21.455260+0000","last_became_peered":"2024-09-12T17:08:21.455260+0000","last_unstale":"2024-09-12T17:09:37.031718+0000","last_undegraded":"2024-09-12T17:09:37.031718+0000","last_fullsized":"2024-09-12T17:09:37.031718+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'73","last_scrub_stamp":"2024-09-12T17:09:37.031528+0000","last_deep_scrub":"103'73","last_deep_scrub_stamp":"2024-09-12T17:09:37.031528+0000","last_clean_scrub_stamp":"2024-09-12T17:09:37.031528+0000","objects_scrubbed":10,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:36:34.990274+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":101,"num_read_kb":130,"num_write":56,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":5726,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:40.047539+0000","last_change":"2024-09-12T17:09:40.047539+0000","last_active":"2024-09-12T17:09:40.047539+0000","last_peered":"2024-09-12T17:09:40.047539+0000","last_clean":"2024-09-12T17:09:40.047539+0000","last_became_active":"2024-09-12T17:05:55.555625+0000","last_became_peered":"2024-09-12T17:05:55.555625+0000","last_unstale":"2024-09-12T17:09:40.047539+0000","last_undegraded":"2024-09-12T17:09:40.047539+0000","last_fullsized":"2024-09-12T17:09:40.047539+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:40.047355+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:40.047355+0000","last_clean_scrub_stamp":"2024-09-12T17:09:40.047355+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:55.499830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"84'6","reported_seq":53,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:33.967183+0000","last_change":"2024-09-12T17:09:33.967183+0000","last_active":"2024-09-12T17:09:33.967183+0000","last_peered":"2024-09-12T17:09:33.967183+0000","last_clean":"2024-09-12T17:09:33.967183+0000","last_became_active":"2024-09-12T17:08:18.446923+0000","last_became_peered":"2024-09-12T17:08:18.446923+0000","last_unstale":"2024-09-12T17:09:33.967183+0000","last_undegraded":"2024-09-12T17:09:33.967183+0000","last_fullsized":"2024-09-12T17:09:33.967183+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'6","last_scrub_stamp":"2024-09-12T17:09:33.966992+0000","last_deep_scrub":"84'6","last_deep_scrub_stamp":"2024-09-12T17:09:33.966992+0000","last_clean_scrub_stamp":"2024-09-12T17:09:33.966992+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:47.713636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.070537+0000","last_change":"2024-09-12T17:09:24.070537+0000","last_active":"2024-09-12T17:09:24.070537+0000","last_peered":"2024-09-12T17:09:24.070537+0000","last_clean":"2024-09-12T17:09:24.070537+0000","last_became_active":"2024-09-12T17:08:21.456705+0000","last_became_peered":"2024-09-12T17:08:21.456705+0000","last_unstale":"2024-09-12T17:09:24.070537+0000","last_undegraded":"2024-09-12T17:09:24.070537+0000","last_fullsized":"2024-09-12T17:09:24.070537+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:24.070352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:24.070352+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.070352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:35:00.265417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:08.346404+0000","last_change":"2024-09-12T17:09:08.346404+0000","last_active":"2024-09-12T17:09:08.346404+0000","last_peered":"2024-09-12T17:09:08.346404+0000","last_clean":"2024-09-12T17:09:08.346404+0000","last_became_active":"2024-09-12T17:05:40.432973+0000","last_became_peered":"2024-09-12T17:05:40.432973+0000","last_unstale":"2024-09-12T17:09:08.346404+0000","last_undegraded":"2024-09-12T17:09:08.346404+0000","last_fullsized":"2024-09-12T17:09:08.346404+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:08.346328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:08.346328+0000","last_clean_scrub_stamp":"2024-09-12T17:09:08.346328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:14:55.221358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041468599999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"103'20","reported_seq":77,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:09.348278+0000","last_change":"2024-09-12T17:09:09.348278+0000","last_active":"2024-09-12T17:09:09.348278+0000","last_peered":"2024-09-12T17:09:09.348278+0000","last_clean":"2024-09-12T17:09:09.348278+0000","last_became_active":"2024-09-12T17:08:18.446837+0000","last_became_peered":"2024-09-12T17:08:18.446837+0000","last_unstale":"2024-09-12T17:09:09.348278+0000","last_undegraded":"2024-09-12T17:09:09.348278+0000","last_fullsized":"2024-09-12T17:09:09.348278+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:09.348085+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:09.348085+0000","last_clean_scrub_stamp":"2024-09-12T17:09:09.348085+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:53.275651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38918,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"103'2","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.538720+0000","last_change":"2024-09-12T17:09:21.538720+0000","last_active":"2024-09-12T17:09:21.538720+0000","last_peered":"2024-09-12T17:09:21.538720+0000","last_clean":"2024-09-12T17:09:21.538720+0000","last_became_active":"2024-09-12T17:05:51.556959+0000","last_became_peered":"2024-09-12T17:05:51.556959+0000","last_unstale":"2024-09-12T17:09:21.538720+0000","last_undegraded":"2024-09-12T17:09:21.538720+0000","last_fullsized":"2024-09-12T17:09:21.538720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-12T17:09:21.538539+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-12T17:09:21.538539+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.538539+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:53:02.037412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"103'24","reported_seq":225,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:33.019862+0000","last_change":"2024-09-12T17:09:33.019862+0000","last_active":"2024-09-12T17:09:33.019862+0000","last_peered":"2024-09-12T17:09:33.019862+0000","last_clean":"2024-09-12T17:09:33.019862+0000","last_became_active":"2024-09-12T17:05:53.554063+0000","last_became_peered":"2024-09-12T17:05:53.554063+0000","last_unstale":"2024-09-12T17:09:33.019862+0000","last_undegraded":"2024-09-12T17:09:33.019862+0000","last_fullsized":"2024-09-12T17:09:33.019862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'24","last_scrub_stamp":"2024-09-12T17:09:33.019637+0000","last_deep_scrub":"103'24","last_deep_scrub_stamp":"2024-09-12T17:09:33.019637+0000","last_clean_scrub_stamp":"2024-09-12T17:09:33.019637+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:44.490697+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:33.876231+0000","last_change":"2024-09-12T17:09:33.876231+0000","last_active":"2024-09-12T17:09:33.876231+0000","last_peered":"2024-09-12T17:09:33.876231+0000","last_clean":"2024-09-12T17:09:33.876231+0000","last_became_active":"2024-09-12T17:05:55.546700+0000","last_became_peered":"2024-09-12T17:05:55.546700+0000","last_unstale":"2024-09-12T17:09:33.876231+0000","last_undegraded":"2024-09-12T17:09:33.876231+0000","last_fullsized":"2024-09-12T17:09:33.876231+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:33.876046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:33.876046+0000","last_clean_scrub_stamp":"2024-09-12T17:09:33.876046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:48.135259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":156,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:43.411333+0000","last_change":"2024-09-12T17:09:43.411333+0000","last_active":"2024-09-12T17:09:43.411333+0000","last_peered":"2024-09-12T17:09:43.411333+0000","last_clean":"2024-09-12T17:09:43.411333+0000","last_became_active":"2024-09-12T17:05:57.587199+0000","last_became_peered":"2024-09-12T17:05:57.587199+0000","last_unstale":"2024-09-12T17:09:43.411333+0000","last_undegraded":"2024-09-12T17:09:43.411333+0000","last_fullsized":"2024-09-12T17:09:43.411333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:43.411017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:43.411017+0000","last_clean_scrub_stamp":"2024-09-12T17:09:43.411017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:09:10.116094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.006173+0000","last_change":"2024-09-12T17:09:27.006173+0000","last_active":"2024-09-12T17:09:27.006173+0000","last_peered":"2024-09-12T17:09:27.006173+0000","last_clean":"2024-09-12T17:09:27.006173+0000","last_became_active":"2024-09-12T17:08:21.455573+0000","last_became_peered":"2024-09-12T17:08:21.455573+0000","last_unstale":"2024-09-12T17:09:27.006173+0000","last_undegraded":"2024-09-12T17:09:27.006173+0000","last_fullsized":"2024-09-12T17:09:27.006173+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:27.005953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:27.005953+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.005953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:34:47.351653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"103'3","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:09.168962+0000","last_change":"2024-09-12T17:09:09.168962+0000","last_active":"2024-09-12T17:09:09.168962+0000","last_peered":"2024-09-12T17:09:09.168962+0000","last_clean":"2024-09-12T17:09:09.168962+0000","last_became_active":"2024-09-12T17:08:18.474152+0000","last_became_peered":"2024-09-12T17:08:18.474152+0000","last_unstale":"2024-09-12T17:09:09.168962+0000","last_undegraded":"2024-09-12T17:09:09.168962+0000","last_fullsized":"2024-09-12T17:09:09.168962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'3","last_scrub_stamp":"2024-09-12T17:09:09.168776+0000","last_deep_scrub":"103'3","last_deep_scrub_stamp":"2024-09-12T17:09:09.168776+0000","last_clean_scrub_stamp":"2024-09-12T17:09:09.168776+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:12:55.870444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0023865750000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"103'18","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:08.805634+0000","last_change":"2024-09-12T17:09:08.805634+0000","last_active":"2024-09-12T17:09:08.805634+0000","last_peered":"2024-09-12T17:09:08.805634+0000","last_clean":"2024-09-12T17:09:08.805634+0000","last_became_active":"2024-09-12T17:05:47.545554+0000","last_became_peered":"2024-09-12T17:05:47.545554+0000","last_unstale":"2024-09-12T17:09:08.805634+0000","last_undegraded":"2024-09-12T17:09:08.805634+0000","last_fullsized":"2024-09-12T17:09:08.805634+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:08.805436+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:08.805436+0000","last_clean_scrub_stamp":"2024-09-12T17:09:08.805436+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:33:01.333417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32771,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":178,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.769447+0000","last_change":"2024-09-12T17:09:26.769447+0000","last_active":"2024-09-12T17:09:26.769447+0000","last_peered":"2024-09-12T17:09:26.769447+0000","last_clean":"2024-09-12T17:09:26.769447+0000","last_became_active":"2024-09-12T17:08:18.450835+0000","last_became_peered":"2024-09-12T17:08:18.450835+0000","last_unstale":"2024-09-12T17:09:26.769447+0000","last_undegraded":"2024-09-12T17:09:26.769447+0000","last_fullsized":"2024-09-12T17:09:26.769447+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:26.769263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:26.769263+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.769263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:59:09.364714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"103'18","reported_seq":188,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:31.397843+0000","last_change":"2024-09-12T17:09:31.397843+0000","last_active":"2024-09-12T17:09:31.397843+0000","last_peered":"2024-09-12T17:09:31.397843+0000","last_clean":"2024-09-12T17:09:31.397843+0000","last_became_active":"2024-09-12T17:05:53.550857+0000","last_became_peered":"2024-09-12T17:05:53.550857+0000","last_unstale":"2024-09-12T17:09:31.397843+0000","last_undegraded":"2024-09-12T17:09:31.397843+0000","last_fullsized":"2024-09-12T17:09:31.397843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:31.397629+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:31.397629+0000","last_clean_scrub_stamp":"2024-09-12T17:09:31.397629+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:47:21.375725+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.180498+0000","last_change":"2024-09-12T17:09:25.180498+0000","last_active":"2024-09-12T17:09:25.180498+0000","last_peered":"2024-09-12T17:09:25.180498+0000","last_clean":"2024-09-12T17:09:25.180498+0000","last_became_active":"2024-09-12T17:05:55.570991+0000","last_became_peered":"2024-09-12T17:05:55.570991+0000","last_unstale":"2024-09-12T17:09:25.180498+0000","last_undegraded":"2024-09-12T17:09:25.180498+0000","last_fullsized":"2024-09-12T17:09:25.180498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:25.180290+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:25.180290+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.180290+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:39:41.344487+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"84'2","reported_seq":157,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:40.079296+0000","last_change":"2024-09-12T17:09:40.079296+0000","last_active":"2024-09-12T17:09:40.079296+0000","last_peered":"2024-09-12T17:09:40.079296+0000","last_clean":"2024-09-12T17:09:40.079296+0000","last_became_active":"2024-09-12T17:05:57.589542+0000","last_became_peered":"2024-09-12T17:05:57.589542+0000","last_unstale":"2024-09-12T17:09:40.079296+0000","last_undegraded":"2024-09-12T17:09:40.079296+0000","last_fullsized":"2024-09-12T17:09:40.079296+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-09-12T17:09:40.079064+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-09-12T17:09:40.079064+0000","last_clean_scrub_stamp":"2024-09-12T17:09:40.079064+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:19:53.198497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.268759+0000","last_change":"2024-09-12T17:09:12.268759+0000","last_active":"2024-09-12T17:09:12.268759+0000","last_peered":"2024-09-12T17:09:12.268759+0000","last_clean":"2024-09-12T17:09:12.268759+0000","last_became_active":"2024-09-12T17:08:21.462608+0000","last_became_peered":"2024-09-12T17:08:21.462608+0000","last_unstale":"2024-09-12T17:09:12.268759+0000","last_undegraded":"2024-09-12T17:09:12.268759+0000","last_fullsized":"2024-09-12T17:09:12.268759+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:12.268576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:12.268576+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.268576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:10.879115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"103'30","reported_seq":222,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.117828+0000","last_change":"2024-09-12T17:09:10.117828+0000","last_active":"2024-09-12T17:09:10.117828+0000","last_peered":"2024-09-12T17:09:10.117828+0000","last_clean":"2024-09-12T17:09:10.117828+0000","last_became_active":"2024-09-12T17:05:47.525258+0000","last_became_peered":"2024-09-12T17:05:47.525258+0000","last_unstale":"2024-09-12T17:09:10.117828+0000","last_undegraded":"2024-09-12T17:09:10.117828+0000","last_fullsized":"2024-09-12T17:09:10.117828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'30","last_scrub_stamp":"2024-09-12T17:09:10.117650+0000","last_deep_scrub":"103'30","last_deep_scrub_stamp":"2024-09-12T17:09:10.117650+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.117650+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:58:48.282872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":59401,"num_write":54,"num_write_kb":59392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":47,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:07.318247+0000","last_change":"2024-09-12T17:09:07.318247+0000","last_active":"2024-09-12T17:09:07.318247+0000","last_peered":"2024-09-12T17:09:07.318247+0000","last_clean":"2024-09-12T17:09:07.318247+0000","last_became_active":"2024-09-12T17:08:18.460435+0000","last_became_peered":"2024-09-12T17:08:18.460435+0000","last_unstale":"2024-09-12T17:09:07.318247+0000","last_undegraded":"2024-09-12T17:09:07.318247+0000","last_fullsized":"2024-09-12T17:09:07.318247+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:07.318140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:07.318140+0000","last_clean_scrub_stamp":"2024-09-12T17:09:07.318140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:14:33.664197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":166,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.782022+0000","last_change":"2024-09-12T17:09:25.782022+0000","last_active":"2024-09-12T17:09:25.782022+0000","last_peered":"2024-09-12T17:09:25.782022+0000","last_clean":"2024-09-12T17:09:25.782022+0000","last_became_active":"2024-09-12T17:05:51.544078+0000","last_became_peered":"2024-09-12T17:05:51.544078+0000","last_unstale":"2024-09-12T17:09:25.782022+0000","last_undegraded":"2024-09-12T17:09:25.782022+0000","last_fullsized":"2024-09-12T17:09:25.782022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:25.781837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:25.781837+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.781837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:56:37.802633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"103'40","reported_seq":224,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:29.784204+0000","last_change":"2024-09-12T17:09:29.784204+0000","last_active":"2024-09-12T17:09:29.784204+0000","last_peered":"2024-09-12T17:09:29.784204+0000","last_clean":"2024-09-12T17:09:29.784204+0000","last_became_active":"2024-09-12T17:05:53.539372+0000","last_became_peered":"2024-09-12T17:05:53.539372+0000","last_unstale":"2024-09-12T17:09:29.784204+0000","last_undegraded":"2024-09-12T17:09:29.784204+0000","last_fullsized":"2024-09-12T17:09:29.784204+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'40","last_scrub_stamp":"2024-09-12T17:09:29.784004+0000","last_deep_scrub":"103'40","last_deep_scrub_stamp":"2024-09-12T17:09:29.784004+0000","last_clean_scrub_stamp":"2024-09-12T17:09:29.784004+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:27.305884+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":59,"num_read_kb":69,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:36.814619+0000","last_change":"2024-09-12T17:09:36.814619+0000","last_active":"2024-09-12T17:09:36.814619+0000","last_peered":"2024-09-12T17:09:36.814619+0000","last_clean":"2024-09-12T17:09:36.814619+0000","last_became_active":"2024-09-12T17:05:55.553263+0000","last_became_peered":"2024-09-12T17:05:55.553263+0000","last_unstale":"2024-09-12T17:09:36.814619+0000","last_undegraded":"2024-09-12T17:09:36.814619+0000","last_fullsized":"2024-09-12T17:09:36.814619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:36.814378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:36.814378+0000","last_clean_scrub_stamp":"2024-09-12T17:09:36.814378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:10:09.046023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":154,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:42.867111+0000","last_change":"2024-09-12T17:09:42.867111+0000","last_active":"2024-09-12T17:09:42.867111+0000","last_peered":"2024-09-12T17:09:42.867111+0000","last_clean":"2024-09-12T17:09:42.867111+0000","last_became_active":"2024-09-12T17:05:58.119755+0000","last_became_peered":"2024-09-12T17:05:58.119755+0000","last_unstale":"2024-09-12T17:09:42.867111+0000","last_undegraded":"2024-09-12T17:09:42.867111+0000","last_fullsized":"2024-09-12T17:09:42.867111+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:42.866917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:42.866917+0000","last_clean_scrub_stamp":"2024-09-12T17:09:42.866917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:53.130519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.901615+0000","last_change":"2024-09-12T17:09:16.901615+0000","last_active":"2024-09-12T17:09:16.901615+0000","last_peered":"2024-09-12T17:09:16.901615+0000","last_clean":"2024-09-12T17:09:16.901615+0000","last_became_active":"2024-09-12T17:05:49.549583+0000","last_became_peered":"2024-09-12T17:05:49.549583+0000","last_unstale":"2024-09-12T17:09:16.901615+0000","last_undegraded":"2024-09-12T17:09:16.901615+0000","last_fullsized":"2024-09-12T17:09:16.901615+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:16.901435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:16.901435+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.901435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:56.459849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"103'20","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.316998+0000","last_change":"2024-09-12T17:09:10.316998+0000","last_active":"2024-09-12T17:09:10.316998+0000","last_peered":"2024-09-12T17:09:10.316998+0000","last_clean":"2024-09-12T17:09:10.316998+0000","last_became_active":"2024-09-12T17:08:18.448295+0000","last_became_peered":"2024-09-12T17:08:18.448295+0000","last_unstale":"2024-09-12T17:09:10.316998+0000","last_undegraded":"2024-09-12T17:09:10.316998+0000","last_fullsized":"2024-09-12T17:09:10.316998+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:10.316935+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:10.316935+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.316935+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:27:10.408719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36867,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":189,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.860433+0000","last_change":"2024-09-12T17:09:12.860433+0000","last_active":"2024-09-12T17:09:12.860433+0000","last_peered":"2024-09-12T17:09:12.860433+0000","last_clean":"2024-09-12T17:09:12.860433+0000","last_became_active":"2024-09-12T17:05:40.208961+0000","last_became_peered":"2024-09-12T17:05:40.208961+0000","last_unstale":"2024-09-12T17:09:12.860433+0000","last_undegraded":"2024-09-12T17:09:12.860433+0000","last_fullsized":"2024-09-12T17:09:12.860433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:12.860165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:12.860165+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.860165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:18:50.719125+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001112058,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.206536+0000","last_change":"2024-09-12T17:09:22.206536+0000","last_active":"2024-09-12T17:09:22.206536+0000","last_peered":"2024-09-12T17:09:22.206536+0000","last_clean":"2024-09-12T17:09:22.206536+0000","last_became_active":"2024-09-12T17:05:51.545225+0000","last_became_peered":"2024-09-12T17:05:51.545225+0000","last_unstale":"2024-09-12T17:09:22.206536+0000","last_undegraded":"2024-09-12T17:09:22.206536+0000","last_fullsized":"2024-09-12T17:09:22.206536+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:22.206356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:22.206356+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.206356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:08:48.969783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"103'21","reported_seq":70,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.051385+0000","last_change":"2024-09-12T17:09:22.051385+0000","last_active":"2024-09-12T17:09:22.051385+0000","last_peered":"2024-09-12T17:09:22.051385+0000","last_clean":"2024-09-12T17:09:22.051385+0000","last_became_active":"2024-09-12T17:08:18.456095+0000","last_became_peered":"2024-09-12T17:08:18.456095+0000","last_unstale":"2024-09-12T17:09:22.051385+0000","last_undegraded":"2024-09-12T17:09:22.051385+0000","last_fullsized":"2024-09-12T17:09:22.051385+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'21","last_scrub_stamp":"2024-09-12T17:09:22.051178+0000","last_deep_scrub":"103'21","last_deep_scrub_stamp":"2024-09-12T17:09:22.051178+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.051178+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:42:01.067947+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"103'21","reported_seq":231,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:37.112282+0000","last_change":"2024-09-12T17:09:37.112282+0000","last_active":"2024-09-12T17:09:37.112282+0000","last_peered":"2024-09-12T17:09:37.112282+0000","last_clean":"2024-09-12T17:09:37.112282+0000","last_became_active":"2024-09-12T17:08:21.467026+0000","last_became_peered":"2024-09-12T17:08:21.467026+0000","last_unstale":"2024-09-12T17:09:37.112282+0000","last_undegraded":"2024-09-12T17:09:37.112282+0000","last_fullsized":"2024-09-12T17:09:37.112282+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'21","last_scrub_stamp":"2024-09-12T17:09:37.112098+0000","last_deep_scrub":"103'21","last_deep_scrub_stamp":"2024-09-12T17:09:37.112098+0000","last_clean_scrub_stamp":"2024-09-12T17:09:37.112098+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:13.916972+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":156,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:45.398935+0000","last_change":"2024-09-12T17:09:45.398935+0000","last_active":"2024-09-12T17:09:45.398935+0000","last_peered":"2024-09-12T17:09:45.398935+0000","last_clean":"2024-09-12T17:09:45.398935+0000","last_became_active":"2024-09-12T17:05:58.117710+0000","last_became_peered":"2024-09-12T17:05:58.117710+0000","last_unstale":"2024-09-12T17:09:45.398935+0000","last_undegraded":"2024-09-12T17:09:45.398935+0000","last_fullsized":"2024-09-12T17:09:45.398935+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:45.398726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:45.398726+0000","last_clean_scrub_stamp":"2024-09-12T17:09:45.398726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:48:18.997606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":134,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.533557+0000","last_change":"2024-09-12T17:09:16.533557+0000","last_active":"2024-09-12T17:09:16.533557+0000","last_peered":"2024-09-12T17:09:16.533557+0000","last_clean":"2024-09-12T17:09:16.533557+0000","last_became_active":"2024-09-12T17:06:27.817451+0000","last_became_peered":"2024-09-12T17:06:27.817451+0000","last_unstale":"2024-09-12T17:09:16.533557+0000","last_undegraded":"2024-09-12T17:09:16.533557+0000","last_fullsized":"2024-09-12T17:09:16.533557+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:16.533375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:16.533375+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.533375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:41:56.600068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"103'14","reported_seq":198,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:09.409890+0000","last_change":"2024-09-12T17:09:09.409890+0000","last_active":"2024-09-12T17:09:09.409890+0000","last_peered":"2024-09-12T17:09:09.409890+0000","last_clean":"2024-09-12T17:09:09.409890+0000","last_became_active":"2024-09-12T17:05:47.534790+0000","last_became_peered":"2024-09-12T17:05:47.534790+0000","last_unstale":"2024-09-12T17:09:09.409890+0000","last_undegraded":"2024-09-12T17:09:09.409890+0000","last_fullsized":"2024-09-12T17:09:09.409890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'14","last_scrub_stamp":"2024-09-12T17:09:09.409700+0000","last_deep_scrub":"103'14","last_deep_scrub_stamp":"2024-09-12T17:09:09.409700+0000","last_clean_scrub_stamp":"2024-09-12T17:09:09.409700+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:13:45.523551+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":26627,"num_write":22,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:08.300906+0000","last_change":"2024-09-12T17:09:08.300906+0000","last_active":"2024-09-12T17:09:08.300906+0000","last_peered":"2024-09-12T17:09:08.300906+0000","last_clean":"2024-09-12T17:09:08.300906+0000","last_became_active":"2024-09-12T17:08:21.467016+0000","last_became_peered":"2024-09-12T17:08:21.467016+0000","last_unstale":"2024-09-12T17:09:08.300906+0000","last_undegraded":"2024-09-12T17:09:08.300906+0000","last_fullsized":"2024-09-12T17:09:08.300906+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:08.300823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:08.300823+0000","last_clean_scrub_stamp":"2024-09-12T17:09:08.300823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:52:01.702916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:28.962414+0000","last_change":"2024-09-12T17:09:28.962414+0000","last_active":"2024-09-12T17:09:28.962414+0000","last_peered":"2024-09-12T17:09:28.962414+0000","last_clean":"2024-09-12T17:09:28.962414+0000","last_became_active":"2024-09-12T17:05:51.532795+0000","last_became_peered":"2024-09-12T17:05:51.532795+0000","last_unstale":"2024-09-12T17:09:28.962414+0000","last_undegraded":"2024-09-12T17:09:28.962414+0000","last_fullsized":"2024-09-12T17:09:28.962414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:28.962206+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:28.962206+0000","last_clean_scrub_stamp":"2024-09-12T17:09:28.962206+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:11:55.679031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"103'15","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:33.914762+0000","last_change":"2024-09-12T17:09:33.914762+0000","last_active":"2024-09-12T17:09:33.914762+0000","last_peered":"2024-09-12T17:09:33.914762+0000","last_clean":"2024-09-12T17:09:33.914762+0000","last_became_active":"2024-09-12T17:05:53.543495+0000","last_became_peered":"2024-09-12T17:05:53.543495+0000","last_unstale":"2024-09-12T17:09:33.914762+0000","last_undegraded":"2024-09-12T17:09:33.914762+0000","last_fullsized":"2024-09-12T17:09:33.914762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'15","last_scrub_stamp":"2024-09-12T17:09:33.914544+0000","last_deep_scrub":"103'15","last_deep_scrub_stamp":"2024-09-12T17:09:33.914544+0000","last_clean_scrub_stamp":"2024-09-12T17:09:33.914544+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:30:40.653167+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"103'19","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:36.454316+0000","last_change":"2024-09-12T17:09:36.454316+0000","last_active":"2024-09-12T17:09:36.454316+0000","last_peered":"2024-09-12T17:09:36.454316+0000","last_clean":"2024-09-12T17:09:36.454316+0000","last_became_active":"2024-09-12T17:05:55.566652+0000","last_became_peered":"2024-09-12T17:05:55.566652+0000","last_unstale":"2024-09-12T17:09:36.454316+0000","last_undegraded":"2024-09-12T17:09:36.454316+0000","last_fullsized":"2024-09-12T17:09:36.454316+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'19","last_scrub_stamp":"2024-09-12T17:09:36.454125+0000","last_deep_scrub":"103'19","last_deep_scrub_stamp":"2024-09-12T17:09:36.454125+0000","last_clean_scrub_stamp":"2024-09-12T17:09:36.454125+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:41:58.311749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"68'2","reported_seq":157,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:41.848832+0000","last_change":"2024-09-12T17:09:41.848832+0000","last_active":"2024-09-12T17:09:41.848832+0000","last_peered":"2024-09-12T17:09:41.848832+0000","last_clean":"2024-09-12T17:09:41.848832+0000","last_became_active":"2024-09-12T17:05:57.584326+0000","last_became_peered":"2024-09-12T17:05:57.584326+0000","last_unstale":"2024-09-12T17:09:41.848832+0000","last_undegraded":"2024-09-12T17:09:41.848832+0000","last_fullsized":"2024-09-12T17:09:41.848832+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-09-12T17:09:41.848643+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-09-12T17:09:41.848643+0000","last_clean_scrub_stamp":"2024-09-12T17:09:41.848643+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:39:01.190186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.788725+0000","last_change":"2024-09-12T17:09:11.788725+0000","last_active":"2024-09-12T17:09:11.788725+0000","last_peered":"2024-09-12T17:09:11.788725+0000","last_clean":"2024-09-12T17:09:11.788725+0000","last_became_active":"2024-09-12T17:05:49.551726+0000","last_became_peered":"2024-09-12T17:05:49.551726+0000","last_unstale":"2024-09-12T17:09:11.788725+0000","last_undegraded":"2024-09-12T17:09:11.788725+0000","last_fullsized":"2024-09-12T17:09:11.788725+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:11.788545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:11.788545+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.788545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:08.935777+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"103'12","reported_seq":220,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:08.716958+0000","last_change":"2024-09-12T17:09:08.716958+0000","last_active":"2024-09-12T17:09:08.716958+0000","last_peered":"2024-09-12T17:09:08.716958+0000","last_clean":"2024-09-12T17:09:08.716958+0000","last_became_active":"2024-09-12T17:08:18.466136+0000","last_became_peered":"2024-09-12T17:08:18.466136+0000","last_unstale":"2024-09-12T17:09:08.716958+0000","last_undegraded":"2024-09-12T17:09:08.716958+0000","last_fullsized":"2024-09-12T17:09:08.716958+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:08.716872+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:08.716872+0000","last_clean_scrub_stamp":"2024-09-12T17:09:08.716872+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:16.240759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":191,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.125408+0000","last_change":"2024-09-12T17:09:14.125408+0000","last_active":"2024-09-12T17:09:14.125408+0000","last_peered":"2024-09-12T17:09:14.125408+0000","last_clean":"2024-09-12T17:09:14.125408+0000","last_became_active":"2024-09-12T17:05:40.215897+0000","last_became_peered":"2024-09-12T17:05:40.215897+0000","last_unstale":"2024-09-12T17:09:14.125408+0000","last_undegraded":"2024-09-12T17:09:14.125408+0000","last_fullsized":"2024-09-12T17:09:14.125408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:14.125234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:14.125234+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.125234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:29:31.022949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001091128,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":180,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.295466+0000","last_change":"2024-09-12T17:09:26.295466+0000","last_active":"2024-09-12T17:09:26.295466+0000","last_peered":"2024-09-12T17:09:26.295466+0000","last_clean":"2024-09-12T17:09:26.295466+0000","last_became_active":"2024-09-12T17:08:18.449746+0000","last_became_peered":"2024-09-12T17:08:18.449746+0000","last_unstale":"2024-09-12T17:09:26.295466+0000","last_undegraded":"2024-09-12T17:09:26.295466+0000","last_fullsized":"2024-09-12T17:09:26.295466+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:26.295255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:26.295255+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.295255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:40:43.350440+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"103'55","reported_seq":246,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:32.036658+0000","last_change":"2024-09-12T17:09:32.036658+0000","last_active":"2024-09-12T17:09:32.036658+0000","last_peered":"2024-09-12T17:09:32.036658+0000","last_clean":"2024-09-12T17:09:32.036658+0000","last_became_active":"2024-09-12T17:05:53.553914+0000","last_became_peered":"2024-09-12T17:05:53.553914+0000","last_unstale":"2024-09-12T17:09:32.036658+0000","last_undegraded":"2024-09-12T17:09:32.036658+0000","last_fullsized":"2024-09-12T17:09:32.036658+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'55","last_scrub_stamp":"2024-09-12T17:09:32.036454+0000","last_deep_scrub":"103'55","last_deep_scrub_stamp":"2024-09-12T17:09:32.036454+0000","last_clean_scrub_stamp":"2024-09-12T17:09:32.036454+0000","objects_scrubbed":8,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:54.691869+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":92,"num_read_kb":158,"num_write":60,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:38.474894+0000","last_change":"2024-09-12T17:09:38.474894+0000","last_active":"2024-09-12T17:09:38.474894+0000","last_peered":"2024-09-12T17:09:38.474894+0000","last_clean":"2024-09-12T17:09:38.474894+0000","last_became_active":"2024-09-12T17:08:21.458521+0000","last_became_peered":"2024-09-12T17:08:21.458521+0000","last_unstale":"2024-09-12T17:09:38.474894+0000","last_undegraded":"2024-09-12T17:09:38.474894+0000","last_fullsized":"2024-09-12T17:09:38.474894+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:38.474685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:38.474685+0000","last_clean_scrub_stamp":"2024-09-12T17:09:38.474685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:05:41.386106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":154,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:41.086759+0000","last_change":"2024-09-12T17:09:41.086759+0000","last_active":"2024-09-12T17:09:41.086759+0000","last_peered":"2024-09-12T17:09:41.086759+0000","last_clean":"2024-09-12T17:09:41.086759+0000","last_became_active":"2024-09-12T17:05:57.605041+0000","last_became_peered":"2024-09-12T17:05:57.605041+0000","last_unstale":"2024-09-12T17:09:41.086759+0000","last_undegraded":"2024-09-12T17:09:41.086759+0000","last_fullsized":"2024-09-12T17:09:41.086759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:41.086552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:41.086552+0000","last_clean_scrub_stamp":"2024-09-12T17:09:41.086552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:49:12.775488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":154,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:45.942789+0000","last_change":"2024-09-12T17:09:45.942789+0000","last_active":"2024-09-12T17:09:45.942789+0000","last_peered":"2024-09-12T17:09:45.942789+0000","last_clean":"2024-09-12T17:09:45.942789+0000","last_became_active":"2024-09-12T17:05:57.590196+0000","last_became_peered":"2024-09-12T17:05:57.590196+0000","last_unstale":"2024-09-12T17:09:45.942789+0000","last_undegraded":"2024-09-12T17:09:45.942789+0000","last_fullsized":"2024-09-12T17:09:45.942789+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:45.942573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:45.942573+0000","last_clean_scrub_stamp":"2024-09-12T17:09:45.942573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:15:08.755062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.819913+0000","last_change":"2024-09-12T17:09:18.819913+0000","last_active":"2024-09-12T17:09:18.819913+0000","last_peered":"2024-09-12T17:09:18.819913+0000","last_clean":"2024-09-12T17:09:18.819913+0000","last_became_active":"2024-09-12T17:05:49.561429+0000","last_became_peered":"2024-09-12T17:05:49.561429+0000","last_unstale":"2024-09-12T17:09:18.819913+0000","last_undegraded":"2024-09-12T17:09:18.819913+0000","last_fullsized":"2024-09-12T17:09:18.819913+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:18.819725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:18.819725+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.819725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:43:17.430263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"103'18","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.765901+0000","last_change":"2024-09-12T17:09:12.765901+0000","last_active":"2024-09-12T17:09:12.765901+0000","last_peered":"2024-09-12T17:09:12.765901+0000","last_clean":"2024-09-12T17:09:12.765901+0000","last_became_active":"2024-09-12T17:05:47.556417+0000","last_became_peered":"2024-09-12T17:05:47.556417+0000","last_unstale":"2024-09-12T17:09:12.765901+0000","last_undegraded":"2024-09-12T17:09:12.765901+0000","last_fullsized":"2024-09-12T17:09:12.765901+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:12.765705+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:12.765705+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.765705+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:11:29.251261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":32774,"num_write":34,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":47,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.145949+0000","last_change":"2024-09-12T17:09:16.145949+0000","last_active":"2024-09-12T17:09:16.145949+0000","last_peered":"2024-09-12T17:09:16.145949+0000","last_clean":"2024-09-12T17:09:16.145949+0000","last_became_active":"2024-09-12T17:08:18.464091+0000","last_became_peered":"2024-09-12T17:08:18.464091+0000","last_unstale":"2024-09-12T17:09:16.145949+0000","last_undegraded":"2024-09-12T17:09:16.145949+0000","last_fullsized":"2024-09-12T17:09:16.145949+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:16.145766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:16.145766+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.145766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:36.857093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"103'25","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:33.381050+0000","last_change":"2024-09-12T17:09:33.381050+0000","last_active":"2024-09-12T17:09:33.381050+0000","last_peered":"2024-09-12T17:09:33.381050+0000","last_clean":"2024-09-12T17:09:33.381050+0000","last_became_active":"2024-09-12T17:05:53.541653+0000","last_became_peered":"2024-09-12T17:05:53.541653+0000","last_unstale":"2024-09-12T17:09:33.381050+0000","last_undegraded":"2024-09-12T17:09:33.381050+0000","last_fullsized":"2024-09-12T17:09:33.381050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'25","last_scrub_stamp":"2024-09-12T17:09:33.380854+0000","last_deep_scrub":"103'25","last_deep_scrub_stamp":"2024-09-12T17:09:33.380854+0000","last_clean_scrub_stamp":"2024-09-12T17:09:33.380854+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:37.298063+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":42,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:39.504328+0000","last_change":"2024-09-12T17:09:39.504328+0000","last_active":"2024-09-12T17:09:39.504328+0000","last_peered":"2024-09-12T17:09:39.504328+0000","last_clean":"2024-09-12T17:09:39.504328+0000","last_became_active":"2024-09-12T17:05:55.555755+0000","last_became_peered":"2024-09-12T17:05:55.555755+0000","last_unstale":"2024-09-12T17:09:39.504328+0000","last_undegraded":"2024-09-12T17:09:39.504328+0000","last_fullsized":"2024-09-12T17:09:39.504328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:39.504123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:39.504123+0000","last_clean_scrub_stamp":"2024-09-12T17:09:39.504123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:31:23.667798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"84'2","reported_seq":159,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:47.320579+0000","last_change":"2024-09-12T17:09:47.320579+0000","last_active":"2024-09-12T17:09:47.320579+0000","last_peered":"2024-09-12T17:09:47.320579+0000","last_clean":"2024-09-12T17:09:47.320579+0000","last_became_active":"2024-09-12T17:05:57.592746+0000","last_became_peered":"2024-09-12T17:05:57.592746+0000","last_unstale":"2024-09-12T17:09:47.320579+0000","last_undegraded":"2024-09-12T17:09:47.320579+0000","last_fullsized":"2024-09-12T17:09:47.320579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'2","last_scrub_stamp":"2024-09-12T17:09:47.320379+0000","last_deep_scrub":"84'2","last_deep_scrub_stamp":"2024-09-12T17:09:47.320379+0000","last_clean_scrub_stamp":"2024-09-12T17:09:47.320379+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:22:36.204900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"68'6","reported_seq":46,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.211873+0000","last_change":"2024-09-12T17:09:14.211873+0000","last_active":"2024-09-12T17:09:14.211873+0000","last_peered":"2024-09-12T17:09:14.211873+0000","last_clean":"2024-09-12T17:09:14.211873+0000","last_became_active":"2024-09-12T17:08:21.466328+0000","last_became_peered":"2024-09-12T17:08:21.466328+0000","last_unstale":"2024-09-12T17:09:14.211873+0000","last_undegraded":"2024-09-12T17:09:14.211873+0000","last_fullsized":"2024-09-12T17:09:14.211873+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-09-12T17:09:14.211689+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-09-12T17:09:14.211689+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.211689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:12:29.550680+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"103'12","reported_seq":195,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.990639+0000","last_change":"2024-09-12T17:09:20.990639+0000","last_active":"2024-09-12T17:09:20.990639+0000","last_peered":"2024-09-12T17:09:20.990639+0000","last_clean":"2024-09-12T17:09:20.990639+0000","last_became_active":"2024-09-12T17:05:47.558641+0000","last_became_peered":"2024-09-12T17:05:47.558641+0000","last_unstale":"2024-09-12T17:09:20.990639+0000","last_undegraded":"2024-09-12T17:09:20.990639+0000","last_fullsized":"2024-09-12T17:09:20.990639+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:20.990456+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:20.990456+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.990456+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:06:18.712905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24585,"num_write":36,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.253209+0000","last_change":"2024-09-12T17:09:27.253209+0000","last_active":"2024-09-12T17:09:27.253209+0000","last_peered":"2024-09-12T17:09:27.253209+0000","last_clean":"2024-09-12T17:09:27.253209+0000","last_became_active":"2024-09-12T17:05:51.539275+0000","last_became_peered":"2024-09-12T17:05:51.539275+0000","last_unstale":"2024-09-12T17:09:27.253209+0000","last_undegraded":"2024-09-12T17:09:27.253209+0000","last_fullsized":"2024-09-12T17:09:27.253209+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:27.253027+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:27.253027+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.253027+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:55:24.774906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"103'9","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:31.814487+0000","last_change":"2024-09-12T17:09:31.814487+0000","last_active":"2024-09-12T17:09:31.814487+0000","last_peered":"2024-09-12T17:09:31.814487+0000","last_clean":"2024-09-12T17:09:31.814487+0000","last_became_active":"2024-09-12T17:05:53.544127+0000","last_became_peered":"2024-09-12T17:05:53.544127+0000","last_unstale":"2024-09-12T17:09:31.814487+0000","last_undegraded":"2024-09-12T17:09:31.814487+0000","last_fullsized":"2024-09-12T17:09:31.814487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'9","last_scrub_stamp":"2024-09-12T17:09:31.814267+0000","last_deep_scrub":"103'9","last_deep_scrub_stamp":"2024-09-12T17:09:31.814267+0000","last_clean_scrub_stamp":"2024-09-12T17:09:31.814267+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:53.755750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:37.975180+0000","last_change":"2024-09-12T17:09:37.975180+0000","last_active":"2024-09-12T17:09:37.975180+0000","last_peered":"2024-09-12T17:09:37.975180+0000","last_clean":"2024-09-12T17:09:37.975180+0000","last_became_active":"2024-09-12T17:05:55.570822+0000","last_became_peered":"2024-09-12T17:05:55.570822+0000","last_unstale":"2024-09-12T17:09:37.975180+0000","last_undegraded":"2024-09-12T17:09:37.975180+0000","last_fullsized":"2024-09-12T17:09:37.975180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:37.974972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:37.974972+0000","last_clean_scrub_stamp":"2024-09-12T17:09:37.974972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:36.126132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"68'2","reported_seq":173,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:44.918719+0000","last_change":"2024-09-12T17:09:44.918719+0000","last_active":"2024-09-12T17:09:44.918719+0000","last_peered":"2024-09-12T17:09:44.918719+0000","last_clean":"2024-09-12T17:09:44.918719+0000","last_became_active":"2024-09-12T17:08:18.450561+0000","last_became_peered":"2024-09-12T17:08:18.450561+0000","last_unstale":"2024-09-12T17:09:44.918719+0000","last_undegraded":"2024-09-12T17:09:44.918719+0000","last_fullsized":"2024-09-12T17:09:44.918719+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-09-12T17:09:44.918513+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-09-12T17:09:44.918513+0000","last_clean_scrub_stamp":"2024-09-12T17:09:44.918513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:41:02.365068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.387598+0000","last_change":"2024-09-12T17:09:21.387598+0000","last_active":"2024-09-12T17:09:21.387598+0000","last_peered":"2024-09-12T17:09:21.387598+0000","last_clean":"2024-09-12T17:09:21.387598+0000","last_became_active":"2024-09-12T17:05:49.519721+0000","last_became_peered":"2024-09-12T17:05:49.519721+0000","last_unstale":"2024-09-12T17:09:21.387598+0000","last_undegraded":"2024-09-12T17:09:21.387598+0000","last_fullsized":"2024-09-12T17:09:21.387598+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:21.387416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:21.387416+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.387416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:12.445311+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"103'16","reported_seq":199,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.063154+0000","last_change":"2024-09-12T17:09:12.063154+0000","last_active":"2024-09-12T17:09:12.063154+0000","last_peered":"2024-09-12T17:09:12.063154+0000","last_clean":"2024-09-12T17:09:12.063154+0000","last_became_active":"2024-09-12T17:05:47.538581+0000","last_became_peered":"2024-09-12T17:05:47.538581+0000","last_unstale":"2024-09-12T17:09:12.063154+0000","last_undegraded":"2024-09-12T17:09:12.063154+0000","last_fullsized":"2024-09-12T17:09:12.063154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:12.062963+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:12.062963+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.062963+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:55:20.939537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":166,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:29.990256+0000","last_change":"2024-09-12T17:09:29.990256+0000","last_active":"2024-09-12T17:09:29.990256+0000","last_peered":"2024-09-12T17:09:29.990256+0000","last_clean":"2024-09-12T17:09:29.990256+0000","last_became_active":"2024-09-12T17:05:51.527515+0000","last_became_peered":"2024-09-12T17:05:51.527515+0000","last_unstale":"2024-09-12T17:09:29.990256+0000","last_undegraded":"2024-09-12T17:09:29.990256+0000","last_fullsized":"2024-09-12T17:09:29.990256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:29.990070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:29.990070+0000","last_clean_scrub_stamp":"2024-09-12T17:09:29.990070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:59:04.177002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"103'25","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:34.395922+0000","last_change":"2024-09-12T17:09:34.395922+0000","last_active":"2024-09-12T17:09:34.395922+0000","last_peered":"2024-09-12T17:09:34.395922+0000","last_clean":"2024-09-12T17:09:34.395922+0000","last_became_active":"2024-09-12T17:05:53.551154+0000","last_became_peered":"2024-09-12T17:05:53.551154+0000","last_unstale":"2024-09-12T17:09:34.395922+0000","last_undegraded":"2024-09-12T17:09:34.395922+0000","last_fullsized":"2024-09-12T17:09:34.395922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'25","last_scrub_stamp":"2024-09-12T17:09:34.395708+0000","last_deep_scrub":"103'25","last_deep_scrub_stamp":"2024-09-12T17:09:34.395708+0000","last_clean_scrub_stamp":"2024-09-12T17:09:34.395708+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:50.756444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":37,"num_write":20,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:29.284862+0000","last_change":"2024-09-12T17:09:29.284862+0000","last_active":"2024-09-12T17:09:29.284862+0000","last_peered":"2024-09-12T17:09:29.284862+0000","last_clean":"2024-09-12T17:09:29.284862+0000","last_became_active":"2024-09-12T17:05:55.570137+0000","last_became_peered":"2024-09-12T17:05:55.570137+0000","last_unstale":"2024-09-12T17:09:29.284862+0000","last_undegraded":"2024-09-12T17:09:29.284862+0000","last_fullsized":"2024-09-12T17:09:29.284862+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:29.284688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:29.284688+0000","last_clean_scrub_stamp":"2024-09-12T17:09:29.284688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:37:38.726077+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":154,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:44.146096+0000","last_change":"2024-09-12T17:09:44.146096+0000","last_active":"2024-09-12T17:09:44.146096+0000","last_peered":"2024-09-12T17:09:44.146096+0000","last_clean":"2024-09-12T17:09:44.146096+0000","last_became_active":"2024-09-12T17:05:57.596377+0000","last_became_peered":"2024-09-12T17:05:57.596377+0000","last_unstale":"2024-09-12T17:09:44.146096+0000","last_undegraded":"2024-09-12T17:09:44.146096+0000","last_fullsized":"2024-09-12T17:09:44.146096+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:44.145902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:44.145902+0000","last_clean_scrub_stamp":"2024-09-12T17:09:44.145902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:28:47.629205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"68'2","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.381722+0000","last_change":"2024-09-12T17:09:18.381722+0000","last_active":"2024-09-12T17:09:18.381722+0000","last_peered":"2024-09-12T17:09:18.381722+0000","last_clean":"2024-09-12T17:09:18.381722+0000","last_became_active":"2024-09-12T17:08:18.449338+0000","last_became_peered":"2024-09-12T17:08:18.449338+0000","last_unstale":"2024-09-12T17:09:18.381722+0000","last_undegraded":"2024-09-12T17:09:18.381722+0000","last_fullsized":"2024-09-12T17:09:18.381722+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-09-12T17:09:18.381508+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-09-12T17:09:18.381508+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.381508+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:16.532668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"103'12","reported_seq":193,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:07.676026+0000","last_change":"2024-09-12T17:09:07.676026+0000","last_active":"2024-09-12T17:09:07.676026+0000","last_peered":"2024-09-12T17:09:07.676026+0000","last_clean":"2024-09-12T17:09:07.676026+0000","last_became_active":"2024-09-12T17:05:47.525874+0000","last_became_peered":"2024-09-12T17:05:47.525874+0000","last_unstale":"2024-09-12T17:09:07.676026+0000","last_undegraded":"2024-09-12T17:09:07.676026+0000","last_fullsized":"2024-09-12T17:09:07.676026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'12","last_scrub_stamp":"2024-09-12T17:09:07.675954+0000","last_deep_scrub":"103'12","last_deep_scrub_stamp":"2024-09-12T17:09:07.675954+0000","last_clean_scrub_stamp":"2024-09-12T17:09:07.675954+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:27.103026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":18435,"num_write":20,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.252302+0000","last_change":"2024-09-12T17:09:23.252302+0000","last_active":"2024-09-12T17:09:23.252302+0000","last_peered":"2024-09-12T17:09:23.252302+0000","last_clean":"2024-09-12T17:09:23.252302+0000","last_became_active":"2024-09-12T17:05:51.539607+0000","last_became_peered":"2024-09-12T17:05:51.539607+0000","last_unstale":"2024-09-12T17:09:23.252302+0000","last_undegraded":"2024-09-12T17:09:23.252302+0000","last_fullsized":"2024-09-12T17:09:23.252302+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:23.252121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:23.252121+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.252121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:42:50.775617+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"103'21","reported_seq":194,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:34.973647+0000","last_change":"2024-09-12T17:09:34.973647+0000","last_active":"2024-09-12T17:09:34.973647+0000","last_peered":"2024-09-12T17:09:34.973647+0000","last_clean":"2024-09-12T17:09:34.973647+0000","last_became_active":"2024-09-12T17:05:53.548561+0000","last_became_peered":"2024-09-12T17:05:53.548561+0000","last_unstale":"2024-09-12T17:09:34.973647+0000","last_undegraded":"2024-09-12T17:09:34.973647+0000","last_fullsized":"2024-09-12T17:09:34.973647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'21","last_scrub_stamp":"2024-09-12T17:09:34.973420+0000","last_deep_scrub":"103'21","last_deep_scrub_stamp":"2024-09-12T17:09:34.973420+0000","last_clean_scrub_stamp":"2024-09-12T17:09:34.973420+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:58:12.254284+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:36.843689+0000","last_change":"2024-09-12T17:09:36.843689+0000","last_active":"2024-09-12T17:09:36.843689+0000","last_peered":"2024-09-12T17:09:36.843689+0000","last_clean":"2024-09-12T17:09:36.843689+0000","last_became_active":"2024-09-12T17:05:55.560708+0000","last_became_peered":"2024-09-12T17:05:55.560708+0000","last_unstale":"2024-09-12T17:09:36.843689+0000","last_undegraded":"2024-09-12T17:09:36.843689+0000","last_fullsized":"2024-09-12T17:09:36.843689+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:36.843428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:36.843428+0000","last_clean_scrub_stamp":"2024-09-12T17:09:36.843428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:08:40.760637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"84'46","reported_seq":221,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.161582+0000","last_change":"2024-09-12T17:09:18.161582+0000","last_active":"2024-09-12T17:09:18.161582+0000","last_peered":"2024-09-12T17:09:18.161582+0000","last_clean":"2024-09-12T17:09:18.161582+0000","last_became_active":"2024-09-12T17:05:49.546232+0000","last_became_peered":"2024-09-12T17:05:49.546232+0000","last_unstale":"2024-09-12T17:09:18.161582+0000","last_undegraded":"2024-09-12T17:09:18.161582+0000","last_fullsized":"2024-09-12T17:09:18.161582+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'46","last_scrub_stamp":"2024-09-12T17:09:18.161400+0000","last_deep_scrub":"84'46","last_deep_scrub_stamp":"2024-09-12T17:09:18.161400+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.161400+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:09:27.986208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"103'16","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.394020+0000","last_change":"2024-09-12T17:09:14.394020+0000","last_active":"2024-09-12T17:09:14.394020+0000","last_peered":"2024-09-12T17:09:14.394020+0000","last_clean":"2024-09-12T17:09:14.394020+0000","last_became_active":"2024-09-12T17:05:47.521097+0000","last_became_peered":"2024-09-12T17:05:47.521097+0000","last_unstale":"2024-09-12T17:09:14.394020+0000","last_undegraded":"2024-09-12T17:09:14.394020+0000","last_fullsized":"2024-09-12T17:09:14.394020+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:14.393817+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:14.393817+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.393817+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:00:53.952231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24579,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":166,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.731908+0000","last_change":"2024-09-12T17:09:27.731908+0000","last_active":"2024-09-12T17:09:27.731908+0000","last_peered":"2024-09-12T17:09:27.731908+0000","last_clean":"2024-09-12T17:09:27.731908+0000","last_became_active":"2024-09-12T17:05:51.525457+0000","last_became_peered":"2024-09-12T17:05:51.525457+0000","last_unstale":"2024-09-12T17:09:27.731908+0000","last_undegraded":"2024-09-12T17:09:27.731908+0000","last_fullsized":"2024-09-12T17:09:27.731908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:27.731717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:27.731717+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.731717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:59.925317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"103'38","reported_seq":78,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.053966+0000","last_change":"2024-09-12T17:09:25.053966+0000","last_active":"2024-09-12T17:09:25.053966+0000","last_peered":"2024-09-12T17:09:25.053966+0000","last_clean":"2024-09-12T17:09:25.053966+0000","last_became_active":"2024-09-12T17:08:18.463961+0000","last_became_peered":"2024-09-12T17:08:18.463961+0000","last_unstale":"2024-09-12T17:09:25.053966+0000","last_undegraded":"2024-09-12T17:09:25.053966+0000","last_fullsized":"2024-09-12T17:09:25.053966+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'38","last_scrub_stamp":"2024-09-12T17:09:25.053751+0000","last_deep_scrub":"103'38","last_deep_scrub_stamp":"2024-09-12T17:09:25.053751+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.053751+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:41.478348+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":64,"num_read_kb":124,"num_write":44,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":16653,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:38.146965+0000","last_change":"2024-09-12T17:09:38.146965+0000","last_active":"2024-09-12T17:09:38.146965+0000","last_peered":"2024-09-12T17:09:38.146965+0000","last_clean":"2024-09-12T17:09:38.146965+0000","last_became_active":"2024-09-12T17:05:55.562405+0000","last_became_peered":"2024-09-12T17:05:55.562405+0000","last_unstale":"2024-09-12T17:09:38.146965+0000","last_undegraded":"2024-09-12T17:09:38.146965+0000","last_fullsized":"2024-09-12T17:09:38.146965+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:38.146778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:38.146778+0000","last_clean_scrub_stamp":"2024-09-12T17:09:38.146778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:33:52.405992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":156,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:44.412097+0000","last_change":"2024-09-12T17:09:44.412097+0000","last_active":"2024-09-12T17:09:44.412097+0000","last_peered":"2024-09-12T17:09:44.412097+0000","last_clean":"2024-09-12T17:09:44.412097+0000","last_became_active":"2024-09-12T17:05:58.120367+0000","last_became_peered":"2024-09-12T17:05:58.120367+0000","last_unstale":"2024-09-12T17:09:44.412097+0000","last_undegraded":"2024-09-12T17:09:44.412097+0000","last_fullsized":"2024-09-12T17:09:44.412097+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:44.411912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:44.411912+0000","last_clean_scrub_stamp":"2024-09-12T17:09:44.411912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:15:02.666421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.876624+0000","last_change":"2024-09-12T17:09:19.876624+0000","last_active":"2024-09-12T17:09:19.876624+0000","last_peered":"2024-09-12T17:09:19.876624+0000","last_clean":"2024-09-12T17:09:19.876624+0000","last_became_active":"2024-09-12T17:05:49.531975+0000","last_became_peered":"2024-09-12T17:05:49.531975+0000","last_unstale":"2024-09-12T17:09:19.876624+0000","last_undegraded":"2024-09-12T17:09:19.876624+0000","last_fullsized":"2024-09-12T17:09:19.876624+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:19.876442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:19.876442+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.876442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:12:03.300892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"103'18","reported_seq":72,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.312490+0000","last_change":"2024-09-12T17:09:11.312490+0000","last_active":"2024-09-12T17:09:11.312490+0000","last_peered":"2024-09-12T17:09:11.312490+0000","last_clean":"2024-09-12T17:09:11.312490+0000","last_became_active":"2024-09-12T17:08:18.457074+0000","last_became_peered":"2024-09-12T17:08:18.457074+0000","last_unstale":"2024-09-12T17:09:11.312490+0000","last_undegraded":"2024-09-12T17:09:11.312490+0000","last_fullsized":"2024-09-12T17:09:11.312490+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:11.312305+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:11.312305+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.312305+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:26:48.628370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":36876,"num_write":50,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.229400+0000","last_change":"2024-09-12T17:09:24.229400+0000","last_active":"2024-09-12T17:09:24.229400+0000","last_peered":"2024-09-12T17:09:24.229400+0000","last_clean":"2024-09-12T17:09:24.229400+0000","last_became_active":"2024-09-12T17:05:51.545154+0000","last_became_peered":"2024-09-12T17:05:51.545154+0000","last_unstale":"2024-09-12T17:09:24.229400+0000","last_undegraded":"2024-09-12T17:09:24.229400+0000","last_fullsized":"2024-09-12T17:09:24.229400+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:24.229185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:24.229185+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.229185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:23:09.557266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"103'30","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:35.967791+0000","last_change":"2024-09-12T17:09:35.967791+0000","last_active":"2024-09-12T17:09:35.967791+0000","last_peered":"2024-09-12T17:09:35.967791+0000","last_clean":"2024-09-12T17:09:35.967791+0000","last_became_active":"2024-09-12T17:05:53.558086+0000","last_became_peered":"2024-09-12T17:05:53.558086+0000","last_unstale":"2024-09-12T17:09:35.967791+0000","last_undegraded":"2024-09-12T17:09:35.967791+0000","last_fullsized":"2024-09-12T17:09:35.967791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'30","last_scrub_stamp":"2024-09-12T17:09:35.967558+0000","last_deep_scrub":"103'30","last_deep_scrub_stamp":"2024-09-12T17:09:35.967558+0000","last_clean_scrub_stamp":"2024-09-12T17:09:35.967558+0000","objects_scrubbed":7,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:46.567604+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":51,"num_write":24,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:30.988272+0000","last_change":"2024-09-12T17:09:30.988272+0000","last_active":"2024-09-12T17:09:30.988272+0000","last_peered":"2024-09-12T17:09:30.988272+0000","last_clean":"2024-09-12T17:09:30.988272+0000","last_became_active":"2024-09-12T17:08:21.466295+0000","last_became_peered":"2024-09-12T17:08:21.466295+0000","last_unstale":"2024-09-12T17:09:30.988272+0000","last_undegraded":"2024-09-12T17:09:30.988272+0000","last_fullsized":"2024-09-12T17:09:30.988272+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:30.988051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:30.988051+0000","last_clean_scrub_stamp":"2024-09-12T17:09:30.988051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:24:17.807747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"68'2","reported_seq":159,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:33.324321+0000","last_change":"2024-09-12T17:09:33.324321+0000","last_active":"2024-09-12T17:09:33.324321+0000","last_peered":"2024-09-12T17:09:33.324321+0000","last_clean":"2024-09-12T17:09:33.324321+0000","last_became_active":"2024-09-12T17:05:57.596651+0000","last_became_peered":"2024-09-12T17:05:57.596651+0000","last_unstale":"2024-09-12T17:09:33.324321+0000","last_undegraded":"2024-09-12T17:09:33.324321+0000","last_fullsized":"2024-09-12T17:09:33.324321+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-09-12T17:09:33.324100+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-09-12T17:09:33.324100+0000","last_clean_scrub_stamp":"2024-09-12T17:09:33.324100+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:56:30.471332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.352736+0000","last_change":"2024-09-12T17:09:23.352736+0000","last_active":"2024-09-12T17:09:23.352736+0000","last_peered":"2024-09-12T17:09:23.352736+0000","last_clean":"2024-09-12T17:09:23.352736+0000","last_became_active":"2024-09-12T17:08:18.465478+0000","last_became_peered":"2024-09-12T17:08:18.465478+0000","last_unstale":"2024-09-12T17:09:23.352736+0000","last_undegraded":"2024-09-12T17:09:23.352736+0000","last_fullsized":"2024-09-12T17:09:23.352736+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:23.352534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:23.352534+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.352534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:10.229056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"103'14","reported_seq":226,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.803082+0000","last_change":"2024-09-12T17:09:10.803082+0000","last_active":"2024-09-12T17:09:10.803082+0000","last_peered":"2024-09-12T17:09:10.803082+0000","last_clean":"2024-09-12T17:09:10.803082+0000","last_became_active":"2024-09-12T17:08:18.447694+0000","last_became_peered":"2024-09-12T17:08:18.447694+0000","last_unstale":"2024-09-12T17:09:10.803082+0000","last_undegraded":"2024-09-12T17:09:10.803082+0000","last_fullsized":"2024-09-12T17:09:10.803082+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'14","last_scrub_stamp":"2024-09-12T17:09:10.802897+0000","last_deep_scrub":"103'14","last_deep_scrub_stamp":"2024-09-12T17:09:10.802897+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.802897+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:42:04.679641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28675,"num_write":22,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:32.858138+0000","last_change":"2024-09-12T17:09:32.858138+0000","last_active":"2024-09-12T17:09:32.858138+0000","last_peered":"2024-09-12T17:09:32.858138+0000","last_clean":"2024-09-12T17:09:32.858138+0000","last_became_active":"2024-09-12T17:05:51.539054+0000","last_became_peered":"2024-09-12T17:05:51.539054+0000","last_unstale":"2024-09-12T17:09:32.858138+0000","last_undegraded":"2024-09-12T17:09:32.858138+0000","last_fullsized":"2024-09-12T17:09:32.858138+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:32.857905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:32.857905+0000","last_clean_scrub_stamp":"2024-09-12T17:09:32.857905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:49:26.566403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"103'25","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:37.445096+0000","last_change":"2024-09-12T17:09:37.445096+0000","last_active":"2024-09-12T17:09:37.445096+0000","last_peered":"2024-09-12T17:09:37.445096+0000","last_clean":"2024-09-12T17:09:37.445096+0000","last_became_active":"2024-09-12T17:05:53.556357+0000","last_became_peered":"2024-09-12T17:05:53.556357+0000","last_unstale":"2024-09-12T17:09:37.445096+0000","last_undegraded":"2024-09-12T17:09:37.445096+0000","last_fullsized":"2024-09-12T17:09:37.445096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'25","last_scrub_stamp":"2024-09-12T17:09:37.444821+0000","last_deep_scrub":"103'25","last_deep_scrub_stamp":"2024-09-12T17:09:37.444821+0000","last_clean_scrub_stamp":"2024-09-12T17:09:37.444821+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:58:13.121724+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":42,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:35.972687+0000","last_change":"2024-09-12T17:09:35.972687+0000","last_active":"2024-09-12T17:09:35.972687+0000","last_peered":"2024-09-12T17:09:35.972687+0000","last_clean":"2024-09-12T17:09:35.972687+0000","last_became_active":"2024-09-12T17:08:21.460894+0000","last_became_peered":"2024-09-12T17:08:21.460894+0000","last_unstale":"2024-09-12T17:09:35.972687+0000","last_undegraded":"2024-09-12T17:09:35.972687+0000","last_fullsized":"2024-09-12T17:09:35.972687+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:35.972510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:35.972510+0000","last_clean_scrub_stamp":"2024-09-12T17:09:35.972510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:23.077006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":154,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:42.135142+0000","last_change":"2024-09-12T17:09:42.135142+0000","last_active":"2024-09-12T17:09:42.135142+0000","last_peered":"2024-09-12T17:09:42.135142+0000","last_clean":"2024-09-12T17:09:42.135142+0000","last_became_active":"2024-09-12T17:05:57.596005+0000","last_became_peered":"2024-09-12T17:05:57.596005+0000","last_unstale":"2024-09-12T17:09:42.135142+0000","last_undegraded":"2024-09-12T17:09:42.135142+0000","last_fullsized":"2024-09-12T17:09:42.135142+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:42.134941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:42.134941+0000","last_clean_scrub_stamp":"2024-09-12T17:09:42.134941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:53.394386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":184,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.569372+0000","last_change":"2024-09-12T17:09:15.569372+0000","last_active":"2024-09-12T17:09:15.569372+0000","last_peered":"2024-09-12T17:09:15.569372+0000","last_clean":"2024-09-12T17:09:15.569372+0000","last_became_active":"2024-09-12T17:08:18.445415+0000","last_became_peered":"2024-09-12T17:08:18.445415+0000","last_unstale":"2024-09-12T17:09:15.569372+0000","last_undegraded":"2024-09-12T17:09:15.569372+0000","last_fullsized":"2024-09-12T17:09:15.569372+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:15.569195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:15.569195+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.569195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:57:44.634479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"103'24","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.802596+0000","last_change":"2024-09-12T17:09:11.802596+0000","last_active":"2024-09-12T17:09:11.802596+0000","last_peered":"2024-09-12T17:09:11.802596+0000","last_clean":"2024-09-12T17:09:11.802596+0000","last_became_active":"2024-09-12T17:05:47.545466+0000","last_became_peered":"2024-09-12T17:05:47.545466+0000","last_unstale":"2024-09-12T17:09:11.802596+0000","last_undegraded":"2024-09-12T17:09:11.802596+0000","last_fullsized":"2024-09-12T17:09:11.802596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'24","last_scrub_stamp":"2024-09-12T17:09:11.802406+0000","last_deep_scrub":"103'24","last_deep_scrub_stamp":"2024-09-12T17:09:11.802406+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.802406+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:05.416311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":40966,"num_write":40,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":47,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.040432+0000","last_change":"2024-09-12T17:09:26.040432+0000","last_active":"2024-09-12T17:09:26.040432+0000","last_peered":"2024-09-12T17:09:26.040432+0000","last_clean":"2024-09-12T17:09:26.040432+0000","last_became_active":"2024-09-12T17:08:18.457099+0000","last_became_peered":"2024-09-12T17:08:18.457099+0000","last_unstale":"2024-09-12T17:09:26.040432+0000","last_undegraded":"2024-09-12T17:09:26.040432+0000","last_fullsized":"2024-09-12T17:09:26.040432+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:26.040252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:26.040252+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.040252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:11:26.001607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"103'18","reported_seq":187,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:38.811882+0000","last_change":"2024-09-12T17:09:38.811882+0000","last_active":"2024-09-12T17:09:38.811882+0000","last_peered":"2024-09-12T17:09:38.811882+0000","last_clean":"2024-09-12T17:09:38.811882+0000","last_became_active":"2024-09-12T17:05:53.559688+0000","last_became_peered":"2024-09-12T17:05:53.559688+0000","last_unstale":"2024-09-12T17:09:38.811882+0000","last_undegraded":"2024-09-12T17:09:38.811882+0000","last_fullsized":"2024-09-12T17:09:38.811882+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:38.811675+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:38.811675+0000","last_clean_scrub_stamp":"2024-09-12T17:09:38.811675+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:08:57.973881+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":21,"num_read_kb":16,"num_write":22,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1716,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"103'18","reported_seq":217,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:30.250778+0000","last_change":"2024-09-12T17:09:30.250778+0000","last_active":"2024-09-12T17:09:30.250778+0000","last_peered":"2024-09-12T17:09:30.250778+0000","last_clean":"2024-09-12T17:09:30.250778+0000","last_became_active":"2024-09-12T17:05:55.571966+0000","last_became_peered":"2024-09-12T17:05:55.571966+0000","last_unstale":"2024-09-12T17:09:30.250778+0000","last_undegraded":"2024-09-12T17:09:30.250778+0000","last_fullsized":"2024-09-12T17:09:30.250778+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:30.250593+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:30.250593+0000","last_clean_scrub_stamp":"2024-09-12T17:09:30.250593+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:17:54.788007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":154,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:43.047702+0000","last_change":"2024-09-12T17:09:43.047702+0000","last_active":"2024-09-12T17:09:43.047702+0000","last_peered":"2024-09-12T17:09:43.047702+0000","last_clean":"2024-09-12T17:09:43.047702+0000","last_became_active":"2024-09-12T17:05:57.594396+0000","last_became_peered":"2024-09-12T17:05:57.594396+0000","last_unstale":"2024-09-12T17:09:43.047702+0000","last_undegraded":"2024-09-12T17:09:43.047702+0000","last_fullsized":"2024-09-12T17:09:43.047702+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:43.047508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:43.047508+0000","last_clean_scrub_stamp":"2024-09-12T17:09:43.047508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:44:29.924031+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.834494+0000","last_change":"2024-09-12T17:09:22.834494+0000","last_active":"2024-09-12T17:09:22.834494+0000","last_peered":"2024-09-12T17:09:22.834494+0000","last_clean":"2024-09-12T17:09:22.834494+0000","last_became_active":"2024-09-12T17:05:49.542414+0000","last_became_peered":"2024-09-12T17:05:49.542414+0000","last_unstale":"2024-09-12T17:09:22.834494+0000","last_undegraded":"2024-09-12T17:09:22.834494+0000","last_fullsized":"2024-09-12T17:09:22.834494+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:22.834262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:22.834262+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.834262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:50:43.545590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"103'24","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:11.407557+0000","last_change":"2024-09-12T17:09:11.407557+0000","last_active":"2024-09-12T17:09:11.407557+0000","last_peered":"2024-09-12T17:09:11.407557+0000","last_clean":"2024-09-12T17:09:11.407557+0000","last_became_active":"2024-09-12T17:06:27.784897+0000","last_became_peered":"2024-09-12T17:06:27.784897+0000","last_unstale":"2024-09-12T17:09:11.407557+0000","last_undegraded":"2024-09-12T17:09:11.407557+0000","last_fullsized":"2024-09-12T17:09:11.407557+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'24","last_scrub_stamp":"2024-09-12T17:09:11.407380+0000","last_deep_scrub":"103'24","last_deep_scrub_stamp":"2024-09-12T17:09:11.407380+0000","last_clean_scrub_stamp":"2024-09-12T17:09:11.407380+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:51:48.270232+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":49158,"num_write":40,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":166,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:30.986591+0000","last_change":"2024-09-12T17:09:30.986591+0000","last_active":"2024-09-12T17:09:30.986591+0000","last_peered":"2024-09-12T17:09:30.986591+0000","last_clean":"2024-09-12T17:09:30.986591+0000","last_became_active":"2024-09-12T17:05:51.527501+0000","last_became_peered":"2024-09-12T17:05:51.527501+0000","last_unstale":"2024-09-12T17:09:30.986591+0000","last_undegraded":"2024-09-12T17:09:30.986591+0000","last_fullsized":"2024-09-12T17:09:30.986591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:30.986397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:30.986397+0000","last_clean_scrub_stamp":"2024-09-12T17:09:30.986397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:02:25.701783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"103'31","reported_seq":251,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:36.108442+0000","last_change":"2024-09-12T17:09:36.108442+0000","last_active":"2024-09-12T17:09:36.108442+0000","last_peered":"2024-09-12T17:09:36.108442+0000","last_clean":"2024-09-12T17:09:36.108442+0000","last_became_active":"2024-09-12T17:08:18.474969+0000","last_became_peered":"2024-09-12T17:08:18.474969+0000","last_unstale":"2024-09-12T17:09:36.108442+0000","last_undegraded":"2024-09-12T17:09:36.108442+0000","last_fullsized":"2024-09-12T17:09:36.108442+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'31","last_scrub_stamp":"2024-09-12T17:09:36.108303+0000","last_deep_scrub":"103'31","last_deep_scrub_stamp":"2024-09-12T17:09:36.108303+0000","last_clean_scrub_stamp":"2024-09-12T17:09:36.108303+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:40:58.049786+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":41,"num_read_kb":46,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":1889,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:37.819034+0000","last_change":"2024-09-12T17:09:37.819034+0000","last_active":"2024-09-12T17:09:37.819034+0000","last_peered":"2024-09-12T17:09:37.819034+0000","last_clean":"2024-09-12T17:09:37.819034+0000","last_became_active":"2024-09-12T17:05:55.564710+0000","last_became_peered":"2024-09-12T17:05:55.564710+0000","last_unstale":"2024-09-12T17:09:37.819034+0000","last_undegraded":"2024-09-12T17:09:37.819034+0000","last_fullsized":"2024-09-12T17:09:37.819034+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:37.818842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:37.818842+0000","last_clean_scrub_stamp":"2024-09-12T17:09:37.818842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:52:54.179578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":154,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:44.036569+0000","last_change":"2024-09-12T17:09:44.036569+0000","last_active":"2024-09-12T17:09:44.036569+0000","last_peered":"2024-09-12T17:09:44.036569+0000","last_clean":"2024-09-12T17:09:44.036569+0000","last_became_active":"2024-09-12T17:05:57.603285+0000","last_became_peered":"2024-09-12T17:05:57.603285+0000","last_unstale":"2024-09-12T17:09:44.036569+0000","last_undegraded":"2024-09-12T17:09:44.036569+0000","last_fullsized":"2024-09-12T17:09:44.036569+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:44.036375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:44.036375+0000","last_clean_scrub_stamp":"2024-09-12T17:09:44.036375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:39:16.229975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"68'6","reported_seq":181,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.811026+0000","last_change":"2024-09-12T17:09:20.811026+0000","last_active":"2024-09-12T17:09:20.811026+0000","last_peered":"2024-09-12T17:09:20.811026+0000","last_clean":"2024-09-12T17:09:20.811026+0000","last_became_active":"2024-09-12T17:05:49.541007+0000","last_became_peered":"2024-09-12T17:05:49.541007+0000","last_unstale":"2024-09-12T17:09:20.811026+0000","last_undegraded":"2024-09-12T17:09:20.811026+0000","last_fullsized":"2024-09-12T17:09:20.811026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'6","last_scrub_stamp":"2024-09-12T17:09:20.810800+0000","last_deep_scrub":"68'6","last_deep_scrub_stamp":"2024-09-12T17:09:20.810800+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.810800+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:31:13.788947+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"103'8","reported_seq":186,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.100077+0000","last_change":"2024-09-12T17:09:13.100077+0000","last_active":"2024-09-12T17:09:13.100077+0000","last_peered":"2024-09-12T17:09:13.100077+0000","last_clean":"2024-09-12T17:09:13.100077+0000","last_became_active":"2024-09-12T17:05:47.542345+0000","last_became_peered":"2024-09-12T17:05:47.542345+0000","last_unstale":"2024-09-12T17:09:13.100077+0000","last_undegraded":"2024-09-12T17:09:13.100077+0000","last_fullsized":"2024-09-12T17:09:13.100077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'8","last_scrub_stamp":"2024-09-12T17:09:13.099848+0000","last_deep_scrub":"103'8","last_deep_scrub_stamp":"2024-09-12T17:09:13.099848+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.099848+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:20.623736+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":166,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:33.120157+0000","last_change":"2024-09-12T17:09:33.120157+0000","last_active":"2024-09-12T17:09:33.120157+0000","last_peered":"2024-09-12T17:09:33.120157+0000","last_clean":"2024-09-12T17:09:33.120157+0000","last_became_active":"2024-09-12T17:05:51.554248+0000","last_became_peered":"2024-09-12T17:05:51.554248+0000","last_unstale":"2024-09-12T17:09:33.120157+0000","last_undegraded":"2024-09-12T17:09:33.120157+0000","last_fullsized":"2024-09-12T17:09:33.120157+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:33.119926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:33.119926+0000","last_clean_scrub_stamp":"2024-09-12T17:09:33.119926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:50:16.784586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"103'20","reported_seq":225,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:32.833563+0000","last_change":"2024-09-12T17:09:32.833563+0000","last_active":"2024-09-12T17:09:32.833563+0000","last_peered":"2024-09-12T17:09:32.833563+0000","last_clean":"2024-09-12T17:09:32.833563+0000","last_became_active":"2024-09-12T17:08:18.450594+0000","last_became_peered":"2024-09-12T17:08:18.450594+0000","last_unstale":"2024-09-12T17:09:32.833563+0000","last_undegraded":"2024-09-12T17:09:32.833563+0000","last_fullsized":"2024-09-12T17:09:32.833563+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:32.833355+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:32.833355+0000","last_clean_scrub_stamp":"2024-09-12T17:09:32.833355+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T05:03:09.638229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":30,"num_read_kb":35,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1332,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:31.262827+0000","last_change":"2024-09-12T17:09:31.262827+0000","last_active":"2024-09-12T17:09:31.262827+0000","last_peered":"2024-09-12T17:09:31.262827+0000","last_clean":"2024-09-12T17:09:31.262827+0000","last_became_active":"2024-09-12T17:05:55.566774+0000","last_became_peered":"2024-09-12T17:05:55.566774+0000","last_unstale":"2024-09-12T17:09:31.262827+0000","last_undegraded":"2024-09-12T17:09:31.262827+0000","last_fullsized":"2024-09-12T17:09:31.262827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:31.262644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:31.262644+0000","last_clean_scrub_stamp":"2024-09-12T17:09:31.262644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:57:00.799355+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":156,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:46.357860+0000","last_change":"2024-09-12T17:09:46.357860+0000","last_active":"2024-09-12T17:09:46.357860+0000","last_peered":"2024-09-12T17:09:46.357860+0000","last_clean":"2024-09-12T17:09:46.357860+0000","last_became_active":"2024-09-12T17:05:58.120364+0000","last_became_peered":"2024-09-12T17:05:58.120364+0000","last_unstale":"2024-09-12T17:09:46.357860+0000","last_undegraded":"2024-09-12T17:09:46.357860+0000","last_fullsized":"2024-09-12T17:09:46.357860+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:46.357630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:46.357630+0000","last_clean_scrub_stamp":"2024-09-12T17:09:46.357630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:56:25.382724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.371952+0000","last_change":"2024-09-12T17:09:22.371952+0000","last_active":"2024-09-12T17:09:22.371952+0000","last_peered":"2024-09-12T17:09:22.371952+0000","last_clean":"2024-09-12T17:09:22.371952+0000","last_became_active":"2024-09-12T17:05:49.549481+0000","last_became_peered":"2024-09-12T17:05:49.549481+0000","last_unstale":"2024-09-12T17:09:22.371952+0000","last_undegraded":"2024-09-12T17:09:22.371952+0000","last_fullsized":"2024-09-12T17:09:22.371952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:22.371763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:22.371763+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.371763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:35.061353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"103'18","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.414570+0000","last_change":"2024-09-12T17:09:13.414423+0000","last_active":"2024-09-12T17:09:13.414570+0000","last_peered":"2024-09-12T17:09:13.414570+0000","last_clean":"2024-09-12T17:09:13.414570+0000","last_became_active":"2024-09-12T17:05:47.510462+0000","last_became_peered":"2024-09-12T17:05:47.510462+0000","last_unstale":"2024-09-12T17:09:13.414570+0000","last_undegraded":"2024-09-12T17:09:13.414570+0000","last_fullsized":"2024-09-12T17:09:13.414570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:13.414237+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:13.414237+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.414237+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:20:24.885296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":30726,"num_write":34,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":168,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:31.890983+0000","last_change":"2024-09-12T17:09:31.890983+0000","last_active":"2024-09-12T17:09:31.890983+0000","last_peered":"2024-09-12T17:09:31.890983+0000","last_clean":"2024-09-12T17:09:31.890983+0000","last_became_active":"2024-09-12T17:05:51.539938+0000","last_became_peered":"2024-09-12T17:05:51.539938+0000","last_unstale":"2024-09-12T17:09:31.890983+0000","last_undegraded":"2024-09-12T17:09:31.890983+0000","last_fullsized":"2024-09-12T17:09:31.890983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:31.890798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:31.890798+0000","last_clean_scrub_stamp":"2024-09-12T17:09:31.890798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:17:48.315396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"103'17","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:35.421861+0000","last_change":"2024-09-12T17:09:35.421861+0000","last_active":"2024-09-12T17:09:35.421861+0000","last_peered":"2024-09-12T17:09:35.421861+0000","last_clean":"2024-09-12T17:09:35.421861+0000","last_became_active":"2024-09-12T17:05:53.552095+0000","last_became_peered":"2024-09-12T17:05:53.552095+0000","last_unstale":"2024-09-12T17:09:35.421861+0000","last_undegraded":"2024-09-12T17:09:35.421861+0000","last_fullsized":"2024-09-12T17:09:35.421861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'17","last_scrub_stamp":"2024-09-12T17:09:35.421731+0000","last_deep_scrub":"103'17","last_deep_scrub_stamp":"2024-09-12T17:09:35.421731+0000","last_clean_scrub_stamp":"2024-09-12T17:09:35.421731+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:14.683923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":43,"num_write":18,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":160,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:40.825185+0000","last_change":"2024-09-12T17:09:40.825185+0000","last_active":"2024-09-12T17:09:40.825185+0000","last_peered":"2024-09-12T17:09:40.825185+0000","last_clean":"2024-09-12T17:09:40.825185+0000","last_became_active":"2024-09-12T17:05:55.570863+0000","last_became_peered":"2024-09-12T17:05:55.570863+0000","last_unstale":"2024-09-12T17:09:40.825185+0000","last_undegraded":"2024-09-12T17:09:40.825185+0000","last_fullsized":"2024-09-12T17:09:40.825185+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:40.825002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:40.825002+0000","last_clean_scrub_stamp":"2024-09-12T17:09:40.825002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:04:54.571646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":166,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:41.065711+0000","last_change":"2024-09-12T17:09:41.065711+0000","last_active":"2024-09-12T17:09:41.065711+0000","last_peered":"2024-09-12T17:09:41.065711+0000","last_clean":"2024-09-12T17:09:41.065711+0000","last_became_active":"2024-09-12T17:08:21.466218+0000","last_became_peered":"2024-09-12T17:08:21.466218+0000","last_unstale":"2024-09-12T17:09:41.065711+0000","last_undegraded":"2024-09-12T17:09:41.065711+0000","last_fullsized":"2024-09-12T17:09:41.065711+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:41.065525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:41.065525+0000","last_clean_scrub_stamp":"2024-09-12T17:09:41.065525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:32.123419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"84'38","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.858626+0000","last_change":"2024-09-12T17:09:19.858626+0000","last_active":"2024-09-12T17:09:19.858626+0000","last_peered":"2024-09-12T17:09:19.858626+0000","last_clean":"2024-09-12T17:09:19.858626+0000","last_became_active":"2024-09-12T17:05:49.560875+0000","last_became_peered":"2024-09-12T17:05:49.560875+0000","last_unstale":"2024-09-12T17:09:19.858626+0000","last_undegraded":"2024-09-12T17:09:19.858626+0000","last_fullsized":"2024-09-12T17:09:19.858626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'38","last_scrub_stamp":"2024-09-12T17:09:19.858426+0000","last_deep_scrub":"84'38","last_deep_scrub_stamp":"2024-09-12T17:09:19.858426+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.858426+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:21:14.057363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"103'24","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.781380+0000","last_change":"2024-09-12T17:09:10.781380+0000","last_active":"2024-09-12T17:09:10.781380+0000","last_peered":"2024-09-12T17:09:10.781380+0000","last_clean":"2024-09-12T17:09:10.781380+0000","last_became_active":"2024-09-12T17:05:47.527364+0000","last_became_peered":"2024-09-12T17:05:47.527364+0000","last_unstale":"2024-09-12T17:09:10.781380+0000","last_undegraded":"2024-09-12T17:09:10.781380+0000","last_fullsized":"2024-09-12T17:09:10.781380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'24","last_scrub_stamp":"2024-09-12T17:09:10.781194+0000","last_deep_scrub":"103'24","last_deep_scrub_stamp":"2024-09-12T17:09:10.781194+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.781194+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:46.126494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45062,"num_write":40,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"103'2","reported_seq":52,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.121308+0000","last_change":"2024-09-12T17:09:18.121308+0000","last_active":"2024-09-12T17:09:18.121308+0000","last_peered":"2024-09-12T17:09:18.121308+0000","last_clean":"2024-09-12T17:09:18.121308+0000","last_became_active":"2024-09-12T17:08:18.463879+0000","last_became_peered":"2024-09-12T17:08:18.463879+0000","last_unstale":"2024-09-12T17:09:18.121308+0000","last_undegraded":"2024-09-12T17:09:18.121308+0000","last_fullsized":"2024-09-12T17:09:18.121308+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'2","last_scrub_stamp":"2024-09-12T17:09:18.121127+0000","last_deep_scrub":"103'2","last_deep_scrub_stamp":"2024-09-12T17:09:18.121127+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.121127+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:50:13.475769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"103'24","reported_seq":199,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:37.793518+0000","last_change":"2024-09-12T17:09:37.793518+0000","last_active":"2024-09-12T17:09:37.793518+0000","last_peered":"2024-09-12T17:09:37.793518+0000","last_clean":"2024-09-12T17:09:37.793518+0000","last_became_active":"2024-09-12T17:05:53.547202+0000","last_became_peered":"2024-09-12T17:05:53.547202+0000","last_unstale":"2024-09-12T17:09:37.793518+0000","last_undegraded":"2024-09-12T17:09:37.793518+0000","last_fullsized":"2024-09-12T17:09:37.793518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'24","last_scrub_stamp":"2024-09-12T17:09:37.793334+0000","last_deep_scrub":"103'24","last_deep_scrub_stamp":"2024-09-12T17:09:37.793334+0000","last_clean_scrub_stamp":"2024-09-12T17:09:37.793334+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:42:43.597036+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":36,"num_read_kb":62,"num_write":24,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":158,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:38.852301+0000","last_change":"2024-09-12T17:09:38.852301+0000","last_active":"2024-09-12T17:09:38.852301+0000","last_peered":"2024-09-12T17:09:38.852301+0000","last_clean":"2024-09-12T17:09:38.852301+0000","last_became_active":"2024-09-12T17:05:55.565403+0000","last_became_peered":"2024-09-12T17:05:55.565403+0000","last_unstale":"2024-09-12T17:09:38.852301+0000","last_undegraded":"2024-09-12T17:09:38.852301+0000","last_fullsized":"2024-09-12T17:09:38.852301+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:38.852125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:38.852125+0000","last_clean_scrub_stamp":"2024-09-12T17:09:38.852125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:18.114317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":156,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:42.753175+0000","last_change":"2024-09-12T17:09:42.753175+0000","last_active":"2024-09-12T17:09:42.753175+0000","last_peered":"2024-09-12T17:09:42.753175+0000","last_clean":"2024-09-12T17:09:42.753175+0000","last_became_active":"2024-09-12T17:05:57.588626+0000","last_became_peered":"2024-09-12T17:05:57.588626+0000","last_unstale":"2024-09-12T17:09:42.753175+0000","last_undegraded":"2024-09-12T17:09:42.753175+0000","last_fullsized":"2024-09-12T17:09:42.753175+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:42.752961+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:42.752961+0000","last_clean_scrub_stamp":"2024-09-12T17:09:42.752961+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:24:29.857457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:32.010315+0000","last_change":"2024-09-12T17:09:32.010315+0000","last_active":"2024-09-12T17:09:32.010315+0000","last_peered":"2024-09-12T17:09:32.010315+0000","last_clean":"2024-09-12T17:09:32.010315+0000","last_became_active":"2024-09-12T17:08:21.473677+0000","last_became_peered":"2024-09-12T17:08:21.473677+0000","last_unstale":"2024-09-12T17:09:32.010315+0000","last_undegraded":"2024-09-12T17:09:32.010315+0000","last_fullsized":"2024-09-12T17:09:32.010315+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:32.010106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:32.010106+0000","last_clean_scrub_stamp":"2024-09-12T17:09:32.010106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:23:33.168470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"103'20","reported_seq":207,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.138511+0000","last_change":"2024-09-12T17:09:15.138511+0000","last_active":"2024-09-12T17:09:15.138511+0000","last_peered":"2024-09-12T17:09:15.138511+0000","last_clean":"2024-09-12T17:09:15.138511+0000","last_became_active":"2024-09-12T17:05:47.531750+0000","last_became_peered":"2024-09-12T17:05:47.531750+0000","last_unstale":"2024-09-12T17:09:15.138511+0000","last_undegraded":"2024-09-12T17:09:15.138511+0000","last_fullsized":"2024-09-12T17:09:15.138511+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:15.138244+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:15.138244+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.138244+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:01:18.358900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36867,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.016282+0000","last_change":"2024-09-12T17:09:21.016282+0000","last_active":"2024-09-12T17:09:21.016282+0000","last_peered":"2024-09-12T17:09:21.016282+0000","last_clean":"2024-09-12T17:09:21.016282+0000","last_became_active":"2024-09-12T17:08:21.462942+0000","last_became_peered":"2024-09-12T17:08:21.462942+0000","last_unstale":"2024-09-12T17:09:21.016282+0000","last_undegraded":"2024-09-12T17:09:21.016282+0000","last_fullsized":"2024-09-12T17:09:21.016282+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:21.016097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:21.016097+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.016097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:54:16.105281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"103'18","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:09.378230+0000","last_change":"2024-09-12T17:09:09.378230+0000","last_active":"2024-09-12T17:09:09.378230+0000","last_peered":"2024-09-12T17:09:09.378230+0000","last_clean":"2024-09-12T17:09:09.378230+0000","last_became_active":"2024-09-12T17:05:47.525481+0000","last_became_peered":"2024-09-12T17:05:47.525481+0000","last_unstale":"2024-09-12T17:09:09.378230+0000","last_undegraded":"2024-09-12T17:09:09.378230+0000","last_fullsized":"2024-09-12T17:09:09.378230+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:09.378083+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:09.378083+0000","last_clean_scrub_stamp":"2024-09-12T17:09:09.378083+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:14:42.577647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":34819,"num_write":26,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"84'46","reported_seq":219,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.271272+0000","last_change":"2024-09-12T17:09:22.271272+0000","last_active":"2024-09-12T17:09:22.271272+0000","last_peered":"2024-09-12T17:09:22.271272+0000","last_clean":"2024-09-12T17:09:22.271272+0000","last_became_active":"2024-09-12T17:05:49.545382+0000","last_became_peered":"2024-09-12T17:05:49.545382+0000","last_unstale":"2024-09-12T17:09:22.271272+0000","last_undegraded":"2024-09-12T17:09:22.271272+0000","last_fullsized":"2024-09-12T17:09:22.271272+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'46","last_scrub_stamp":"2024-09-12T17:09:22.271031+0000","last_deep_scrub":"84'46","last_deep_scrub_stamp":"2024-09-12T17:09:22.271031+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.271031+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:59.551895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"103'16","reported_seq":114,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.456013+0000","last_change":"2024-09-12T17:09:12.455874+0000","last_active":"2024-09-12T17:09:12.456013+0000","last_peered":"2024-09-12T17:09:12.456013+0000","last_clean":"2024-09-12T17:09:12.456013+0000","last_became_active":"2024-09-12T17:07:28.191632+0000","last_became_peered":"2024-09-12T17:07:28.191632+0000","last_unstale":"2024-09-12T17:09:12.456013+0000","last_undegraded":"2024-09-12T17:09:12.456013+0000","last_fullsized":"2024-09-12T17:09:12.456013+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:12.455703+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:12.455703+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.455703+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:34:29.492372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":16390,"num_write":32,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":42,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:28.998502+0000","last_change":"2024-09-12T17:09:28.998502+0000","last_active":"2024-09-12T17:09:28.998502+0000","last_peered":"2024-09-12T17:09:28.998502+0000","last_clean":"2024-09-12T17:09:28.998502+0000","last_became_active":"2024-09-12T17:08:21.457133+0000","last_became_peered":"2024-09-12T17:08:21.457133+0000","last_unstale":"2024-09-12T17:09:28.998502+0000","last_undegraded":"2024-09-12T17:09:28.998502+0000","last_fullsized":"2024-09-12T17:09:28.998502+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:28.998306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:28.998306+0000","last_clean_scrub_stamp":"2024-09-12T17:09:28.998306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:19:07.443936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"103'20","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.821881+0000","last_change":"2024-09-12T17:09:12.821881+0000","last_active":"2024-09-12T17:09:12.821881+0000","last_peered":"2024-09-12T17:09:12.821881+0000","last_clean":"2024-09-12T17:09:12.821881+0000","last_became_active":"2024-09-12T17:05:47.529857+0000","last_became_peered":"2024-09-12T17:05:47.529857+0000","last_unstale":"2024-09-12T17:09:12.821881+0000","last_undegraded":"2024-09-12T17:09:12.821881+0000","last_fullsized":"2024-09-12T17:09:12.821881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:12.821691+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:12.821691+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.821691+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:40.170708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32768,"num_write":20,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"84'42","reported_seq":217,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.320871+0000","last_change":"2024-09-12T17:09:24.320871+0000","last_active":"2024-09-12T17:09:24.320871+0000","last_peered":"2024-09-12T17:09:24.320871+0000","last_clean":"2024-09-12T17:09:24.320871+0000","last_became_active":"2024-09-12T17:05:49.524567+0000","last_became_peered":"2024-09-12T17:05:49.524567+0000","last_unstale":"2024-09-12T17:09:24.320871+0000","last_undegraded":"2024-09-12T17:09:24.320871+0000","last_fullsized":"2024-09-12T17:09:24.320871+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'42","last_scrub_stamp":"2024-09-12T17:09:24.320675+0000","last_deep_scrub":"84'42","last_deep_scrub_stamp":"2024-09-12T17:09:24.320675+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.320675+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T21:38:56.514275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"103'16","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:12.408151+0000","last_change":"2024-09-12T17:09:12.408151+0000","last_active":"2024-09-12T17:09:12.408151+0000","last_peered":"2024-09-12T17:09:12.408151+0000","last_clean":"2024-09-12T17:09:12.408151+0000","last_became_active":"2024-09-12T17:05:47.547393+0000","last_became_peered":"2024-09-12T17:05:47.547393+0000","last_unstale":"2024-09-12T17:09:12.408151+0000","last_undegraded":"2024-09-12T17:09:12.408151+0000","last_fullsized":"2024-09-12T17:09:12.408151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:12.407969+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:12.407969+0000","last_clean_scrub_stamp":"2024-09-12T17:09:12.407969+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:37:35.063384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":30729,"num_write":40,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:21.850009+0000","last_change":"2024-09-12T17:09:21.850009+0000","last_active":"2024-09-12T17:09:21.850009+0000","last_peered":"2024-09-12T17:09:21.850009+0000","last_clean":"2024-09-12T17:09:21.850009+0000","last_became_active":"2024-09-12T17:05:49.560993+0000","last_became_peered":"2024-09-12T17:05:49.560993+0000","last_unstale":"2024-09-12T17:09:21.850009+0000","last_undegraded":"2024-09-12T17:09:21.850009+0000","last_fullsized":"2024-09-12T17:09:21.850009+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:21.849815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:21.849815+0000","last_clean_scrub_stamp":"2024-09-12T17:09:21.849815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T02:03:13.024431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"103'16","reported_seq":67,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.120401+0000","last_change":"2024-09-12T17:09:17.120401+0000","last_active":"2024-09-12T17:09:17.120401+0000","last_peered":"2024-09-12T17:09:17.120401+0000","last_clean":"2024-09-12T17:09:17.120401+0000","last_became_active":"2024-09-12T17:08:21.461010+0000","last_became_peered":"2024-09-12T17:08:21.461010+0000","last_unstale":"2024-09-12T17:09:17.120401+0000","last_undegraded":"2024-09-12T17:09:17.120401+0000","last_fullsized":"2024-09-12T17:09:17.120401+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:17.120215+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:17.120215+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.120215+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:15.327625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24579,"num_write":24,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"68'2","reported_seq":203,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.287467+0000","last_change":"2024-09-12T17:09:25.287467+0000","last_active":"2024-09-12T17:09:25.287467+0000","last_peered":"2024-09-12T17:09:25.287467+0000","last_clean":"2024-09-12T17:09:25.287467+0000","last_became_active":"2024-09-12T17:08:28.558588+0000","last_became_peered":"2024-09-12T17:08:28.558588+0000","last_unstale":"2024-09-12T17:09:25.287467+0000","last_undegraded":"2024-09-12T17:09:25.287467+0000","last_fullsized":"2024-09-12T17:09:25.287467+0000","mapping_epoch":97,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":98,"parent":"0.0","parent_split_bits":0,"last_scrub":"68'2","last_scrub_stamp":"2024-09-12T17:09:25.287274+0000","last_deep_scrub":"68'2","last_deep_scrub_stamp":"2024-09-12T17:09:25.287274+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.287274+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:54:53.081061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"103'16","reported_seq":200,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.092495+0000","last_change":"2024-09-12T17:09:13.092495+0000","last_active":"2024-09-12T17:09:13.092495+0000","last_peered":"2024-09-12T17:09:13.092495+0000","last_clean":"2024-09-12T17:09:13.092495+0000","last_became_active":"2024-09-12T17:05:47.540469+0000","last_became_peered":"2024-09-12T17:05:47.540469+0000","last_unstale":"2024-09-12T17:09:13.092495+0000","last_undegraded":"2024-09-12T17:09:13.092495+0000","last_fullsized":"2024-09-12T17:09:13.092495+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:13.092301+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:13.092301+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.092301+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:38:17.391036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":30720,"num_write":16,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"84'42","reported_seq":217,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:19.175909+0000","last_change":"2024-09-12T17:09:19.175909+0000","last_active":"2024-09-12T17:09:19.175909+0000","last_peered":"2024-09-12T17:09:19.175909+0000","last_clean":"2024-09-12T17:09:19.175909+0000","last_became_active":"2024-09-12T17:05:49.540395+0000","last_became_peered":"2024-09-12T17:05:49.540395+0000","last_unstale":"2024-09-12T17:09:19.175909+0000","last_undegraded":"2024-09-12T17:09:19.175909+0000","last_fullsized":"2024-09-12T17:09:19.175909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'42","last_scrub_stamp":"2024-09-12T17:09:19.175717+0000","last_deep_scrub":"84'42","last_deep_scrub_stamp":"2024-09-12T17:09:19.175717+0000","last_clean_scrub_stamp":"2024-09-12T17:09:19.175717+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:15:21.821690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"103'32","reported_seq":226,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.360291+0000","last_change":"2024-09-12T17:09:15.360291+0000","last_active":"2024-09-12T17:09:15.360291+0000","last_peered":"2024-09-12T17:09:15.360291+0000","last_clean":"2024-09-12T17:09:15.360291+0000","last_became_active":"2024-09-12T17:05:47.539603+0000","last_became_peered":"2024-09-12T17:05:47.539603+0000","last_unstale":"2024-09-12T17:09:15.360291+0000","last_undegraded":"2024-09-12T17:09:15.360291+0000","last_fullsized":"2024-09-12T17:09:15.360291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'32","last_scrub_stamp":"2024-09-12T17:09:15.360088+0000","last_deep_scrub":"103'32","last_deep_scrub_stamp":"2024-09-12T17:09:15.360088+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.360088+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T20:57:52.640951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":57350,"num_write":48,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.847642+0000","last_change":"2024-09-12T17:09:22.847642+0000","last_active":"2024-09-12T17:09:22.847642+0000","last_peered":"2024-09-12T17:09:22.847642+0000","last_clean":"2024-09-12T17:09:22.847642+0000","last_became_active":"2024-09-12T17:05:49.531769+0000","last_became_peered":"2024-09-12T17:05:49.531769+0000","last_unstale":"2024-09-12T17:09:22.847642+0000","last_undegraded":"2024-09-12T17:09:22.847642+0000","last_fullsized":"2024-09-12T17:09:22.847642+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:22.847422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:22.847422+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.847422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:56:38.299897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"103'20","reported_seq":205,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.119957+0000","last_change":"2024-09-12T17:09:14.119957+0000","last_active":"2024-09-12T17:09:14.119957+0000","last_peered":"2024-09-12T17:09:14.119957+0000","last_clean":"2024-09-12T17:09:14.119957+0000","last_became_active":"2024-09-12T17:05:47.524922+0000","last_became_peered":"2024-09-12T17:05:47.524922+0000","last_unstale":"2024-09-12T17:09:14.119957+0000","last_undegraded":"2024-09-12T17:09:14.119957+0000","last_fullsized":"2024-09-12T17:09:14.119957+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:14.119777+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:14.119777+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.119777+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:10:07.793407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":38915,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":172,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.875497+0000","last_change":"2024-09-12T17:09:24.875497+0000","last_active":"2024-09-12T17:09:24.875497+0000","last_peered":"2024-09-12T17:09:24.875497+0000","last_clean":"2024-09-12T17:09:24.875497+0000","last_became_active":"2024-09-12T17:05:49.554566+0000","last_became_peered":"2024-09-12T17:05:49.554566+0000","last_unstale":"2024-09-12T17:09:24.875497+0000","last_undegraded":"2024-09-12T17:09:24.875497+0000","last_fullsized":"2024-09-12T17:09:24.875497+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:24.875286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:24.875286+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.875286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:49:17.732964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"103'18","reported_seq":206,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.313093+0000","last_change":"2024-09-12T17:09:16.313093+0000","last_active":"2024-09-12T17:09:16.313093+0000","last_peered":"2024-09-12T17:09:16.313093+0000","last_clean":"2024-09-12T17:09:16.313093+0000","last_became_active":"2024-09-12T17:05:47.542753+0000","last_became_peered":"2024-09-12T17:05:47.542753+0000","last_unstale":"2024-09-12T17:09:16.313093+0000","last_undegraded":"2024-09-12T17:09:16.313093+0000","last_fullsized":"2024-09-12T17:09:16.313093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'18","last_scrub_stamp":"2024-09-12T17:09:16.312920+0000","last_deep_scrub":"103'18","last_deep_scrub_stamp":"2024-09-12T17:09:16.312920+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.312920+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:26.912967+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":34825,"num_write":42,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"84'34","reported_seq":209,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:14.524910+0000","last_change":"2024-09-12T17:09:14.524910+0000","last_active":"2024-09-12T17:09:14.524910+0000","last_peered":"2024-09-12T17:09:14.524910+0000","last_clean":"2024-09-12T17:09:14.524910+0000","last_became_active":"2024-09-12T17:05:49.536385+0000","last_became_peered":"2024-09-12T17:05:49.536385+0000","last_unstale":"2024-09-12T17:09:14.524910+0000","last_undegraded":"2024-09-12T17:09:14.524910+0000","last_fullsized":"2024-09-12T17:09:14.524910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'34","last_scrub_stamp":"2024-09-12T17:09:14.524718+0000","last_deep_scrub":"84'34","last_deep_scrub_stamp":"2024-09-12T17:09:14.524718+0000","last_clean_scrub_stamp":"2024-09-12T17:09:14.524718+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T18:14:37.090006+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"103'10","reported_seq":190,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:16.168976+0000","last_change":"2024-09-12T17:09:16.168976+0000","last_active":"2024-09-12T17:09:16.168976+0000","last_peered":"2024-09-12T17:09:16.168976+0000","last_clean":"2024-09-12T17:09:16.168976+0000","last_became_active":"2024-09-12T17:05:47.544406+0000","last_became_peered":"2024-09-12T17:05:47.544406+0000","last_unstale":"2024-09-12T17:09:16.168976+0000","last_undegraded":"2024-09-12T17:09:16.168976+0000","last_fullsized":"2024-09-12T17:09:16.168976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'10","last_scrub_stamp":"2024-09-12T17:09:16.168791+0000","last_deep_scrub":"103'10","last_deep_scrub_stamp":"2024-09-12T17:09:16.168791+0000","last_clean_scrub_stamp":"2024-09-12T17:09:16.168791+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T01:05:38.060627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20483,"num_write":18,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"84'38","reported_seq":213,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.847149+0000","last_change":"2024-09-12T17:09:23.847149+0000","last_active":"2024-09-12T17:09:23.847149+0000","last_peered":"2024-09-12T17:09:23.847149+0000","last_clean":"2024-09-12T17:09:23.847149+0000","last_became_active":"2024-09-12T17:05:49.563625+0000","last_became_peered":"2024-09-12T17:05:49.563625+0000","last_unstale":"2024-09-12T17:09:23.847149+0000","last_undegraded":"2024-09-12T17:09:23.847149+0000","last_fullsized":"2024-09-12T17:09:23.847149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'38","last_scrub_stamp":"2024-09-12T17:09:23.846959+0000","last_deep_scrub":"84'38","last_deep_scrub_stamp":"2024-09-12T17:09:23.846959+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.846959+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:03:22.054370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"103'20","reported_seq":204,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:13.845588+0000","last_change":"2024-09-12T17:09:13.845588+0000","last_active":"2024-09-12T17:09:13.845588+0000","last_peered":"2024-09-12T17:09:13.845588+0000","last_clean":"2024-09-12T17:09:13.845588+0000","last_became_active":"2024-09-12T17:05:47.558047+0000","last_became_peered":"2024-09-12T17:05:47.558047+0000","last_unstale":"2024-09-12T17:09:13.845588+0000","last_undegraded":"2024-09-12T17:09:13.845588+0000","last_fullsized":"2024-09-12T17:09:13.845588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'20","last_scrub_stamp":"2024-09-12T17:09:13.845404+0000","last_deep_scrub":"103'20","last_deep_scrub_stamp":"2024-09-12T17:09:13.845404+0000","last_clean_scrub_stamp":"2024-09-12T17:09:13.845404+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:28.438127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":38912,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:26.939857+0000","last_change":"2024-09-12T17:09:26.939857+0000","last_active":"2024-09-12T17:09:26.939857+0000","last_peered":"2024-09-12T17:09:26.939857+0000","last_clean":"2024-09-12T17:09:26.939857+0000","last_became_active":"2024-09-12T17:05:49.522097+0000","last_became_peered":"2024-09-12T17:05:49.522097+0000","last_unstale":"2024-09-12T17:09:26.939857+0000","last_undegraded":"2024-09-12T17:09:26.939857+0000","last_fullsized":"2024-09-12T17:09:26.939857+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:26.939655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:26.939655+0000","last_clean_scrub_stamp":"2024-09-12T17:09:26.939655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:29:12.322502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"103'22","reported_seq":212,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:27.251654+0000","last_change":"2024-09-12T17:09:27.251654+0000","last_active":"2024-09-12T17:09:27.251654+0000","last_peered":"2024-09-12T17:09:27.251654+0000","last_clean":"2024-09-12T17:09:27.251654+0000","last_became_active":"2024-09-12T17:05:47.552207+0000","last_became_peered":"2024-09-12T17:05:47.552207+0000","last_unstale":"2024-09-12T17:09:27.251654+0000","last_undegraded":"2024-09-12T17:09:27.251654+0000","last_fullsized":"2024-09-12T17:09:27.251654+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'22","last_scrub_stamp":"2024-09-12T17:09:27.251470+0000","last_deep_scrub":"103'22","last_deep_scrub_stamp":"2024-09-12T17:09:27.251470+0000","last_clean_scrub_stamp":"2024-09-12T17:09:27.251470+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:21:03.495280+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":40969,"num_write":46,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":182,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:20.848494+0000","last_change":"2024-09-12T17:09:20.848494+0000","last_active":"2024-09-12T17:09:20.848494+0000","last_peered":"2024-09-12T17:09:20.848494+0000","last_clean":"2024-09-12T17:09:20.848494+0000","last_became_active":"2024-09-12T17:08:18.464823+0000","last_became_peered":"2024-09-12T17:08:18.464823+0000","last_unstale":"2024-09-12T17:09:20.848494+0000","last_undegraded":"2024-09-12T17:09:20.848494+0000","last_fullsized":"2024-09-12T17:09:20.848494+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:20.848277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:20.848277+0000","last_clean_scrub_stamp":"2024-09-12T17:09:20.848277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:18.999436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"103'26","reported_seq":214,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:24.980330+0000","last_change":"2024-09-12T17:09:24.980330+0000","last_active":"2024-09-12T17:09:24.980330+0000","last_peered":"2024-09-12T17:09:24.980330+0000","last_clean":"2024-09-12T17:09:24.980330+0000","last_became_active":"2024-09-12T17:05:47.560439+0000","last_became_peered":"2024-09-12T17:05:47.560439+0000","last_unstale":"2024-09-12T17:09:24.980330+0000","last_undegraded":"2024-09-12T17:09:24.980330+0000","last_fullsized":"2024-09-12T17:09:24.980330+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'26","last_scrub_stamp":"2024-09-12T17:09:24.980144+0000","last_deep_scrub":"103'26","last_deep_scrub_stamp":"2024-09-12T17:09:24.980144+0000","last_clean_scrub_stamp":"2024-09-12T17:09:24.980144+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T23:03:05.560406+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":51203,"num_write":34,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":132,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.234259+0000","last_change":"2024-09-12T17:09:23.234259+0000","last_active":"2024-09-12T17:09:23.234259+0000","last_peered":"2024-09-12T17:09:23.234259+0000","last_clean":"2024-09-12T17:09:23.234259+0000","last_became_active":"2024-09-12T17:06:27.818761+0000","last_became_peered":"2024-09-12T17:06:27.818761+0000","last_unstale":"2024-09-12T17:09:23.234259+0000","last_undegraded":"2024-09-12T17:09:23.234259+0000","last_fullsized":"2024-09-12T17:09:23.234259+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:23.234072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:23.234072+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.234072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T00:02:33.834118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"103'16","reported_seq":201,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:10.356398+0000","last_change":"2024-09-12T17:09:10.356398+0000","last_active":"2024-09-12T17:09:10.356398+0000","last_peered":"2024-09-12T17:09:10.356398+0000","last_clean":"2024-09-12T17:09:10.356398+0000","last_became_active":"2024-09-12T17:05:47.511470+0000","last_became_peered":"2024-09-12T17:05:47.511470+0000","last_unstale":"2024-09-12T17:09:10.356398+0000","last_undegraded":"2024-09-12T17:09:10.356398+0000","last_fullsized":"2024-09-12T17:09:10.356398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'16","last_scrub_stamp":"2024-09-12T17:09:10.356302+0000","last_deep_scrub":"103'16","last_deep_scrub_stamp":"2024-09-12T17:09:10.356302+0000","last_clean_scrub_stamp":"2024-09-12T17:09:10.356302+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:25:14.053803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":30723,"num_write":24,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:22.896316+0000","last_change":"2024-09-12T17:09:22.896316+0000","last_active":"2024-09-12T17:09:22.896316+0000","last_peered":"2024-09-12T17:09:22.896316+0000","last_clean":"2024-09-12T17:09:22.896316+0000","last_became_active":"2024-09-12T17:05:49.522157+0000","last_became_peered":"2024-09-12T17:05:49.522157+0000","last_unstale":"2024-09-12T17:09:22.896316+0000","last_undegraded":"2024-09-12T17:09:22.896316+0000","last_fullsized":"2024-09-12T17:09:22.896316+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:22.896130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:22.896130+0000","last_clean_scrub_stamp":"2024-09-12T17:09:22.896130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:18:55.720555+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"103'10","reported_seq":189,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:17.170255+0000","last_change":"2024-09-12T17:09:17.170255+0000","last_active":"2024-09-12T17:09:17.170255+0000","last_peered":"2024-09-12T17:09:17.170255+0000","last_clean":"2024-09-12T17:09:17.170255+0000","last_became_active":"2024-09-12T17:05:47.535569+0000","last_became_peered":"2024-09-12T17:05:47.535569+0000","last_unstale":"2024-09-12T17:09:17.170255+0000","last_undegraded":"2024-09-12T17:09:17.170255+0000","last_fullsized":"2024-09-12T17:09:17.170255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'10","last_scrub_stamp":"2024-09-12T17:09:17.170029+0000","last_deep_scrub":"103'10","last_deep_scrub_stamp":"2024-09-12T17:09:17.170029+0000","last_clean_scrub_stamp":"2024-09-12T17:09:17.170029+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T04:52:44.519046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":18432,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"103'10","reported_seq":189,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:18.190636+0000","last_change":"2024-09-12T17:09:18.190636+0000","last_active":"2024-09-12T17:09:18.190636+0000","last_peered":"2024-09-12T17:09:18.190636+0000","last_clean":"2024-09-12T17:09:18.190636+0000","last_became_active":"2024-09-12T17:05:47.536958+0000","last_became_peered":"2024-09-12T17:05:47.536958+0000","last_unstale":"2024-09-12T17:09:18.190636+0000","last_undegraded":"2024-09-12T17:09:18.190636+0000","last_fullsized":"2024-09-12T17:09:18.190636+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'10","last_scrub_stamp":"2024-09-12T17:09:18.190457+0000","last_deep_scrub":"103'10","last_deep_scrub_stamp":"2024-09-12T17:09:18.190457+0000","last_clean_scrub_stamp":"2024-09-12T17:09:18.190457+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T22:31:32.783180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:23.849600+0000","last_change":"2024-09-12T17:09:23.849600+0000","last_active":"2024-09-12T17:09:23.849600+0000","last_peered":"2024-09-12T17:09:23.849600+0000","last_clean":"2024-09-12T17:09:23.849600+0000","last_became_active":"2024-09-12T17:05:49.538757+0000","last_became_peered":"2024-09-12T17:05:49.538757+0000","last_unstale":"2024-09-12T17:09:23.849600+0000","last_undegraded":"2024-09-12T17:09:23.849600+0000","last_fullsized":"2024-09-12T17:09:23.849600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:23.849400+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:23.849400+0000","last_clean_scrub_stamp":"2024-09-12T17:09:23.849400+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T03:41:14.907294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"103'14","reported_seq":68,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:15.163300+0000","last_change":"2024-09-12T17:09:15.163300+0000","last_active":"2024-09-12T17:09:15.163300+0000","last_peered":"2024-09-12T17:09:15.163300+0000","last_clean":"2024-09-12T17:09:15.163300+0000","last_became_active":"2024-09-12T17:08:18.441161+0000","last_became_peered":"2024-09-12T17:08:18.441161+0000","last_unstale":"2024-09-12T17:09:15.163300+0000","last_undegraded":"2024-09-12T17:09:15.163300+0000","last_fullsized":"2024-09-12T17:09:15.163300+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"103'14","last_scrub_stamp":"2024-09-12T17:09:15.163115+0000","last_deep_scrub":"103'14","last_deep_scrub_stamp":"2024-09-12T17:09:15.163115+0000","last_clean_scrub_stamp":"2024-09-12T17:09:15.163115+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T19:55:00.669243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24582,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":170,"reported_epoch":103,"state":"active+clean","last_fresh":"2024-09-12T17:09:25.254417+0000","last_change":"2024-09-12T17:09:25.254417+0000","last_active":"2024-09-12T17:09:25.254417+0000","last_peered":"2024-09-12T17:09:25.254417+0000","last_clean":"2024-09-12T17:09:25.254417+0000","last_became_active":"2024-09-12T17:05:49.551604+0000","last_became_peered":"2024-09-12T17:05:49.551604+0000","last_unstale":"2024-09-12T17:09:25.254417+0000","last_undegraded":"2024-09-12T17:09:25.254417+0000","last_fullsized":"2024-09-12T17:09:25.254417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T17:09:25.254214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T17:09:25.254214+0000","last_clean_scrub_stamp":"2024-09-12T17:09:25.254214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T17:11:23.405373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":40,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":127268,"num_objects":180,"num_object_clones":0,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":180,"num_whiteouts":0,"num_read":1212,"num_read_kb":1590,"num_write":777,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":85,"num_bytes_recovered":41697,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":871,"ondisk_log_size":871,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1867,"num_read_kb":1448,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1533,"num_read_kb":2031945,"num_write":1980,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":241172480,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542199,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41328,"kb_used_data":1824,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330512,"statfs":{"total":96636764160,"available":96594444288,"internally_reserved":0,"allocated":1867776,"data_stored":1295858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542200,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40724,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331116,"statfs":{"total":96636764160,"available":96595062784,"internally_reserved":0,"allocated":1249280,"data_stored":704830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542200,"num_pgs":68,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40776,"kb_used_data":1272,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331064,"statfs":{"total":96636764160,"available":96595009536,"internally_reserved":0,"allocated":1302528,"data_stored":706113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542200,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40712,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331128,"statfs":{"total":96636764160,"available":96595075072,"internally_reserved":0,"allocated":1236992,"data_stored":704328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542200,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36584,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335256,"statfs":{"total":96636764160,"available":96599302144,"internally_reserved":0,"allocated":1269760,"data_stored":705662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542200,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36556,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335284,"statfs":{"total":96636764160,"available":96599330816,"internally_reserved":0,"allocated":1241088,"data_stored":705385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542199,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40744,"kb_used_data":1240,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331096,"statfs":{"total":96636764160,"available":96595042304,"internally_reserved":0,"allocated":1269760,"data_stored":705099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542200,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37152,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334688,"statfs":{"total":96636764160,"available":96598720512,"internally_reserved":0,"allocated":1851392,"data_stored":1296257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T17:09:51.177 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T17:09:51.549 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T17:09:51.550 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T17:09:51.550 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T17:09:51.550 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:51.633 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T17:09:51.633 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T17:09:51.633 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:51.714 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T17:09:51.714 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T17:09:51.714 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:51.802 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T17:09:51.802 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T17:09:51.802 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:51.880 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T17:09:51.880 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T17:09:51.881 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:51.959 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T17:09:51.959 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T17:09:51.959 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:52.044 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T17:09:52.044 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T17:09:52.044 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:52.125 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T17:09:52.125 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T17:09:52.125 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:53.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-12T17:09:58.227 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T17:09:58.227 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T17:09:58.228 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T17:09:58.228 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:58.256 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T17:09:58.257 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T17:09:58.257 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:58.288 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T17:09:58.288 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T17:09:58.288 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T17:09:58.288 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:58.323 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T17:09:58.323 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T17:09:58.323 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:58.383 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T17:09:58.383 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T17:09:58.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T17:09:58.408 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T17:09:58.408 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T17:09:58.409 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T17:09:58.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-12T17:09:58.449 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T17:09:58.449 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T17:09:58.752 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T17:09:58.752 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T17:09:58.940 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T17:09:58.940 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T17:09:59.117 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T17:09:59.117 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T17:09:59.282 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:09:59.282 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T17:09:59.489 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:09:59.490 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T17:09:59.689 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:09:59.689 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T17:09:59.865 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:09:59.865 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T17:10:00.174 INFO:tasks.ceph:Archiving mon data... 2024-09-12T17:10:00.175 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703/data/mon.a.tgz 2024-09-12T17:10:00.176 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-12T17:10:00.181 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.awvd6d1kq4 2024-09-12T17:10:00.182 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.awvd6d1kq4 2024-09-12T17:10:00.340 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.awvd6d1kq4 2024-09-12T17:10:00.402 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.awvd6d1kq4 is 493KB 2024-09-12T17:10:00.466 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.awvd6d1kq4 2024-09-12T17:10:00.471 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703/data/mon.c.tgz 2024-09-12T17:10:00.472 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-09-12T17:10:00.520 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.Wrt7a4a6qJ 2024-09-12T17:10:00.520 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Wrt7a4a6qJ 2024-09-12T17:10:00.726 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.Wrt7a4a6qJ 2024-09-12T17:10:00.791 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.Wrt7a4a6qJ is 641KB 2024-09-12T17:10:00.857 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.Wrt7a4a6qJ 2024-09-12T17:10:00.863 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703/data/mon.b.tgz 2024-09-12T17:10:00.863 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-09-12T17:10:00.869 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.0wSLywRGLB 2024-09-12T17:10:00.869 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0wSLywRGLB 2024-09-12T17:10:01.072 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.0wSLywRGLB 2024-09-12T17:10:01.148 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.0wSLywRGLB is 640KB 2024-09-12T17:10:01.228 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.0wSLywRGLB 2024-09-12T17:10:01.235 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T17:10:01.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T17:10:01.238 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T17:10:01.301 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T17:10:01.343 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T17:10:01.343 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T17:10:01.404 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703/remote/smithi017/crash 2024-09-12T17:10:01.451 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T17:10:01.467 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703/remote/smithi047/crash 2024-09-12T17:10:01.470 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T17:10:01.485 INFO:tasks.ceph:Compressing logs... 2024-09-12T17:10:01.485 DEBUG:teuthology.orchestra.run.smithi017:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T17:10:01.516 DEBUG:teuthology.orchestra.run.smithi047:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T17:10:01.538 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30640.log 2024-09-12T17:10:01.538 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40057.log 2024-09-12T17:10:01.539 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T17:10:01.539 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30640.log: /var/log/ceph/ceph-client.admin.40057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30640.log.gz 2024-09-12T17:10:01.540 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40057.log.gz 2024-09-12T17:10:01.540 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38882.log 2024-09-12T17:10:01.543 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35204.log 2024-09-12T17:10:01.543 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.38882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40756.log 2024-09-12T17:10:01.543 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38882.log.gz 2024-09-12T17:10:01.543 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31056.log 2024-09-12T17:10:01.543 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35204.log.gz 2024-09-12T17:10:01.543 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40756.log.gz 2024-09-12T17:10:01.543 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T17:10:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35100.log 2024-09-12T17:10:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31056.log.gz 2024-09-12T17:10:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33401.log 2024-09-12T17:10:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33578.log 2024-09-12T17:10:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35100.log.gz 2024-09-12T17:10:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33401.log.gz 2024-09-12T17:10:01.544 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33209.log 2024-09-12T17:10:01.574 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26423.log 2024-09-12T17:10:01.575 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26399.log 2024-09-12T17:10:01.575 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.26423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26423.log.gz 2024-09-12T17:10:01.575 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26279.log 2024-09-12T17:10:01.575 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.26399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26303.log 2024-09-12T17:10:01.575 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26399.log.gz 2024-09-12T17:10:01.575 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.26279.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T17:10:01.575 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26279.log.gz 2024-09-12T17:10:01.575 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.26303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26303.log.gz 2024-09-12T17:10:01.575 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T17:10:01.576 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T17:10:01.576 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26351.log 2024-09-12T17:10:01.576 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26447.log 2024-09-12T17:10:01.576 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.26351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26351.log.gz 2024-09-12T17:10:01.576 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T17:10:01.576 INFO:teuthology.orchestra.run.smithi047.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26375.log 2024-09-12T17:10:01.576 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.26447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26447.log.gz 2024-09-12T17:10:01.576 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26327.log 2024-09-12T17:10:01.576 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.26375.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T17:10:01.577 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26375.log.gz 2024-09-12T17:10:01.577 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-client.admin.26327.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T17:10:01.577 INFO:teuthology.orchestra.run.smithi047.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26327.log.gz 2024-09-12T17:10:01.577 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T17:10:01.577 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T17:10:01.577 INFO:teuthology.orchestra.run.smithi047.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T17:10:01.577 INFO:teuthology.orchestra.run.smithi047.stderr: 85.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T17:10:01.611 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40991.log 2024-09-12T17:10:01.612 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33578.log.gz 2024-09-12T17:10:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38939.log 2024-09-12T17:10:01.612 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33209.log.gz 2024-09-12T17:10:01.612 INFO:teuthology.orchestra.run.smithi017.stderr: 91.8% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T17:10:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40991.log.gz 2024-09-12T17:10:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T17:10:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41279.log 2024-09-12T17:10:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38939.log.gz 2024-09-12T17:10:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41121.log 2024-09-12T17:10:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41279.log.gz 2024-09-12T17:10:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39355.log 2024-09-12T17:10:01.612 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39850.log 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41121.log.gz 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33652.log 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39355.log.gz 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39850.log: 93.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39616.log 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39850.log.gz 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30624.log 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33652.log.gz 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41199.log 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39616.log.gz 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30624.log.gz 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39849.log 2024-09-12T17:10:01.613 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40939.log 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41199.log.gz 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39638.log 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39849.log.gz 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40939.log.gz 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37073.log 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26428.log 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39638.log.gz 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37073.log.gzgzip 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.30440.log 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.26428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33917.log 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26428.log.gz 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35702.log 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30440.log.gz 2024-09-12T17:10:01.614 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35179.log 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33917.log.gz 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35702.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35702.log.gz -5 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39329.log 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30588.log 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35179.log.gz 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30632.log 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39329.log.gz 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30588.log.gz 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39277.log 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33875.log 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30632.log.gz 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41043.log 2024-09-12T17:10:01.615 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39277.log.gz 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33875.log.gz 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40083.log 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34061.log 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41043.log.gz 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39846.log 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40083.log.gz 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34061.log.gz 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32195.log 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37649.log 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39846.log.gz 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34172.log 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32195.log.gz 2024-09-12T17:10:01.616 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30562.log 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37649.log.gz 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35366.log 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34172.log.gz 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37399.log 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30562.log.gz 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40887.log 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35366.log.gz 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35449.log 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37399.log.gz 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40887.log.gz 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38076.log 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35449.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35449.log.gz 2024-09-12T17:10:01.617 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32233.log 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38076.log.gz 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39621.log 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32233.log.gz 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38050.log 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31862.log 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39621.log.gz 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38050.log.gz 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30833.log 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31862.log.gz 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30833.log.gz 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32736.log 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34467.log 2024-09-12T17:10:01.618 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.32736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32736.log.gz 2024-09-12T17:10:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37690.log 2024-09-12T17:10:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34467.log.gz 2024-09-12T17:10:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33181.log 2024-09-12T17:10:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30847.log 2024-09-12T17:10:01.619 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37690.log.gz 2024-09-12T17:10:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33181.log.gz 2024-09-12T17:10:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38991.log 2024-09-12T17:10:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41225.log 2024-09-12T17:10:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30847.log.gz 2024-09-12T17:10:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38991.log.gz 2024-09-12T17:10:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39627.log 2024-09-12T17:10:01.619 INFO:teuthology.orchestra.run.smithi017.stderr:gzip/var/log/ceph/ceph-client.admin.41225.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30378.log 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41225.log.gz 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39017.log 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39627.log.gz 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30378.log.gz 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37187.log 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37217.log 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39017.log.gz 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30842.log 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37187.log.gz 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37217.log.gz 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35522.log 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39435.log 2024-09-12T17:10:01.620 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30842.log: /var/log/ceph/ceph-client.admin.35522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35522.log.gz 2024-09-12T17:10:01.621 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30842.log.gz 2024-09-12T17:10:01.621 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39851.log 2024-09-12T17:10:01.621 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34471.log 2024-09-12T17:10:01.621 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39435.log: /var/log/ceph/ceph-client.admin.39851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39435.log.gz 2024-09-12T17:10:01.621 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.40809.log 2024-09-12T17:10:01.621 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39851.log.gz 2024-09-12T17:10:01.621 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31030.log 2024-09-12T17:10:01.621 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34471.log.gz 2024-09-12T17:10:01.621 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40809.log.gz 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31888.log 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33776.log 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31030.log.gz 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31888.log.gz 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31132.log 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40965.log 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33776.log: /var/log/ceph/ceph-client.admin.31132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33776.log.gz 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31132.log.gz 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32946.log 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40965.log.gz 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40861.log 2024-09-12T17:10:01.622 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32674.log 2024-09-12T17:10:01.623 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32946.log.gz 2024-09-12T17:10:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41095.log 2024-09-12T17:10:01.623 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40861.log.gz 2024-09-12T17:10:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32674.log.gz 2024-09-12T17:10:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39637.log 2024-09-12T17:10:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40913.log 2024-09-12T17:10:01.623 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41095.log.gz 2024-09-12T17:10:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39303.log 2024-09-12T17:10:01.623 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39637.log.gz 2024-09-12T17:10:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39624.log 2024-09-12T17:10:01.623 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40913.log.gz 2024-09-12T17:10:01.623 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30641.log 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39303.log.gz 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40730.log 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39624.log.gz 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26336.log 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30641.log.gz 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40730.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21392.log 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40730.log.gz 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.26336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37691.log 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26336.log.gz 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.tmp-client.admin.21392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39381.log 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21392.log.gz 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35311.log 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37691.log.gz 2024-09-12T17:10:01.624 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32835.log 2024-09-12T17:10:01.625 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39381.log.gz 2024-09-12T17:10:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39424.log 2024-09-12T17:10:01.625 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35311.log.gz 2024-09-12T17:10:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30639.log 2024-09-12T17:10:01.625 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32835.log.gz 2024-09-12T17:10:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37440.log 2024-09-12T17:10:01.625 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39424.log.gz 2024-09-12T17:10:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37753.log 2024-09-12T17:10:01.625 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30639.log.gz 2024-09-12T17:10:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33982.log 2024-09-12T17:10:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37440.log.gz 2024-09-12T17:10:01.625 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37898.log 2024-09-12T17:10:01.626 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37753.log.gz 2024-09-12T17:10:01.626 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38908.log 2024-09-12T17:10:01.626 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33982.log.gz 2024-09-12T17:10:01.626 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40782.log 2024-09-12T17:10:01.626 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37898.log.gz 2024-09-12T17:10:01.626 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38908.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T17:10:01.626 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38908.log.gz 2024-09-12T17:10:01.626 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37441.log 2024-09-12T17:10:01.626 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40782.log.gz 2024-09-12T17:10:01.626 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30490.log 2024-09-12T17:10:01.626 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32492.log 2024-09-12T17:10:01.626 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37441.log.gz 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37297.log 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30490.log.gz 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32492.log.gz 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30825.log 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33676.log 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37297.log.gz 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39432.log 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30825.log.gz 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39173.log 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33676.log: /var/log/ceph/ceph-client.admin.39432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33676.log.gz 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38965.log 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39432.log.gz 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39173.log.gz 2024-09-12T17:10:01.627 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39427.log 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34313.log 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38965.log.gz 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30636.log 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39427.log.gz 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34313.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34313.log.gz -5 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr: --verbose -- /var/log/ceph/ceph-client.admin.41147.log 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38160.log 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30636.log.gz 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41147.log.gz 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26189.log 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38855.log 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38160.log.gz 2024-09-12T17:10:01.628 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.26189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26189.log.gz 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39225.log 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37842.log 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38855.log.gz 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32015.log 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39225.log.gz 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30510.log 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37842.log: /var/log/ceph/ceph-client.admin.32015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37842.log.gz 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41069.log 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32015.log.gz 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39199.log 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30510.log: /var/log/ceph/ceph-client.admin.41069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30510.log.gz 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39416.log 2024-09-12T17:10:01.629 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41069.log.gz 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39199.log: /var/log/ceph/ceph-client.admin.39416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37607.log 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39199.log.gz 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39416.log.gz 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41173.log 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37607.log: 92.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32831.log 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37607.log.gz 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35407.log 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41173.log.gz 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31106.log 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32831.log.gz 2024-09-12T17:10:01.630 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41017.log 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35407.log.gz 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32773.log 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31106.log.gz 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39639.log 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41017.log.gz 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32336.log 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32773.log.gz 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39639.log.gz 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35617.log 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31082.log 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32336.log.gz 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30850.log 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35617.log.gz 2024-09-12T17:10:01.631 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31082.log.gz 2024-09-12T17:10:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32648.log 2024-09-12T17:10:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33731.log 2024-09-12T17:10:01.632 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30850.log.gz 2024-09-12T17:10:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33314.log 2024-09-12T17:10:01.632 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32648.log.gz 2024-09-12T17:10:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33731.log.gz 2024-09-12T17:10:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37530.log 2024-09-12T17:10:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31156.log 2024-09-12T17:10:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33834.log 2024-09-12T17:10:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37530.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33314.log.gz 2024-09-12T17:10:01.632 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37530.log.gz 2024-09-12T17:10:01.632 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31156.log.gz 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37993.log 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33834.log.gz 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31940.log 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32422.log 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37993.log: /var/log/ceph/ceph-client.admin.31940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37993.log.gz 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31940.log.gz 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30841.log 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32422.log.gz 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39433.log 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33265.log 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30841.log.gz 2024-09-12T17:10:01.633 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39433.log.gz 2024-09-12T17:10:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33458.log 2024-09-12T17:10:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33496.log 2024-09-12T17:10:01.634 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33265.log.gz 2024-09-12T17:10:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33458.log.gz 2024-09-12T17:10:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32389.log 2024-09-12T17:10:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T17:10:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33496.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33496.log.gz 2024-09-12T17:10:01.634 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32389.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34401.log 2024-09-12T17:10:01.634 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32389.log.gz 2024-09-12T17:10:01.635 INFO:teuthology.orchestra.run.smithi047.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T17:10:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T17:10:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39043.log 2024-09-12T17:10:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T17:10:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34401.log.gz 2024-09-12T17:10:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39830.log 2024-09-12T17:10:01.658 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39043.log.gz 2024-09-12T17:10:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph.audit.log: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T17:10:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34093.log 2024-09-12T17:10:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32007.log 2024-09-12T17:10:01.658 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39830.log.gz 2024-09-12T17:10:01.658 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31182.log 2024-09-12T17:10:01.659 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34093.log.gz 2024-09-12T17:10:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32007.log.gz 2024-09-12T17:10:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34016.log 2024-09-12T17:10:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.31182.log: -- /var/log/ceph/ceph-client.admin.38829.log 2024-09-12T17:10:01.659 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31182.log.gz 2024-09-12T17:10:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34016.log.gz 2024-09-12T17:10:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33090.log 2024-09-12T17:10:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39431.log 2024-09-12T17:10:01.659 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38829.log.gz 2024-09-12T17:10:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33090.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33131.log 2024-09-12T17:10:01.659 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33090.log.gz 2024-09-12T17:10:01.659 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39431.log.gz 2024-09-12T17:10:01.660 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30835.log 2024-09-12T17:10:01.660 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32531.log 2024-09-12T17:10:01.660 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33131.log: /var/log/ceph/ceph-client.admin.30835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33131.log.gz 2024-09-12T17:10:01.660 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30835.log.gz 2024-09-12T17:10:01.660 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38773.log 2024-09-12T17:10:01.660 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35261.log 2024-09-12T17:10:01.660 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32531.log: /var/log/ceph/ceph-client.admin.38773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32531.log.gz 2024-09-12T17:10:01.660 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38773.log.gz 2024-09-12T17:10:01.660 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41303.log 2024-09-12T17:10:01.660 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37105.log 2024-09-12T17:10:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35261.log.gz 2024-09-12T17:10:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41303.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40704.log 2024-09-12T17:10:01.661 INFO:teuthology.orchestra.run.smithi017.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41303.log.gz 2024-09-12T17:10:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30836.log 2024-09-12T17:10:01.661 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37105.log.gz/var/log/ceph/ceph-client.admin.40704.log: 2024-09-12T17:10:01.661 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40704.log.gz 2024-09-12T17:10:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35547.log 2024-09-12T17:10:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32014.log 2024-09-12T17:10:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30836.log.gz 2024-09-12T17:10:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35547.log.gz 2024-09-12T17:10:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34259.log 2024-09-12T17:10:01.661 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32014.log.gz 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40031.log 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39251.log 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34259.log.gz 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40031.log.gz 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37868.log 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39251.log.gz 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32302.log 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36888.log 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37868.log.gz 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32302.log.gz 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39847.log 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32587.log 2024-09-12T17:10:01.662 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36888.log.gz 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39847.log.gz 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34205.log 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32987.log 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32587.log.gz 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.34205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34205.log.gz 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30465.log 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32987.log.gz 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39069.log 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40835.log 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30465.log.gz 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39069.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32154.log 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-12T17:10:01.663 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.40835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40835.log.gz 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30536.log 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37341.log 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.32154.log: /var/log/ceph/ceph-client.admin.30536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32154.log.gz 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30536.log.gz 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39434.log 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30627.log 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37341.log.gz 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39434.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37534.log 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30627.log.gz 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37894.log 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39823.log 2024-09-12T17:10:01.664 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37534.log.gz 2024-09-12T17:10:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37894.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38129.log 2024-09-12T17:10:01.665 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-12T17:10:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39823.log.gz 2024-09-12T17:10:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39121.log 2024-09-12T17:10:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36935.log 2024-09-12T17:10:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.38129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38129.log.gz 2024-09-12T17:10:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39121.log.gz 2024-09-12T17:10:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30642.log 2024-09-12T17:10:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.36935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36935.log.gz 2024-09-12T17:10:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37582.log 2024-09-12T17:10:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31914.log 2024-09-12T17:10:01.665 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.30642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30642.log.gz 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37582.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37582.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35614.log 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31914.log.gz 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41251.log 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39831.log 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.35614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35614.log.gz 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.41251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41251.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39643.log 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39831.log.gz 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31970.log 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37804.log 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39643.log.gz 2024-09-12T17:10:01.666 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.31970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31970.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33537.log 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37804.log.gz 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36292.log 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37001.log 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33537.log: /var/log/ceph/ceph-client.admin.36292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33537.log.gz 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36292.log.gz 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39147.log 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40111.log 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.37001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37001.log.gz 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39147.log.gz 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39095.log 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.0.40111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33021.log 2024-09-12T17:10:01.667 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.40111.log.gz 2024-09-12T17:10:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.39095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39095.log.gz 2024-09-12T17:10:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33355.log 2024-09-12T17:10:01.668 INFO:teuthology.orchestra.run.smithi017.stderr:/var/log/ceph/ceph-client.admin.33021.log: 0.0%/var/log/ceph/ceph-client.admin.33355.log: -- replaced with /var/log/ceph/ceph-client.admin.33021.log.gz 2024-09-12T17:10:01.668 INFO:teuthology.orchestra.run.smithi017.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33355.log.gz 2024-09-12T17:10:01.759 INFO:teuthology.orchestra.run.smithi047.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T17:10:01.771 INFO:teuthology.orchestra.run.smithi017.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T17:10:01.851 INFO:teuthology.orchestra.run.smithi017.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T17:10:02.075 INFO:teuthology.orchestra.run.smithi017.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T17:10:02.091 INFO:teuthology.orchestra.run.smithi017.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T17:10:02.106 INFO:teuthology.orchestra.run.smithi047.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T17:10:02.191 INFO:teuthology.orchestra.run.smithi047.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T17:10:02.215 INFO:teuthology.orchestra.run.smithi047.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T17:10:02.235 INFO:teuthology.orchestra.run.smithi047.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T17:10:02.236 INFO:teuthology.orchestra.run.smithi047.stderr: 2024-09-12T17:10:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:real 0m0.703s 2024-09-12T17:10:02.236 INFO:teuthology.orchestra.run.smithi047.stderr:user 0m2.706s 2024-09-12T17:10:02.237 INFO:teuthology.orchestra.run.smithi047.stderr:sys 0m0.111s 2024-09-12T17:10:02.254 INFO:teuthology.orchestra.run.smithi017.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T17:10:02.273 INFO:teuthology.orchestra.run.smithi017.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T17:10:02.275 INFO:teuthology.orchestra.run.smithi017.stderr: 2024-09-12T17:10:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:real 0m0.756s 2024-09-12T17:10:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:user 0m2.940s 2024-09-12T17:10:02.275 INFO:teuthology.orchestra.run.smithi017.stderr:sys 0m0.207s 2024-09-12T17:10:02.275 INFO:tasks.ceph:Archiving logs... 2024-09-12T17:10:02.276 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703/remote/smithi017/log 2024-09-12T17:10:02.277 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T17:10:02.807 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703/remote/smithi047/log 2024-09-12T17:10:02.808 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T17:10:03.137 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T17:10:03.147 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T17:10:03.147 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T17:10:03.150 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T17:10:03.222 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T17:10:03.231 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T17:10:03.231 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:10:03.234 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T17:10:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:10:03.246 INFO:teuthology.orchestra.run.smithi017.stdout:============================================================================== 2024-09-12T17:10:03.246 INFO:teuthology.orchestra.run.smithi017.stdout:+hv01.front.sepi 67.205.162.81 3 u 39 64 177 0.078 -0.431 0.478 2024-09-12T17:10:03.246 INFO:teuthology.orchestra.run.smithi017.stdout:*hv02.front.sepi 63.231.80.2 3 u 40 64 177 0.060 +0.360 0.485 2024-09-12T17:10:03.246 INFO:teuthology.orchestra.run.smithi017.stdout:+hv03.front.sepi 74.6.168.72 3 u 40 64 177 0.076 +0.125 0.364 2024-09-12T17:10:03.246 INFO:teuthology.orchestra.run.smithi017.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:10:03.248 INFO:teuthology.orchestra.run.smithi047.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T17:10:03.248 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================== 2024-09-12T17:10:03.248 INFO:teuthology.orchestra.run.smithi047.stdout:+hv01.front.sepi 67.205.162.81 3 u 38 64 177 0.088 -2.579 1.336 2024-09-12T17:10:03.248 INFO:teuthology.orchestra.run.smithi047.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 64 177 0.093 -0.713 0.952 2024-09-12T17:10:03.248 INFO:teuthology.orchestra.run.smithi047.stdout:*hv03.front.sepi 74.6.168.72 3 u 39 64 177 0.092 -0.182 1.154 2024-09-12T17:10:03.248 INFO:teuthology.orchestra.run.smithi047.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T17:10:03.248 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T17:10:03.257 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T17:10:03.257 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T17:10:03.265 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T17:10:03.273 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T17:10:03.281 INFO:teuthology.task.internal:Duration was 904.396643 seconds 2024-09-12T17:10:03.282 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T17:10:03.290 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T17:10:03.291 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T17:10:03.293 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T17:10:03.332 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T17:10:03.332 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-09-12T17:10:03.333 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T17:10:03.381 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-09-12T17:10:03.381 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T17:10:03.391 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T17:10:03.392 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T17:10:03.424 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T17:10:03.461 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T17:10:03.461 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T17:10:03.496 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T17:10:03.566 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T17:10:03.577 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T17:10:03.577 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T17:10:03.590 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T17:10:03.601 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T17:10:03.659 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:10:03.661 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:10:03.672 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-09-12T17:10:03.673 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-09-12T17:10:03.689 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:10:03.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:10:03.736 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T17:10:03.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T17:10:03.742 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T17:10:03.751 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T17:10:03.752 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703/remote/smithi017 2024-09-12T17:10:03.752 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T17:10:03.800 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-12_15:39:52-rgw-wip-rgw-meta-handlers-distro-default-smithi/7902703/remote/smithi047 2024-09-12T17:10:03.801 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T17:10:03.823 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T17:10:03.823 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T17:10:03.840 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T17:10:03.866 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T17:10:03.876 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T17:10:03.876 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T17:10:03.886 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T17:10:03.886 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T17:10:03.888 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T17:10:03.892 INFO:teuthology.orchestra.run.smithi017.stdout: 658616 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 17:10 /home/ubuntu/cephtest 2024-09-12T17:10:03.914 INFO:teuthology.orchestra.run.smithi047.stdout: 658624 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 17:10 /home/ubuntu/cephtest 2024-09-12T17:10:03.915 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T17:10:03.927 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T17:10:03.961 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} duration: 904.3966426849365 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T17:10:03.962 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T17:10:04.039 INFO:teuthology.run:pass